00:00:00.001 Started by upstream project "autotest-nightly-lts" build number 2447 00:00:00.001 originally caused by: 00:00:00.001 Started by upstream project "nightly-trigger" build number 3708 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.111 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.112 The recommended git tool is: git 00:00:00.112 using credential 00000000-0000-0000-0000-000000000002 00:00:00.113 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.150 Fetching changes from the remote Git repository 00:00:00.154 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.197 Using shallow fetch with depth 1 00:00:00.197 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.197 > git --version # timeout=10 00:00:00.234 > git --version # 'git version 2.39.2' 00:00:00.234 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.255 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.255 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:05.256 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:05.267 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:05.277 Checking out Revision db4637e8b949f278f369ec13f70585206ccd9507 (FETCH_HEAD) 00:00:05.277 > git config core.sparsecheckout # timeout=10 00:00:05.287 > git read-tree -mu HEAD # timeout=10 00:00:05.302 > git checkout -f db4637e8b949f278f369ec13f70585206ccd9507 # timeout=5 00:00:05.327 Commit message: "jenkins/jjb-config: Add missing SPDK_TEST_NVME_INTERRUPT flag" 00:00:05.327 > git rev-list --no-walk db4637e8b949f278f369ec13f70585206ccd9507 # timeout=10 00:00:05.425 [Pipeline] Start of Pipeline 00:00:05.441 [Pipeline] library 00:00:05.442 Loading library shm_lib@master 00:00:05.443 Library shm_lib@master is cached. Copying from home. 00:00:05.461 [Pipeline] node 00:00:05.471 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:05.473 [Pipeline] { 00:00:05.482 [Pipeline] catchError 00:00:05.483 [Pipeline] { 00:00:05.497 [Pipeline] wrap 00:00:05.506 [Pipeline] { 00:00:05.514 [Pipeline] stage 00:00:05.516 [Pipeline] { (Prologue) 00:00:05.710 [Pipeline] sh 00:00:05.993 + logger -p user.info -t JENKINS-CI 00:00:06.010 [Pipeline] echo 00:00:06.011 Node: GP11 00:00:06.016 [Pipeline] sh 00:00:06.318 [Pipeline] setCustomBuildProperty 00:00:06.329 [Pipeline] echo 00:00:06.331 Cleanup processes 00:00:06.337 [Pipeline] sh 00:00:06.623 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.623 1908961 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.637 [Pipeline] sh 00:00:06.923 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.923 ++ grep -v 'sudo pgrep' 00:00:06.923 ++ awk '{print $1}' 00:00:06.923 + sudo kill -9 00:00:06.923 + true 00:00:06.937 [Pipeline] cleanWs 00:00:06.947 [WS-CLEANUP] Deleting project workspace... 00:00:06.947 [WS-CLEANUP] Deferred wipeout is used... 00:00:06.954 [WS-CLEANUP] done 00:00:06.958 [Pipeline] setCustomBuildProperty 00:00:06.968 [Pipeline] sh 00:00:07.248 + sudo git config --global --replace-all safe.directory '*' 00:00:07.322 [Pipeline] httpRequest 00:00:07.935 [Pipeline] echo 00:00:07.936 Sorcerer 10.211.164.20 is alive 00:00:07.943 [Pipeline] retry 00:00:07.945 [Pipeline] { 00:00:07.953 [Pipeline] httpRequest 00:00:07.956 HttpMethod: GET 00:00:07.957 URL: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:07.958 Sending request to url: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:07.980 Response Code: HTTP/1.1 200 OK 00:00:07.980 Success: Status code 200 is in the accepted range: 200,404 00:00:07.980 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:32.101 [Pipeline] } 00:00:32.118 [Pipeline] // retry 00:00:32.125 [Pipeline] sh 00:00:32.413 + tar --no-same-owner -xf jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:32.431 [Pipeline] httpRequest 00:00:32.814 [Pipeline] echo 00:00:32.816 Sorcerer 10.211.164.20 is alive 00:00:32.826 [Pipeline] retry 00:00:32.828 [Pipeline] { 00:00:32.843 [Pipeline] httpRequest 00:00:32.848 HttpMethod: GET 00:00:32.848 URL: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:32.849 Sending request to url: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:32.853 Response Code: HTTP/1.1 200 OK 00:00:32.853 Success: Status code 200 is in the accepted range: 200,404 00:00:32.854 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:46.171 [Pipeline] } 00:00:46.189 [Pipeline] // retry 00:00:46.196 [Pipeline] sh 00:00:46.478 + tar --no-same-owner -xf spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:49.012 [Pipeline] sh 00:00:49.292 + git -C spdk log --oneline -n5 00:00:49.292 c13c99a5e test: Various fixes for Fedora40 00:00:49.292 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:00:49.292 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:00:49.292 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:00:49.292 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:00:49.303 [Pipeline] } 00:00:49.316 [Pipeline] // stage 00:00:49.324 [Pipeline] stage 00:00:49.326 [Pipeline] { (Prepare) 00:00:49.341 [Pipeline] writeFile 00:00:49.355 [Pipeline] sh 00:00:49.640 + logger -p user.info -t JENKINS-CI 00:00:49.652 [Pipeline] sh 00:00:49.936 + logger -p user.info -t JENKINS-CI 00:00:49.948 [Pipeline] sh 00:00:50.233 + cat autorun-spdk.conf 00:00:50.233 SPDK_RUN_FUNCTIONAL_TEST=1 00:00:50.233 SPDK_TEST_NVMF=1 00:00:50.233 SPDK_TEST_NVME_CLI=1 00:00:50.233 SPDK_TEST_NVMF_TRANSPORT=tcp 00:00:50.233 SPDK_TEST_NVMF_NICS=e810 00:00:50.233 SPDK_RUN_UBSAN=1 00:00:50.233 NET_TYPE=phy 00:00:50.240 RUN_NIGHTLY=1 00:00:50.245 [Pipeline] readFile 00:00:50.268 [Pipeline] withEnv 00:00:50.270 [Pipeline] { 00:00:50.281 [Pipeline] sh 00:00:50.567 + set -ex 00:00:50.567 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:00:50.567 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:00:50.567 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:00:50.567 ++ SPDK_TEST_NVMF=1 00:00:50.567 ++ SPDK_TEST_NVME_CLI=1 00:00:50.567 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:00:50.567 ++ SPDK_TEST_NVMF_NICS=e810 00:00:50.567 ++ SPDK_RUN_UBSAN=1 00:00:50.567 ++ NET_TYPE=phy 00:00:50.567 ++ RUN_NIGHTLY=1 00:00:50.567 + case $SPDK_TEST_NVMF_NICS in 00:00:50.567 + DRIVERS=ice 00:00:50.567 + [[ tcp == \r\d\m\a ]] 00:00:50.567 + [[ -n ice ]] 00:00:50.567 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:00:50.567 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:00:50.567 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:00:50.567 rmmod: ERROR: Module irdma is not currently loaded 00:00:50.567 rmmod: ERROR: Module i40iw is not currently loaded 00:00:50.567 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:00:50.567 + true 00:00:50.567 + for D in $DRIVERS 00:00:50.567 + sudo modprobe ice 00:00:50.567 + exit 0 00:00:50.577 [Pipeline] } 00:00:50.590 [Pipeline] // withEnv 00:00:50.595 [Pipeline] } 00:00:50.608 [Pipeline] // stage 00:00:50.617 [Pipeline] catchError 00:00:50.619 [Pipeline] { 00:00:50.631 [Pipeline] timeout 00:00:50.632 Timeout set to expire in 1 hr 0 min 00:00:50.634 [Pipeline] { 00:00:50.647 [Pipeline] stage 00:00:50.648 [Pipeline] { (Tests) 00:00:50.662 [Pipeline] sh 00:00:50.948 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:50.948 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:50.948 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:50.948 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:00:50.948 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:50.948 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:00:50.948 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:00:50.948 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:00:50.948 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:00:50.948 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:00:50.948 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:00:50.948 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:50.948 + source /etc/os-release 00:00:50.948 ++ NAME='Fedora Linux' 00:00:50.948 ++ VERSION='39 (Cloud Edition)' 00:00:50.948 ++ ID=fedora 00:00:50.948 ++ VERSION_ID=39 00:00:50.948 ++ VERSION_CODENAME= 00:00:50.948 ++ PLATFORM_ID=platform:f39 00:00:50.948 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:00:50.948 ++ ANSI_COLOR='0;38;2;60;110;180' 00:00:50.948 ++ LOGO=fedora-logo-icon 00:00:50.948 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:00:50.948 ++ HOME_URL=https://fedoraproject.org/ 00:00:50.948 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:00:50.948 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:00:50.948 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:00:50.948 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:00:50.948 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:00:50.948 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:00:50.948 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:00:50.948 ++ SUPPORT_END=2024-11-12 00:00:50.948 ++ VARIANT='Cloud Edition' 00:00:50.948 ++ VARIANT_ID=cloud 00:00:50.948 + uname -a 00:00:50.948 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:00:50.948 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:00:51.886 Hugepages 00:00:51.886 node hugesize free / total 00:00:51.886 node0 1048576kB 0 / 0 00:00:51.886 node0 2048kB 0 / 0 00:00:51.886 node1 1048576kB 0 / 0 00:00:51.886 node1 2048kB 0 / 0 00:00:51.886 00:00:51.886 Type BDF Vendor Device NUMA Driver Device Block devices 00:00:51.886 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:00:51.886 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:00:51.886 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:00:51.886 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:00:51.886 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:00:51.886 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:00:51.886 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:00:51.886 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:00:51.886 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:00:51.886 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:00:51.886 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:00:51.886 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:00:51.886 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:00:51.886 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:00:51.886 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:00:51.886 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:00:51.886 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:00:51.886 + rm -f /tmp/spdk-ld-path 00:00:51.886 + source autorun-spdk.conf 00:00:51.886 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:00:51.886 ++ SPDK_TEST_NVMF=1 00:00:51.886 ++ SPDK_TEST_NVME_CLI=1 00:00:51.886 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:00:51.886 ++ SPDK_TEST_NVMF_NICS=e810 00:00:51.886 ++ SPDK_RUN_UBSAN=1 00:00:51.886 ++ NET_TYPE=phy 00:00:51.886 ++ RUN_NIGHTLY=1 00:00:51.886 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:00:51.886 + [[ -n '' ]] 00:00:51.886 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:51.886 + for M in /var/spdk/build-*-manifest.txt 00:00:51.886 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:00:51.886 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:00:51.886 + for M in /var/spdk/build-*-manifest.txt 00:00:51.886 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:00:51.886 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:00:51.886 + for M in /var/spdk/build-*-manifest.txt 00:00:51.886 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:00:51.887 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:00:51.887 ++ uname 00:00:51.887 + [[ Linux == \L\i\n\u\x ]] 00:00:51.887 + sudo dmesg -T 00:00:52.145 + sudo dmesg --clear 00:00:52.145 + dmesg_pid=1910257 00:00:52.145 + [[ Fedora Linux == FreeBSD ]] 00:00:52.145 + sudo dmesg -Tw 00:00:52.145 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:00:52.145 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:00:52.145 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:00:52.145 + [[ -x /usr/src/fio-static/fio ]] 00:00:52.145 + export FIO_BIN=/usr/src/fio-static/fio 00:00:52.145 + FIO_BIN=/usr/src/fio-static/fio 00:00:52.145 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:00:52.145 + [[ ! -v VFIO_QEMU_BIN ]] 00:00:52.145 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:00:52.145 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:00:52.145 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:00:52.145 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:00:52.145 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:00:52.145 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:00:52.145 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:00:52.145 Test configuration: 00:00:52.145 SPDK_RUN_FUNCTIONAL_TEST=1 00:00:52.145 SPDK_TEST_NVMF=1 00:00:52.145 SPDK_TEST_NVME_CLI=1 00:00:52.145 SPDK_TEST_NVMF_TRANSPORT=tcp 00:00:52.145 SPDK_TEST_NVMF_NICS=e810 00:00:52.145 SPDK_RUN_UBSAN=1 00:00:52.145 NET_TYPE=phy 00:00:52.145 RUN_NIGHTLY=1 02:03:19 -- common/autotest_common.sh@1689 -- $ [[ n == y ]] 00:00:52.145 02:03:19 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:00:52.145 02:03:19 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:00:52.145 02:03:19 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:00:52.145 02:03:19 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:00:52.145 02:03:19 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:52.145 02:03:19 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:52.145 02:03:19 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:52.145 02:03:19 -- paths/export.sh@5 -- $ export PATH 00:00:52.145 02:03:19 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:52.145 02:03:19 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:00:52.145 02:03:19 -- common/autobuild_common.sh@440 -- $ date +%s 00:00:52.145 02:03:19 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1733619799.XXXXXX 00:00:52.145 02:03:19 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1733619799.5QoNSV 00:00:52.145 02:03:19 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:00:52.145 02:03:19 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:00:52.146 02:03:19 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:00:52.146 02:03:19 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:00:52.146 02:03:19 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:00:52.146 02:03:19 -- common/autobuild_common.sh@456 -- $ get_config_params 00:00:52.146 02:03:19 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:00:52.146 02:03:19 -- common/autotest_common.sh@10 -- $ set +x 00:00:52.146 02:03:19 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:00:52.146 02:03:19 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:00:52.146 02:03:19 -- spdk/autobuild.sh@12 -- $ umask 022 00:00:52.146 02:03:19 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:52.146 02:03:19 -- spdk/autobuild.sh@16 -- $ date -u 00:00:52.146 Sun Dec 8 01:03:19 AM UTC 2024 00:00:52.146 02:03:19 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:00:52.146 LTS-67-gc13c99a5e 00:00:52.146 02:03:19 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:00:52.146 02:03:19 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:00:52.146 02:03:19 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:00:52.146 02:03:19 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:00:52.146 02:03:19 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:00:52.146 02:03:19 -- common/autotest_common.sh@10 -- $ set +x 00:00:52.146 ************************************ 00:00:52.146 START TEST ubsan 00:00:52.146 ************************************ 00:00:52.146 02:03:19 -- common/autotest_common.sh@1114 -- $ echo 'using ubsan' 00:00:52.146 using ubsan 00:00:52.146 00:00:52.146 real 0m0.000s 00:00:52.146 user 0m0.000s 00:00:52.146 sys 0m0.000s 00:00:52.146 02:03:19 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:00:52.146 02:03:19 -- common/autotest_common.sh@10 -- $ set +x 00:00:52.146 ************************************ 00:00:52.146 END TEST ubsan 00:00:52.146 ************************************ 00:00:52.146 02:03:19 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:00:52.146 02:03:19 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:00:52.146 02:03:19 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:00:52.146 02:03:19 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:00:52.146 02:03:19 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:00:52.146 02:03:19 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:00:52.146 02:03:19 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:00:52.146 02:03:19 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:00:52.146 02:03:19 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-shared 00:00:52.146 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:00:52.146 Using default DPDK in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:00:52.404 Using 'verbs' RDMA provider 00:01:02.964 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:01:12.951 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:01:12.951 Creating mk/config.mk...done. 00:01:12.951 Creating mk/cc.flags.mk...done. 00:01:12.951 Type 'make' to build. 00:01:12.951 02:03:39 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:01:12.951 02:03:39 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:12.951 02:03:39 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:12.951 02:03:39 -- common/autotest_common.sh@10 -- $ set +x 00:01:12.951 ************************************ 00:01:12.951 START TEST make 00:01:12.951 ************************************ 00:01:12.951 02:03:39 -- common/autotest_common.sh@1114 -- $ make -j48 00:01:12.951 make[1]: Nothing to be done for 'all'. 00:01:21.085 The Meson build system 00:01:21.085 Version: 1.5.0 00:01:21.085 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk 00:01:21.085 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp 00:01:21.085 Build type: native build 00:01:21.085 Program cat found: YES (/usr/bin/cat) 00:01:21.085 Project name: DPDK 00:01:21.085 Project version: 23.11.0 00:01:21.085 C compiler for the host machine: cc (gcc 13.3.1 "cc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:21.085 C linker for the host machine: cc ld.bfd 2.40-14 00:01:21.085 Host machine cpu family: x86_64 00:01:21.085 Host machine cpu: x86_64 00:01:21.085 Message: ## Building in Developer Mode ## 00:01:21.085 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:21.085 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:01:21.085 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:01:21.085 Program python3 found: YES (/usr/bin/python3) 00:01:21.085 Program cat found: YES (/usr/bin/cat) 00:01:21.085 Compiler for C supports arguments -march=native: YES 00:01:21.085 Checking for size of "void *" : 8 00:01:21.085 Checking for size of "void *" : 8 (cached) 00:01:21.085 Library m found: YES 00:01:21.085 Library numa found: YES 00:01:21.085 Has header "numaif.h" : YES 00:01:21.085 Library fdt found: NO 00:01:21.085 Library execinfo found: NO 00:01:21.085 Has header "execinfo.h" : YES 00:01:21.085 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:21.085 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:21.085 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:21.085 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:21.085 Run-time dependency openssl found: YES 3.1.1 00:01:21.085 Run-time dependency libpcap found: YES 1.10.4 00:01:21.085 Has header "pcap.h" with dependency libpcap: YES 00:01:21.085 Compiler for C supports arguments -Wcast-qual: YES 00:01:21.085 Compiler for C supports arguments -Wdeprecated: YES 00:01:21.085 Compiler for C supports arguments -Wformat: YES 00:01:21.085 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:21.085 Compiler for C supports arguments -Wformat-security: NO 00:01:21.085 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:21.085 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:21.085 Compiler for C supports arguments -Wnested-externs: YES 00:01:21.085 Compiler for C supports arguments -Wold-style-definition: YES 00:01:21.085 Compiler for C supports arguments -Wpointer-arith: YES 00:01:21.085 Compiler for C supports arguments -Wsign-compare: YES 00:01:21.085 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:21.085 Compiler for C supports arguments -Wundef: YES 00:01:21.085 Compiler for C supports arguments -Wwrite-strings: YES 00:01:21.085 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:21.085 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:21.085 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:21.085 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:21.085 Program objdump found: YES (/usr/bin/objdump) 00:01:21.085 Compiler for C supports arguments -mavx512f: YES 00:01:21.085 Checking if "AVX512 checking" compiles: YES 00:01:21.085 Fetching value of define "__SSE4_2__" : 1 00:01:21.085 Fetching value of define "__AES__" : 1 00:01:21.085 Fetching value of define "__AVX__" : 1 00:01:21.085 Fetching value of define "__AVX2__" : (undefined) 00:01:21.085 Fetching value of define "__AVX512BW__" : (undefined) 00:01:21.085 Fetching value of define "__AVX512CD__" : (undefined) 00:01:21.085 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:21.085 Fetching value of define "__AVX512F__" : (undefined) 00:01:21.085 Fetching value of define "__AVX512VL__" : (undefined) 00:01:21.085 Fetching value of define "__PCLMUL__" : 1 00:01:21.085 Fetching value of define "__RDRND__" : 1 00:01:21.085 Fetching value of define "__RDSEED__" : (undefined) 00:01:21.085 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:21.085 Fetching value of define "__znver1__" : (undefined) 00:01:21.085 Fetching value of define "__znver2__" : (undefined) 00:01:21.085 Fetching value of define "__znver3__" : (undefined) 00:01:21.085 Fetching value of define "__znver4__" : (undefined) 00:01:21.085 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:21.085 Message: lib/log: Defining dependency "log" 00:01:21.085 Message: lib/kvargs: Defining dependency "kvargs" 00:01:21.085 Message: lib/telemetry: Defining dependency "telemetry" 00:01:21.085 Checking for function "getentropy" : NO 00:01:21.085 Message: lib/eal: Defining dependency "eal" 00:01:21.085 Message: lib/ring: Defining dependency "ring" 00:01:21.085 Message: lib/rcu: Defining dependency "rcu" 00:01:21.085 Message: lib/mempool: Defining dependency "mempool" 00:01:21.085 Message: lib/mbuf: Defining dependency "mbuf" 00:01:21.085 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:21.085 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:21.085 Compiler for C supports arguments -mpclmul: YES 00:01:21.085 Compiler for C supports arguments -maes: YES 00:01:21.085 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:21.085 Compiler for C supports arguments -mavx512bw: YES 00:01:21.085 Compiler for C supports arguments -mavx512dq: YES 00:01:21.085 Compiler for C supports arguments -mavx512vl: YES 00:01:21.085 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:21.085 Compiler for C supports arguments -mavx2: YES 00:01:21.085 Compiler for C supports arguments -mavx: YES 00:01:21.085 Message: lib/net: Defining dependency "net" 00:01:21.085 Message: lib/meter: Defining dependency "meter" 00:01:21.085 Message: lib/ethdev: Defining dependency "ethdev" 00:01:21.085 Message: lib/pci: Defining dependency "pci" 00:01:21.085 Message: lib/cmdline: Defining dependency "cmdline" 00:01:21.085 Message: lib/hash: Defining dependency "hash" 00:01:21.085 Message: lib/timer: Defining dependency "timer" 00:01:21.085 Message: lib/compressdev: Defining dependency "compressdev" 00:01:21.085 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:21.085 Message: lib/dmadev: Defining dependency "dmadev" 00:01:21.085 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:21.085 Message: lib/power: Defining dependency "power" 00:01:21.085 Message: lib/reorder: Defining dependency "reorder" 00:01:21.085 Message: lib/security: Defining dependency "security" 00:01:21.085 Has header "linux/userfaultfd.h" : YES 00:01:21.085 Has header "linux/vduse.h" : YES 00:01:21.085 Message: lib/vhost: Defining dependency "vhost" 00:01:21.085 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:21.085 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:21.085 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:21.085 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:21.085 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:01:21.085 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:01:21.085 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:01:21.085 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:01:21.085 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:01:21.085 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:01:21.085 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:21.085 Configuring doxy-api-html.conf using configuration 00:01:21.085 Configuring doxy-api-man.conf using configuration 00:01:21.085 Program mandb found: YES (/usr/bin/mandb) 00:01:21.085 Program sphinx-build found: NO 00:01:21.085 Configuring rte_build_config.h using configuration 00:01:21.085 Message: 00:01:21.085 ================= 00:01:21.085 Applications Enabled 00:01:21.085 ================= 00:01:21.085 00:01:21.085 apps: 00:01:21.085 00:01:21.085 00:01:21.085 Message: 00:01:21.085 ================= 00:01:21.085 Libraries Enabled 00:01:21.085 ================= 00:01:21.085 00:01:21.085 libs: 00:01:21.085 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:21.085 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:01:21.085 cryptodev, dmadev, power, reorder, security, vhost, 00:01:21.085 00:01:21.085 Message: 00:01:21.085 =============== 00:01:21.085 Drivers Enabled 00:01:21.085 =============== 00:01:21.085 00:01:21.085 common: 00:01:21.085 00:01:21.085 bus: 00:01:21.085 pci, vdev, 00:01:21.085 mempool: 00:01:21.086 ring, 00:01:21.086 dma: 00:01:21.086 00:01:21.086 net: 00:01:21.086 00:01:21.086 crypto: 00:01:21.086 00:01:21.086 compress: 00:01:21.086 00:01:21.086 vdpa: 00:01:21.086 00:01:21.086 00:01:21.086 Message: 00:01:21.086 ================= 00:01:21.086 Content Skipped 00:01:21.086 ================= 00:01:21.086 00:01:21.086 apps: 00:01:21.086 dumpcap: explicitly disabled via build config 00:01:21.086 graph: explicitly disabled via build config 00:01:21.086 pdump: explicitly disabled via build config 00:01:21.086 proc-info: explicitly disabled via build config 00:01:21.086 test-acl: explicitly disabled via build config 00:01:21.086 test-bbdev: explicitly disabled via build config 00:01:21.086 test-cmdline: explicitly disabled via build config 00:01:21.086 test-compress-perf: explicitly disabled via build config 00:01:21.086 test-crypto-perf: explicitly disabled via build config 00:01:21.086 test-dma-perf: explicitly disabled via build config 00:01:21.086 test-eventdev: explicitly disabled via build config 00:01:21.086 test-fib: explicitly disabled via build config 00:01:21.086 test-flow-perf: explicitly disabled via build config 00:01:21.086 test-gpudev: explicitly disabled via build config 00:01:21.086 test-mldev: explicitly disabled via build config 00:01:21.086 test-pipeline: explicitly disabled via build config 00:01:21.086 test-pmd: explicitly disabled via build config 00:01:21.086 test-regex: explicitly disabled via build config 00:01:21.086 test-sad: explicitly disabled via build config 00:01:21.086 test-security-perf: explicitly disabled via build config 00:01:21.086 00:01:21.086 libs: 00:01:21.086 metrics: explicitly disabled via build config 00:01:21.086 acl: explicitly disabled via build config 00:01:21.086 bbdev: explicitly disabled via build config 00:01:21.086 bitratestats: explicitly disabled via build config 00:01:21.086 bpf: explicitly disabled via build config 00:01:21.086 cfgfile: explicitly disabled via build config 00:01:21.086 distributor: explicitly disabled via build config 00:01:21.086 efd: explicitly disabled via build config 00:01:21.086 eventdev: explicitly disabled via build config 00:01:21.086 dispatcher: explicitly disabled via build config 00:01:21.086 gpudev: explicitly disabled via build config 00:01:21.086 gro: explicitly disabled via build config 00:01:21.086 gso: explicitly disabled via build config 00:01:21.086 ip_frag: explicitly disabled via build config 00:01:21.086 jobstats: explicitly disabled via build config 00:01:21.086 latencystats: explicitly disabled via build config 00:01:21.086 lpm: explicitly disabled via build config 00:01:21.086 member: explicitly disabled via build config 00:01:21.086 pcapng: explicitly disabled via build config 00:01:21.086 rawdev: explicitly disabled via build config 00:01:21.086 regexdev: explicitly disabled via build config 00:01:21.086 mldev: explicitly disabled via build config 00:01:21.086 rib: explicitly disabled via build config 00:01:21.086 sched: explicitly disabled via build config 00:01:21.086 stack: explicitly disabled via build config 00:01:21.086 ipsec: explicitly disabled via build config 00:01:21.086 pdcp: explicitly disabled via build config 00:01:21.086 fib: explicitly disabled via build config 00:01:21.086 port: explicitly disabled via build config 00:01:21.086 pdump: explicitly disabled via build config 00:01:21.086 table: explicitly disabled via build config 00:01:21.086 pipeline: explicitly disabled via build config 00:01:21.086 graph: explicitly disabled via build config 00:01:21.086 node: explicitly disabled via build config 00:01:21.086 00:01:21.086 drivers: 00:01:21.086 common/cpt: not in enabled drivers build config 00:01:21.086 common/dpaax: not in enabled drivers build config 00:01:21.086 common/iavf: not in enabled drivers build config 00:01:21.086 common/idpf: not in enabled drivers build config 00:01:21.086 common/mvep: not in enabled drivers build config 00:01:21.086 common/octeontx: not in enabled drivers build config 00:01:21.086 bus/auxiliary: not in enabled drivers build config 00:01:21.086 bus/cdx: not in enabled drivers build config 00:01:21.086 bus/dpaa: not in enabled drivers build config 00:01:21.086 bus/fslmc: not in enabled drivers build config 00:01:21.086 bus/ifpga: not in enabled drivers build config 00:01:21.086 bus/platform: not in enabled drivers build config 00:01:21.086 bus/vmbus: not in enabled drivers build config 00:01:21.086 common/cnxk: not in enabled drivers build config 00:01:21.086 common/mlx5: not in enabled drivers build config 00:01:21.086 common/nfp: not in enabled drivers build config 00:01:21.086 common/qat: not in enabled drivers build config 00:01:21.086 common/sfc_efx: not in enabled drivers build config 00:01:21.086 mempool/bucket: not in enabled drivers build config 00:01:21.086 mempool/cnxk: not in enabled drivers build config 00:01:21.086 mempool/dpaa: not in enabled drivers build config 00:01:21.086 mempool/dpaa2: not in enabled drivers build config 00:01:21.086 mempool/octeontx: not in enabled drivers build config 00:01:21.086 mempool/stack: not in enabled drivers build config 00:01:21.086 dma/cnxk: not in enabled drivers build config 00:01:21.086 dma/dpaa: not in enabled drivers build config 00:01:21.086 dma/dpaa2: not in enabled drivers build config 00:01:21.086 dma/hisilicon: not in enabled drivers build config 00:01:21.086 dma/idxd: not in enabled drivers build config 00:01:21.086 dma/ioat: not in enabled drivers build config 00:01:21.086 dma/skeleton: not in enabled drivers build config 00:01:21.086 net/af_packet: not in enabled drivers build config 00:01:21.086 net/af_xdp: not in enabled drivers build config 00:01:21.086 net/ark: not in enabled drivers build config 00:01:21.086 net/atlantic: not in enabled drivers build config 00:01:21.086 net/avp: not in enabled drivers build config 00:01:21.086 net/axgbe: not in enabled drivers build config 00:01:21.086 net/bnx2x: not in enabled drivers build config 00:01:21.086 net/bnxt: not in enabled drivers build config 00:01:21.086 net/bonding: not in enabled drivers build config 00:01:21.086 net/cnxk: not in enabled drivers build config 00:01:21.086 net/cpfl: not in enabled drivers build config 00:01:21.086 net/cxgbe: not in enabled drivers build config 00:01:21.086 net/dpaa: not in enabled drivers build config 00:01:21.086 net/dpaa2: not in enabled drivers build config 00:01:21.086 net/e1000: not in enabled drivers build config 00:01:21.086 net/ena: not in enabled drivers build config 00:01:21.086 net/enetc: not in enabled drivers build config 00:01:21.086 net/enetfec: not in enabled drivers build config 00:01:21.086 net/enic: not in enabled drivers build config 00:01:21.086 net/failsafe: not in enabled drivers build config 00:01:21.086 net/fm10k: not in enabled drivers build config 00:01:21.086 net/gve: not in enabled drivers build config 00:01:21.086 net/hinic: not in enabled drivers build config 00:01:21.086 net/hns3: not in enabled drivers build config 00:01:21.086 net/i40e: not in enabled drivers build config 00:01:21.086 net/iavf: not in enabled drivers build config 00:01:21.086 net/ice: not in enabled drivers build config 00:01:21.086 net/idpf: not in enabled drivers build config 00:01:21.086 net/igc: not in enabled drivers build config 00:01:21.086 net/ionic: not in enabled drivers build config 00:01:21.086 net/ipn3ke: not in enabled drivers build config 00:01:21.086 net/ixgbe: not in enabled drivers build config 00:01:21.086 net/mana: not in enabled drivers build config 00:01:21.086 net/memif: not in enabled drivers build config 00:01:21.086 net/mlx4: not in enabled drivers build config 00:01:21.086 net/mlx5: not in enabled drivers build config 00:01:21.086 net/mvneta: not in enabled drivers build config 00:01:21.086 net/mvpp2: not in enabled drivers build config 00:01:21.086 net/netvsc: not in enabled drivers build config 00:01:21.086 net/nfb: not in enabled drivers build config 00:01:21.086 net/nfp: not in enabled drivers build config 00:01:21.086 net/ngbe: not in enabled drivers build config 00:01:21.086 net/null: not in enabled drivers build config 00:01:21.086 net/octeontx: not in enabled drivers build config 00:01:21.086 net/octeon_ep: not in enabled drivers build config 00:01:21.086 net/pcap: not in enabled drivers build config 00:01:21.086 net/pfe: not in enabled drivers build config 00:01:21.086 net/qede: not in enabled drivers build config 00:01:21.086 net/ring: not in enabled drivers build config 00:01:21.086 net/sfc: not in enabled drivers build config 00:01:21.087 net/softnic: not in enabled drivers build config 00:01:21.087 net/tap: not in enabled drivers build config 00:01:21.087 net/thunderx: not in enabled drivers build config 00:01:21.087 net/txgbe: not in enabled drivers build config 00:01:21.087 net/vdev_netvsc: not in enabled drivers build config 00:01:21.087 net/vhost: not in enabled drivers build config 00:01:21.087 net/virtio: not in enabled drivers build config 00:01:21.087 net/vmxnet3: not in enabled drivers build config 00:01:21.087 raw/*: missing internal dependency, "rawdev" 00:01:21.087 crypto/armv8: not in enabled drivers build config 00:01:21.087 crypto/bcmfs: not in enabled drivers build config 00:01:21.087 crypto/caam_jr: not in enabled drivers build config 00:01:21.087 crypto/ccp: not in enabled drivers build config 00:01:21.087 crypto/cnxk: not in enabled drivers build config 00:01:21.087 crypto/dpaa_sec: not in enabled drivers build config 00:01:21.087 crypto/dpaa2_sec: not in enabled drivers build config 00:01:21.087 crypto/ipsec_mb: not in enabled drivers build config 00:01:21.087 crypto/mlx5: not in enabled drivers build config 00:01:21.087 crypto/mvsam: not in enabled drivers build config 00:01:21.087 crypto/nitrox: not in enabled drivers build config 00:01:21.087 crypto/null: not in enabled drivers build config 00:01:21.087 crypto/octeontx: not in enabled drivers build config 00:01:21.087 crypto/openssl: not in enabled drivers build config 00:01:21.087 crypto/scheduler: not in enabled drivers build config 00:01:21.087 crypto/uadk: not in enabled drivers build config 00:01:21.087 crypto/virtio: not in enabled drivers build config 00:01:21.087 compress/isal: not in enabled drivers build config 00:01:21.087 compress/mlx5: not in enabled drivers build config 00:01:21.087 compress/octeontx: not in enabled drivers build config 00:01:21.087 compress/zlib: not in enabled drivers build config 00:01:21.087 regex/*: missing internal dependency, "regexdev" 00:01:21.087 ml/*: missing internal dependency, "mldev" 00:01:21.087 vdpa/ifc: not in enabled drivers build config 00:01:21.087 vdpa/mlx5: not in enabled drivers build config 00:01:21.087 vdpa/nfp: not in enabled drivers build config 00:01:21.087 vdpa/sfc: not in enabled drivers build config 00:01:21.087 event/*: missing internal dependency, "eventdev" 00:01:21.087 baseband/*: missing internal dependency, "bbdev" 00:01:21.087 gpu/*: missing internal dependency, "gpudev" 00:01:21.087 00:01:21.087 00:01:21.087 Build targets in project: 85 00:01:21.087 00:01:21.087 DPDK 23.11.0 00:01:21.087 00:01:21.087 User defined options 00:01:21.087 buildtype : debug 00:01:21.087 default_library : shared 00:01:21.087 libdir : lib 00:01:21.087 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:21.087 c_args : -fPIC -Werror -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds 00:01:21.087 c_link_args : 00:01:21.087 cpu_instruction_set: native 00:01:21.087 disable_apps : test-sad,test-acl,test-dma-perf,test-pipeline,test-compress-perf,test-fib,test-flow-perf,test-crypto-perf,test-bbdev,test-eventdev,pdump,test-mldev,test-cmdline,graph,test-security-perf,test-pmd,test,proc-info,test-regex,dumpcap,test-gpudev 00:01:21.087 disable_libs : port,sched,rib,node,ipsec,distributor,gro,eventdev,pdcp,acl,member,latencystats,efd,stack,regexdev,rawdev,bpf,metrics,gpudev,pipeline,pdump,table,fib,dispatcher,mldev,gso,cfgfile,bitratestats,ip_frag,graph,lpm,jobstats,pcapng,bbdev 00:01:21.087 enable_docs : false 00:01:21.087 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:01:21.087 enable_kmods : false 00:01:21.087 tests : false 00:01:21.087 00:01:21.087 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:21.664 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp' 00:01:21.664 [1/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:21.664 [2/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:21.664 [3/265] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:21.665 [4/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:21.665 [5/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:21.665 [6/265] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:21.665 [7/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:21.665 [8/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:21.665 [9/265] Linking static target lib/librte_kvargs.a 00:01:21.665 [10/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:21.665 [11/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:21.665 [12/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:21.665 [13/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:21.665 [14/265] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:21.665 [15/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:21.665 [16/265] Linking static target lib/librte_log.a 00:01:21.665 [17/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:21.665 [18/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:21.665 [19/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:21.928 [20/265] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:21.928 [21/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:22.190 [22/265] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:22.449 [23/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:22.449 [24/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:22.449 [25/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:22.449 [26/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:22.449 [27/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:22.449 [28/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:22.449 [29/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:22.449 [30/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:22.449 [31/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:22.449 [32/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:22.449 [33/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:22.449 [34/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:22.449 [35/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:22.449 [36/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:22.449 [37/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:22.717 [38/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:22.717 [39/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:22.717 [40/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:22.717 [41/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:22.717 [42/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:22.717 [43/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:22.717 [44/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:22.717 [45/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:22.717 [46/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:22.717 [47/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:22.717 [48/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:22.717 [49/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:22.717 [50/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:22.717 [51/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:22.717 [52/265] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:22.717 [53/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:22.717 [54/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:22.717 [55/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:22.717 [56/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:22.717 [57/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:22.717 [58/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:22.717 [59/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:22.717 [60/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:22.717 [61/265] Linking static target lib/librte_telemetry.a 00:01:22.717 [62/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:22.717 [63/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:22.717 [64/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:22.978 [65/265] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:22.978 [66/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:22.978 [67/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:22.978 [68/265] Linking target lib/librte_log.so.24.0 00:01:22.978 [69/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:22.978 [70/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:22.978 [71/265] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:22.978 [72/265] Linking static target lib/librte_pci.a 00:01:22.978 [73/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:22.978 [74/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:22.978 [75/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:22.978 [76/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:22.978 [77/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:22.978 [78/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:23.237 [79/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:23.237 [80/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:23.237 [81/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:23.237 [82/265] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:23.237 [83/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:23.237 [84/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:23.237 [85/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:23.237 [86/265] Linking target lib/librte_kvargs.so.24.0 00:01:23.237 [87/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:23.237 [88/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:23.237 [89/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:23.502 [90/265] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:23.502 [91/265] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:23.502 [92/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:23.502 [93/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:23.502 [94/265] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:23.502 [95/265] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:23.502 [96/265] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:23.502 [97/265] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:23.502 [98/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:23.502 [99/265] Linking static target lib/librte_ring.a 00:01:23.502 [100/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:23.502 [101/265] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:23.502 [102/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:23.502 [103/265] Linking static target lib/librte_eal.a 00:01:23.502 [104/265] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:23.502 [105/265] Linking static target lib/librte_meter.a 00:01:23.502 [106/265] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:23.502 [107/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:23.502 [108/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:23.761 [109/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:23.761 [110/265] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:23.761 [111/265] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:23.761 [112/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:23.761 [113/265] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:23.761 [114/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:23.761 [115/265] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:23.761 [116/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:23.761 [117/265] Linking static target lib/librte_mempool.a 00:01:23.761 [118/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:23.761 [119/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:23.761 [120/265] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:23.761 [121/265] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:23.761 [122/265] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:23.761 [123/265] Linking static target lib/librte_rcu.a 00:01:23.761 [124/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:23.761 [125/265] Linking target lib/librte_telemetry.so.24.0 00:01:23.761 [126/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:24.023 [127/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:24.023 [128/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:24.023 [129/265] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:24.023 [130/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:24.023 [131/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:24.023 [132/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:24.023 [133/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:24.023 [134/265] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:24.023 [135/265] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:24.023 [136/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:24.023 [137/265] Linking static target lib/librte_cmdline.a 00:01:24.282 [138/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:24.282 [139/265] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:24.282 [140/265] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:24.282 [141/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:24.282 [142/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:24.282 [143/265] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:24.282 [144/265] Linking static target lib/librte_net.a 00:01:24.282 [145/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:24.282 [146/265] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:24.282 [147/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:24.282 [148/265] Linking static target lib/librte_timer.a 00:01:24.282 [149/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:24.282 [150/265] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:24.541 [151/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:24.541 [152/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:24.541 [153/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:24.541 [154/265] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:24.541 [155/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:24.541 [156/265] Linking static target lib/librte_dmadev.a 00:01:24.541 [157/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:24.541 [158/265] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:24.541 [159/265] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:24.851 [160/265] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:24.851 [161/265] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:24.851 [162/265] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:24.851 [163/265] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:24.851 [164/265] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:24.851 [165/265] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:24.851 [166/265] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:24.851 [167/265] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:24.851 [168/265] Linking static target lib/librte_hash.a 00:01:24.851 [169/265] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:24.851 [170/265] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:24.851 [171/265] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:24.851 [172/265] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:24.851 [173/265] Linking static target lib/librte_power.a 00:01:24.851 [174/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:24.851 [175/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:24.851 [176/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:25.108 [177/265] Linking static target lib/librte_compressdev.a 00:01:25.108 [178/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:25.108 [179/265] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:25.108 [180/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:25.108 [181/265] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:25.108 [182/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:25.108 [183/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:25.108 [184/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:25.108 [185/265] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:25.108 [186/265] Linking static target lib/librte_mbuf.a 00:01:25.108 [187/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:25.108 [188/265] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:25.108 [189/265] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:25.108 [190/265] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:25.108 [191/265] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:25.108 [192/265] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:25.364 [193/265] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:25.364 [194/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:25.364 [195/265] Linking static target lib/librte_security.a 00:01:25.364 [196/265] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:25.364 [197/265] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:25.364 [198/265] Linking static target lib/librte_reorder.a 00:01:25.364 [199/265] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:25.364 [200/265] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:25.365 [201/265] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:25.365 [202/265] Linking static target drivers/librte_bus_vdev.a 00:01:25.365 [203/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:25.365 [204/265] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:25.365 [205/265] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:25.365 [206/265] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:25.365 [207/265] Linking static target drivers/librte_bus_pci.a 00:01:25.365 [208/265] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:25.365 [209/265] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:25.365 [210/265] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:25.365 [211/265] Linking static target drivers/librte_mempool_ring.a 00:01:25.365 [212/265] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:25.365 [213/265] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:25.621 [214/265] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:25.621 [215/265] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:25.621 [216/265] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:25.621 [217/265] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:25.621 [218/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:25.878 [219/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:25.878 [220/265] Linking static target lib/librte_cryptodev.a 00:01:25.878 [221/265] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:25.878 [222/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:25.878 [223/265] Linking static target lib/librte_ethdev.a 00:01:26.808 [224/265] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:28.182 [225/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:01:30.084 [226/265] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.084 [227/265] Linking target lib/librte_eal.so.24.0 00:01:30.084 [228/265] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.084 [229/265] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:01:30.084 [230/265] Linking target lib/librte_ring.so.24.0 00:01:30.084 [231/265] Linking target lib/librte_timer.so.24.0 00:01:30.084 [232/265] Linking target lib/librte_meter.so.24.0 00:01:30.084 [233/265] Linking target lib/librte_pci.so.24.0 00:01:30.084 [234/265] Linking target lib/librte_dmadev.so.24.0 00:01:30.084 [235/265] Linking target drivers/librte_bus_vdev.so.24.0 00:01:30.084 [236/265] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:01:30.084 [237/265] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:01:30.084 [238/265] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:01:30.084 [239/265] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:01:30.084 [240/265] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:01:30.084 [241/265] Linking target lib/librte_rcu.so.24.0 00:01:30.084 [242/265] Linking target lib/librte_mempool.so.24.0 00:01:30.084 [243/265] Linking target drivers/librte_bus_pci.so.24.0 00:01:30.342 [244/265] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:01:30.342 [245/265] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:01:30.343 [246/265] Linking target drivers/librte_mempool_ring.so.24.0 00:01:30.343 [247/265] Linking target lib/librte_mbuf.so.24.0 00:01:30.343 [248/265] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:01:30.343 [249/265] Linking target lib/librte_reorder.so.24.0 00:01:30.343 [250/265] Linking target lib/librte_compressdev.so.24.0 00:01:30.343 [251/265] Linking target lib/librte_cryptodev.so.24.0 00:01:30.343 [252/265] Linking target lib/librte_net.so.24.0 00:01:30.601 [253/265] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:01:30.601 [254/265] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:01:30.601 [255/265] Linking target lib/librte_cmdline.so.24.0 00:01:30.601 [256/265] Linking target lib/librte_hash.so.24.0 00:01:30.601 [257/265] Linking target lib/librte_security.so.24.0 00:01:30.601 [258/265] Linking target lib/librte_ethdev.so.24.0 00:01:30.601 [259/265] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:01:30.859 [260/265] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:01:30.859 [261/265] Linking target lib/librte_power.so.24.0 00:01:33.473 [262/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:01:33.473 [263/265] Linking static target lib/librte_vhost.a 00:01:34.408 [264/265] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.408 [265/265] Linking target lib/librte_vhost.so.24.0 00:01:34.408 INFO: autodetecting backend as ninja 00:01:34.408 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp -j 48 00:01:35.342 CC lib/ut_mock/mock.o 00:01:35.343 CC lib/log/log.o 00:01:35.343 CC lib/log/log_flags.o 00:01:35.343 CC lib/log/log_deprecated.o 00:01:35.343 CC lib/ut/ut.o 00:01:35.601 LIB libspdk_ut_mock.a 00:01:35.601 SO libspdk_ut_mock.so.5.0 00:01:35.601 LIB libspdk_log.a 00:01:35.601 LIB libspdk_ut.a 00:01:35.601 SO libspdk_log.so.6.1 00:01:35.601 SO libspdk_ut.so.1.0 00:01:35.601 SYMLINK libspdk_ut_mock.so 00:01:35.601 SYMLINK libspdk_ut.so 00:01:35.601 SYMLINK libspdk_log.so 00:01:35.859 CC lib/dma/dma.o 00:01:35.859 CC lib/ioat/ioat.o 00:01:35.859 CXX lib/trace_parser/trace.o 00:01:35.859 CC lib/util/base64.o 00:01:35.859 CC lib/util/bit_array.o 00:01:35.859 CC lib/util/cpuset.o 00:01:35.859 CC lib/util/crc16.o 00:01:35.859 CC lib/util/crc32.o 00:01:35.859 CC lib/util/crc32c.o 00:01:35.859 CC lib/util/crc32_ieee.o 00:01:35.859 CC lib/util/crc64.o 00:01:35.859 CC lib/util/dif.o 00:01:35.859 CC lib/util/fd.o 00:01:35.859 CC lib/util/file.o 00:01:35.859 CC lib/util/hexlify.o 00:01:35.859 CC lib/util/iov.o 00:01:35.859 CC lib/util/math.o 00:01:35.859 CC lib/util/pipe.o 00:01:35.859 CC lib/util/strerror_tls.o 00:01:35.859 CC lib/util/string.o 00:01:35.859 CC lib/util/uuid.o 00:01:35.859 CC lib/util/fd_group.o 00:01:35.859 CC lib/util/xor.o 00:01:35.859 CC lib/util/zipf.o 00:01:35.859 CC lib/vfio_user/host/vfio_user_pci.o 00:01:35.859 CC lib/vfio_user/host/vfio_user.o 00:01:35.859 LIB libspdk_dma.a 00:01:36.118 SO libspdk_dma.so.3.0 00:01:36.118 SYMLINK libspdk_dma.so 00:01:36.118 LIB libspdk_ioat.a 00:01:36.118 SO libspdk_ioat.so.6.0 00:01:36.118 LIB libspdk_vfio_user.a 00:01:36.118 SO libspdk_vfio_user.so.4.0 00:01:36.118 SYMLINK libspdk_ioat.so 00:01:36.118 SYMLINK libspdk_vfio_user.so 00:01:36.375 LIB libspdk_util.a 00:01:36.375 SO libspdk_util.so.8.0 00:01:36.375 SYMLINK libspdk_util.so 00:01:36.634 CC lib/conf/conf.o 00:01:36.634 CC lib/vmd/vmd.o 00:01:36.634 CC lib/idxd/idxd.o 00:01:36.634 CC lib/vmd/led.o 00:01:36.634 CC lib/rdma/common.o 00:01:36.634 CC lib/json/json_parse.o 00:01:36.634 CC lib/idxd/idxd_user.o 00:01:36.634 CC lib/env_dpdk/env.o 00:01:36.634 CC lib/rdma/rdma_verbs.o 00:01:36.634 CC lib/json/json_util.o 00:01:36.634 CC lib/idxd/idxd_kernel.o 00:01:36.634 CC lib/env_dpdk/memory.o 00:01:36.634 CC lib/json/json_write.o 00:01:36.634 CC lib/env_dpdk/pci.o 00:01:36.634 CC lib/env_dpdk/init.o 00:01:36.634 CC lib/env_dpdk/threads.o 00:01:36.634 CC lib/env_dpdk/pci_ioat.o 00:01:36.634 CC lib/env_dpdk/pci_virtio.o 00:01:36.634 CC lib/env_dpdk/pci_vmd.o 00:01:36.634 CC lib/env_dpdk/pci_idxd.o 00:01:36.634 CC lib/env_dpdk/pci_event.o 00:01:36.634 CC lib/env_dpdk/pci_dpdk.o 00:01:36.634 CC lib/env_dpdk/sigbus_handler.o 00:01:36.634 CC lib/env_dpdk/pci_dpdk_2207.o 00:01:36.634 CC lib/env_dpdk/pci_dpdk_2211.o 00:01:36.892 LIB libspdk_trace_parser.a 00:01:36.892 SO libspdk_trace_parser.so.4.0 00:01:36.892 LIB libspdk_conf.a 00:01:36.892 SO libspdk_conf.so.5.0 00:01:36.892 SYMLINK libspdk_trace_parser.so 00:01:36.892 LIB libspdk_rdma.a 00:01:36.892 SYMLINK libspdk_conf.so 00:01:36.892 SO libspdk_rdma.so.5.0 00:01:36.892 LIB libspdk_json.a 00:01:36.892 SO libspdk_json.so.5.1 00:01:36.892 SYMLINK libspdk_rdma.so 00:01:37.150 SYMLINK libspdk_json.so 00:01:37.150 CC lib/jsonrpc/jsonrpc_server.o 00:01:37.150 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:01:37.150 CC lib/jsonrpc/jsonrpc_client.o 00:01:37.150 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:01:37.150 LIB libspdk_idxd.a 00:01:37.150 SO libspdk_idxd.so.11.0 00:01:37.150 SYMLINK libspdk_idxd.so 00:01:37.150 LIB libspdk_vmd.a 00:01:37.412 SO libspdk_vmd.so.5.0 00:01:37.412 SYMLINK libspdk_vmd.so 00:01:37.412 LIB libspdk_jsonrpc.a 00:01:37.412 SO libspdk_jsonrpc.so.5.1 00:01:37.412 SYMLINK libspdk_jsonrpc.so 00:01:37.672 CC lib/rpc/rpc.o 00:01:37.672 LIB libspdk_rpc.a 00:01:37.672 SO libspdk_rpc.so.5.0 00:01:37.928 SYMLINK libspdk_rpc.so 00:01:37.929 CC lib/trace/trace.o 00:01:37.929 CC lib/trace/trace_flags.o 00:01:37.929 CC lib/trace/trace_rpc.o 00:01:37.929 CC lib/notify/notify.o 00:01:37.929 CC lib/notify/notify_rpc.o 00:01:37.929 CC lib/sock/sock.o 00:01:37.929 CC lib/sock/sock_rpc.o 00:01:38.186 LIB libspdk_notify.a 00:01:38.186 SO libspdk_notify.so.5.0 00:01:38.186 SYMLINK libspdk_notify.so 00:01:38.186 LIB libspdk_trace.a 00:01:38.186 SO libspdk_trace.so.9.0 00:01:38.186 SYMLINK libspdk_trace.so 00:01:38.443 LIB libspdk_sock.a 00:01:38.443 CC lib/thread/thread.o 00:01:38.443 CC lib/thread/iobuf.o 00:01:38.443 SO libspdk_sock.so.8.0 00:01:38.443 SYMLINK libspdk_sock.so 00:01:38.443 CC lib/nvme/nvme_ctrlr_cmd.o 00:01:38.443 CC lib/nvme/nvme_ctrlr.o 00:01:38.443 CC lib/nvme/nvme_fabric.o 00:01:38.443 CC lib/nvme/nvme_ns_cmd.o 00:01:38.443 CC lib/nvme/nvme_ns.o 00:01:38.443 CC lib/nvme/nvme_pcie_common.o 00:01:38.443 CC lib/nvme/nvme_pcie.o 00:01:38.443 CC lib/nvme/nvme_qpair.o 00:01:38.443 CC lib/nvme/nvme.o 00:01:38.443 CC lib/nvme/nvme_quirks.o 00:01:38.443 CC lib/nvme/nvme_transport.o 00:01:38.443 CC lib/nvme/nvme_discovery.o 00:01:38.443 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:01:38.443 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:01:38.443 CC lib/nvme/nvme_tcp.o 00:01:38.443 CC lib/nvme/nvme_opal.o 00:01:38.443 CC lib/nvme/nvme_io_msg.o 00:01:38.443 CC lib/nvme/nvme_poll_group.o 00:01:38.443 CC lib/nvme/nvme_zns.o 00:01:38.443 CC lib/nvme/nvme_cuse.o 00:01:38.443 CC lib/nvme/nvme_rdma.o 00:01:38.443 CC lib/nvme/nvme_vfio_user.o 00:01:38.701 LIB libspdk_env_dpdk.a 00:01:38.701 SO libspdk_env_dpdk.so.13.0 00:01:38.958 SYMLINK libspdk_env_dpdk.so 00:01:39.891 LIB libspdk_thread.a 00:01:39.891 SO libspdk_thread.so.9.0 00:01:40.149 SYMLINK libspdk_thread.so 00:01:40.150 CC lib/init/json_config.o 00:01:40.150 CC lib/blob/blobstore.o 00:01:40.150 CC lib/init/subsystem.o 00:01:40.150 CC lib/blob/request.o 00:01:40.150 CC lib/init/subsystem_rpc.o 00:01:40.150 CC lib/blob/zeroes.o 00:01:40.150 CC lib/init/rpc.o 00:01:40.150 CC lib/blob/blob_bs_dev.o 00:01:40.150 CC lib/virtio/virtio.o 00:01:40.150 CC lib/accel/accel.o 00:01:40.150 CC lib/virtio/virtio_vhost_user.o 00:01:40.150 CC lib/accel/accel_rpc.o 00:01:40.150 CC lib/virtio/virtio_vfio_user.o 00:01:40.150 CC lib/accel/accel_sw.o 00:01:40.150 CC lib/virtio/virtio_pci.o 00:01:40.408 LIB libspdk_init.a 00:01:40.409 SO libspdk_init.so.4.0 00:01:40.409 SYMLINK libspdk_init.so 00:01:40.409 LIB libspdk_virtio.a 00:01:40.668 SO libspdk_virtio.so.6.0 00:01:40.668 CC lib/event/app.o 00:01:40.668 CC lib/event/reactor.o 00:01:40.668 SYMLINK libspdk_virtio.so 00:01:40.668 CC lib/event/log_rpc.o 00:01:40.668 CC lib/event/app_rpc.o 00:01:40.668 CC lib/event/scheduler_static.o 00:01:40.926 LIB libspdk_nvme.a 00:01:40.926 SO libspdk_nvme.so.12.0 00:01:40.926 LIB libspdk_event.a 00:01:40.926 SO libspdk_event.so.12.0 00:01:41.185 SYMLINK libspdk_event.so 00:01:41.185 SYMLINK libspdk_nvme.so 00:01:41.185 LIB libspdk_accel.a 00:01:41.185 SO libspdk_accel.so.14.0 00:01:41.444 SYMLINK libspdk_accel.so 00:01:41.444 CC lib/bdev/bdev.o 00:01:41.444 CC lib/bdev/bdev_rpc.o 00:01:41.444 CC lib/bdev/bdev_zone.o 00:01:41.444 CC lib/bdev/part.o 00:01:41.444 CC lib/bdev/scsi_nvme.o 00:01:42.819 LIB libspdk_blob.a 00:01:43.077 SO libspdk_blob.so.10.1 00:01:43.077 SYMLINK libspdk_blob.so 00:01:43.077 CC lib/blobfs/blobfs.o 00:01:43.077 CC lib/blobfs/tree.o 00:01:43.077 CC lib/lvol/lvol.o 00:01:44.034 LIB libspdk_blobfs.a 00:01:44.034 SO libspdk_blobfs.so.9.0 00:01:44.034 LIB libspdk_lvol.a 00:01:44.034 LIB libspdk_bdev.a 00:01:44.034 SYMLINK libspdk_blobfs.so 00:01:44.034 SO libspdk_lvol.so.9.1 00:01:44.034 SO libspdk_bdev.so.14.0 00:01:44.034 SYMLINK libspdk_lvol.so 00:01:44.034 SYMLINK libspdk_bdev.so 00:01:44.296 CC lib/nvmf/ctrlr.o 00:01:44.296 CC lib/nbd/nbd.o 00:01:44.296 CC lib/nvmf/ctrlr_discovery.o 00:01:44.296 CC lib/nbd/nbd_rpc.o 00:01:44.296 CC lib/ublk/ublk.o 00:01:44.296 CC lib/nvmf/ctrlr_bdev.o 00:01:44.296 CC lib/scsi/dev.o 00:01:44.296 CC lib/nvmf/subsystem.o 00:01:44.296 CC lib/ublk/ublk_rpc.o 00:01:44.296 CC lib/ftl/ftl_core.o 00:01:44.296 CC lib/nvmf/nvmf.o 00:01:44.296 CC lib/scsi/lun.o 00:01:44.296 CC lib/ftl/ftl_init.o 00:01:44.296 CC lib/scsi/port.o 00:01:44.296 CC lib/nvmf/nvmf_rpc.o 00:01:44.296 CC lib/ftl/ftl_layout.o 00:01:44.296 CC lib/nvmf/transport.o 00:01:44.296 CC lib/ftl/ftl_debug.o 00:01:44.296 CC lib/scsi/scsi.o 00:01:44.296 CC lib/nvmf/tcp.o 00:01:44.296 CC lib/scsi/scsi_bdev.o 00:01:44.296 CC lib/nvmf/rdma.o 00:01:44.296 CC lib/ftl/ftl_io.o 00:01:44.296 CC lib/scsi/scsi_pr.o 00:01:44.296 CC lib/ftl/ftl_sb.o 00:01:44.296 CC lib/scsi/scsi_rpc.o 00:01:44.296 CC lib/ftl/ftl_l2p.o 00:01:44.296 CC lib/ftl/ftl_l2p_flat.o 00:01:44.296 CC lib/scsi/task.o 00:01:44.296 CC lib/ftl/ftl_nv_cache.o 00:01:44.296 CC lib/ftl/ftl_band_ops.o 00:01:44.296 CC lib/ftl/ftl_band.o 00:01:44.296 CC lib/ftl/ftl_rq.o 00:01:44.296 CC lib/ftl/ftl_writer.o 00:01:44.296 CC lib/ftl/ftl_reloc.o 00:01:44.296 CC lib/ftl/ftl_l2p_cache.o 00:01:44.296 CC lib/ftl/ftl_p2l.o 00:01:44.296 CC lib/ftl/mngt/ftl_mngt.o 00:01:44.296 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:01:44.296 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:01:44.296 CC lib/ftl/mngt/ftl_mngt_startup.o 00:01:44.296 CC lib/ftl/mngt/ftl_mngt_md.o 00:01:44.296 CC lib/ftl/mngt/ftl_mngt_misc.o 00:01:44.296 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:01:44.296 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:01:44.296 CC lib/ftl/mngt/ftl_mngt_band.o 00:01:44.296 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:01:44.296 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:01:44.558 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:01:44.558 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:01:44.558 CC lib/ftl/utils/ftl_conf.o 00:01:44.558 CC lib/ftl/utils/ftl_md.o 00:01:44.558 CC lib/ftl/utils/ftl_mempool.o 00:01:44.559 CC lib/ftl/utils/ftl_bitmap.o 00:01:44.559 CC lib/ftl/utils/ftl_property.o 00:01:44.559 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:01:44.559 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:01:44.559 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:01:44.559 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:01:44.559 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:01:44.559 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:01:44.559 CC lib/ftl/upgrade/ftl_sb_v3.o 00:01:44.559 CC lib/ftl/upgrade/ftl_sb_v5.o 00:01:44.559 CC lib/ftl/nvc/ftl_nvc_dev.o 00:01:44.817 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:01:44.817 CC lib/ftl/base/ftl_base_dev.o 00:01:44.817 CC lib/ftl/base/ftl_base_bdev.o 00:01:44.817 CC lib/ftl/ftl_trace.o 00:01:45.074 LIB libspdk_nbd.a 00:01:45.074 SO libspdk_nbd.so.6.0 00:01:45.074 SYMLINK libspdk_nbd.so 00:01:45.074 LIB libspdk_scsi.a 00:01:45.074 SO libspdk_scsi.so.8.0 00:01:45.333 SYMLINK libspdk_scsi.so 00:01:45.333 LIB libspdk_ublk.a 00:01:45.333 SO libspdk_ublk.so.2.0 00:01:45.333 SYMLINK libspdk_ublk.so 00:01:45.333 CC lib/iscsi/conn.o 00:01:45.333 CC lib/vhost/vhost.o 00:01:45.333 CC lib/iscsi/init_grp.o 00:01:45.333 CC lib/vhost/vhost_rpc.o 00:01:45.333 CC lib/iscsi/iscsi.o 00:01:45.333 CC lib/vhost/vhost_scsi.o 00:01:45.333 CC lib/iscsi/md5.o 00:01:45.333 CC lib/vhost/vhost_blk.o 00:01:45.333 CC lib/iscsi/param.o 00:01:45.333 CC lib/vhost/rte_vhost_user.o 00:01:45.333 CC lib/iscsi/portal_grp.o 00:01:45.333 CC lib/iscsi/tgt_node.o 00:01:45.333 CC lib/iscsi/iscsi_subsystem.o 00:01:45.333 CC lib/iscsi/iscsi_rpc.o 00:01:45.333 CC lib/iscsi/task.o 00:01:45.592 LIB libspdk_ftl.a 00:01:45.592 SO libspdk_ftl.so.8.0 00:01:45.850 SYMLINK libspdk_ftl.so 00:01:46.787 LIB libspdk_vhost.a 00:01:46.787 SO libspdk_vhost.so.7.1 00:01:46.787 LIB libspdk_nvmf.a 00:01:46.787 SYMLINK libspdk_vhost.so 00:01:46.787 LIB libspdk_iscsi.a 00:01:46.787 SO libspdk_nvmf.so.17.0 00:01:46.787 SO libspdk_iscsi.so.7.0 00:01:46.787 SYMLINK libspdk_nvmf.so 00:01:46.787 SYMLINK libspdk_iscsi.so 00:01:47.046 CC module/env_dpdk/env_dpdk_rpc.o 00:01:47.046 CC module/accel/ioat/accel_ioat.o 00:01:47.046 CC module/blob/bdev/blob_bdev.o 00:01:47.046 CC module/scheduler/dynamic/scheduler_dynamic.o 00:01:47.046 CC module/accel/ioat/accel_ioat_rpc.o 00:01:47.046 CC module/accel/dsa/accel_dsa.o 00:01:47.046 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:01:47.046 CC module/accel/dsa/accel_dsa_rpc.o 00:01:47.046 CC module/accel/iaa/accel_iaa.o 00:01:47.046 CC module/sock/posix/posix.o 00:01:47.046 CC module/scheduler/gscheduler/gscheduler.o 00:01:47.046 CC module/accel/iaa/accel_iaa_rpc.o 00:01:47.046 CC module/accel/error/accel_error.o 00:01:47.046 CC module/accel/error/accel_error_rpc.o 00:01:47.305 LIB libspdk_env_dpdk_rpc.a 00:01:47.305 SO libspdk_env_dpdk_rpc.so.5.0 00:01:47.305 SYMLINK libspdk_env_dpdk_rpc.so 00:01:47.305 LIB libspdk_scheduler_gscheduler.a 00:01:47.305 LIB libspdk_scheduler_dpdk_governor.a 00:01:47.305 SO libspdk_scheduler_gscheduler.so.3.0 00:01:47.305 SO libspdk_scheduler_dpdk_governor.so.3.0 00:01:47.305 LIB libspdk_accel_error.a 00:01:47.305 LIB libspdk_accel_ioat.a 00:01:47.305 LIB libspdk_scheduler_dynamic.a 00:01:47.305 LIB libspdk_accel_iaa.a 00:01:47.305 SO libspdk_accel_error.so.1.0 00:01:47.305 SO libspdk_accel_ioat.so.5.0 00:01:47.305 SYMLINK libspdk_scheduler_gscheduler.so 00:01:47.305 SO libspdk_scheduler_dynamic.so.3.0 00:01:47.305 SYMLINK libspdk_scheduler_dpdk_governor.so 00:01:47.305 SO libspdk_accel_iaa.so.2.0 00:01:47.305 LIB libspdk_accel_dsa.a 00:01:47.305 SYMLINK libspdk_accel_error.so 00:01:47.305 SYMLINK libspdk_accel_ioat.so 00:01:47.305 SYMLINK libspdk_scheduler_dynamic.so 00:01:47.305 SO libspdk_accel_dsa.so.4.0 00:01:47.305 LIB libspdk_blob_bdev.a 00:01:47.305 SYMLINK libspdk_accel_iaa.so 00:01:47.563 SO libspdk_blob_bdev.so.10.1 00:01:47.563 SYMLINK libspdk_accel_dsa.so 00:01:47.563 SYMLINK libspdk_blob_bdev.so 00:01:47.563 CC module/bdev/error/vbdev_error.o 00:01:47.563 CC module/bdev/gpt/gpt.o 00:01:47.563 CC module/bdev/delay/vbdev_delay.o 00:01:47.563 CC module/bdev/passthru/vbdev_passthru.o 00:01:47.563 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:01:47.563 CC module/bdev/nvme/bdev_nvme.o 00:01:47.563 CC module/bdev/null/bdev_null.o 00:01:47.563 CC module/bdev/delay/vbdev_delay_rpc.o 00:01:47.563 CC module/bdev/error/vbdev_error_rpc.o 00:01:47.563 CC module/bdev/raid/bdev_raid.o 00:01:47.563 CC module/bdev/nvme/bdev_nvme_rpc.o 00:01:47.563 CC module/bdev/gpt/vbdev_gpt.o 00:01:47.563 CC module/bdev/nvme/nvme_rpc.o 00:01:47.563 CC module/bdev/raid/bdev_raid_rpc.o 00:01:47.563 CC module/bdev/lvol/vbdev_lvol.o 00:01:47.563 CC module/bdev/aio/bdev_aio.o 00:01:47.563 CC module/bdev/malloc/bdev_malloc.o 00:01:47.563 CC module/bdev/nvme/bdev_mdns_client.o 00:01:47.563 CC module/bdev/malloc/bdev_malloc_rpc.o 00:01:47.563 CC module/bdev/raid/raid0.o 00:01:47.563 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:01:47.563 CC module/bdev/iscsi/bdev_iscsi.o 00:01:47.563 CC module/bdev/null/bdev_null_rpc.o 00:01:47.563 CC module/bdev/split/vbdev_split.o 00:01:47.563 CC module/bdev/raid/bdev_raid_sb.o 00:01:47.563 CC module/bdev/aio/bdev_aio_rpc.o 00:01:47.563 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:01:47.563 CC module/bdev/nvme/vbdev_opal.o 00:01:47.563 CC module/bdev/split/vbdev_split_rpc.o 00:01:47.563 CC module/bdev/nvme/vbdev_opal_rpc.o 00:01:47.563 CC module/bdev/raid/raid1.o 00:01:47.563 CC module/bdev/zone_block/vbdev_zone_block.o 00:01:47.563 CC module/bdev/raid/concat.o 00:01:47.563 CC module/bdev/ftl/bdev_ftl.o 00:01:47.563 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:01:47.563 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:01:47.563 CC module/bdev/ftl/bdev_ftl_rpc.o 00:01:47.563 CC module/bdev/virtio/bdev_virtio_scsi.o 00:01:47.563 CC module/blobfs/bdev/blobfs_bdev.o 00:01:47.563 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:01:47.563 CC module/bdev/virtio/bdev_virtio_blk.o 00:01:47.563 CC module/bdev/virtio/bdev_virtio_rpc.o 00:01:48.127 LIB libspdk_sock_posix.a 00:01:48.127 LIB libspdk_blobfs_bdev.a 00:01:48.127 SO libspdk_sock_posix.so.5.0 00:01:48.127 SO libspdk_blobfs_bdev.so.5.0 00:01:48.127 LIB libspdk_bdev_aio.a 00:01:48.127 SO libspdk_bdev_aio.so.5.0 00:01:48.127 LIB libspdk_bdev_null.a 00:01:48.127 SYMLINK libspdk_sock_posix.so 00:01:48.127 SYMLINK libspdk_blobfs_bdev.so 00:01:48.127 LIB libspdk_bdev_split.a 00:01:48.127 SO libspdk_bdev_null.so.5.0 00:01:48.127 LIB libspdk_bdev_passthru.a 00:01:48.127 LIB libspdk_bdev_error.a 00:01:48.127 SO libspdk_bdev_split.so.5.0 00:01:48.127 SYMLINK libspdk_bdev_aio.so 00:01:48.127 LIB libspdk_bdev_ftl.a 00:01:48.127 SO libspdk_bdev_passthru.so.5.0 00:01:48.127 LIB libspdk_bdev_gpt.a 00:01:48.127 SO libspdk_bdev_error.so.5.0 00:01:48.127 SO libspdk_bdev_ftl.so.5.0 00:01:48.127 SYMLINK libspdk_bdev_null.so 00:01:48.127 SO libspdk_bdev_gpt.so.5.0 00:01:48.127 SYMLINK libspdk_bdev_split.so 00:01:48.127 LIB libspdk_bdev_iscsi.a 00:01:48.127 LIB libspdk_bdev_delay.a 00:01:48.127 SYMLINK libspdk_bdev_passthru.so 00:01:48.127 SYMLINK libspdk_bdev_error.so 00:01:48.127 SO libspdk_bdev_iscsi.so.5.0 00:01:48.127 SO libspdk_bdev_delay.so.5.0 00:01:48.127 LIB libspdk_bdev_zone_block.a 00:01:48.127 SYMLINK libspdk_bdev_ftl.so 00:01:48.127 SYMLINK libspdk_bdev_gpt.so 00:01:48.127 LIB libspdk_bdev_malloc.a 00:01:48.127 SO libspdk_bdev_zone_block.so.5.0 00:01:48.385 SO libspdk_bdev_malloc.so.5.0 00:01:48.385 SYMLINK libspdk_bdev_delay.so 00:01:48.385 SYMLINK libspdk_bdev_iscsi.so 00:01:48.385 SYMLINK libspdk_bdev_zone_block.so 00:01:48.385 SYMLINK libspdk_bdev_malloc.so 00:01:48.386 LIB libspdk_bdev_lvol.a 00:01:48.386 LIB libspdk_bdev_virtio.a 00:01:48.386 SO libspdk_bdev_lvol.so.5.0 00:01:48.386 SO libspdk_bdev_virtio.so.5.0 00:01:48.386 SYMLINK libspdk_bdev_lvol.so 00:01:48.386 SYMLINK libspdk_bdev_virtio.so 00:01:48.644 LIB libspdk_bdev_raid.a 00:01:48.644 SO libspdk_bdev_raid.so.5.0 00:01:48.902 SYMLINK libspdk_bdev_raid.so 00:01:49.837 LIB libspdk_bdev_nvme.a 00:01:49.837 SO libspdk_bdev_nvme.so.6.0 00:01:50.096 SYMLINK libspdk_bdev_nvme.so 00:01:50.354 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:01:50.354 CC module/event/subsystems/vmd/vmd.o 00:01:50.354 CC module/event/subsystems/vmd/vmd_rpc.o 00:01:50.354 CC module/event/subsystems/sock/sock.o 00:01:50.354 CC module/event/subsystems/iobuf/iobuf.o 00:01:50.354 CC module/event/subsystems/scheduler/scheduler.o 00:01:50.354 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:01:50.354 LIB libspdk_event_sock.a 00:01:50.354 LIB libspdk_event_vhost_blk.a 00:01:50.354 LIB libspdk_event_scheduler.a 00:01:50.354 LIB libspdk_event_vmd.a 00:01:50.354 LIB libspdk_event_iobuf.a 00:01:50.354 SO libspdk_event_sock.so.4.0 00:01:50.354 SO libspdk_event_vhost_blk.so.2.0 00:01:50.354 SO libspdk_event_scheduler.so.3.0 00:01:50.354 SO libspdk_event_vmd.so.5.0 00:01:50.354 SO libspdk_event_iobuf.so.2.0 00:01:50.613 SYMLINK libspdk_event_sock.so 00:01:50.613 SYMLINK libspdk_event_vhost_blk.so 00:01:50.613 SYMLINK libspdk_event_scheduler.so 00:01:50.613 SYMLINK libspdk_event_vmd.so 00:01:50.613 SYMLINK libspdk_event_iobuf.so 00:01:50.613 CC module/event/subsystems/accel/accel.o 00:01:50.871 LIB libspdk_event_accel.a 00:01:50.871 SO libspdk_event_accel.so.5.0 00:01:50.871 SYMLINK libspdk_event_accel.so 00:01:50.871 CC module/event/subsystems/bdev/bdev.o 00:01:51.130 LIB libspdk_event_bdev.a 00:01:51.130 SO libspdk_event_bdev.so.5.0 00:01:51.130 SYMLINK libspdk_event_bdev.so 00:01:51.388 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:01:51.388 CC module/event/subsystems/ublk/ublk.o 00:01:51.388 CC module/event/subsystems/scsi/scsi.o 00:01:51.388 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:01:51.388 CC module/event/subsystems/nbd/nbd.o 00:01:51.388 LIB libspdk_event_ublk.a 00:01:51.388 LIB libspdk_event_nbd.a 00:01:51.388 LIB libspdk_event_scsi.a 00:01:51.388 SO libspdk_event_nbd.so.5.0 00:01:51.388 SO libspdk_event_ublk.so.2.0 00:01:51.388 SO libspdk_event_scsi.so.5.0 00:01:51.388 SYMLINK libspdk_event_nbd.so 00:01:51.388 SYMLINK libspdk_event_ublk.so 00:01:51.646 SYMLINK libspdk_event_scsi.so 00:01:51.646 LIB libspdk_event_nvmf.a 00:01:51.646 SO libspdk_event_nvmf.so.5.0 00:01:51.646 SYMLINK libspdk_event_nvmf.so 00:01:51.646 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:01:51.646 CC module/event/subsystems/iscsi/iscsi.o 00:01:51.905 LIB libspdk_event_vhost_scsi.a 00:01:51.905 LIB libspdk_event_iscsi.a 00:01:51.905 SO libspdk_event_vhost_scsi.so.2.0 00:01:51.905 SO libspdk_event_iscsi.so.5.0 00:01:51.905 SYMLINK libspdk_event_vhost_scsi.so 00:01:51.905 SYMLINK libspdk_event_iscsi.so 00:01:51.905 SO libspdk.so.5.0 00:01:51.905 SYMLINK libspdk.so 00:01:52.165 TEST_HEADER include/spdk/accel.h 00:01:52.165 CXX app/trace/trace.o 00:01:52.165 CC test/rpc_client/rpc_client_test.o 00:01:52.165 TEST_HEADER include/spdk/accel_module.h 00:01:52.165 CC app/spdk_lspci/spdk_lspci.o 00:01:52.165 CC app/trace_record/trace_record.o 00:01:52.165 TEST_HEADER include/spdk/assert.h 00:01:52.165 CC app/spdk_nvme_identify/identify.o 00:01:52.165 TEST_HEADER include/spdk/barrier.h 00:01:52.165 CC app/spdk_top/spdk_top.o 00:01:52.165 CC app/spdk_nvme_perf/perf.o 00:01:52.165 CC app/spdk_nvme_discover/discovery_aer.o 00:01:52.165 TEST_HEADER include/spdk/base64.h 00:01:52.165 TEST_HEADER include/spdk/bdev.h 00:01:52.165 TEST_HEADER include/spdk/bdev_module.h 00:01:52.165 TEST_HEADER include/spdk/bdev_zone.h 00:01:52.165 TEST_HEADER include/spdk/bit_array.h 00:01:52.165 TEST_HEADER include/spdk/bit_pool.h 00:01:52.165 TEST_HEADER include/spdk/blob_bdev.h 00:01:52.165 TEST_HEADER include/spdk/blobfs_bdev.h 00:01:52.165 TEST_HEADER include/spdk/blobfs.h 00:01:52.165 TEST_HEADER include/spdk/blob.h 00:01:52.165 TEST_HEADER include/spdk/conf.h 00:01:52.165 TEST_HEADER include/spdk/config.h 00:01:52.165 TEST_HEADER include/spdk/cpuset.h 00:01:52.165 CC examples/interrupt_tgt/interrupt_tgt.o 00:01:52.165 TEST_HEADER include/spdk/crc16.h 00:01:52.165 CC app/spdk_dd/spdk_dd.o 00:01:52.165 TEST_HEADER include/spdk/crc32.h 00:01:52.165 TEST_HEADER include/spdk/crc64.h 00:01:52.165 TEST_HEADER include/spdk/dif.h 00:01:52.165 TEST_HEADER include/spdk/dma.h 00:01:52.165 CC app/iscsi_tgt/iscsi_tgt.o 00:01:52.165 TEST_HEADER include/spdk/endian.h 00:01:52.165 CC app/vhost/vhost.o 00:01:52.165 TEST_HEADER include/spdk/env_dpdk.h 00:01:52.165 TEST_HEADER include/spdk/env.h 00:01:52.165 CC app/nvmf_tgt/nvmf_main.o 00:01:52.165 CC test/app/histogram_perf/histogram_perf.o 00:01:52.165 CC test/nvme/sgl/sgl.o 00:01:52.165 CC examples/accel/perf/accel_perf.o 00:01:52.165 CC test/app/jsoncat/jsoncat.o 00:01:52.165 CC examples/nvme/reconnect/reconnect.o 00:01:52.165 CC test/app/stub/stub.o 00:01:52.165 TEST_HEADER include/spdk/event.h 00:01:52.165 CC test/env/vtophys/vtophys.o 00:01:52.165 CC test/nvme/reset/reset.o 00:01:52.165 TEST_HEADER include/spdk/fd_group.h 00:01:52.165 CC examples/nvme/hello_world/hello_world.o 00:01:52.165 CC examples/ioat/verify/verify.o 00:01:52.165 CC examples/nvme/nvme_manage/nvme_manage.o 00:01:52.165 TEST_HEADER include/spdk/fd.h 00:01:52.165 CC examples/util/zipf/zipf.o 00:01:52.165 TEST_HEADER include/spdk/file.h 00:01:52.165 CC examples/idxd/perf/perf.o 00:01:52.165 CC examples/vmd/lsvmd/lsvmd.o 00:01:52.165 CC test/nvme/aer/aer.o 00:01:52.165 CC app/fio/nvme/fio_plugin.o 00:01:52.165 CC examples/sock/hello_world/hello_sock.o 00:01:52.165 CC examples/ioat/perf/perf.o 00:01:52.165 CC test/thread/poller_perf/poller_perf.o 00:01:52.165 CC test/event/event_perf/event_perf.o 00:01:52.165 TEST_HEADER include/spdk/ftl.h 00:01:52.165 TEST_HEADER include/spdk/gpt_spec.h 00:01:52.165 TEST_HEADER include/spdk/hexlify.h 00:01:52.165 TEST_HEADER include/spdk/histogram_data.h 00:01:52.165 CC app/spdk_tgt/spdk_tgt.o 00:01:52.165 TEST_HEADER include/spdk/idxd.h 00:01:52.165 TEST_HEADER include/spdk/idxd_spec.h 00:01:52.165 TEST_HEADER include/spdk/init.h 00:01:52.165 TEST_HEADER include/spdk/ioat.h 00:01:52.165 TEST_HEADER include/spdk/ioat_spec.h 00:01:52.165 TEST_HEADER include/spdk/iscsi_spec.h 00:01:52.165 TEST_HEADER include/spdk/json.h 00:01:52.165 TEST_HEADER include/spdk/jsonrpc.h 00:01:52.165 CC test/accel/dif/dif.o 00:01:52.165 CC examples/blob/cli/blobcli.o 00:01:52.165 CC test/blobfs/mkfs/mkfs.o 00:01:52.165 TEST_HEADER include/spdk/likely.h 00:01:52.165 CC examples/thread/thread/thread_ex.o 00:01:52.165 CC test/dma/test_dma/test_dma.o 00:01:52.165 TEST_HEADER include/spdk/log.h 00:01:52.165 CC test/bdev/bdevio/bdevio.o 00:01:52.165 CC test/app/bdev_svc/bdev_svc.o 00:01:52.166 CC examples/nvmf/nvmf/nvmf.o 00:01:52.166 TEST_HEADER include/spdk/lvol.h 00:01:52.166 CC examples/bdev/hello_world/hello_bdev.o 00:01:52.166 CC examples/blob/hello_world/hello_blob.o 00:01:52.166 TEST_HEADER include/spdk/memory.h 00:01:52.435 TEST_HEADER include/spdk/mmio.h 00:01:52.435 TEST_HEADER include/spdk/nbd.h 00:01:52.435 TEST_HEADER include/spdk/notify.h 00:01:52.435 TEST_HEADER include/spdk/nvme.h 00:01:52.435 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:01:52.435 TEST_HEADER include/spdk/nvme_intel.h 00:01:52.435 TEST_HEADER include/spdk/nvme_ocssd.h 00:01:52.435 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:01:52.435 TEST_HEADER include/spdk/nvme_spec.h 00:01:52.435 CC test/env/mem_callbacks/mem_callbacks.o 00:01:52.435 TEST_HEADER include/spdk/nvme_zns.h 00:01:52.435 TEST_HEADER include/spdk/nvmf_cmd.h 00:01:52.435 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:01:52.435 TEST_HEADER include/spdk/nvmf.h 00:01:52.435 TEST_HEADER include/spdk/nvmf_spec.h 00:01:52.435 TEST_HEADER include/spdk/nvmf_transport.h 00:01:52.435 CC test/lvol/esnap/esnap.o 00:01:52.435 TEST_HEADER include/spdk/opal.h 00:01:52.435 TEST_HEADER include/spdk/opal_spec.h 00:01:52.435 TEST_HEADER include/spdk/pci_ids.h 00:01:52.435 TEST_HEADER include/spdk/pipe.h 00:01:52.435 TEST_HEADER include/spdk/queue.h 00:01:52.435 TEST_HEADER include/spdk/reduce.h 00:01:52.435 TEST_HEADER include/spdk/rpc.h 00:01:52.435 TEST_HEADER include/spdk/scheduler.h 00:01:52.436 TEST_HEADER include/spdk/scsi.h 00:01:52.436 TEST_HEADER include/spdk/scsi_spec.h 00:01:52.436 LINK spdk_lspci 00:01:52.436 TEST_HEADER include/spdk/sock.h 00:01:52.436 TEST_HEADER include/spdk/stdinc.h 00:01:52.436 TEST_HEADER include/spdk/string.h 00:01:52.436 TEST_HEADER include/spdk/thread.h 00:01:52.436 TEST_HEADER include/spdk/trace.h 00:01:52.436 TEST_HEADER include/spdk/trace_parser.h 00:01:52.436 TEST_HEADER include/spdk/tree.h 00:01:52.436 TEST_HEADER include/spdk/ublk.h 00:01:52.436 TEST_HEADER include/spdk/util.h 00:01:52.436 TEST_HEADER include/spdk/uuid.h 00:01:52.436 TEST_HEADER include/spdk/version.h 00:01:52.436 TEST_HEADER include/spdk/vfio_user_pci.h 00:01:52.436 TEST_HEADER include/spdk/vfio_user_spec.h 00:01:52.436 LINK rpc_client_test 00:01:52.436 TEST_HEADER include/spdk/vhost.h 00:01:52.436 TEST_HEADER include/spdk/vmd.h 00:01:52.436 TEST_HEADER include/spdk/xor.h 00:01:52.436 TEST_HEADER include/spdk/zipf.h 00:01:52.436 CXX test/cpp_headers/accel.o 00:01:52.436 LINK jsoncat 00:01:52.436 LINK spdk_nvme_discover 00:01:52.436 LINK lsvmd 00:01:52.436 LINK histogram_perf 00:01:52.436 LINK interrupt_tgt 00:01:52.436 LINK zipf 00:01:52.436 LINK poller_perf 00:01:52.436 LINK event_perf 00:01:52.436 LINK vtophys 00:01:52.436 LINK stub 00:01:52.697 LINK nvmf_tgt 00:01:52.697 LINK vhost 00:01:52.697 LINK spdk_trace_record 00:01:52.698 LINK iscsi_tgt 00:01:52.698 LINK bdev_svc 00:01:52.698 LINK verify 00:01:52.698 LINK mkfs 00:01:52.698 LINK ioat_perf 00:01:52.698 LINK hello_world 00:01:52.698 LINK spdk_tgt 00:01:52.698 LINK hello_sock 00:01:52.698 LINK reset 00:01:52.698 LINK sgl 00:01:52.698 LINK hello_blob 00:01:52.698 LINK thread 00:01:52.698 LINK hello_bdev 00:01:52.698 LINK aer 00:01:52.960 LINK reconnect 00:01:52.960 CXX test/cpp_headers/accel_module.o 00:01:52.960 LINK nvmf 00:01:52.960 CC test/event/reactor/reactor.o 00:01:52.960 CC examples/vmd/led/led.o 00:01:52.960 LINK spdk_dd 00:01:52.960 LINK idxd_perf 00:01:52.960 CC examples/nvme/arbitration/arbitration.o 00:01:52.960 CC test/nvme/e2edp/nvme_dp.o 00:01:52.960 CC test/event/reactor_perf/reactor_perf.o 00:01:52.960 CXX test/cpp_headers/assert.o 00:01:52.960 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:01:52.960 CC test/nvme/overhead/overhead.o 00:01:52.960 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:01:52.960 LINK spdk_trace 00:01:52.960 CXX test/cpp_headers/barrier.o 00:01:52.960 CC app/fio/bdev/fio_plugin.o 00:01:52.960 LINK dif 00:01:52.960 CC examples/nvme/hotplug/hotplug.o 00:01:52.960 CC examples/nvme/cmb_copy/cmb_copy.o 00:01:52.960 LINK bdevio 00:01:52.960 CC test/nvme/err_injection/err_injection.o 00:01:52.960 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:01:52.960 LINK test_dma 00:01:52.960 CC examples/bdev/bdevperf/bdevperf.o 00:01:52.960 LINK accel_perf 00:01:52.960 CXX test/cpp_headers/base64.o 00:01:53.222 CC test/event/app_repeat/app_repeat.o 00:01:53.222 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:01:53.222 CC test/nvme/startup/startup.o 00:01:53.222 LINK nvme_fuzz 00:01:53.222 CXX test/cpp_headers/bdev.o 00:01:53.222 LINK reactor 00:01:53.222 CC examples/nvme/abort/abort.o 00:01:53.222 LINK nvme_manage 00:01:53.222 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:01:53.222 CXX test/cpp_headers/bdev_module.o 00:01:53.222 CC test/event/scheduler/scheduler.o 00:01:53.222 CXX test/cpp_headers/bdev_zone.o 00:01:53.222 CXX test/cpp_headers/bit_array.o 00:01:53.222 CC test/env/memory/memory_ut.o 00:01:53.222 LINK led 00:01:53.222 CC test/env/pci/pci_ut.o 00:01:53.222 CC test/nvme/reserve/reserve.o 00:01:53.222 LINK reactor_perf 00:01:53.222 CXX test/cpp_headers/bit_pool.o 00:01:53.222 CXX test/cpp_headers/blob_bdev.o 00:01:53.222 LINK spdk_nvme 00:01:53.222 LINK blobcli 00:01:53.222 CC test/nvme/simple_copy/simple_copy.o 00:01:53.222 CC test/nvme/connect_stress/connect_stress.o 00:01:53.222 CC test/nvme/boot_partition/boot_partition.o 00:01:53.488 LINK cmb_copy 00:01:53.488 LINK err_injection 00:01:53.488 CC test/nvme/compliance/nvme_compliance.o 00:01:53.488 CXX test/cpp_headers/blobfs_bdev.o 00:01:53.488 LINK env_dpdk_post_init 00:01:53.488 CC test/nvme/fused_ordering/fused_ordering.o 00:01:53.488 CXX test/cpp_headers/blobfs.o 00:01:53.488 CXX test/cpp_headers/blob.o 00:01:53.488 LINK app_repeat 00:01:53.488 CXX test/cpp_headers/conf.o 00:01:53.488 CXX test/cpp_headers/config.o 00:01:53.488 CC test/nvme/doorbell_aers/doorbell_aers.o 00:01:53.488 CXX test/cpp_headers/cpuset.o 00:01:53.488 CXX test/cpp_headers/crc16.o 00:01:53.488 LINK startup 00:01:53.488 LINK hotplug 00:01:53.488 LINK nvme_dp 00:01:53.488 CXX test/cpp_headers/crc32.o 00:01:53.488 CC test/nvme/fdp/fdp.o 00:01:53.488 LINK mem_callbacks 00:01:53.488 CXX test/cpp_headers/crc64.o 00:01:53.488 CC test/nvme/cuse/cuse.o 00:01:53.488 LINK pmr_persistence 00:01:53.488 LINK arbitration 00:01:53.488 CXX test/cpp_headers/dif.o 00:01:53.488 LINK overhead 00:01:53.488 CXX test/cpp_headers/dma.o 00:01:53.488 CXX test/cpp_headers/endian.o 00:01:53.488 CXX test/cpp_headers/env_dpdk.o 00:01:53.488 LINK scheduler 00:01:53.488 CXX test/cpp_headers/env.o 00:01:53.488 CXX test/cpp_headers/event.o 00:01:53.749 CXX test/cpp_headers/fd_group.o 00:01:53.749 LINK spdk_nvme_perf 00:01:53.749 LINK reserve 00:01:53.749 CXX test/cpp_headers/fd.o 00:01:53.749 CXX test/cpp_headers/file.o 00:01:53.749 LINK boot_partition 00:01:53.749 LINK connect_stress 00:01:53.749 CXX test/cpp_headers/ftl.o 00:01:53.749 LINK simple_copy 00:01:53.749 CXX test/cpp_headers/gpt_spec.o 00:01:53.749 LINK spdk_nvme_identify 00:01:53.749 CXX test/cpp_headers/hexlify.o 00:01:53.749 CXX test/cpp_headers/histogram_data.o 00:01:53.749 CXX test/cpp_headers/idxd.o 00:01:53.749 CXX test/cpp_headers/idxd_spec.o 00:01:53.749 CXX test/cpp_headers/init.o 00:01:53.749 CXX test/cpp_headers/ioat.o 00:01:53.749 CXX test/cpp_headers/ioat_spec.o 00:01:53.749 CXX test/cpp_headers/iscsi_spec.o 00:01:53.749 LINK vhost_fuzz 00:01:53.749 CXX test/cpp_headers/json.o 00:01:53.749 CXX test/cpp_headers/jsonrpc.o 00:01:53.750 CXX test/cpp_headers/likely.o 00:01:53.750 CXX test/cpp_headers/log.o 00:01:53.750 LINK fused_ordering 00:01:53.750 LINK doorbell_aers 00:01:53.750 CXX test/cpp_headers/lvol.o 00:01:53.750 CXX test/cpp_headers/memory.o 00:01:53.750 CXX test/cpp_headers/mmio.o 00:01:53.750 LINK spdk_top 00:01:53.750 CXX test/cpp_headers/nbd.o 00:01:53.750 LINK abort 00:01:54.011 CXX test/cpp_headers/notify.o 00:01:54.011 CXX test/cpp_headers/nvme.o 00:01:54.011 CXX test/cpp_headers/nvme_intel.o 00:01:54.011 CXX test/cpp_headers/nvme_ocssd.o 00:01:54.011 CXX test/cpp_headers/nvme_ocssd_spec.o 00:01:54.011 LINK spdk_bdev 00:01:54.011 LINK pci_ut 00:01:54.011 CXX test/cpp_headers/nvme_spec.o 00:01:54.011 CXX test/cpp_headers/nvme_zns.o 00:01:54.011 CXX test/cpp_headers/nvmf_cmd.o 00:01:54.011 CXX test/cpp_headers/nvmf_fc_spec.o 00:01:54.011 CXX test/cpp_headers/nvmf.o 00:01:54.011 CXX test/cpp_headers/nvmf_spec.o 00:01:54.011 CXX test/cpp_headers/nvmf_transport.o 00:01:54.011 CXX test/cpp_headers/opal.o 00:01:54.011 CXX test/cpp_headers/opal_spec.o 00:01:54.011 CXX test/cpp_headers/pci_ids.o 00:01:54.011 CXX test/cpp_headers/pipe.o 00:01:54.011 CXX test/cpp_headers/queue.o 00:01:54.011 LINK nvme_compliance 00:01:54.011 LINK fdp 00:01:54.011 CXX test/cpp_headers/reduce.o 00:01:54.011 CXX test/cpp_headers/rpc.o 00:01:54.011 CXX test/cpp_headers/scheduler.o 00:01:54.011 CXX test/cpp_headers/scsi.o 00:01:54.011 CXX test/cpp_headers/scsi_spec.o 00:01:54.011 CXX test/cpp_headers/sock.o 00:01:54.011 CXX test/cpp_headers/stdinc.o 00:01:54.270 CXX test/cpp_headers/string.o 00:01:54.270 CXX test/cpp_headers/thread.o 00:01:54.270 CXX test/cpp_headers/trace.o 00:01:54.270 CXX test/cpp_headers/trace_parser.o 00:01:54.270 CXX test/cpp_headers/tree.o 00:01:54.270 CXX test/cpp_headers/ublk.o 00:01:54.270 CXX test/cpp_headers/util.o 00:01:54.270 CXX test/cpp_headers/uuid.o 00:01:54.270 CXX test/cpp_headers/version.o 00:01:54.270 CXX test/cpp_headers/vfio_user_pci.o 00:01:54.270 CXX test/cpp_headers/vfio_user_spec.o 00:01:54.270 CXX test/cpp_headers/vhost.o 00:01:54.270 CXX test/cpp_headers/vmd.o 00:01:54.270 CXX test/cpp_headers/xor.o 00:01:54.270 CXX test/cpp_headers/zipf.o 00:01:54.528 LINK bdevperf 00:01:54.786 LINK memory_ut 00:01:55.044 LINK cuse 00:01:55.302 LINK iscsi_fuzz 00:01:57.834 LINK esnap 00:01:58.092 00:01:58.092 real 0m46.085s 00:01:58.092 user 9m36.904s 00:01:58.092 sys 2m7.668s 00:01:58.092 02:04:25 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:01:58.093 02:04:25 -- common/autotest_common.sh@10 -- $ set +x 00:01:58.093 ************************************ 00:01:58.093 END TEST make 00:01:58.093 ************************************ 00:01:58.093 02:04:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:01:58.093 02:04:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:01:58.093 02:04:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:01:58.093 02:04:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:01:58.093 02:04:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:01:58.093 02:04:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:01:58.093 02:04:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:01:58.093 02:04:25 -- scripts/common.sh@335 -- # IFS=.-: 00:01:58.093 02:04:25 -- scripts/common.sh@335 -- # read -ra ver1 00:01:58.093 02:04:25 -- scripts/common.sh@336 -- # IFS=.-: 00:01:58.093 02:04:25 -- scripts/common.sh@336 -- # read -ra ver2 00:01:58.093 02:04:25 -- scripts/common.sh@337 -- # local 'op=<' 00:01:58.093 02:04:25 -- scripts/common.sh@339 -- # ver1_l=2 00:01:58.093 02:04:25 -- scripts/common.sh@340 -- # ver2_l=1 00:01:58.093 02:04:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:01:58.093 02:04:25 -- scripts/common.sh@343 -- # case "$op" in 00:01:58.093 02:04:25 -- scripts/common.sh@344 -- # : 1 00:01:58.093 02:04:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:01:58.093 02:04:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:58.093 02:04:25 -- scripts/common.sh@364 -- # decimal 1 00:01:58.093 02:04:25 -- scripts/common.sh@352 -- # local d=1 00:01:58.093 02:04:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:01:58.093 02:04:25 -- scripts/common.sh@354 -- # echo 1 00:01:58.093 02:04:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:01:58.093 02:04:25 -- scripts/common.sh@365 -- # decimal 2 00:01:58.093 02:04:25 -- scripts/common.sh@352 -- # local d=2 00:01:58.093 02:04:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:01:58.093 02:04:25 -- scripts/common.sh@354 -- # echo 2 00:01:58.093 02:04:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:01:58.093 02:04:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:01:58.093 02:04:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:01:58.093 02:04:25 -- scripts/common.sh@367 -- # return 0 00:01:58.093 02:04:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:01:58.093 02:04:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:01:58.093 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:01:58.093 --rc genhtml_branch_coverage=1 00:01:58.093 --rc genhtml_function_coverage=1 00:01:58.093 --rc genhtml_legend=1 00:01:58.093 --rc geninfo_all_blocks=1 00:01:58.093 --rc geninfo_unexecuted_blocks=1 00:01:58.093 00:01:58.093 ' 00:01:58.093 02:04:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:01:58.093 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:01:58.093 --rc genhtml_branch_coverage=1 00:01:58.093 --rc genhtml_function_coverage=1 00:01:58.093 --rc genhtml_legend=1 00:01:58.093 --rc geninfo_all_blocks=1 00:01:58.093 --rc geninfo_unexecuted_blocks=1 00:01:58.093 00:01:58.093 ' 00:01:58.093 02:04:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:01:58.093 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:01:58.093 --rc genhtml_branch_coverage=1 00:01:58.093 --rc genhtml_function_coverage=1 00:01:58.093 --rc genhtml_legend=1 00:01:58.093 --rc geninfo_all_blocks=1 00:01:58.093 --rc geninfo_unexecuted_blocks=1 00:01:58.093 00:01:58.093 ' 00:01:58.093 02:04:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:01:58.093 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:01:58.093 --rc genhtml_branch_coverage=1 00:01:58.093 --rc genhtml_function_coverage=1 00:01:58.093 --rc genhtml_legend=1 00:01:58.093 --rc geninfo_all_blocks=1 00:01:58.093 --rc geninfo_unexecuted_blocks=1 00:01:58.093 00:01:58.093 ' 00:01:58.093 02:04:25 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:01:58.093 02:04:25 -- nvmf/common.sh@7 -- # uname -s 00:01:58.093 02:04:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:01:58.093 02:04:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:01:58.093 02:04:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:01:58.093 02:04:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:01:58.093 02:04:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:01:58.093 02:04:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:01:58.093 02:04:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:01:58.093 02:04:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:01:58.093 02:04:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:01:58.093 02:04:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:01:58.093 02:04:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:01:58.093 02:04:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:01:58.093 02:04:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:01:58.093 02:04:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:01:58.093 02:04:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:01:58.093 02:04:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:58.093 02:04:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:01:58.093 02:04:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:58.093 02:04:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:58.093 02:04:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:58.093 02:04:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:58.093 02:04:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:58.093 02:04:25 -- paths/export.sh@5 -- # export PATH 00:01:58.093 02:04:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:58.093 02:04:25 -- nvmf/common.sh@46 -- # : 0 00:01:58.093 02:04:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:01:58.093 02:04:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:01:58.093 02:04:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:01:58.093 02:04:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:01:58.093 02:04:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:01:58.093 02:04:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:01:58.093 02:04:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:01:58.093 02:04:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:01:58.093 02:04:25 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:01:58.093 02:04:25 -- spdk/autotest.sh@32 -- # uname -s 00:01:58.093 02:04:25 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:01:58.093 02:04:25 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:01:58.093 02:04:25 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:01:58.093 02:04:25 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:01:58.093 02:04:25 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:01:58.093 02:04:25 -- spdk/autotest.sh@44 -- # modprobe nbd 00:01:58.093 02:04:25 -- spdk/autotest.sh@46 -- # type -P udevadm 00:01:58.093 02:04:25 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:01:58.093 02:04:25 -- spdk/autotest.sh@48 -- # udevadm_pid=1952553 00:01:58.093 02:04:25 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:01:58.093 02:04:25 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:01:58.093 02:04:25 -- spdk/autotest.sh@54 -- # echo 1952555 00:01:58.094 02:04:25 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:01:58.094 02:04:25 -- spdk/autotest.sh@56 -- # echo 1952556 00:01:58.094 02:04:25 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:01:58.094 02:04:25 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:01:58.094 02:04:25 -- spdk/autotest.sh@60 -- # echo 1952557 00:01:58.094 02:04:25 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:01:58.094 02:04:25 -- spdk/autotest.sh@62 -- # echo 1952558 00:01:58.094 02:04:25 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:01:58.094 02:04:25 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:01:58.094 02:04:25 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:01:58.094 02:04:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:01:58.094 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:01:58.094 02:04:25 -- spdk/autotest.sh@70 -- # create_test_list 00:01:58.094 02:04:25 -- common/autotest_common.sh@746 -- # xtrace_disable 00:01:58.094 02:04:25 -- common/autotest_common.sh@10 -- # set +x 00:01:58.094 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:01:58.094 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:01:58.094 02:04:25 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:01:58.094 02:04:25 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:58.094 02:04:25 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:58.094 02:04:25 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:58.094 02:04:25 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:58.094 02:04:25 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:01:58.094 02:04:25 -- common/autotest_common.sh@1450 -- # uname 00:01:58.094 02:04:25 -- common/autotest_common.sh@1450 -- # '[' Linux = FreeBSD ']' 00:01:58.094 02:04:25 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:01:58.094 02:04:25 -- common/autotest_common.sh@1470 -- # uname 00:01:58.094 02:04:25 -- common/autotest_common.sh@1470 -- # [[ Linux = FreeBSD ]] 00:01:58.094 02:04:25 -- spdk/autotest.sh@79 -- # [[ y == y ]] 00:01:58.094 02:04:25 -- spdk/autotest.sh@81 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:01:58.352 lcov: LCOV version 1.15 00:01:58.353 02:04:25 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:02:01.629 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:02:01.629 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:02:01.629 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:02:01.629 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:02:01.629 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:02:01.629 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:02:33.786 02:04:58 -- spdk/autotest.sh@87 -- # timing_enter pre_cleanup 00:02:33.786 02:04:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:02:33.786 02:04:58 -- common/autotest_common.sh@10 -- # set +x 00:02:33.786 02:04:58 -- spdk/autotest.sh@89 -- # rm -f 00:02:33.786 02:04:58 -- spdk/autotest.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:33.786 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:02:33.786 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:02:33.786 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:02:33.786 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:02:33.786 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:02:33.786 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:02:33.786 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:02:33.786 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:02:33.786 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:02:33.786 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:02:33.786 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:02:33.786 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:02:33.786 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:02:33.786 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:02:33.786 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:02:33.786 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:02:33.786 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:02:33.786 02:05:00 -- spdk/autotest.sh@94 -- # get_zoned_devs 00:02:33.786 02:05:00 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:02:33.786 02:05:00 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:02:33.786 02:05:00 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:02:33.786 02:05:00 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:02:33.786 02:05:00 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:02:33.786 02:05:00 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:02:33.786 02:05:00 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:33.786 02:05:00 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:02:33.786 02:05:00 -- spdk/autotest.sh@96 -- # (( 0 > 0 )) 00:02:33.786 02:05:00 -- spdk/autotest.sh@108 -- # grep -v p 00:02:33.786 02:05:00 -- spdk/autotest.sh@108 -- # ls /dev/nvme0n1 00:02:33.786 02:05:00 -- spdk/autotest.sh@108 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:02:33.786 02:05:00 -- spdk/autotest.sh@110 -- # [[ -z '' ]] 00:02:33.786 02:05:00 -- spdk/autotest.sh@111 -- # block_in_use /dev/nvme0n1 00:02:33.786 02:05:00 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:02:33.786 02:05:00 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:02:33.786 No valid GPT data, bailing 00:02:33.786 02:05:00 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:02:33.786 02:05:00 -- scripts/common.sh@393 -- # pt= 00:02:33.786 02:05:00 -- scripts/common.sh@394 -- # return 1 00:02:33.786 02:05:00 -- spdk/autotest.sh@112 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:02:33.786 1+0 records in 00:02:33.786 1+0 records out 00:02:33.786 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00266662 s, 393 MB/s 00:02:33.786 02:05:00 -- spdk/autotest.sh@116 -- # sync 00:02:33.786 02:05:00 -- spdk/autotest.sh@118 -- # xtrace_disable_per_cmd reap_spdk_processes 00:02:33.786 02:05:00 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:02:33.786 02:05:00 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:02:34.356 02:05:02 -- spdk/autotest.sh@122 -- # uname -s 00:02:34.356 02:05:02 -- spdk/autotest.sh@122 -- # '[' Linux = Linux ']' 00:02:34.356 02:05:02 -- spdk/autotest.sh@123 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:02:34.356 02:05:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:34.356 02:05:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:34.356 02:05:02 -- common/autotest_common.sh@10 -- # set +x 00:02:34.356 ************************************ 00:02:34.356 START TEST setup.sh 00:02:34.356 ************************************ 00:02:34.356 02:05:02 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:02:34.356 * Looking for test storage... 00:02:34.356 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:34.356 02:05:02 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:34.356 02:05:02 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:34.356 02:05:02 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:34.615 02:05:02 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:34.615 02:05:02 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:34.615 02:05:02 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:34.615 02:05:02 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:34.615 02:05:02 -- scripts/common.sh@335 -- # IFS=.-: 00:02:34.615 02:05:02 -- scripts/common.sh@335 -- # read -ra ver1 00:02:34.615 02:05:02 -- scripts/common.sh@336 -- # IFS=.-: 00:02:34.615 02:05:02 -- scripts/common.sh@336 -- # read -ra ver2 00:02:34.615 02:05:02 -- scripts/common.sh@337 -- # local 'op=<' 00:02:34.615 02:05:02 -- scripts/common.sh@339 -- # ver1_l=2 00:02:34.615 02:05:02 -- scripts/common.sh@340 -- # ver2_l=1 00:02:34.615 02:05:02 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:34.615 02:05:02 -- scripts/common.sh@343 -- # case "$op" in 00:02:34.615 02:05:02 -- scripts/common.sh@344 -- # : 1 00:02:34.615 02:05:02 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:34.615 02:05:02 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:34.615 02:05:02 -- scripts/common.sh@364 -- # decimal 1 00:02:34.615 02:05:02 -- scripts/common.sh@352 -- # local d=1 00:02:34.615 02:05:02 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:34.615 02:05:02 -- scripts/common.sh@354 -- # echo 1 00:02:34.615 02:05:02 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:34.615 02:05:02 -- scripts/common.sh@365 -- # decimal 2 00:02:34.615 02:05:02 -- scripts/common.sh@352 -- # local d=2 00:02:34.615 02:05:02 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:34.615 02:05:02 -- scripts/common.sh@354 -- # echo 2 00:02:34.616 02:05:02 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:34.616 02:05:02 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:34.616 02:05:02 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:34.616 02:05:02 -- scripts/common.sh@367 -- # return 0 00:02:34.616 02:05:02 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:34.616 02:05:02 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:34.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:34.616 --rc genhtml_branch_coverage=1 00:02:34.616 --rc genhtml_function_coverage=1 00:02:34.616 --rc genhtml_legend=1 00:02:34.616 --rc geninfo_all_blocks=1 00:02:34.616 --rc geninfo_unexecuted_blocks=1 00:02:34.616 00:02:34.616 ' 00:02:34.616 02:05:02 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:34.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:34.616 --rc genhtml_branch_coverage=1 00:02:34.616 --rc genhtml_function_coverage=1 00:02:34.616 --rc genhtml_legend=1 00:02:34.616 --rc geninfo_all_blocks=1 00:02:34.616 --rc geninfo_unexecuted_blocks=1 00:02:34.616 00:02:34.616 ' 00:02:34.616 02:05:02 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:34.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:34.616 --rc genhtml_branch_coverage=1 00:02:34.616 --rc genhtml_function_coverage=1 00:02:34.616 --rc genhtml_legend=1 00:02:34.616 --rc geninfo_all_blocks=1 00:02:34.616 --rc geninfo_unexecuted_blocks=1 00:02:34.616 00:02:34.616 ' 00:02:34.616 02:05:02 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:34.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:34.616 --rc genhtml_branch_coverage=1 00:02:34.616 --rc genhtml_function_coverage=1 00:02:34.616 --rc genhtml_legend=1 00:02:34.616 --rc geninfo_all_blocks=1 00:02:34.616 --rc geninfo_unexecuted_blocks=1 00:02:34.616 00:02:34.616 ' 00:02:34.616 02:05:02 -- setup/test-setup.sh@10 -- # uname -s 00:02:34.616 02:05:02 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:02:34.616 02:05:02 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:02:34.616 02:05:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:34.616 02:05:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:34.616 02:05:02 -- common/autotest_common.sh@10 -- # set +x 00:02:34.616 ************************************ 00:02:34.616 START TEST acl 00:02:34.616 ************************************ 00:02:34.616 02:05:02 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:02:34.616 * Looking for test storage... 00:02:34.616 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:34.616 02:05:02 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:34.616 02:05:02 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:34.616 02:05:02 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:34.616 02:05:02 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:34.616 02:05:02 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:34.616 02:05:02 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:34.616 02:05:02 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:34.616 02:05:02 -- scripts/common.sh@335 -- # IFS=.-: 00:02:34.616 02:05:02 -- scripts/common.sh@335 -- # read -ra ver1 00:02:34.616 02:05:02 -- scripts/common.sh@336 -- # IFS=.-: 00:02:34.616 02:05:02 -- scripts/common.sh@336 -- # read -ra ver2 00:02:34.616 02:05:02 -- scripts/common.sh@337 -- # local 'op=<' 00:02:34.616 02:05:02 -- scripts/common.sh@339 -- # ver1_l=2 00:02:34.616 02:05:02 -- scripts/common.sh@340 -- # ver2_l=1 00:02:34.616 02:05:02 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:34.616 02:05:02 -- scripts/common.sh@343 -- # case "$op" in 00:02:34.616 02:05:02 -- scripts/common.sh@344 -- # : 1 00:02:34.616 02:05:02 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:34.616 02:05:02 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:34.616 02:05:02 -- scripts/common.sh@364 -- # decimal 1 00:02:34.616 02:05:02 -- scripts/common.sh@352 -- # local d=1 00:02:34.616 02:05:02 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:34.616 02:05:02 -- scripts/common.sh@354 -- # echo 1 00:02:34.616 02:05:02 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:34.616 02:05:02 -- scripts/common.sh@365 -- # decimal 2 00:02:34.616 02:05:02 -- scripts/common.sh@352 -- # local d=2 00:02:34.616 02:05:02 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:34.616 02:05:02 -- scripts/common.sh@354 -- # echo 2 00:02:34.616 02:05:02 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:34.616 02:05:02 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:34.616 02:05:02 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:34.616 02:05:02 -- scripts/common.sh@367 -- # return 0 00:02:34.616 02:05:02 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:34.616 02:05:02 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:34.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:34.616 --rc genhtml_branch_coverage=1 00:02:34.616 --rc genhtml_function_coverage=1 00:02:34.616 --rc genhtml_legend=1 00:02:34.616 --rc geninfo_all_blocks=1 00:02:34.616 --rc geninfo_unexecuted_blocks=1 00:02:34.616 00:02:34.616 ' 00:02:34.616 02:05:02 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:34.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:34.616 --rc genhtml_branch_coverage=1 00:02:34.616 --rc genhtml_function_coverage=1 00:02:34.616 --rc genhtml_legend=1 00:02:34.616 --rc geninfo_all_blocks=1 00:02:34.616 --rc geninfo_unexecuted_blocks=1 00:02:34.616 00:02:34.616 ' 00:02:34.616 02:05:02 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:34.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:34.616 --rc genhtml_branch_coverage=1 00:02:34.616 --rc genhtml_function_coverage=1 00:02:34.616 --rc genhtml_legend=1 00:02:34.616 --rc geninfo_all_blocks=1 00:02:34.616 --rc geninfo_unexecuted_blocks=1 00:02:34.616 00:02:34.616 ' 00:02:34.616 02:05:02 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:34.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:34.616 --rc genhtml_branch_coverage=1 00:02:34.616 --rc genhtml_function_coverage=1 00:02:34.616 --rc genhtml_legend=1 00:02:34.616 --rc geninfo_all_blocks=1 00:02:34.616 --rc geninfo_unexecuted_blocks=1 00:02:34.616 00:02:34.616 ' 00:02:34.616 02:05:02 -- setup/acl.sh@10 -- # get_zoned_devs 00:02:34.616 02:05:02 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:02:34.616 02:05:02 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:02:34.616 02:05:02 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:02:34.616 02:05:02 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:02:34.616 02:05:02 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:02:34.616 02:05:02 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:02:34.616 02:05:02 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:34.616 02:05:02 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:02:34.616 02:05:02 -- setup/acl.sh@12 -- # devs=() 00:02:34.617 02:05:02 -- setup/acl.sh@12 -- # declare -a devs 00:02:34.617 02:05:02 -- setup/acl.sh@13 -- # drivers=() 00:02:34.617 02:05:02 -- setup/acl.sh@13 -- # declare -A drivers 00:02:34.617 02:05:02 -- setup/acl.sh@51 -- # setup reset 00:02:34.617 02:05:02 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:34.617 02:05:02 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:35.996 02:05:03 -- setup/acl.sh@52 -- # collect_setup_devs 00:02:35.996 02:05:03 -- setup/acl.sh@16 -- # local dev driver 00:02:35.996 02:05:03 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:35.996 02:05:03 -- setup/acl.sh@15 -- # setup output status 00:02:35.996 02:05:03 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:35.996 02:05:03 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:02:37.370 Hugepages 00:02:37.370 node hugesize free / total 00:02:37.370 02:05:04 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:02:37.370 02:05:04 -- setup/acl.sh@19 -- # continue 00:02:37.370 02:05:04 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:37.370 02:05:04 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:02:37.370 02:05:04 -- setup/acl.sh@19 -- # continue 00:02:37.370 02:05:04 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:37.370 02:05:04 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:02:37.370 02:05:04 -- setup/acl.sh@19 -- # continue 00:02:37.370 02:05:04 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:37.370 00:02:37.370 Type BDF Vendor Device NUMA Driver Device Block devices 00:02:37.370 02:05:04 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:02:37.370 02:05:04 -- setup/acl.sh@19 -- # continue 00:02:37.370 02:05:04 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:37.370 02:05:04 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:02:37.370 02:05:04 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:37.370 02:05:04 -- setup/acl.sh@20 -- # continue 00:02:37.370 02:05:04 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:37.370 02:05:04 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:02:37.370 02:05:04 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:37.370 02:05:04 -- setup/acl.sh@20 -- # continue 00:02:37.370 02:05:04 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:37.370 02:05:04 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:02:37.370 02:05:04 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:37.370 02:05:04 -- setup/acl.sh@20 -- # continue 00:02:37.370 02:05:04 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:37.370 02:05:04 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:02:37.370 02:05:04 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:37.370 02:05:04 -- setup/acl.sh@20 -- # continue 00:02:37.370 02:05:04 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:37.370 02:05:04 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:02:37.370 02:05:04 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:37.370 02:05:04 -- setup/acl.sh@20 -- # continue 00:02:37.370 02:05:04 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:37.370 02:05:04 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:02:37.370 02:05:04 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:37.370 02:05:04 -- setup/acl.sh@20 -- # continue 00:02:37.370 02:05:04 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:37.370 02:05:04 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:02:37.370 02:05:04 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:37.370 02:05:04 -- setup/acl.sh@20 -- # continue 00:02:37.370 02:05:04 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:37.370 02:05:04 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:02:37.370 02:05:04 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:37.370 02:05:04 -- setup/acl.sh@20 -- # continue 00:02:37.370 02:05:04 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:37.370 02:05:04 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:02:37.370 02:05:04 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:37.370 02:05:04 -- setup/acl.sh@20 -- # continue 00:02:37.370 02:05:04 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:37.370 02:05:04 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:02:37.370 02:05:04 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:37.370 02:05:04 -- setup/acl.sh@20 -- # continue 00:02:37.370 02:05:04 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:37.370 02:05:04 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:02:37.370 02:05:04 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:37.370 02:05:04 -- setup/acl.sh@20 -- # continue 00:02:37.370 02:05:04 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:37.370 02:05:04 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:02:37.370 02:05:04 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:37.370 02:05:04 -- setup/acl.sh@20 -- # continue 00:02:37.370 02:05:04 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:37.370 02:05:04 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:02:37.370 02:05:04 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:37.370 02:05:04 -- setup/acl.sh@20 -- # continue 00:02:37.370 02:05:04 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:37.370 02:05:04 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:02:37.370 02:05:04 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:37.370 02:05:04 -- setup/acl.sh@20 -- # continue 00:02:37.370 02:05:04 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:37.370 02:05:04 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:02:37.370 02:05:04 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:37.370 02:05:04 -- setup/acl.sh@20 -- # continue 00:02:37.370 02:05:04 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:37.370 02:05:04 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:02:37.370 02:05:04 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:37.370 02:05:04 -- setup/acl.sh@20 -- # continue 00:02:37.370 02:05:04 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:37.370 02:05:04 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:02:37.370 02:05:04 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:02:37.370 02:05:04 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:02:37.370 02:05:04 -- setup/acl.sh@22 -- # devs+=("$dev") 00:02:37.370 02:05:04 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:02:37.370 02:05:04 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:37.370 02:05:04 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:02:37.370 02:05:04 -- setup/acl.sh@54 -- # run_test denied denied 00:02:37.370 02:05:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:37.370 02:05:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:37.370 02:05:04 -- common/autotest_common.sh@10 -- # set +x 00:02:37.370 ************************************ 00:02:37.370 START TEST denied 00:02:37.371 ************************************ 00:02:37.371 02:05:04 -- common/autotest_common.sh@1114 -- # denied 00:02:37.371 02:05:04 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:02:37.371 02:05:04 -- setup/acl.sh@38 -- # setup output config 00:02:37.371 02:05:04 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:02:37.371 02:05:04 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:37.371 02:05:04 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:02:38.741 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:02:38.741 02:05:06 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:02:38.741 02:05:06 -- setup/acl.sh@28 -- # local dev driver 00:02:38.741 02:05:06 -- setup/acl.sh@30 -- # for dev in "$@" 00:02:38.741 02:05:06 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:02:38.741 02:05:06 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:02:38.741 02:05:06 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:02:38.741 02:05:06 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:02:38.741 02:05:06 -- setup/acl.sh@41 -- # setup reset 00:02:38.741 02:05:06 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:38.741 02:05:06 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:41.277 00:02:41.277 real 0m3.802s 00:02:41.277 user 0m1.091s 00:02:41.277 sys 0m1.820s 00:02:41.277 02:05:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:41.277 02:05:08 -- common/autotest_common.sh@10 -- # set +x 00:02:41.277 ************************************ 00:02:41.277 END TEST denied 00:02:41.277 ************************************ 00:02:41.277 02:05:08 -- setup/acl.sh@55 -- # run_test allowed allowed 00:02:41.277 02:05:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:41.277 02:05:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:41.277 02:05:08 -- common/autotest_common.sh@10 -- # set +x 00:02:41.277 ************************************ 00:02:41.277 START TEST allowed 00:02:41.277 ************************************ 00:02:41.277 02:05:08 -- common/autotest_common.sh@1114 -- # allowed 00:02:41.277 02:05:08 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:02:41.277 02:05:08 -- setup/acl.sh@45 -- # setup output config 00:02:41.277 02:05:08 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:02:41.277 02:05:08 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:41.277 02:05:08 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:02:43.182 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:02:43.182 02:05:10 -- setup/acl.sh@47 -- # verify 00:02:43.182 02:05:10 -- setup/acl.sh@28 -- # local dev driver 00:02:43.182 02:05:10 -- setup/acl.sh@48 -- # setup reset 00:02:43.182 02:05:10 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:43.182 02:05:10 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:45.086 00:02:45.086 real 0m3.826s 00:02:45.086 user 0m1.007s 00:02:45.086 sys 0m1.713s 00:02:45.086 02:05:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:45.086 02:05:12 -- common/autotest_common.sh@10 -- # set +x 00:02:45.086 ************************************ 00:02:45.086 END TEST allowed 00:02:45.086 ************************************ 00:02:45.086 00:02:45.086 real 0m10.283s 00:02:45.086 user 0m3.199s 00:02:45.086 sys 0m5.169s 00:02:45.086 02:05:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:45.086 02:05:12 -- common/autotest_common.sh@10 -- # set +x 00:02:45.086 ************************************ 00:02:45.086 END TEST acl 00:02:45.086 ************************************ 00:02:45.086 02:05:12 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:02:45.086 02:05:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:45.086 02:05:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:45.086 02:05:12 -- common/autotest_common.sh@10 -- # set +x 00:02:45.086 ************************************ 00:02:45.086 START TEST hugepages 00:02:45.086 ************************************ 00:02:45.086 02:05:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:02:45.086 * Looking for test storage... 00:02:45.086 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:45.086 02:05:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:45.086 02:05:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:45.086 02:05:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:45.086 02:05:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:45.086 02:05:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:45.086 02:05:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:45.086 02:05:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:45.086 02:05:12 -- scripts/common.sh@335 -- # IFS=.-: 00:02:45.086 02:05:12 -- scripts/common.sh@335 -- # read -ra ver1 00:02:45.086 02:05:12 -- scripts/common.sh@336 -- # IFS=.-: 00:02:45.086 02:05:12 -- scripts/common.sh@336 -- # read -ra ver2 00:02:45.086 02:05:12 -- scripts/common.sh@337 -- # local 'op=<' 00:02:45.086 02:05:12 -- scripts/common.sh@339 -- # ver1_l=2 00:02:45.086 02:05:12 -- scripts/common.sh@340 -- # ver2_l=1 00:02:45.086 02:05:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:45.086 02:05:12 -- scripts/common.sh@343 -- # case "$op" in 00:02:45.086 02:05:12 -- scripts/common.sh@344 -- # : 1 00:02:45.086 02:05:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:45.086 02:05:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:45.086 02:05:12 -- scripts/common.sh@364 -- # decimal 1 00:02:45.086 02:05:12 -- scripts/common.sh@352 -- # local d=1 00:02:45.086 02:05:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:45.086 02:05:12 -- scripts/common.sh@354 -- # echo 1 00:02:45.086 02:05:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:45.086 02:05:12 -- scripts/common.sh@365 -- # decimal 2 00:02:45.086 02:05:12 -- scripts/common.sh@352 -- # local d=2 00:02:45.086 02:05:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:45.086 02:05:12 -- scripts/common.sh@354 -- # echo 2 00:02:45.086 02:05:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:45.086 02:05:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:45.086 02:05:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:45.086 02:05:12 -- scripts/common.sh@367 -- # return 0 00:02:45.086 02:05:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:45.086 02:05:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:45.086 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:45.086 --rc genhtml_branch_coverage=1 00:02:45.086 --rc genhtml_function_coverage=1 00:02:45.086 --rc genhtml_legend=1 00:02:45.086 --rc geninfo_all_blocks=1 00:02:45.086 --rc geninfo_unexecuted_blocks=1 00:02:45.086 00:02:45.086 ' 00:02:45.086 02:05:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:45.086 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:45.086 --rc genhtml_branch_coverage=1 00:02:45.086 --rc genhtml_function_coverage=1 00:02:45.086 --rc genhtml_legend=1 00:02:45.086 --rc geninfo_all_blocks=1 00:02:45.086 --rc geninfo_unexecuted_blocks=1 00:02:45.086 00:02:45.086 ' 00:02:45.086 02:05:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:45.086 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:45.086 --rc genhtml_branch_coverage=1 00:02:45.086 --rc genhtml_function_coverage=1 00:02:45.086 --rc genhtml_legend=1 00:02:45.086 --rc geninfo_all_blocks=1 00:02:45.086 --rc geninfo_unexecuted_blocks=1 00:02:45.086 00:02:45.086 ' 00:02:45.086 02:05:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:45.086 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:45.086 --rc genhtml_branch_coverage=1 00:02:45.086 --rc genhtml_function_coverage=1 00:02:45.086 --rc genhtml_legend=1 00:02:45.086 --rc geninfo_all_blocks=1 00:02:45.086 --rc geninfo_unexecuted_blocks=1 00:02:45.086 00:02:45.086 ' 00:02:45.086 02:05:12 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:02:45.086 02:05:12 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:02:45.086 02:05:12 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:02:45.086 02:05:12 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:02:45.086 02:05:12 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:02:45.086 02:05:12 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:02:45.087 02:05:12 -- setup/common.sh@17 -- # local get=Hugepagesize 00:02:45.087 02:05:12 -- setup/common.sh@18 -- # local node= 00:02:45.087 02:05:12 -- setup/common.sh@19 -- # local var val 00:02:45.087 02:05:12 -- setup/common.sh@20 -- # local mem_f mem 00:02:45.087 02:05:12 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:45.087 02:05:12 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:45.087 02:05:12 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:45.087 02:05:12 -- setup/common.sh@28 -- # mapfile -t mem 00:02:45.087 02:05:12 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.087 02:05:12 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 43674864 kB' 'MemAvailable: 47429616 kB' 'Buffers: 3740 kB' 'Cached: 10223504 kB' 'SwapCached: 0 kB' 'Active: 6927028 kB' 'Inactive: 3759384 kB' 'Active(anon): 6526368 kB' 'Inactive(anon): 0 kB' 'Active(file): 400660 kB' 'Inactive(file): 3759384 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 462552 kB' 'Mapped: 181728 kB' 'Shmem: 6067200 kB' 'KReclaimable: 176572 kB' 'Slab: 662080 kB' 'SReclaimable: 176572 kB' 'SUnreclaim: 485508 kB' 'KernelStack: 12704 kB' 'PageTables: 7748 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559280 kB' 'Committed_AS: 7597484 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198104 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 1640028 kB' 'DirectMap2M: 15056896 kB' 'DirectMap1G: 53477376 kB' 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.087 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.087 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # continue 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.088 02:05:12 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.088 02:05:12 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.088 02:05:12 -- setup/common.sh@33 -- # echo 2048 00:02:45.088 02:05:12 -- setup/common.sh@33 -- # return 0 00:02:45.088 02:05:12 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:02:45.088 02:05:12 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:02:45.088 02:05:12 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:02:45.088 02:05:12 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:02:45.088 02:05:12 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:02:45.088 02:05:12 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:02:45.088 02:05:12 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:02:45.088 02:05:12 -- setup/hugepages.sh@207 -- # get_nodes 00:02:45.088 02:05:12 -- setup/hugepages.sh@27 -- # local node 00:02:45.088 02:05:12 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:45.088 02:05:12 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:02:45.088 02:05:12 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:45.088 02:05:12 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:02:45.088 02:05:12 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:45.088 02:05:12 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:45.088 02:05:12 -- setup/hugepages.sh@208 -- # clear_hp 00:02:45.088 02:05:12 -- setup/hugepages.sh@37 -- # local node hp 00:02:45.088 02:05:12 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:02:45.088 02:05:12 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:45.088 02:05:12 -- setup/hugepages.sh@41 -- # echo 0 00:02:45.088 02:05:12 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:45.088 02:05:12 -- setup/hugepages.sh@41 -- # echo 0 00:02:45.088 02:05:12 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:02:45.088 02:05:12 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:45.088 02:05:12 -- setup/hugepages.sh@41 -- # echo 0 00:02:45.088 02:05:12 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:45.088 02:05:12 -- setup/hugepages.sh@41 -- # echo 0 00:02:45.088 02:05:12 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:02:45.088 02:05:12 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:02:45.088 02:05:12 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:02:45.088 02:05:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:45.088 02:05:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:45.088 02:05:12 -- common/autotest_common.sh@10 -- # set +x 00:02:45.088 ************************************ 00:02:45.088 START TEST default_setup 00:02:45.088 ************************************ 00:02:45.088 02:05:12 -- common/autotest_common.sh@1114 -- # default_setup 00:02:45.088 02:05:12 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:02:45.088 02:05:12 -- setup/hugepages.sh@49 -- # local size=2097152 00:02:45.088 02:05:12 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:02:45.088 02:05:12 -- setup/hugepages.sh@51 -- # shift 00:02:45.088 02:05:12 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:02:45.088 02:05:12 -- setup/hugepages.sh@52 -- # local node_ids 00:02:45.088 02:05:12 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:45.088 02:05:12 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:02:45.088 02:05:12 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:02:45.088 02:05:12 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:02:45.088 02:05:12 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:45.088 02:05:12 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:45.088 02:05:12 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:45.088 02:05:12 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:45.088 02:05:12 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:45.088 02:05:12 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:02:45.088 02:05:12 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:45.088 02:05:12 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:02:45.088 02:05:12 -- setup/hugepages.sh@73 -- # return 0 00:02:45.088 02:05:12 -- setup/hugepages.sh@137 -- # setup output 00:02:45.088 02:05:12 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:45.088 02:05:12 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:46.465 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:02:46.465 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:02:46.465 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:02:46.465 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:02:46.465 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:02:46.465 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:02:46.465 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:02:46.465 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:02:46.465 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:02:46.465 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:02:46.465 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:02:46.465 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:02:46.465 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:02:46.465 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:02:46.465 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:02:46.465 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:02:47.415 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:02:47.415 02:05:14 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:02:47.415 02:05:14 -- setup/hugepages.sh@89 -- # local node 00:02:47.415 02:05:14 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:47.415 02:05:14 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:47.415 02:05:14 -- setup/hugepages.sh@92 -- # local surp 00:02:47.415 02:05:14 -- setup/hugepages.sh@93 -- # local resv 00:02:47.415 02:05:14 -- setup/hugepages.sh@94 -- # local anon 00:02:47.415 02:05:14 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:47.415 02:05:14 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:47.415 02:05:14 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:47.415 02:05:14 -- setup/common.sh@18 -- # local node= 00:02:47.415 02:05:14 -- setup/common.sh@19 -- # local var val 00:02:47.415 02:05:14 -- setup/common.sh@20 -- # local mem_f mem 00:02:47.415 02:05:14 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:47.415 02:05:14 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:47.415 02:05:14 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:47.415 02:05:14 -- setup/common.sh@28 -- # mapfile -t mem 00:02:47.415 02:05:14 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:14 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45774364 kB' 'MemAvailable: 49529116 kB' 'Buffers: 3740 kB' 'Cached: 10223592 kB' 'SwapCached: 0 kB' 'Active: 6927372 kB' 'Inactive: 3759384 kB' 'Active(anon): 6526712 kB' 'Inactive(anon): 0 kB' 'Active(file): 400660 kB' 'Inactive(file): 3759384 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 462640 kB' 'Mapped: 181504 kB' 'Shmem: 6067288 kB' 'KReclaimable: 176572 kB' 'Slab: 661992 kB' 'SReclaimable: 176572 kB' 'SUnreclaim: 485420 kB' 'KernelStack: 12800 kB' 'PageTables: 7784 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 7601696 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198424 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1640028 kB' 'DirectMap2M: 15056896 kB' 'DirectMap1G: 53477376 kB' 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:14 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:15 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:15 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:15 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:15 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:15 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:15 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:15 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:15 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:15 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:15 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:15 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:15 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.415 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.415 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.415 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.415 02:05:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:47.416 02:05:15 -- setup/common.sh@33 -- # echo 0 00:02:47.416 02:05:15 -- setup/common.sh@33 -- # return 0 00:02:47.416 02:05:15 -- setup/hugepages.sh@97 -- # anon=0 00:02:47.416 02:05:15 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:47.416 02:05:15 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:47.416 02:05:15 -- setup/common.sh@18 -- # local node= 00:02:47.416 02:05:15 -- setup/common.sh@19 -- # local var val 00:02:47.416 02:05:15 -- setup/common.sh@20 -- # local mem_f mem 00:02:47.416 02:05:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:47.416 02:05:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:47.416 02:05:15 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:47.416 02:05:15 -- setup/common.sh@28 -- # mapfile -t mem 00:02:47.416 02:05:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45770048 kB' 'MemAvailable: 49524800 kB' 'Buffers: 3740 kB' 'Cached: 10223596 kB' 'SwapCached: 0 kB' 'Active: 6930684 kB' 'Inactive: 3759384 kB' 'Active(anon): 6530024 kB' 'Inactive(anon): 0 kB' 'Active(file): 400660 kB' 'Inactive(file): 3759384 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 466012 kB' 'Mapped: 181424 kB' 'Shmem: 6067292 kB' 'KReclaimable: 176572 kB' 'Slab: 661924 kB' 'SReclaimable: 176572 kB' 'SUnreclaim: 485352 kB' 'KernelStack: 12832 kB' 'PageTables: 7976 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 7604888 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198396 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1640028 kB' 'DirectMap2M: 15056896 kB' 'DirectMap1G: 53477376 kB' 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.416 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.416 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.417 02:05:15 -- setup/common.sh@33 -- # echo 0 00:02:47.417 02:05:15 -- setup/common.sh@33 -- # return 0 00:02:47.417 02:05:15 -- setup/hugepages.sh@99 -- # surp=0 00:02:47.417 02:05:15 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:47.417 02:05:15 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:47.417 02:05:15 -- setup/common.sh@18 -- # local node= 00:02:47.417 02:05:15 -- setup/common.sh@19 -- # local var val 00:02:47.417 02:05:15 -- setup/common.sh@20 -- # local mem_f mem 00:02:47.417 02:05:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:47.417 02:05:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:47.417 02:05:15 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:47.417 02:05:15 -- setup/common.sh@28 -- # mapfile -t mem 00:02:47.417 02:05:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45772632 kB' 'MemAvailable: 49527384 kB' 'Buffers: 3740 kB' 'Cached: 10223608 kB' 'SwapCached: 0 kB' 'Active: 6930624 kB' 'Inactive: 3759384 kB' 'Active(anon): 6529964 kB' 'Inactive(anon): 0 kB' 'Active(file): 400660 kB' 'Inactive(file): 3759384 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 465908 kB' 'Mapped: 181752 kB' 'Shmem: 6067304 kB' 'KReclaimable: 176572 kB' 'Slab: 661924 kB' 'SReclaimable: 176572 kB' 'SUnreclaim: 485352 kB' 'KernelStack: 12768 kB' 'PageTables: 7748 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 7604904 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198424 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1640028 kB' 'DirectMap2M: 15056896 kB' 'DirectMap1G: 53477376 kB' 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.417 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.417 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:47.418 02:05:15 -- setup/common.sh@33 -- # echo 0 00:02:47.418 02:05:15 -- setup/common.sh@33 -- # return 0 00:02:47.418 02:05:15 -- setup/hugepages.sh@100 -- # resv=0 00:02:47.418 02:05:15 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:47.418 nr_hugepages=1024 00:02:47.418 02:05:15 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:47.418 resv_hugepages=0 00:02:47.418 02:05:15 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:47.418 surplus_hugepages=0 00:02:47.418 02:05:15 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:47.418 anon_hugepages=0 00:02:47.418 02:05:15 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:47.418 02:05:15 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:47.418 02:05:15 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:47.418 02:05:15 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:47.418 02:05:15 -- setup/common.sh@18 -- # local node= 00:02:47.418 02:05:15 -- setup/common.sh@19 -- # local var val 00:02:47.418 02:05:15 -- setup/common.sh@20 -- # local mem_f mem 00:02:47.418 02:05:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:47.418 02:05:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:47.418 02:05:15 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:47.418 02:05:15 -- setup/common.sh@28 -- # mapfile -t mem 00:02:47.418 02:05:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.418 02:05:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45775372 kB' 'MemAvailable: 49530124 kB' 'Buffers: 3740 kB' 'Cached: 10223608 kB' 'SwapCached: 0 kB' 'Active: 6927232 kB' 'Inactive: 3759384 kB' 'Active(anon): 6526572 kB' 'Inactive(anon): 0 kB' 'Active(file): 400660 kB' 'Inactive(file): 3759384 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 462552 kB' 'Mapped: 181416 kB' 'Shmem: 6067304 kB' 'KReclaimable: 176572 kB' 'Slab: 661924 kB' 'SReclaimable: 176572 kB' 'SUnreclaim: 485352 kB' 'KernelStack: 12768 kB' 'PageTables: 7736 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 7602136 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198440 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1640028 kB' 'DirectMap2M: 15056896 kB' 'DirectMap1G: 53477376 kB' 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.418 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.418 02:05:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:47.419 02:05:15 -- setup/common.sh@33 -- # echo 1024 00:02:47.419 02:05:15 -- setup/common.sh@33 -- # return 0 00:02:47.419 02:05:15 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:47.419 02:05:15 -- setup/hugepages.sh@112 -- # get_nodes 00:02:47.419 02:05:15 -- setup/hugepages.sh@27 -- # local node 00:02:47.419 02:05:15 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:47.419 02:05:15 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:02:47.419 02:05:15 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:47.419 02:05:15 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:02:47.419 02:05:15 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:47.419 02:05:15 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:47.419 02:05:15 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:47.419 02:05:15 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:47.419 02:05:15 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:47.419 02:05:15 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:47.419 02:05:15 -- setup/common.sh@18 -- # local node=0 00:02:47.419 02:05:15 -- setup/common.sh@19 -- # local var val 00:02:47.419 02:05:15 -- setup/common.sh@20 -- # local mem_f mem 00:02:47.419 02:05:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:47.419 02:05:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:47.419 02:05:15 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:47.419 02:05:15 -- setup/common.sh@28 -- # mapfile -t mem 00:02:47.419 02:05:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27301428 kB' 'MemUsed: 5524428 kB' 'SwapCached: 0 kB' 'Active: 2192860 kB' 'Inactive: 183308 kB' 'Active(anon): 2018612 kB' 'Inactive(anon): 0 kB' 'Active(file): 174248 kB' 'Inactive(file): 183308 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2247992 kB' 'Mapped: 79820 kB' 'AnonPages: 131416 kB' 'Shmem: 1890436 kB' 'KernelStack: 6952 kB' 'PageTables: 3324 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 89544 kB' 'Slab: 378124 kB' 'SReclaimable: 89544 kB' 'SUnreclaim: 288580 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.419 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.419 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # continue 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # IFS=': ' 00:02:47.420 02:05:15 -- setup/common.sh@31 -- # read -r var val _ 00:02:47.420 02:05:15 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:47.420 02:05:15 -- setup/common.sh@33 -- # echo 0 00:02:47.420 02:05:15 -- setup/common.sh@33 -- # return 0 00:02:47.420 02:05:15 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:47.420 02:05:15 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:47.420 02:05:15 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:47.420 02:05:15 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:47.420 02:05:15 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:02:47.420 node0=1024 expecting 1024 00:02:47.420 02:05:15 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:02:47.420 00:02:47.420 real 0m2.397s 00:02:47.420 user 0m0.663s 00:02:47.420 sys 0m0.856s 00:02:47.420 02:05:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:47.420 02:05:15 -- common/autotest_common.sh@10 -- # set +x 00:02:47.420 ************************************ 00:02:47.420 END TEST default_setup 00:02:47.420 ************************************ 00:02:47.420 02:05:15 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:02:47.420 02:05:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:47.420 02:05:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:47.420 02:05:15 -- common/autotest_common.sh@10 -- # set +x 00:02:47.420 ************************************ 00:02:47.420 START TEST per_node_1G_alloc 00:02:47.420 ************************************ 00:02:47.420 02:05:15 -- common/autotest_common.sh@1114 -- # per_node_1G_alloc 00:02:47.420 02:05:15 -- setup/hugepages.sh@143 -- # local IFS=, 00:02:47.420 02:05:15 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:02:47.420 02:05:15 -- setup/hugepages.sh@49 -- # local size=1048576 00:02:47.420 02:05:15 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:02:47.420 02:05:15 -- setup/hugepages.sh@51 -- # shift 00:02:47.420 02:05:15 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:02:47.420 02:05:15 -- setup/hugepages.sh@52 -- # local node_ids 00:02:47.420 02:05:15 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:47.420 02:05:15 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:02:47.420 02:05:15 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:02:47.420 02:05:15 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:02:47.420 02:05:15 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:47.420 02:05:15 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:02:47.420 02:05:15 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:47.420 02:05:15 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:47.420 02:05:15 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:47.420 02:05:15 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:02:47.420 02:05:15 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:47.420 02:05:15 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:02:47.420 02:05:15 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:47.420 02:05:15 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:02:47.420 02:05:15 -- setup/hugepages.sh@73 -- # return 0 00:02:47.420 02:05:15 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:02:47.420 02:05:15 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:02:47.420 02:05:15 -- setup/hugepages.sh@146 -- # setup output 00:02:47.420 02:05:15 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:47.420 02:05:15 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:48.795 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:48.795 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:48.795 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:48.796 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:48.796 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:48.796 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:48.796 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:48.796 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:48.796 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:48.796 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:48.796 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:48.796 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:48.796 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:48.796 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:48.796 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:48.796 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:48.796 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:48.796 02:05:16 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:02:48.796 02:05:16 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:02:48.796 02:05:16 -- setup/hugepages.sh@89 -- # local node 00:02:48.796 02:05:16 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:48.796 02:05:16 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:48.796 02:05:16 -- setup/hugepages.sh@92 -- # local surp 00:02:48.796 02:05:16 -- setup/hugepages.sh@93 -- # local resv 00:02:48.796 02:05:16 -- setup/hugepages.sh@94 -- # local anon 00:02:48.796 02:05:16 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:48.796 02:05:16 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:48.796 02:05:16 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:48.796 02:05:16 -- setup/common.sh@18 -- # local node= 00:02:48.796 02:05:16 -- setup/common.sh@19 -- # local var val 00:02:48.796 02:05:16 -- setup/common.sh@20 -- # local mem_f mem 00:02:48.796 02:05:16 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:48.796 02:05:16 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:48.796 02:05:16 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:48.796 02:05:16 -- setup/common.sh@28 -- # mapfile -t mem 00:02:48.796 02:05:16 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.796 02:05:16 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45779656 kB' 'MemAvailable: 49534408 kB' 'Buffers: 3740 kB' 'Cached: 10223684 kB' 'SwapCached: 0 kB' 'Active: 6925396 kB' 'Inactive: 3759384 kB' 'Active(anon): 6524736 kB' 'Inactive(anon): 0 kB' 'Active(file): 400660 kB' 'Inactive(file): 3759384 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 460616 kB' 'Mapped: 181000 kB' 'Shmem: 6067380 kB' 'KReclaimable: 176572 kB' 'Slab: 662328 kB' 'SReclaimable: 176572 kB' 'SUnreclaim: 485756 kB' 'KernelStack: 12768 kB' 'PageTables: 7744 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 7598980 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1640028 kB' 'DirectMap2M: 15056896 kB' 'DirectMap1G: 53477376 kB' 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.796 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.796 02:05:16 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:48.797 02:05:16 -- setup/common.sh@33 -- # echo 0 00:02:48.797 02:05:16 -- setup/common.sh@33 -- # return 0 00:02:48.797 02:05:16 -- setup/hugepages.sh@97 -- # anon=0 00:02:48.797 02:05:16 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:48.797 02:05:16 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:48.797 02:05:16 -- setup/common.sh@18 -- # local node= 00:02:48.797 02:05:16 -- setup/common.sh@19 -- # local var val 00:02:48.797 02:05:16 -- setup/common.sh@20 -- # local mem_f mem 00:02:48.797 02:05:16 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:48.797 02:05:16 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:48.797 02:05:16 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:48.797 02:05:16 -- setup/common.sh@28 -- # mapfile -t mem 00:02:48.797 02:05:16 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.797 02:05:16 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45781692 kB' 'MemAvailable: 49536444 kB' 'Buffers: 3740 kB' 'Cached: 10223684 kB' 'SwapCached: 0 kB' 'Active: 6926112 kB' 'Inactive: 3759384 kB' 'Active(anon): 6525452 kB' 'Inactive(anon): 0 kB' 'Active(file): 400660 kB' 'Inactive(file): 3759384 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 461344 kB' 'Mapped: 181076 kB' 'Shmem: 6067380 kB' 'KReclaimable: 176572 kB' 'Slab: 662372 kB' 'SReclaimable: 176572 kB' 'SUnreclaim: 485800 kB' 'KernelStack: 12800 kB' 'PageTables: 7836 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 7598992 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1640028 kB' 'DirectMap2M: 15056896 kB' 'DirectMap1G: 53477376 kB' 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.797 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.797 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.798 02:05:16 -- setup/common.sh@33 -- # echo 0 00:02:48.798 02:05:16 -- setup/common.sh@33 -- # return 0 00:02:48.798 02:05:16 -- setup/hugepages.sh@99 -- # surp=0 00:02:48.798 02:05:16 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:48.798 02:05:16 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:48.798 02:05:16 -- setup/common.sh@18 -- # local node= 00:02:48.798 02:05:16 -- setup/common.sh@19 -- # local var val 00:02:48.798 02:05:16 -- setup/common.sh@20 -- # local mem_f mem 00:02:48.798 02:05:16 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:48.798 02:05:16 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:48.798 02:05:16 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:48.798 02:05:16 -- setup/common.sh@28 -- # mapfile -t mem 00:02:48.798 02:05:16 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.798 02:05:16 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45781216 kB' 'MemAvailable: 49535968 kB' 'Buffers: 3740 kB' 'Cached: 10223684 kB' 'SwapCached: 0 kB' 'Active: 6925160 kB' 'Inactive: 3759384 kB' 'Active(anon): 6524500 kB' 'Inactive(anon): 0 kB' 'Active(file): 400660 kB' 'Inactive(file): 3759384 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 460352 kB' 'Mapped: 181064 kB' 'Shmem: 6067380 kB' 'KReclaimable: 176572 kB' 'Slab: 662372 kB' 'SReclaimable: 176572 kB' 'SUnreclaim: 485800 kB' 'KernelStack: 12784 kB' 'PageTables: 7728 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 7599004 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1640028 kB' 'DirectMap2M: 15056896 kB' 'DirectMap1G: 53477376 kB' 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.798 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.798 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.799 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.799 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:48.800 02:05:16 -- setup/common.sh@33 -- # echo 0 00:02:48.800 02:05:16 -- setup/common.sh@33 -- # return 0 00:02:48.800 02:05:16 -- setup/hugepages.sh@100 -- # resv=0 00:02:48.800 02:05:16 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:48.800 nr_hugepages=1024 00:02:48.800 02:05:16 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:48.800 resv_hugepages=0 00:02:48.800 02:05:16 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:48.800 surplus_hugepages=0 00:02:48.800 02:05:16 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:48.800 anon_hugepages=0 00:02:48.800 02:05:16 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:48.800 02:05:16 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:48.800 02:05:16 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:48.800 02:05:16 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:48.800 02:05:16 -- setup/common.sh@18 -- # local node= 00:02:48.800 02:05:16 -- setup/common.sh@19 -- # local var val 00:02:48.800 02:05:16 -- setup/common.sh@20 -- # local mem_f mem 00:02:48.800 02:05:16 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:48.800 02:05:16 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:48.800 02:05:16 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:48.800 02:05:16 -- setup/common.sh@28 -- # mapfile -t mem 00:02:48.800 02:05:16 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.800 02:05:16 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45781484 kB' 'MemAvailable: 49536236 kB' 'Buffers: 3740 kB' 'Cached: 10223712 kB' 'SwapCached: 0 kB' 'Active: 6925276 kB' 'Inactive: 3759384 kB' 'Active(anon): 6524616 kB' 'Inactive(anon): 0 kB' 'Active(file): 400660 kB' 'Inactive(file): 3759384 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 460420 kB' 'Mapped: 180988 kB' 'Shmem: 6067408 kB' 'KReclaimable: 176572 kB' 'Slab: 662360 kB' 'SReclaimable: 176572 kB' 'SUnreclaim: 485788 kB' 'KernelStack: 12768 kB' 'PageTables: 7672 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 7599020 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1640028 kB' 'DirectMap2M: 15056896 kB' 'DirectMap1G: 53477376 kB' 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.800 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.800 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:48.801 02:05:16 -- setup/common.sh@33 -- # echo 1024 00:02:48.801 02:05:16 -- setup/common.sh@33 -- # return 0 00:02:48.801 02:05:16 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:48.801 02:05:16 -- setup/hugepages.sh@112 -- # get_nodes 00:02:48.801 02:05:16 -- setup/hugepages.sh@27 -- # local node 00:02:48.801 02:05:16 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:48.801 02:05:16 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:48.801 02:05:16 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:48.801 02:05:16 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:48.801 02:05:16 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:48.801 02:05:16 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:48.801 02:05:16 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:48.801 02:05:16 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:48.801 02:05:16 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:48.801 02:05:16 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:48.801 02:05:16 -- setup/common.sh@18 -- # local node=0 00:02:48.801 02:05:16 -- setup/common.sh@19 -- # local var val 00:02:48.801 02:05:16 -- setup/common.sh@20 -- # local mem_f mem 00:02:48.801 02:05:16 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:48.801 02:05:16 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:48.801 02:05:16 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:48.801 02:05:16 -- setup/common.sh@28 -- # mapfile -t mem 00:02:48.801 02:05:16 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.801 02:05:16 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 28367164 kB' 'MemUsed: 4458692 kB' 'SwapCached: 0 kB' 'Active: 2192960 kB' 'Inactive: 183308 kB' 'Active(anon): 2018712 kB' 'Inactive(anon): 0 kB' 'Active(file): 174248 kB' 'Inactive(file): 183308 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2248064 kB' 'Mapped: 78976 kB' 'AnonPages: 131352 kB' 'Shmem: 1890508 kB' 'KernelStack: 6984 kB' 'PageTables: 3380 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 89544 kB' 'Slab: 378196 kB' 'SReclaimable: 89544 kB' 'SUnreclaim: 288652 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.801 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.801 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.802 02:05:16 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.802 02:05:16 -- setup/common.sh@33 -- # echo 0 00:02:48.802 02:05:16 -- setup/common.sh@33 -- # return 0 00:02:48.802 02:05:16 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:48.802 02:05:16 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:48.802 02:05:16 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:48.802 02:05:16 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:02:48.802 02:05:16 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:48.802 02:05:16 -- setup/common.sh@18 -- # local node=1 00:02:48.802 02:05:16 -- setup/common.sh@19 -- # local var val 00:02:48.802 02:05:16 -- setup/common.sh@20 -- # local mem_f mem 00:02:48.802 02:05:16 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:48.802 02:05:16 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:02:48.802 02:05:16 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:02:48.802 02:05:16 -- setup/common.sh@28 -- # mapfile -t mem 00:02:48.802 02:05:16 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.802 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709800 kB' 'MemFree: 17417740 kB' 'MemUsed: 10292060 kB' 'SwapCached: 0 kB' 'Active: 4732608 kB' 'Inactive: 3576076 kB' 'Active(anon): 4506196 kB' 'Inactive(anon): 0 kB' 'Active(file): 226412 kB' 'Inactive(file): 3576076 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7979404 kB' 'Mapped: 102012 kB' 'AnonPages: 329472 kB' 'Shmem: 4176916 kB' 'KernelStack: 5848 kB' 'PageTables: 4568 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 87028 kB' 'Slab: 284168 kB' 'SReclaimable: 87028 kB' 'SUnreclaim: 197140 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # continue 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # IFS=': ' 00:02:48.803 02:05:16 -- setup/common.sh@31 -- # read -r var val _ 00:02:48.803 02:05:16 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:48.803 02:05:16 -- setup/common.sh@33 -- # echo 0 00:02:48.803 02:05:16 -- setup/common.sh@33 -- # return 0 00:02:48.803 02:05:16 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:48.803 02:05:16 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:48.803 02:05:16 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:48.803 02:05:16 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:48.803 02:05:16 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:02:48.803 node0=512 expecting 512 00:02:48.803 02:05:16 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:48.803 02:05:16 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:48.803 02:05:16 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:48.803 02:05:16 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:02:48.803 node1=512 expecting 512 00:02:48.803 02:05:16 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:02:48.804 00:02:48.804 real 0m1.419s 00:02:48.804 user 0m0.634s 00:02:48.804 sys 0m0.747s 00:02:48.804 02:05:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:48.804 02:05:16 -- common/autotest_common.sh@10 -- # set +x 00:02:48.804 ************************************ 00:02:48.804 END TEST per_node_1G_alloc 00:02:48.804 ************************************ 00:02:49.061 02:05:16 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:02:49.061 02:05:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:49.061 02:05:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:49.061 02:05:16 -- common/autotest_common.sh@10 -- # set +x 00:02:49.061 ************************************ 00:02:49.061 START TEST even_2G_alloc 00:02:49.061 ************************************ 00:02:49.061 02:05:16 -- common/autotest_common.sh@1114 -- # even_2G_alloc 00:02:49.061 02:05:16 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:02:49.061 02:05:16 -- setup/hugepages.sh@49 -- # local size=2097152 00:02:49.061 02:05:16 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:02:49.061 02:05:16 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:49.061 02:05:16 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:02:49.061 02:05:16 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:02:49.061 02:05:16 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:49.061 02:05:16 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:49.061 02:05:16 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:49.061 02:05:16 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:49.061 02:05:16 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:49.062 02:05:16 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:49.062 02:05:16 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:49.062 02:05:16 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:02:49.062 02:05:16 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:49.062 02:05:16 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:02:49.062 02:05:16 -- setup/hugepages.sh@83 -- # : 512 00:02:49.062 02:05:16 -- setup/hugepages.sh@84 -- # : 1 00:02:49.062 02:05:16 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:49.062 02:05:16 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:02:49.062 02:05:16 -- setup/hugepages.sh@83 -- # : 0 00:02:49.062 02:05:16 -- setup/hugepages.sh@84 -- # : 0 00:02:49.062 02:05:16 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:49.062 02:05:16 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:02:49.062 02:05:16 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:02:49.062 02:05:16 -- setup/hugepages.sh@153 -- # setup output 00:02:49.062 02:05:16 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:49.062 02:05:16 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:49.994 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:49.994 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:49.994 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:49.994 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:49.994 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:49.994 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:49.994 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:49.994 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:49.994 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:49.994 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:49.994 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:49.994 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:49.994 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:49.994 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:49.994 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:49.994 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:49.994 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:50.256 02:05:17 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:02:50.256 02:05:17 -- setup/hugepages.sh@89 -- # local node 00:02:50.256 02:05:17 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:50.257 02:05:17 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:50.257 02:05:17 -- setup/hugepages.sh@92 -- # local surp 00:02:50.257 02:05:17 -- setup/hugepages.sh@93 -- # local resv 00:02:50.257 02:05:17 -- setup/hugepages.sh@94 -- # local anon 00:02:50.257 02:05:17 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:50.257 02:05:17 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:50.257 02:05:17 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:50.257 02:05:17 -- setup/common.sh@18 -- # local node= 00:02:50.257 02:05:17 -- setup/common.sh@19 -- # local var val 00:02:50.257 02:05:17 -- setup/common.sh@20 -- # local mem_f mem 00:02:50.257 02:05:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:50.257 02:05:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:50.257 02:05:17 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:50.257 02:05:17 -- setup/common.sh@28 -- # mapfile -t mem 00:02:50.257 02:05:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45783232 kB' 'MemAvailable: 49537984 kB' 'Buffers: 3740 kB' 'Cached: 10223772 kB' 'SwapCached: 0 kB' 'Active: 6925700 kB' 'Inactive: 3759384 kB' 'Active(anon): 6525040 kB' 'Inactive(anon): 0 kB' 'Active(file): 400660 kB' 'Inactive(file): 3759384 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 460804 kB' 'Mapped: 181000 kB' 'Shmem: 6067468 kB' 'KReclaimable: 176572 kB' 'Slab: 662172 kB' 'SReclaimable: 176572 kB' 'SUnreclaim: 485600 kB' 'KernelStack: 12800 kB' 'PageTables: 7788 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 7599068 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1640028 kB' 'DirectMap2M: 15056896 kB' 'DirectMap1G: 53477376 kB' 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:50.257 02:05:17 -- setup/common.sh@33 -- # echo 0 00:02:50.257 02:05:17 -- setup/common.sh@33 -- # return 0 00:02:50.257 02:05:17 -- setup/hugepages.sh@97 -- # anon=0 00:02:50.257 02:05:17 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:50.257 02:05:17 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:50.257 02:05:17 -- setup/common.sh@18 -- # local node= 00:02:50.257 02:05:17 -- setup/common.sh@19 -- # local var val 00:02:50.257 02:05:17 -- setup/common.sh@20 -- # local mem_f mem 00:02:50.257 02:05:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:50.257 02:05:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:50.257 02:05:17 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:50.257 02:05:17 -- setup/common.sh@28 -- # mapfile -t mem 00:02:50.257 02:05:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45786188 kB' 'MemAvailable: 49540940 kB' 'Buffers: 3740 kB' 'Cached: 10223772 kB' 'SwapCached: 0 kB' 'Active: 6926600 kB' 'Inactive: 3759384 kB' 'Active(anon): 6525940 kB' 'Inactive(anon): 0 kB' 'Active(file): 400660 kB' 'Inactive(file): 3759384 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 461712 kB' 'Mapped: 181076 kB' 'Shmem: 6067468 kB' 'KReclaimable: 176572 kB' 'Slab: 662184 kB' 'SReclaimable: 176572 kB' 'SUnreclaim: 485612 kB' 'KernelStack: 12816 kB' 'PageTables: 7844 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 7599080 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1640028 kB' 'DirectMap2M: 15056896 kB' 'DirectMap1G: 53477376 kB' 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.257 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.257 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.258 02:05:17 -- setup/common.sh@33 -- # echo 0 00:02:50.258 02:05:17 -- setup/common.sh@33 -- # return 0 00:02:50.258 02:05:17 -- setup/hugepages.sh@99 -- # surp=0 00:02:50.258 02:05:17 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:50.258 02:05:17 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:50.258 02:05:17 -- setup/common.sh@18 -- # local node= 00:02:50.258 02:05:17 -- setup/common.sh@19 -- # local var val 00:02:50.258 02:05:17 -- setup/common.sh@20 -- # local mem_f mem 00:02:50.258 02:05:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:50.258 02:05:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:50.258 02:05:17 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:50.258 02:05:17 -- setup/common.sh@28 -- # mapfile -t mem 00:02:50.258 02:05:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45786208 kB' 'MemAvailable: 49540960 kB' 'Buffers: 3740 kB' 'Cached: 10223784 kB' 'SwapCached: 0 kB' 'Active: 6925516 kB' 'Inactive: 3759384 kB' 'Active(anon): 6524856 kB' 'Inactive(anon): 0 kB' 'Active(file): 400660 kB' 'Inactive(file): 3759384 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 460624 kB' 'Mapped: 180992 kB' 'Shmem: 6067480 kB' 'KReclaimable: 176572 kB' 'Slab: 662192 kB' 'SReclaimable: 176572 kB' 'SUnreclaim: 485620 kB' 'KernelStack: 12832 kB' 'PageTables: 7832 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 7599096 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1640028 kB' 'DirectMap2M: 15056896 kB' 'DirectMap1G: 53477376 kB' 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.258 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.258 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:50.259 02:05:17 -- setup/common.sh@33 -- # echo 0 00:02:50.259 02:05:17 -- setup/common.sh@33 -- # return 0 00:02:50.259 02:05:17 -- setup/hugepages.sh@100 -- # resv=0 00:02:50.259 02:05:17 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:50.259 nr_hugepages=1024 00:02:50.259 02:05:17 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:50.259 resv_hugepages=0 00:02:50.259 02:05:17 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:50.259 surplus_hugepages=0 00:02:50.259 02:05:17 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:50.259 anon_hugepages=0 00:02:50.259 02:05:17 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:50.259 02:05:17 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:50.259 02:05:17 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:50.259 02:05:17 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:50.259 02:05:17 -- setup/common.sh@18 -- # local node= 00:02:50.259 02:05:17 -- setup/common.sh@19 -- # local var val 00:02:50.259 02:05:17 -- setup/common.sh@20 -- # local mem_f mem 00:02:50.259 02:05:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:50.259 02:05:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:50.259 02:05:17 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:50.259 02:05:17 -- setup/common.sh@28 -- # mapfile -t mem 00:02:50.259 02:05:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45786208 kB' 'MemAvailable: 49540960 kB' 'Buffers: 3740 kB' 'Cached: 10223800 kB' 'SwapCached: 0 kB' 'Active: 6925528 kB' 'Inactive: 3759384 kB' 'Active(anon): 6524868 kB' 'Inactive(anon): 0 kB' 'Active(file): 400660 kB' 'Inactive(file): 3759384 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 460656 kB' 'Mapped: 180992 kB' 'Shmem: 6067496 kB' 'KReclaimable: 176572 kB' 'Slab: 662192 kB' 'SReclaimable: 176572 kB' 'SUnreclaim: 485620 kB' 'KernelStack: 12848 kB' 'PageTables: 7884 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 7599108 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1640028 kB' 'DirectMap2M: 15056896 kB' 'DirectMap1G: 53477376 kB' 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.259 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.259 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:50.260 02:05:17 -- setup/common.sh@33 -- # echo 1024 00:02:50.260 02:05:17 -- setup/common.sh@33 -- # return 0 00:02:50.260 02:05:17 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:50.260 02:05:17 -- setup/hugepages.sh@112 -- # get_nodes 00:02:50.260 02:05:17 -- setup/hugepages.sh@27 -- # local node 00:02:50.260 02:05:17 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:50.260 02:05:17 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:50.260 02:05:17 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:50.260 02:05:17 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:50.260 02:05:17 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:50.260 02:05:17 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:50.260 02:05:17 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:50.260 02:05:17 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:50.260 02:05:17 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:50.260 02:05:17 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:50.260 02:05:17 -- setup/common.sh@18 -- # local node=0 00:02:50.260 02:05:17 -- setup/common.sh@19 -- # local var val 00:02:50.260 02:05:17 -- setup/common.sh@20 -- # local mem_f mem 00:02:50.260 02:05:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:50.260 02:05:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:50.260 02:05:17 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:50.260 02:05:17 -- setup/common.sh@28 -- # mapfile -t mem 00:02:50.260 02:05:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 28365020 kB' 'MemUsed: 4460836 kB' 'SwapCached: 0 kB' 'Active: 2192376 kB' 'Inactive: 183308 kB' 'Active(anon): 2018128 kB' 'Inactive(anon): 0 kB' 'Active(file): 174248 kB' 'Inactive(file): 183308 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2248092 kB' 'Mapped: 78980 kB' 'AnonPages: 130672 kB' 'Shmem: 1890536 kB' 'KernelStack: 6984 kB' 'PageTables: 3280 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 89544 kB' 'Slab: 378108 kB' 'SReclaimable: 89544 kB' 'SUnreclaim: 288564 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@33 -- # echo 0 00:02:50.260 02:05:17 -- setup/common.sh@33 -- # return 0 00:02:50.260 02:05:17 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:50.260 02:05:17 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:50.260 02:05:17 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:50.260 02:05:17 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:02:50.260 02:05:17 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:50.260 02:05:17 -- setup/common.sh@18 -- # local node=1 00:02:50.260 02:05:17 -- setup/common.sh@19 -- # local var val 00:02:50.260 02:05:17 -- setup/common.sh@20 -- # local mem_f mem 00:02:50.260 02:05:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:50.260 02:05:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:02:50.260 02:05:17 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:02:50.260 02:05:17 -- setup/common.sh@28 -- # mapfile -t mem 00:02:50.260 02:05:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709800 kB' 'MemFree: 17421284 kB' 'MemUsed: 10288516 kB' 'SwapCached: 0 kB' 'Active: 4733104 kB' 'Inactive: 3576076 kB' 'Active(anon): 4506692 kB' 'Inactive(anon): 0 kB' 'Active(file): 226412 kB' 'Inactive(file): 3576076 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7979476 kB' 'Mapped: 102012 kB' 'AnonPages: 329888 kB' 'Shmem: 4176988 kB' 'KernelStack: 5832 kB' 'PageTables: 4500 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 87028 kB' 'Slab: 284084 kB' 'SReclaimable: 87028 kB' 'SUnreclaim: 197056 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.260 02:05:17 -- setup/common.sh@32 -- # continue 00:02:50.260 02:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.260 02:05:18 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.260 02:05:18 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.261 02:05:18 -- setup/common.sh@32 -- # continue 00:02:50.261 02:05:18 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.261 02:05:18 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.261 02:05:18 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.261 02:05:18 -- setup/common.sh@32 -- # continue 00:02:50.261 02:05:18 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.261 02:05:18 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.261 02:05:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.261 02:05:18 -- setup/common.sh@32 -- # continue 00:02:50.261 02:05:18 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.261 02:05:18 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.261 02:05:18 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.261 02:05:18 -- setup/common.sh@32 -- # continue 00:02:50.261 02:05:18 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.261 02:05:18 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.261 02:05:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.261 02:05:18 -- setup/common.sh@32 -- # continue 00:02:50.261 02:05:18 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.261 02:05:18 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.261 02:05:18 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.261 02:05:18 -- setup/common.sh@32 -- # continue 00:02:50.261 02:05:18 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.261 02:05:18 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.261 02:05:18 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.261 02:05:18 -- setup/common.sh@32 -- # continue 00:02:50.261 02:05:18 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.261 02:05:18 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.261 02:05:18 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.261 02:05:18 -- setup/common.sh@32 -- # continue 00:02:50.261 02:05:18 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.261 02:05:18 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.261 02:05:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.261 02:05:18 -- setup/common.sh@32 -- # continue 00:02:50.261 02:05:18 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.261 02:05:18 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.261 02:05:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.261 02:05:18 -- setup/common.sh@32 -- # continue 00:02:50.261 02:05:18 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.261 02:05:18 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.261 02:05:18 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.261 02:05:18 -- setup/common.sh@32 -- # continue 00:02:50.261 02:05:18 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.261 02:05:18 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.261 02:05:18 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.261 02:05:18 -- setup/common.sh@32 -- # continue 00:02:50.261 02:05:18 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.261 02:05:18 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.261 02:05:18 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.261 02:05:18 -- setup/common.sh@32 -- # continue 00:02:50.261 02:05:18 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.261 02:05:18 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.261 02:05:18 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.261 02:05:18 -- setup/common.sh@32 -- # continue 00:02:50.261 02:05:18 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.261 02:05:18 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.261 02:05:18 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.261 02:05:18 -- setup/common.sh@32 -- # continue 00:02:50.261 02:05:18 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.261 02:05:18 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.261 02:05:18 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.261 02:05:18 -- setup/common.sh@32 -- # continue 00:02:50.261 02:05:18 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.261 02:05:18 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.261 02:05:18 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.261 02:05:18 -- setup/common.sh@32 -- # continue 00:02:50.261 02:05:18 -- setup/common.sh@31 -- # IFS=': ' 00:02:50.261 02:05:18 -- setup/common.sh@31 -- # read -r var val _ 00:02:50.261 02:05:18 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:50.261 02:05:18 -- setup/common.sh@33 -- # echo 0 00:02:50.261 02:05:18 -- setup/common.sh@33 -- # return 0 00:02:50.261 02:05:18 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:50.261 02:05:18 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:50.261 02:05:18 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:50.261 02:05:18 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:50.261 02:05:18 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:02:50.261 node0=512 expecting 512 00:02:50.261 02:05:18 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:50.261 02:05:18 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:50.261 02:05:18 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:50.261 02:05:18 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:02:50.261 node1=512 expecting 512 00:02:50.261 02:05:18 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:02:50.261 00:02:50.261 real 0m1.434s 00:02:50.261 user 0m0.582s 00:02:50.261 sys 0m0.818s 00:02:50.261 02:05:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:50.261 02:05:18 -- common/autotest_common.sh@10 -- # set +x 00:02:50.261 ************************************ 00:02:50.261 END TEST even_2G_alloc 00:02:50.261 ************************************ 00:02:50.519 02:05:18 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:02:50.519 02:05:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:50.519 02:05:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:50.519 02:05:18 -- common/autotest_common.sh@10 -- # set +x 00:02:50.519 ************************************ 00:02:50.519 START TEST odd_alloc 00:02:50.519 ************************************ 00:02:50.519 02:05:18 -- common/autotest_common.sh@1114 -- # odd_alloc 00:02:50.519 02:05:18 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:02:50.519 02:05:18 -- setup/hugepages.sh@49 -- # local size=2098176 00:02:50.519 02:05:18 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:02:50.519 02:05:18 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:50.519 02:05:18 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:02:50.519 02:05:18 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:02:50.519 02:05:18 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:50.519 02:05:18 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:50.519 02:05:18 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:02:50.519 02:05:18 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:50.519 02:05:18 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:50.519 02:05:18 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:50.519 02:05:18 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:50.519 02:05:18 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:02:50.519 02:05:18 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:50.519 02:05:18 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:02:50.519 02:05:18 -- setup/hugepages.sh@83 -- # : 513 00:02:50.519 02:05:18 -- setup/hugepages.sh@84 -- # : 1 00:02:50.519 02:05:18 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:50.519 02:05:18 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:02:50.519 02:05:18 -- setup/hugepages.sh@83 -- # : 0 00:02:50.519 02:05:18 -- setup/hugepages.sh@84 -- # : 0 00:02:50.519 02:05:18 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:50.519 02:05:18 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:02:50.519 02:05:18 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:02:50.519 02:05:18 -- setup/hugepages.sh@160 -- # setup output 00:02:50.519 02:05:18 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:50.519 02:05:18 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:51.456 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:51.456 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:51.456 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:51.456 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:51.456 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:51.456 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:51.456 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:51.456 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:51.456 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:51.456 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:51.456 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:51.456 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:51.456 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:51.456 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:51.456 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:51.456 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:51.456 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:51.720 02:05:19 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:02:51.720 02:05:19 -- setup/hugepages.sh@89 -- # local node 00:02:51.720 02:05:19 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:51.720 02:05:19 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:51.720 02:05:19 -- setup/hugepages.sh@92 -- # local surp 00:02:51.720 02:05:19 -- setup/hugepages.sh@93 -- # local resv 00:02:51.720 02:05:19 -- setup/hugepages.sh@94 -- # local anon 00:02:51.720 02:05:19 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:51.720 02:05:19 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:51.720 02:05:19 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:51.720 02:05:19 -- setup/common.sh@18 -- # local node= 00:02:51.720 02:05:19 -- setup/common.sh@19 -- # local var val 00:02:51.720 02:05:19 -- setup/common.sh@20 -- # local mem_f mem 00:02:51.720 02:05:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:51.720 02:05:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:51.720 02:05:19 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:51.720 02:05:19 -- setup/common.sh@28 -- # mapfile -t mem 00:02:51.720 02:05:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:51.720 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.720 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.720 02:05:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45830160 kB' 'MemAvailable: 49584912 kB' 'Buffers: 3740 kB' 'Cached: 10223864 kB' 'SwapCached: 0 kB' 'Active: 6923104 kB' 'Inactive: 3759384 kB' 'Active(anon): 6522444 kB' 'Inactive(anon): 0 kB' 'Active(file): 400660 kB' 'Inactive(file): 3759384 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 458560 kB' 'Mapped: 179984 kB' 'Shmem: 6067560 kB' 'KReclaimable: 176572 kB' 'Slab: 661860 kB' 'SReclaimable: 176572 kB' 'SUnreclaim: 485288 kB' 'KernelStack: 12784 kB' 'PageTables: 7532 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606832 kB' 'Committed_AS: 7583788 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1640028 kB' 'DirectMap2M: 15056896 kB' 'DirectMap1G: 53477376 kB' 00:02:51.720 02:05:19 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.720 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.720 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.720 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.720 02:05:19 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.720 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.720 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.720 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.720 02:05:19 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.720 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.720 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.720 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.720 02:05:19 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.720 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.720 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.720 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.720 02:05:19 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.720 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.720 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.720 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.720 02:05:19 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.720 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.720 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.720 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.720 02:05:19 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.720 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.720 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.720 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.720 02:05:19 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.720 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.720 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.720 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.720 02:05:19 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.720 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.720 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.720 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.720 02:05:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.720 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.720 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.720 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.720 02:05:19 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.720 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.720 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.720 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.720 02:05:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.720 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.720 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.720 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.720 02:05:19 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:51.721 02:05:19 -- setup/common.sh@33 -- # echo 0 00:02:51.721 02:05:19 -- setup/common.sh@33 -- # return 0 00:02:51.721 02:05:19 -- setup/hugepages.sh@97 -- # anon=0 00:02:51.721 02:05:19 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:51.721 02:05:19 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:51.721 02:05:19 -- setup/common.sh@18 -- # local node= 00:02:51.721 02:05:19 -- setup/common.sh@19 -- # local var val 00:02:51.721 02:05:19 -- setup/common.sh@20 -- # local mem_f mem 00:02:51.721 02:05:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:51.721 02:05:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:51.721 02:05:19 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:51.721 02:05:19 -- setup/common.sh@28 -- # mapfile -t mem 00:02:51.721 02:05:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.721 02:05:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45830964 kB' 'MemAvailable: 49585716 kB' 'Buffers: 3740 kB' 'Cached: 10223864 kB' 'SwapCached: 0 kB' 'Active: 6923528 kB' 'Inactive: 3759384 kB' 'Active(anon): 6522868 kB' 'Inactive(anon): 0 kB' 'Active(file): 400660 kB' 'Inactive(file): 3759384 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 458552 kB' 'Mapped: 179984 kB' 'Shmem: 6067560 kB' 'KReclaimable: 176572 kB' 'Slab: 661844 kB' 'SReclaimable: 176572 kB' 'SUnreclaim: 485272 kB' 'KernelStack: 12768 kB' 'PageTables: 7464 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606832 kB' 'Committed_AS: 7583800 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1640028 kB' 'DirectMap2M: 15056896 kB' 'DirectMap1G: 53477376 kB' 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.721 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.721 02:05:19 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.722 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.722 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.723 02:05:19 -- setup/common.sh@33 -- # echo 0 00:02:51.723 02:05:19 -- setup/common.sh@33 -- # return 0 00:02:51.723 02:05:19 -- setup/hugepages.sh@99 -- # surp=0 00:02:51.723 02:05:19 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:51.723 02:05:19 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:51.723 02:05:19 -- setup/common.sh@18 -- # local node= 00:02:51.723 02:05:19 -- setup/common.sh@19 -- # local var val 00:02:51.723 02:05:19 -- setup/common.sh@20 -- # local mem_f mem 00:02:51.723 02:05:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:51.723 02:05:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:51.723 02:05:19 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:51.723 02:05:19 -- setup/common.sh@28 -- # mapfile -t mem 00:02:51.723 02:05:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.723 02:05:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45832428 kB' 'MemAvailable: 49587180 kB' 'Buffers: 3740 kB' 'Cached: 10223876 kB' 'SwapCached: 0 kB' 'Active: 6923288 kB' 'Inactive: 3759384 kB' 'Active(anon): 6522628 kB' 'Inactive(anon): 0 kB' 'Active(file): 400660 kB' 'Inactive(file): 3759384 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 458300 kB' 'Mapped: 180060 kB' 'Shmem: 6067572 kB' 'KReclaimable: 176572 kB' 'Slab: 661924 kB' 'SReclaimable: 176572 kB' 'SUnreclaim: 485352 kB' 'KernelStack: 12800 kB' 'PageTables: 7588 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606832 kB' 'Committed_AS: 7583816 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1640028 kB' 'DirectMap2M: 15056896 kB' 'DirectMap1G: 53477376 kB' 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.723 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.723 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:51.724 02:05:19 -- setup/common.sh@33 -- # echo 0 00:02:51.724 02:05:19 -- setup/common.sh@33 -- # return 0 00:02:51.724 02:05:19 -- setup/hugepages.sh@100 -- # resv=0 00:02:51.724 02:05:19 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:02:51.724 nr_hugepages=1025 00:02:51.724 02:05:19 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:51.724 resv_hugepages=0 00:02:51.724 02:05:19 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:51.724 surplus_hugepages=0 00:02:51.724 02:05:19 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:51.724 anon_hugepages=0 00:02:51.724 02:05:19 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:02:51.724 02:05:19 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:02:51.724 02:05:19 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:51.724 02:05:19 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:51.724 02:05:19 -- setup/common.sh@18 -- # local node= 00:02:51.724 02:05:19 -- setup/common.sh@19 -- # local var val 00:02:51.724 02:05:19 -- setup/common.sh@20 -- # local mem_f mem 00:02:51.724 02:05:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:51.724 02:05:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:51.724 02:05:19 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:51.724 02:05:19 -- setup/common.sh@28 -- # mapfile -t mem 00:02:51.724 02:05:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.724 02:05:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45833008 kB' 'MemAvailable: 49587760 kB' 'Buffers: 3740 kB' 'Cached: 10223888 kB' 'SwapCached: 0 kB' 'Active: 6922516 kB' 'Inactive: 3759384 kB' 'Active(anon): 6521856 kB' 'Inactive(anon): 0 kB' 'Active(file): 400660 kB' 'Inactive(file): 3759384 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 457484 kB' 'Mapped: 179984 kB' 'Shmem: 6067584 kB' 'KReclaimable: 176572 kB' 'Slab: 661904 kB' 'SReclaimable: 176572 kB' 'SUnreclaim: 485332 kB' 'KernelStack: 12784 kB' 'PageTables: 7532 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606832 kB' 'Committed_AS: 7583828 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1640028 kB' 'DirectMap2M: 15056896 kB' 'DirectMap1G: 53477376 kB' 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.724 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.724 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.725 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.725 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:51.726 02:05:19 -- setup/common.sh@33 -- # echo 1025 00:02:51.726 02:05:19 -- setup/common.sh@33 -- # return 0 00:02:51.726 02:05:19 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:02:51.726 02:05:19 -- setup/hugepages.sh@112 -- # get_nodes 00:02:51.726 02:05:19 -- setup/hugepages.sh@27 -- # local node 00:02:51.726 02:05:19 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:51.726 02:05:19 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:51.726 02:05:19 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:51.726 02:05:19 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:02:51.726 02:05:19 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:51.726 02:05:19 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:51.726 02:05:19 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:51.726 02:05:19 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:51.726 02:05:19 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:51.726 02:05:19 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:51.726 02:05:19 -- setup/common.sh@18 -- # local node=0 00:02:51.726 02:05:19 -- setup/common.sh@19 -- # local var val 00:02:51.726 02:05:19 -- setup/common.sh@20 -- # local mem_f mem 00:02:51.726 02:05:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:51.726 02:05:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:51.726 02:05:19 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:51.726 02:05:19 -- setup/common.sh@28 -- # mapfile -t mem 00:02:51.726 02:05:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.726 02:05:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 28399436 kB' 'MemUsed: 4426420 kB' 'SwapCached: 0 kB' 'Active: 2190652 kB' 'Inactive: 183308 kB' 'Active(anon): 2016404 kB' 'Inactive(anon): 0 kB' 'Active(file): 174248 kB' 'Inactive(file): 183308 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2248136 kB' 'Mapped: 78540 kB' 'AnonPages: 128988 kB' 'Shmem: 1890580 kB' 'KernelStack: 6952 kB' 'PageTables: 3156 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 89544 kB' 'Slab: 378040 kB' 'SReclaimable: 89544 kB' 'SUnreclaim: 288496 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.726 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.726 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.727 02:05:19 -- setup/common.sh@33 -- # echo 0 00:02:51.727 02:05:19 -- setup/common.sh@33 -- # return 0 00:02:51.727 02:05:19 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:51.727 02:05:19 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:51.727 02:05:19 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:51.727 02:05:19 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:02:51.727 02:05:19 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:51.727 02:05:19 -- setup/common.sh@18 -- # local node=1 00:02:51.727 02:05:19 -- setup/common.sh@19 -- # local var val 00:02:51.727 02:05:19 -- setup/common.sh@20 -- # local mem_f mem 00:02:51.727 02:05:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:51.727 02:05:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:02:51.727 02:05:19 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:02:51.727 02:05:19 -- setup/common.sh@28 -- # mapfile -t mem 00:02:51.727 02:05:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.727 02:05:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709800 kB' 'MemFree: 17433572 kB' 'MemUsed: 10276228 kB' 'SwapCached: 0 kB' 'Active: 4732032 kB' 'Inactive: 3576076 kB' 'Active(anon): 4505620 kB' 'Inactive(anon): 0 kB' 'Active(file): 226412 kB' 'Inactive(file): 3576076 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7979492 kB' 'Mapped: 101444 kB' 'AnonPages: 328660 kB' 'Shmem: 4177004 kB' 'KernelStack: 5832 kB' 'PageTables: 4376 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 87028 kB' 'Slab: 283864 kB' 'SReclaimable: 87028 kB' 'SUnreclaim: 196836 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.727 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.727 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.728 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.728 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.728 02:05:19 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.728 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.728 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.728 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.728 02:05:19 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.728 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.728 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.728 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.728 02:05:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.728 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.728 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.728 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.728 02:05:19 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.728 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.728 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.728 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.728 02:05:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.728 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.728 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.728 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.728 02:05:19 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.728 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.728 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.728 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.728 02:05:19 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.728 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.728 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.728 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.728 02:05:19 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.728 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.728 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.728 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.728 02:05:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.728 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.728 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.728 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.728 02:05:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.728 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.728 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.728 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.728 02:05:19 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.728 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.728 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.728 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.728 02:05:19 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.728 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.728 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.728 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.728 02:05:19 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.728 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.728 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.728 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.728 02:05:19 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.728 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.728 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.728 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.728 02:05:19 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.728 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.728 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.728 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.728 02:05:19 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.728 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.728 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.728 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.728 02:05:19 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.728 02:05:19 -- setup/common.sh@32 -- # continue 00:02:51.728 02:05:19 -- setup/common.sh@31 -- # IFS=': ' 00:02:51.728 02:05:19 -- setup/common.sh@31 -- # read -r var val _ 00:02:51.728 02:05:19 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:51.728 02:05:19 -- setup/common.sh@33 -- # echo 0 00:02:51.728 02:05:19 -- setup/common.sh@33 -- # return 0 00:02:51.728 02:05:19 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:51.728 02:05:19 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:51.728 02:05:19 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:51.728 02:05:19 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:51.728 02:05:19 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:02:51.728 node0=512 expecting 513 00:02:51.728 02:05:19 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:51.728 02:05:19 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:51.728 02:05:19 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:51.728 02:05:19 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:02:51.728 node1=513 expecting 512 00:02:51.728 02:05:19 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:02:51.728 00:02:51.728 real 0m1.342s 00:02:51.728 user 0m0.562s 00:02:51.728 sys 0m0.742s 00:02:51.728 02:05:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:51.728 02:05:19 -- common/autotest_common.sh@10 -- # set +x 00:02:51.728 ************************************ 00:02:51.728 END TEST odd_alloc 00:02:51.728 ************************************ 00:02:51.728 02:05:19 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:02:51.728 02:05:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:51.728 02:05:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:51.728 02:05:19 -- common/autotest_common.sh@10 -- # set +x 00:02:51.728 ************************************ 00:02:51.728 START TEST custom_alloc 00:02:51.728 ************************************ 00:02:51.728 02:05:19 -- common/autotest_common.sh@1114 -- # custom_alloc 00:02:51.728 02:05:19 -- setup/hugepages.sh@167 -- # local IFS=, 00:02:51.728 02:05:19 -- setup/hugepages.sh@169 -- # local node 00:02:51.728 02:05:19 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:02:51.728 02:05:19 -- setup/hugepages.sh@170 -- # local nodes_hp 00:02:51.728 02:05:19 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:02:51.728 02:05:19 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:02:51.728 02:05:19 -- setup/hugepages.sh@49 -- # local size=1048576 00:02:51.728 02:05:19 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:02:51.728 02:05:19 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:51.728 02:05:19 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:02:51.728 02:05:19 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:02:51.728 02:05:19 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:51.728 02:05:19 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:51.728 02:05:19 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:02:51.728 02:05:19 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:51.728 02:05:19 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:51.728 02:05:19 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:51.728 02:05:19 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:51.728 02:05:19 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:02:51.728 02:05:19 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:51.728 02:05:19 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:02:51.728 02:05:19 -- setup/hugepages.sh@83 -- # : 256 00:02:51.728 02:05:19 -- setup/hugepages.sh@84 -- # : 1 00:02:51.728 02:05:19 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:51.728 02:05:19 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:02:51.728 02:05:19 -- setup/hugepages.sh@83 -- # : 0 00:02:51.728 02:05:19 -- setup/hugepages.sh@84 -- # : 0 00:02:51.728 02:05:19 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:51.728 02:05:19 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:02:51.728 02:05:19 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:02:51.728 02:05:19 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:02:51.728 02:05:19 -- setup/hugepages.sh@49 -- # local size=2097152 00:02:51.728 02:05:19 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:02:51.728 02:05:19 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:51.728 02:05:19 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:02:51.728 02:05:19 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:02:51.728 02:05:19 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:51.728 02:05:19 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:51.728 02:05:19 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:51.728 02:05:19 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:51.728 02:05:19 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:51.728 02:05:19 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:51.728 02:05:19 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:51.728 02:05:19 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:02:51.728 02:05:19 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:02:51.728 02:05:19 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:02:51.728 02:05:19 -- setup/hugepages.sh@78 -- # return 0 00:02:51.728 02:05:19 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:02:51.728 02:05:19 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:02:51.728 02:05:19 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:02:51.728 02:05:19 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:02:51.728 02:05:19 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:02:51.728 02:05:19 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:02:51.728 02:05:19 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:02:51.728 02:05:19 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:02:51.728 02:05:19 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:51.728 02:05:19 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:51.728 02:05:19 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:51.728 02:05:19 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:51.728 02:05:19 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:51.728 02:05:19 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:51.728 02:05:19 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:51.729 02:05:19 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:02:51.729 02:05:19 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:02:51.729 02:05:19 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:02:51.729 02:05:19 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:02:51.729 02:05:19 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:02:51.729 02:05:19 -- setup/hugepages.sh@78 -- # return 0 00:02:51.729 02:05:19 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:02:51.729 02:05:19 -- setup/hugepages.sh@187 -- # setup output 00:02:51.729 02:05:19 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:51.729 02:05:19 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:53.111 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:53.111 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:53.111 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:53.111 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:53.112 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:53.112 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:53.112 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:53.112 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:53.112 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:53.112 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:53.112 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:53.112 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:53.112 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:53.112 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:53.112 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:53.112 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:53.112 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:53.112 02:05:20 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:02:53.112 02:05:20 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:02:53.112 02:05:20 -- setup/hugepages.sh@89 -- # local node 00:02:53.112 02:05:20 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:53.112 02:05:20 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:53.112 02:05:20 -- setup/hugepages.sh@92 -- # local surp 00:02:53.112 02:05:20 -- setup/hugepages.sh@93 -- # local resv 00:02:53.112 02:05:20 -- setup/hugepages.sh@94 -- # local anon 00:02:53.112 02:05:20 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:53.112 02:05:20 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:53.112 02:05:20 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:53.112 02:05:20 -- setup/common.sh@18 -- # local node= 00:02:53.112 02:05:20 -- setup/common.sh@19 -- # local var val 00:02:53.112 02:05:20 -- setup/common.sh@20 -- # local mem_f mem 00:02:53.112 02:05:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:53.112 02:05:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:53.112 02:05:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:53.112 02:05:20 -- setup/common.sh@28 -- # mapfile -t mem 00:02:53.112 02:05:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.112 02:05:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 44770616 kB' 'MemAvailable: 48525352 kB' 'Buffers: 3740 kB' 'Cached: 10223960 kB' 'SwapCached: 0 kB' 'Active: 6929536 kB' 'Inactive: 3759384 kB' 'Active(anon): 6528876 kB' 'Inactive(anon): 0 kB' 'Active(file): 400660 kB' 'Inactive(file): 3759384 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 464088 kB' 'Mapped: 180560 kB' 'Shmem: 6067656 kB' 'KReclaimable: 176540 kB' 'Slab: 661544 kB' 'SReclaimable: 176540 kB' 'SUnreclaim: 485004 kB' 'KernelStack: 12800 kB' 'PageTables: 7588 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083568 kB' 'Committed_AS: 7590136 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198380 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1640028 kB' 'DirectMap2M: 15056896 kB' 'DirectMap1G: 53477376 kB' 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.112 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.112 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.113 02:05:20 -- setup/common.sh@33 -- # echo 0 00:02:53.113 02:05:20 -- setup/common.sh@33 -- # return 0 00:02:53.113 02:05:20 -- setup/hugepages.sh@97 -- # anon=0 00:02:53.113 02:05:20 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:53.113 02:05:20 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:53.113 02:05:20 -- setup/common.sh@18 -- # local node= 00:02:53.113 02:05:20 -- setup/common.sh@19 -- # local var val 00:02:53.113 02:05:20 -- setup/common.sh@20 -- # local mem_f mem 00:02:53.113 02:05:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:53.113 02:05:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:53.113 02:05:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:53.113 02:05:20 -- setup/common.sh@28 -- # mapfile -t mem 00:02:53.113 02:05:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.113 02:05:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 44771420 kB' 'MemAvailable: 48526156 kB' 'Buffers: 3740 kB' 'Cached: 10223964 kB' 'SwapCached: 0 kB' 'Active: 6929660 kB' 'Inactive: 3759384 kB' 'Active(anon): 6529000 kB' 'Inactive(anon): 0 kB' 'Active(file): 400660 kB' 'Inactive(file): 3759384 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 464620 kB' 'Mapped: 180948 kB' 'Shmem: 6067660 kB' 'KReclaimable: 176540 kB' 'Slab: 661600 kB' 'SReclaimable: 176540 kB' 'SUnreclaim: 485060 kB' 'KernelStack: 12768 kB' 'PageTables: 7480 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083568 kB' 'Committed_AS: 7590148 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198332 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1640028 kB' 'DirectMap2M: 15056896 kB' 'DirectMap1G: 53477376 kB' 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.113 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.113 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.114 02:05:20 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.114 02:05:20 -- setup/common.sh@33 -- # echo 0 00:02:53.114 02:05:20 -- setup/common.sh@33 -- # return 0 00:02:53.114 02:05:20 -- setup/hugepages.sh@99 -- # surp=0 00:02:53.114 02:05:20 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:53.114 02:05:20 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:53.114 02:05:20 -- setup/common.sh@18 -- # local node= 00:02:53.114 02:05:20 -- setup/common.sh@19 -- # local var val 00:02:53.114 02:05:20 -- setup/common.sh@20 -- # local mem_f mem 00:02:53.114 02:05:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:53.114 02:05:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:53.114 02:05:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:53.114 02:05:20 -- setup/common.sh@28 -- # mapfile -t mem 00:02:53.114 02:05:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.114 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 44769924 kB' 'MemAvailable: 48524660 kB' 'Buffers: 3740 kB' 'Cached: 10223968 kB' 'SwapCached: 0 kB' 'Active: 6925528 kB' 'Inactive: 3759384 kB' 'Active(anon): 6524868 kB' 'Inactive(anon): 0 kB' 'Active(file): 400660 kB' 'Inactive(file): 3759384 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 460032 kB' 'Mapped: 180904 kB' 'Shmem: 6067664 kB' 'KReclaimable: 176540 kB' 'Slab: 661592 kB' 'SReclaimable: 176540 kB' 'SUnreclaim: 485052 kB' 'KernelStack: 12784 kB' 'PageTables: 7512 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083568 kB' 'Committed_AS: 7586588 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1640028 kB' 'DirectMap2M: 15056896 kB' 'DirectMap1G: 53477376 kB' 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.115 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.115 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.116 02:05:20 -- setup/common.sh@33 -- # echo 0 00:02:53.116 02:05:20 -- setup/common.sh@33 -- # return 0 00:02:53.116 02:05:20 -- setup/hugepages.sh@100 -- # resv=0 00:02:53.116 02:05:20 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:02:53.116 nr_hugepages=1536 00:02:53.116 02:05:20 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:53.116 resv_hugepages=0 00:02:53.116 02:05:20 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:53.116 surplus_hugepages=0 00:02:53.116 02:05:20 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:53.116 anon_hugepages=0 00:02:53.116 02:05:20 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:02:53.116 02:05:20 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:02:53.116 02:05:20 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:53.116 02:05:20 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:53.116 02:05:20 -- setup/common.sh@18 -- # local node= 00:02:53.116 02:05:20 -- setup/common.sh@19 -- # local var val 00:02:53.116 02:05:20 -- setup/common.sh@20 -- # local mem_f mem 00:02:53.116 02:05:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:53.116 02:05:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:53.116 02:05:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:53.116 02:05:20 -- setup/common.sh@28 -- # mapfile -t mem 00:02:53.116 02:05:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.116 02:05:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 44763312 kB' 'MemAvailable: 48518048 kB' 'Buffers: 3740 kB' 'Cached: 10223988 kB' 'SwapCached: 0 kB' 'Active: 6928320 kB' 'Inactive: 3759384 kB' 'Active(anon): 6527660 kB' 'Inactive(anon): 0 kB' 'Active(file): 400660 kB' 'Inactive(file): 3759384 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 463172 kB' 'Mapped: 180424 kB' 'Shmem: 6067684 kB' 'KReclaimable: 176540 kB' 'Slab: 661540 kB' 'SReclaimable: 176540 kB' 'SUnreclaim: 485000 kB' 'KernelStack: 12720 kB' 'PageTables: 7284 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083568 kB' 'Committed_AS: 7590176 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198348 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1640028 kB' 'DirectMap2M: 15056896 kB' 'DirectMap1G: 53477376 kB' 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.116 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.116 02:05:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.117 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.117 02:05:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.117 02:05:20 -- setup/common.sh@33 -- # echo 1536 00:02:53.117 02:05:20 -- setup/common.sh@33 -- # return 0 00:02:53.117 02:05:20 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:02:53.117 02:05:20 -- setup/hugepages.sh@112 -- # get_nodes 00:02:53.117 02:05:20 -- setup/hugepages.sh@27 -- # local node 00:02:53.117 02:05:20 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:53.117 02:05:20 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:53.117 02:05:20 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:53.117 02:05:20 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:02:53.117 02:05:20 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:53.117 02:05:20 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:53.117 02:05:20 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:53.117 02:05:20 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:53.117 02:05:20 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:53.117 02:05:20 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:53.117 02:05:20 -- setup/common.sh@18 -- # local node=0 00:02:53.118 02:05:20 -- setup/common.sh@19 -- # local var val 00:02:53.118 02:05:20 -- setup/common.sh@20 -- # local mem_f mem 00:02:53.118 02:05:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:53.118 02:05:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:53.118 02:05:20 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:53.118 02:05:20 -- setup/common.sh@28 -- # mapfile -t mem 00:02:53.118 02:05:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.118 02:05:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 28368856 kB' 'MemUsed: 4457000 kB' 'SwapCached: 0 kB' 'Active: 2196892 kB' 'Inactive: 183308 kB' 'Active(anon): 2022644 kB' 'Inactive(anon): 0 kB' 'Active(file): 174248 kB' 'Inactive(file): 183308 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2248240 kB' 'Mapped: 79348 kB' 'AnonPages: 135116 kB' 'Shmem: 1890684 kB' 'KernelStack: 6920 kB' 'PageTables: 3068 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 89544 kB' 'Slab: 377800 kB' 'SReclaimable: 89544 kB' 'SUnreclaim: 288256 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.118 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.118 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.119 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.119 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.119 02:05:20 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.119 02:05:20 -- setup/common.sh@33 -- # echo 0 00:02:53.119 02:05:20 -- setup/common.sh@33 -- # return 0 00:02:53.119 02:05:20 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:53.119 02:05:20 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:53.119 02:05:20 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:53.119 02:05:20 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:02:53.119 02:05:20 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:53.119 02:05:20 -- setup/common.sh@18 -- # local node=1 00:02:53.119 02:05:20 -- setup/common.sh@19 -- # local var val 00:02:53.119 02:05:20 -- setup/common.sh@20 -- # local mem_f mem 00:02:53.119 02:05:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:53.119 02:05:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:02:53.119 02:05:20 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:02:53.119 02:05:20 -- setup/common.sh@28 -- # mapfile -t mem 00:02:53.119 02:05:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:53.119 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.119 02:05:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709800 kB' 'MemFree: 16394456 kB' 'MemUsed: 11315344 kB' 'SwapCached: 0 kB' 'Active: 4731652 kB' 'Inactive: 3576076 kB' 'Active(anon): 4505240 kB' 'Inactive(anon): 0 kB' 'Active(file): 226412 kB' 'Inactive(file): 3576076 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7979504 kB' 'Mapped: 101468 kB' 'AnonPages: 328272 kB' 'Shmem: 4177016 kB' 'KernelStack: 5800 kB' 'PageTables: 4236 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 86996 kB' 'Slab: 283740 kB' 'SReclaimable: 86996 kB' 'SUnreclaim: 196744 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:02:53.119 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.119 02:05:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.119 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.119 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.119 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.119 02:05:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.119 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.119 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.119 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.119 02:05:20 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.119 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.119 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.119 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.119 02:05:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.119 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.119 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.119 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.119 02:05:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.119 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.119 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.119 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.119 02:05:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.119 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.119 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.119 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.119 02:05:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.119 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.119 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.119 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.119 02:05:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.119 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.119 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.119 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.119 02:05:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.119 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.119 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.119 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.119 02:05:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.119 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.119 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.119 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # continue 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.379 02:05:20 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.379 02:05:20 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.379 02:05:20 -- setup/common.sh@33 -- # echo 0 00:02:53.379 02:05:20 -- setup/common.sh@33 -- # return 0 00:02:53.379 02:05:20 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:53.379 02:05:20 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:53.379 02:05:20 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:53.379 02:05:20 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:53.379 02:05:20 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:02:53.379 node0=512 expecting 512 00:02:53.379 02:05:20 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:53.379 02:05:20 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:53.380 02:05:20 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:53.380 02:05:20 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:02:53.380 node1=1024 expecting 1024 00:02:53.380 02:05:20 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:02:53.380 00:02:53.380 real 0m1.499s 00:02:53.380 user 0m0.634s 00:02:53.380 sys 0m0.832s 00:02:53.380 02:05:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:53.380 02:05:20 -- common/autotest_common.sh@10 -- # set +x 00:02:53.380 ************************************ 00:02:53.380 END TEST custom_alloc 00:02:53.380 ************************************ 00:02:53.380 02:05:20 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:02:53.380 02:05:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:53.380 02:05:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:53.380 02:05:20 -- common/autotest_common.sh@10 -- # set +x 00:02:53.380 ************************************ 00:02:53.380 START TEST no_shrink_alloc 00:02:53.380 ************************************ 00:02:53.380 02:05:20 -- common/autotest_common.sh@1114 -- # no_shrink_alloc 00:02:53.380 02:05:20 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:02:53.380 02:05:20 -- setup/hugepages.sh@49 -- # local size=2097152 00:02:53.380 02:05:20 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:02:53.380 02:05:20 -- setup/hugepages.sh@51 -- # shift 00:02:53.380 02:05:20 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:02:53.380 02:05:20 -- setup/hugepages.sh@52 -- # local node_ids 00:02:53.380 02:05:20 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:53.380 02:05:20 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:02:53.380 02:05:20 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:02:53.380 02:05:20 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:02:53.380 02:05:20 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:53.380 02:05:20 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:53.380 02:05:20 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:53.380 02:05:20 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:53.380 02:05:20 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:53.380 02:05:20 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:02:53.380 02:05:20 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:53.380 02:05:20 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:02:53.380 02:05:20 -- setup/hugepages.sh@73 -- # return 0 00:02:53.380 02:05:20 -- setup/hugepages.sh@198 -- # setup output 00:02:53.380 02:05:20 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:53.380 02:05:20 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:54.315 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:54.315 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:54.315 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:54.315 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:54.315 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:54.315 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:54.315 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:54.315 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:54.315 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:54.316 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:54.316 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:54.316 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:54.316 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:54.316 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:54.316 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:54.316 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:54.316 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:54.580 02:05:22 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:02:54.580 02:05:22 -- setup/hugepages.sh@89 -- # local node 00:02:54.580 02:05:22 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:54.580 02:05:22 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:54.580 02:05:22 -- setup/hugepages.sh@92 -- # local surp 00:02:54.580 02:05:22 -- setup/hugepages.sh@93 -- # local resv 00:02:54.580 02:05:22 -- setup/hugepages.sh@94 -- # local anon 00:02:54.580 02:05:22 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:54.580 02:05:22 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:54.580 02:05:22 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:54.580 02:05:22 -- setup/common.sh@18 -- # local node= 00:02:54.580 02:05:22 -- setup/common.sh@19 -- # local var val 00:02:54.580 02:05:22 -- setup/common.sh@20 -- # local mem_f mem 00:02:54.580 02:05:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:54.580 02:05:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:54.580 02:05:22 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:54.580 02:05:22 -- setup/common.sh@28 -- # mapfile -t mem 00:02:54.580 02:05:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.580 02:05:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45749520 kB' 'MemAvailable: 49504256 kB' 'Buffers: 3740 kB' 'Cached: 10224056 kB' 'SwapCached: 0 kB' 'Active: 6923844 kB' 'Inactive: 3759384 kB' 'Active(anon): 6523184 kB' 'Inactive(anon): 0 kB' 'Active(file): 400660 kB' 'Inactive(file): 3759384 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 458652 kB' 'Mapped: 180080 kB' 'Shmem: 6067752 kB' 'KReclaimable: 176540 kB' 'Slab: 661564 kB' 'SReclaimable: 176540 kB' 'SUnreclaim: 485024 kB' 'KernelStack: 12768 kB' 'PageTables: 7408 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 7584244 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1640028 kB' 'DirectMap2M: 15056896 kB' 'DirectMap1G: 53477376 kB' 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.580 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.580 02:05:22 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:54.581 02:05:22 -- setup/common.sh@33 -- # echo 0 00:02:54.581 02:05:22 -- setup/common.sh@33 -- # return 0 00:02:54.581 02:05:22 -- setup/hugepages.sh@97 -- # anon=0 00:02:54.581 02:05:22 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:54.581 02:05:22 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:54.581 02:05:22 -- setup/common.sh@18 -- # local node= 00:02:54.581 02:05:22 -- setup/common.sh@19 -- # local var val 00:02:54.581 02:05:22 -- setup/common.sh@20 -- # local mem_f mem 00:02:54.581 02:05:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:54.581 02:05:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:54.581 02:05:22 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:54.581 02:05:22 -- setup/common.sh@28 -- # mapfile -t mem 00:02:54.581 02:05:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.581 02:05:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45750144 kB' 'MemAvailable: 49504880 kB' 'Buffers: 3740 kB' 'Cached: 10224056 kB' 'SwapCached: 0 kB' 'Active: 6924208 kB' 'Inactive: 3759384 kB' 'Active(anon): 6523548 kB' 'Inactive(anon): 0 kB' 'Active(file): 400660 kB' 'Inactive(file): 3759384 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 459056 kB' 'Mapped: 180080 kB' 'Shmem: 6067752 kB' 'KReclaimable: 176540 kB' 'Slab: 661564 kB' 'SReclaimable: 176540 kB' 'SUnreclaim: 485024 kB' 'KernelStack: 12768 kB' 'PageTables: 7416 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 7584256 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1640028 kB' 'DirectMap2M: 15056896 kB' 'DirectMap1G: 53477376 kB' 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.581 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.581 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.582 02:05:22 -- setup/common.sh@33 -- # echo 0 00:02:54.582 02:05:22 -- setup/common.sh@33 -- # return 0 00:02:54.582 02:05:22 -- setup/hugepages.sh@99 -- # surp=0 00:02:54.582 02:05:22 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:54.582 02:05:22 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:54.582 02:05:22 -- setup/common.sh@18 -- # local node= 00:02:54.582 02:05:22 -- setup/common.sh@19 -- # local var val 00:02:54.582 02:05:22 -- setup/common.sh@20 -- # local mem_f mem 00:02:54.582 02:05:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:54.582 02:05:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:54.582 02:05:22 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:54.582 02:05:22 -- setup/common.sh@28 -- # mapfile -t mem 00:02:54.582 02:05:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.582 02:05:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45750368 kB' 'MemAvailable: 49505104 kB' 'Buffers: 3740 kB' 'Cached: 10224060 kB' 'SwapCached: 0 kB' 'Active: 6923444 kB' 'Inactive: 3759384 kB' 'Active(anon): 6522784 kB' 'Inactive(anon): 0 kB' 'Active(file): 400660 kB' 'Inactive(file): 3759384 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 458336 kB' 'Mapped: 180072 kB' 'Shmem: 6067756 kB' 'KReclaimable: 176540 kB' 'Slab: 661564 kB' 'SReclaimable: 176540 kB' 'SUnreclaim: 485024 kB' 'KernelStack: 12800 kB' 'PageTables: 7408 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 7584272 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1640028 kB' 'DirectMap2M: 15056896 kB' 'DirectMap1G: 53477376 kB' 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.582 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.582 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.583 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.583 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:54.584 02:05:22 -- setup/common.sh@33 -- # echo 0 00:02:54.584 02:05:22 -- setup/common.sh@33 -- # return 0 00:02:54.584 02:05:22 -- setup/hugepages.sh@100 -- # resv=0 00:02:54.584 02:05:22 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:54.584 nr_hugepages=1024 00:02:54.584 02:05:22 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:54.584 resv_hugepages=0 00:02:54.584 02:05:22 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:54.584 surplus_hugepages=0 00:02:54.584 02:05:22 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:54.584 anon_hugepages=0 00:02:54.584 02:05:22 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:54.584 02:05:22 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:54.584 02:05:22 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:54.584 02:05:22 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:54.584 02:05:22 -- setup/common.sh@18 -- # local node= 00:02:54.584 02:05:22 -- setup/common.sh@19 -- # local var val 00:02:54.584 02:05:22 -- setup/common.sh@20 -- # local mem_f mem 00:02:54.584 02:05:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:54.584 02:05:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:54.584 02:05:22 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:54.584 02:05:22 -- setup/common.sh@28 -- # mapfile -t mem 00:02:54.584 02:05:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.584 02:05:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45750644 kB' 'MemAvailable: 49505380 kB' 'Buffers: 3740 kB' 'Cached: 10224084 kB' 'SwapCached: 0 kB' 'Active: 6923448 kB' 'Inactive: 3759384 kB' 'Active(anon): 6522788 kB' 'Inactive(anon): 0 kB' 'Active(file): 400660 kB' 'Inactive(file): 3759384 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 458192 kB' 'Mapped: 179996 kB' 'Shmem: 6067780 kB' 'KReclaimable: 176540 kB' 'Slab: 661548 kB' 'SReclaimable: 176540 kB' 'SUnreclaim: 485008 kB' 'KernelStack: 12848 kB' 'PageTables: 7536 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 7584288 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1640028 kB' 'DirectMap2M: 15056896 kB' 'DirectMap1G: 53477376 kB' 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.584 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.584 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.585 02:05:22 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:54.585 02:05:22 -- setup/common.sh@33 -- # echo 1024 00:02:54.585 02:05:22 -- setup/common.sh@33 -- # return 0 00:02:54.585 02:05:22 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:54.585 02:05:22 -- setup/hugepages.sh@112 -- # get_nodes 00:02:54.585 02:05:22 -- setup/hugepages.sh@27 -- # local node 00:02:54.585 02:05:22 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:54.585 02:05:22 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:02:54.585 02:05:22 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:54.585 02:05:22 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:02:54.585 02:05:22 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:54.585 02:05:22 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:54.585 02:05:22 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:54.585 02:05:22 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:54.585 02:05:22 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:54.585 02:05:22 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:54.585 02:05:22 -- setup/common.sh@18 -- # local node=0 00:02:54.585 02:05:22 -- setup/common.sh@19 -- # local var val 00:02:54.585 02:05:22 -- setup/common.sh@20 -- # local mem_f mem 00:02:54.585 02:05:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:54.585 02:05:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:54.585 02:05:22 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:54.585 02:05:22 -- setup/common.sh@28 -- # mapfile -t mem 00:02:54.585 02:05:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.585 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.585 02:05:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27304944 kB' 'MemUsed: 5520912 kB' 'SwapCached: 0 kB' 'Active: 2190792 kB' 'Inactive: 183308 kB' 'Active(anon): 2016544 kB' 'Inactive(anon): 0 kB' 'Active(file): 174248 kB' 'Inactive(file): 183308 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2248324 kB' 'Mapped: 78552 kB' 'AnonPages: 128920 kB' 'Shmem: 1890768 kB' 'KernelStack: 7000 kB' 'PageTables: 3104 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 89544 kB' 'Slab: 377576 kB' 'SReclaimable: 89544 kB' 'SUnreclaim: 288032 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # continue 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # IFS=': ' 00:02:54.586 02:05:22 -- setup/common.sh@31 -- # read -r var val _ 00:02:54.586 02:05:22 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:54.586 02:05:22 -- setup/common.sh@33 -- # echo 0 00:02:54.586 02:05:22 -- setup/common.sh@33 -- # return 0 00:02:54.586 02:05:22 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:54.586 02:05:22 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:54.586 02:05:22 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:54.586 02:05:22 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:54.586 02:05:22 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:02:54.586 node0=1024 expecting 1024 00:02:54.586 02:05:22 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:02:54.586 02:05:22 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:02:54.586 02:05:22 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:02:54.586 02:05:22 -- setup/hugepages.sh@202 -- # setup output 00:02:54.586 02:05:22 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:54.586 02:05:22 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:55.964 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:55.964 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:55.964 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:55.964 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:55.964 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:55.964 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:55.964 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:55.964 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:55.964 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:55.964 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:55.964 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:55.964 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:55.964 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:55.964 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:55.964 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:55.964 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:55.964 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:55.964 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:02:55.964 02:05:23 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:02:55.964 02:05:23 -- setup/hugepages.sh@89 -- # local node 00:02:55.964 02:05:23 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:55.964 02:05:23 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:55.964 02:05:23 -- setup/hugepages.sh@92 -- # local surp 00:02:55.964 02:05:23 -- setup/hugepages.sh@93 -- # local resv 00:02:55.964 02:05:23 -- setup/hugepages.sh@94 -- # local anon 00:02:55.964 02:05:23 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:55.964 02:05:23 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:55.964 02:05:23 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:55.964 02:05:23 -- setup/common.sh@18 -- # local node= 00:02:55.964 02:05:23 -- setup/common.sh@19 -- # local var val 00:02:55.964 02:05:23 -- setup/common.sh@20 -- # local mem_f mem 00:02:55.964 02:05:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:55.964 02:05:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:55.964 02:05:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:55.964 02:05:23 -- setup/common.sh@28 -- # mapfile -t mem 00:02:55.964 02:05:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:55.964 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.964 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.964 02:05:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45739848 kB' 'MemAvailable: 49494584 kB' 'Buffers: 3740 kB' 'Cached: 10224132 kB' 'SwapCached: 0 kB' 'Active: 6923728 kB' 'Inactive: 3759384 kB' 'Active(anon): 6523068 kB' 'Inactive(anon): 0 kB' 'Active(file): 400660 kB' 'Inactive(file): 3759384 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 458360 kB' 'Mapped: 180000 kB' 'Shmem: 6067828 kB' 'KReclaimable: 176540 kB' 'Slab: 661440 kB' 'SReclaimable: 176540 kB' 'SUnreclaim: 484900 kB' 'KernelStack: 12848 kB' 'PageTables: 7456 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 7584320 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198472 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1640028 kB' 'DirectMap2M: 15056896 kB' 'DirectMap1G: 53477376 kB' 00:02:55.964 02:05:23 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.964 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.964 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.964 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.964 02:05:23 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.964 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.964 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.964 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.964 02:05:23 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.964 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.964 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.964 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.964 02:05:23 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.964 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.965 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.965 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.966 02:05:23 -- setup/common.sh@33 -- # echo 0 00:02:55.966 02:05:23 -- setup/common.sh@33 -- # return 0 00:02:55.966 02:05:23 -- setup/hugepages.sh@97 -- # anon=0 00:02:55.966 02:05:23 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:55.966 02:05:23 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:55.966 02:05:23 -- setup/common.sh@18 -- # local node= 00:02:55.966 02:05:23 -- setup/common.sh@19 -- # local var val 00:02:55.966 02:05:23 -- setup/common.sh@20 -- # local mem_f mem 00:02:55.966 02:05:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:55.966 02:05:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:55.966 02:05:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:55.966 02:05:23 -- setup/common.sh@28 -- # mapfile -t mem 00:02:55.966 02:05:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.966 02:05:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45740152 kB' 'MemAvailable: 49494888 kB' 'Buffers: 3740 kB' 'Cached: 10224136 kB' 'SwapCached: 0 kB' 'Active: 6924024 kB' 'Inactive: 3759384 kB' 'Active(anon): 6523364 kB' 'Inactive(anon): 0 kB' 'Active(file): 400660 kB' 'Inactive(file): 3759384 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 458668 kB' 'Mapped: 180000 kB' 'Shmem: 6067832 kB' 'KReclaimable: 176540 kB' 'Slab: 661432 kB' 'SReclaimable: 176540 kB' 'SUnreclaim: 484892 kB' 'KernelStack: 12816 kB' 'PageTables: 7348 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 7584332 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198440 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1640028 kB' 'DirectMap2M: 15056896 kB' 'DirectMap1G: 53477376 kB' 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.966 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.966 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.967 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.967 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.968 02:05:23 -- setup/common.sh@33 -- # echo 0 00:02:55.968 02:05:23 -- setup/common.sh@33 -- # return 0 00:02:55.968 02:05:23 -- setup/hugepages.sh@99 -- # surp=0 00:02:55.968 02:05:23 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:55.968 02:05:23 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:55.968 02:05:23 -- setup/common.sh@18 -- # local node= 00:02:55.968 02:05:23 -- setup/common.sh@19 -- # local var val 00:02:55.968 02:05:23 -- setup/common.sh@20 -- # local mem_f mem 00:02:55.968 02:05:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:55.968 02:05:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:55.968 02:05:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:55.968 02:05:23 -- setup/common.sh@28 -- # mapfile -t mem 00:02:55.968 02:05:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.968 02:05:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45740432 kB' 'MemAvailable: 49495168 kB' 'Buffers: 3740 kB' 'Cached: 10224140 kB' 'SwapCached: 0 kB' 'Active: 6923984 kB' 'Inactive: 3759384 kB' 'Active(anon): 6523324 kB' 'Inactive(anon): 0 kB' 'Active(file): 400660 kB' 'Inactive(file): 3759384 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 458628 kB' 'Mapped: 180008 kB' 'Shmem: 6067836 kB' 'KReclaimable: 176540 kB' 'Slab: 661432 kB' 'SReclaimable: 176540 kB' 'SUnreclaim: 484892 kB' 'KernelStack: 12864 kB' 'PageTables: 7468 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 7584348 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198440 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1640028 kB' 'DirectMap2M: 15056896 kB' 'DirectMap1G: 53477376 kB' 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.968 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.968 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.969 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.969 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.970 02:05:23 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.970 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.970 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.970 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.970 02:05:23 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.970 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.970 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.970 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.970 02:05:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.970 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.970 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.970 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.970 02:05:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.970 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.970 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.970 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.970 02:05:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.970 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.970 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.970 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.970 02:05:23 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.970 02:05:23 -- setup/common.sh@33 -- # echo 0 00:02:55.970 02:05:23 -- setup/common.sh@33 -- # return 0 00:02:55.970 02:05:23 -- setup/hugepages.sh@100 -- # resv=0 00:02:55.970 02:05:23 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:55.970 nr_hugepages=1024 00:02:55.970 02:05:23 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:55.970 resv_hugepages=0 00:02:55.970 02:05:23 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:55.970 surplus_hugepages=0 00:02:55.970 02:05:23 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:55.970 anon_hugepages=0 00:02:55.970 02:05:23 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:55.970 02:05:23 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:55.970 02:05:23 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:55.970 02:05:23 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:55.970 02:05:23 -- setup/common.sh@18 -- # local node= 00:02:55.970 02:05:23 -- setup/common.sh@19 -- # local var val 00:02:55.970 02:05:23 -- setup/common.sh@20 -- # local mem_f mem 00:02:55.970 02:05:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:55.970 02:05:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:55.970 02:05:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:55.970 02:05:23 -- setup/common.sh@28 -- # mapfile -t mem 00:02:55.970 02:05:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:55.970 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.970 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.970 02:05:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535656 kB' 'MemFree: 45740432 kB' 'MemAvailable: 49495168 kB' 'Buffers: 3740 kB' 'Cached: 10224140 kB' 'SwapCached: 0 kB' 'Active: 6923968 kB' 'Inactive: 3759384 kB' 'Active(anon): 6523308 kB' 'Inactive(anon): 0 kB' 'Active(file): 400660 kB' 'Inactive(file): 3759384 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 458300 kB' 'Mapped: 180008 kB' 'Shmem: 6067836 kB' 'KReclaimable: 176540 kB' 'Slab: 661464 kB' 'SReclaimable: 176540 kB' 'SUnreclaim: 484924 kB' 'KernelStack: 12880 kB' 'PageTables: 7548 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 7584164 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198472 kB' 'VmallocChunk: 0 kB' 'Percpu: 34368 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1640028 kB' 'DirectMap2M: 15056896 kB' 'DirectMap1G: 53477376 kB' 00:02:55.970 02:05:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.970 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.970 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.970 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.970 02:05:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.970 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.970 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.970 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.970 02:05:23 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.970 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.970 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.970 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.970 02:05:23 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.970 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.970 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.970 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.970 02:05:23 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.970 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.970 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.970 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.970 02:05:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.970 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.970 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.970 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.970 02:05:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.970 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.970 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.970 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.970 02:05:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.970 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.970 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.970 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.971 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.971 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.972 02:05:23 -- setup/common.sh@33 -- # echo 1024 00:02:55.972 02:05:23 -- setup/common.sh@33 -- # return 0 00:02:55.972 02:05:23 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:55.972 02:05:23 -- setup/hugepages.sh@112 -- # get_nodes 00:02:55.972 02:05:23 -- setup/hugepages.sh@27 -- # local node 00:02:55.972 02:05:23 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:55.972 02:05:23 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:02:55.972 02:05:23 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:55.972 02:05:23 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:02:55.972 02:05:23 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:55.972 02:05:23 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:55.972 02:05:23 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:55.972 02:05:23 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:55.972 02:05:23 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:55.972 02:05:23 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:55.972 02:05:23 -- setup/common.sh@18 -- # local node=0 00:02:55.972 02:05:23 -- setup/common.sh@19 -- # local var val 00:02:55.972 02:05:23 -- setup/common.sh@20 -- # local mem_f mem 00:02:55.972 02:05:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:55.972 02:05:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:55.972 02:05:23 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:55.972 02:05:23 -- setup/common.sh@28 -- # mapfile -t mem 00:02:55.972 02:05:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.972 02:05:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27293372 kB' 'MemUsed: 5532484 kB' 'SwapCached: 0 kB' 'Active: 2191052 kB' 'Inactive: 183308 kB' 'Active(anon): 2016804 kB' 'Inactive(anon): 0 kB' 'Active(file): 174248 kB' 'Inactive(file): 183308 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2248396 kB' 'Mapped: 78560 kB' 'AnonPages: 129088 kB' 'Shmem: 1890840 kB' 'KernelStack: 6984 kB' 'PageTables: 3000 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 89544 kB' 'Slab: 377616 kB' 'SReclaimable: 89544 kB' 'SUnreclaim: 288072 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.972 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.972 02:05:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # continue 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.973 02:05:23 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.973 02:05:23 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.973 02:05:23 -- setup/common.sh@33 -- # echo 0 00:02:55.973 02:05:23 -- setup/common.sh@33 -- # return 0 00:02:55.973 02:05:23 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:55.973 02:05:23 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:55.973 02:05:23 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:55.973 02:05:23 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:55.973 02:05:23 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:02:55.973 node0=1024 expecting 1024 00:02:55.973 02:05:23 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:02:55.973 00:02:55.973 real 0m2.734s 00:02:55.973 user 0m1.132s 00:02:55.973 sys 0m1.527s 00:02:55.974 02:05:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:55.974 02:05:23 -- common/autotest_common.sh@10 -- # set +x 00:02:55.974 ************************************ 00:02:55.974 END TEST no_shrink_alloc 00:02:55.974 ************************************ 00:02:55.974 02:05:23 -- setup/hugepages.sh@217 -- # clear_hp 00:02:55.974 02:05:23 -- setup/hugepages.sh@37 -- # local node hp 00:02:55.974 02:05:23 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:02:55.974 02:05:23 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:55.974 02:05:23 -- setup/hugepages.sh@41 -- # echo 0 00:02:55.974 02:05:23 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:55.974 02:05:23 -- setup/hugepages.sh@41 -- # echo 0 00:02:55.974 02:05:23 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:02:55.974 02:05:23 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:55.974 02:05:23 -- setup/hugepages.sh@41 -- # echo 0 00:02:55.974 02:05:23 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:55.974 02:05:23 -- setup/hugepages.sh@41 -- # echo 0 00:02:55.974 02:05:23 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:02:55.974 02:05:23 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:02:55.974 00:02:55.974 real 0m11.160s 00:02:55.974 user 0m4.390s 00:02:55.974 sys 0m5.706s 00:02:55.974 02:05:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:55.974 02:05:23 -- common/autotest_common.sh@10 -- # set +x 00:02:55.974 ************************************ 00:02:55.974 END TEST hugepages 00:02:55.974 ************************************ 00:02:55.974 02:05:23 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:02:55.974 02:05:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:55.974 02:05:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:55.974 02:05:23 -- common/autotest_common.sh@10 -- # set +x 00:02:55.974 ************************************ 00:02:55.974 START TEST driver 00:02:55.974 ************************************ 00:02:55.974 02:05:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:02:56.231 * Looking for test storage... 00:02:56.231 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:56.231 02:05:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:56.231 02:05:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:56.231 02:05:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:56.231 02:05:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:56.231 02:05:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:56.231 02:05:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:56.231 02:05:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:56.231 02:05:23 -- scripts/common.sh@335 -- # IFS=.-: 00:02:56.231 02:05:23 -- scripts/common.sh@335 -- # read -ra ver1 00:02:56.231 02:05:23 -- scripts/common.sh@336 -- # IFS=.-: 00:02:56.231 02:05:23 -- scripts/common.sh@336 -- # read -ra ver2 00:02:56.231 02:05:23 -- scripts/common.sh@337 -- # local 'op=<' 00:02:56.231 02:05:23 -- scripts/common.sh@339 -- # ver1_l=2 00:02:56.231 02:05:23 -- scripts/common.sh@340 -- # ver2_l=1 00:02:56.231 02:05:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:56.231 02:05:23 -- scripts/common.sh@343 -- # case "$op" in 00:02:56.231 02:05:23 -- scripts/common.sh@344 -- # : 1 00:02:56.231 02:05:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:56.231 02:05:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:56.231 02:05:23 -- scripts/common.sh@364 -- # decimal 1 00:02:56.231 02:05:23 -- scripts/common.sh@352 -- # local d=1 00:02:56.231 02:05:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:56.231 02:05:23 -- scripts/common.sh@354 -- # echo 1 00:02:56.231 02:05:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:56.231 02:05:23 -- scripts/common.sh@365 -- # decimal 2 00:02:56.231 02:05:23 -- scripts/common.sh@352 -- # local d=2 00:02:56.231 02:05:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:56.231 02:05:23 -- scripts/common.sh@354 -- # echo 2 00:02:56.231 02:05:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:56.231 02:05:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:56.231 02:05:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:56.231 02:05:23 -- scripts/common.sh@367 -- # return 0 00:02:56.231 02:05:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:56.231 02:05:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:56.231 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:56.231 --rc genhtml_branch_coverage=1 00:02:56.231 --rc genhtml_function_coverage=1 00:02:56.231 --rc genhtml_legend=1 00:02:56.231 --rc geninfo_all_blocks=1 00:02:56.231 --rc geninfo_unexecuted_blocks=1 00:02:56.231 00:02:56.231 ' 00:02:56.231 02:05:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:56.231 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:56.231 --rc genhtml_branch_coverage=1 00:02:56.231 --rc genhtml_function_coverage=1 00:02:56.231 --rc genhtml_legend=1 00:02:56.231 --rc geninfo_all_blocks=1 00:02:56.231 --rc geninfo_unexecuted_blocks=1 00:02:56.231 00:02:56.231 ' 00:02:56.231 02:05:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:56.231 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:56.231 --rc genhtml_branch_coverage=1 00:02:56.231 --rc genhtml_function_coverage=1 00:02:56.231 --rc genhtml_legend=1 00:02:56.231 --rc geninfo_all_blocks=1 00:02:56.231 --rc geninfo_unexecuted_blocks=1 00:02:56.231 00:02:56.231 ' 00:02:56.231 02:05:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:56.231 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:56.231 --rc genhtml_branch_coverage=1 00:02:56.231 --rc genhtml_function_coverage=1 00:02:56.231 --rc genhtml_legend=1 00:02:56.231 --rc geninfo_all_blocks=1 00:02:56.231 --rc geninfo_unexecuted_blocks=1 00:02:56.231 00:02:56.231 ' 00:02:56.231 02:05:23 -- setup/driver.sh@68 -- # setup reset 00:02:56.231 02:05:23 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:56.231 02:05:23 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:58.761 02:05:26 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:02:58.761 02:05:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:58.761 02:05:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:58.761 02:05:26 -- common/autotest_common.sh@10 -- # set +x 00:02:58.761 ************************************ 00:02:58.761 START TEST guess_driver 00:02:58.761 ************************************ 00:02:58.761 02:05:26 -- common/autotest_common.sh@1114 -- # guess_driver 00:02:58.761 02:05:26 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:02:58.761 02:05:26 -- setup/driver.sh@47 -- # local fail=0 00:02:58.761 02:05:26 -- setup/driver.sh@49 -- # pick_driver 00:02:58.761 02:05:26 -- setup/driver.sh@36 -- # vfio 00:02:58.761 02:05:26 -- setup/driver.sh@21 -- # local iommu_grups 00:02:58.761 02:05:26 -- setup/driver.sh@22 -- # local unsafe_vfio 00:02:58.761 02:05:26 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:02:58.761 02:05:26 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:02:58.761 02:05:26 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:02:58.761 02:05:26 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:02:58.761 02:05:26 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:02:58.761 02:05:26 -- setup/driver.sh@14 -- # mod vfio_pci 00:02:58.761 02:05:26 -- setup/driver.sh@12 -- # dep vfio_pci 00:02:58.761 02:05:26 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:02:58.761 02:05:26 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:02:58.761 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:02:58.761 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:02:58.762 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:02:58.762 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:02:58.762 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:02:58.762 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:02:58.762 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:02:58.762 02:05:26 -- setup/driver.sh@30 -- # return 0 00:02:58.762 02:05:26 -- setup/driver.sh@37 -- # echo vfio-pci 00:02:58.762 02:05:26 -- setup/driver.sh@49 -- # driver=vfio-pci 00:02:58.762 02:05:26 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:02:58.762 02:05:26 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:02:58.762 Looking for driver=vfio-pci 00:02:58.762 02:05:26 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:02:58.762 02:05:26 -- setup/driver.sh@45 -- # setup output config 00:02:58.762 02:05:26 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:58.762 02:05:26 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:00.136 02:05:27 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:00.136 02:05:27 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:00.136 02:05:27 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:00.136 02:05:27 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:00.136 02:05:27 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:00.136 02:05:27 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:00.136 02:05:27 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:00.136 02:05:27 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:00.136 02:05:27 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:00.136 02:05:27 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:00.136 02:05:27 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:00.136 02:05:27 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:00.136 02:05:27 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:00.136 02:05:27 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:00.136 02:05:27 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:00.136 02:05:27 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:00.136 02:05:27 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:00.137 02:05:27 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:00.137 02:05:27 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:00.137 02:05:27 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:00.137 02:05:27 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:00.137 02:05:27 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:00.137 02:05:27 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:00.137 02:05:27 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:00.137 02:05:27 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:00.137 02:05:27 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:00.137 02:05:27 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:00.137 02:05:27 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:00.137 02:05:27 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:00.137 02:05:27 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:00.137 02:05:27 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:00.137 02:05:27 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:00.137 02:05:27 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:00.137 02:05:27 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:00.137 02:05:27 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:00.137 02:05:27 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:00.137 02:05:27 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:00.137 02:05:27 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:00.137 02:05:27 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:00.137 02:05:27 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:00.137 02:05:27 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:00.137 02:05:27 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:00.137 02:05:27 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:00.137 02:05:27 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:00.137 02:05:27 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:00.137 02:05:27 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:00.137 02:05:27 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:00.137 02:05:27 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:01.075 02:05:28 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:01.075 02:05:28 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:01.075 02:05:28 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:01.075 02:05:28 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:03:01.075 02:05:28 -- setup/driver.sh@65 -- # setup reset 00:03:01.075 02:05:28 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:01.075 02:05:28 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:03.615 00:03:03.615 real 0m4.757s 00:03:03.615 user 0m1.106s 00:03:03.615 sys 0m1.841s 00:03:03.615 02:05:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:03.615 02:05:31 -- common/autotest_common.sh@10 -- # set +x 00:03:03.615 ************************************ 00:03:03.615 END TEST guess_driver 00:03:03.615 ************************************ 00:03:03.615 00:03:03.615 real 0m7.456s 00:03:03.615 user 0m1.745s 00:03:03.615 sys 0m2.970s 00:03:03.615 02:05:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:03.615 02:05:31 -- common/autotest_common.sh@10 -- # set +x 00:03:03.615 ************************************ 00:03:03.615 END TEST driver 00:03:03.615 ************************************ 00:03:03.615 02:05:31 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:03.615 02:05:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:03.615 02:05:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:03.615 02:05:31 -- common/autotest_common.sh@10 -- # set +x 00:03:03.616 ************************************ 00:03:03.616 START TEST devices 00:03:03.616 ************************************ 00:03:03.616 02:05:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:03.616 * Looking for test storage... 00:03:03.616 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:03.616 02:05:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:03.616 02:05:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:03.616 02:05:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:03.616 02:05:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:03.616 02:05:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:03.616 02:05:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:03.616 02:05:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:03.616 02:05:31 -- scripts/common.sh@335 -- # IFS=.-: 00:03:03.616 02:05:31 -- scripts/common.sh@335 -- # read -ra ver1 00:03:03.616 02:05:31 -- scripts/common.sh@336 -- # IFS=.-: 00:03:03.616 02:05:31 -- scripts/common.sh@336 -- # read -ra ver2 00:03:03.616 02:05:31 -- scripts/common.sh@337 -- # local 'op=<' 00:03:03.616 02:05:31 -- scripts/common.sh@339 -- # ver1_l=2 00:03:03.616 02:05:31 -- scripts/common.sh@340 -- # ver2_l=1 00:03:03.616 02:05:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:03.616 02:05:31 -- scripts/common.sh@343 -- # case "$op" in 00:03:03.616 02:05:31 -- scripts/common.sh@344 -- # : 1 00:03:03.616 02:05:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:03.616 02:05:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:03.616 02:05:31 -- scripts/common.sh@364 -- # decimal 1 00:03:03.616 02:05:31 -- scripts/common.sh@352 -- # local d=1 00:03:03.616 02:05:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:03.616 02:05:31 -- scripts/common.sh@354 -- # echo 1 00:03:03.616 02:05:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:03.616 02:05:31 -- scripts/common.sh@365 -- # decimal 2 00:03:03.616 02:05:31 -- scripts/common.sh@352 -- # local d=2 00:03:03.616 02:05:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:03.616 02:05:31 -- scripts/common.sh@354 -- # echo 2 00:03:03.616 02:05:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:03.616 02:05:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:03.616 02:05:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:03.616 02:05:31 -- scripts/common.sh@367 -- # return 0 00:03:03.616 02:05:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:03.616 02:05:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:03.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:03.616 --rc genhtml_branch_coverage=1 00:03:03.616 --rc genhtml_function_coverage=1 00:03:03.616 --rc genhtml_legend=1 00:03:03.616 --rc geninfo_all_blocks=1 00:03:03.616 --rc geninfo_unexecuted_blocks=1 00:03:03.616 00:03:03.616 ' 00:03:03.616 02:05:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:03.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:03.616 --rc genhtml_branch_coverage=1 00:03:03.616 --rc genhtml_function_coverage=1 00:03:03.616 --rc genhtml_legend=1 00:03:03.616 --rc geninfo_all_blocks=1 00:03:03.616 --rc geninfo_unexecuted_blocks=1 00:03:03.616 00:03:03.616 ' 00:03:03.616 02:05:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:03.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:03.616 --rc genhtml_branch_coverage=1 00:03:03.616 --rc genhtml_function_coverage=1 00:03:03.616 --rc genhtml_legend=1 00:03:03.616 --rc geninfo_all_blocks=1 00:03:03.616 --rc geninfo_unexecuted_blocks=1 00:03:03.616 00:03:03.616 ' 00:03:03.616 02:05:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:03.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:03.616 --rc genhtml_branch_coverage=1 00:03:03.616 --rc genhtml_function_coverage=1 00:03:03.616 --rc genhtml_legend=1 00:03:03.616 --rc geninfo_all_blocks=1 00:03:03.616 --rc geninfo_unexecuted_blocks=1 00:03:03.616 00:03:03.616 ' 00:03:03.616 02:05:31 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:03:03.616 02:05:31 -- setup/devices.sh@192 -- # setup reset 00:03:03.616 02:05:31 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:03.616 02:05:31 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:05.032 02:05:32 -- setup/devices.sh@194 -- # get_zoned_devs 00:03:05.032 02:05:32 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:05.032 02:05:32 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:05.032 02:05:32 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:05.032 02:05:32 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:05.032 02:05:32 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:05.032 02:05:32 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:05.032 02:05:32 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:05.032 02:05:32 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:05.032 02:05:32 -- setup/devices.sh@196 -- # blocks=() 00:03:05.032 02:05:32 -- setup/devices.sh@196 -- # declare -a blocks 00:03:05.032 02:05:32 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:03:05.032 02:05:32 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:03:05.032 02:05:32 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:03:05.032 02:05:32 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:03:05.032 02:05:32 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:03:05.032 02:05:32 -- setup/devices.sh@201 -- # ctrl=nvme0 00:03:05.032 02:05:32 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:03:05.032 02:05:32 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:05.032 02:05:32 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:03:05.032 02:05:32 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:03:05.032 02:05:32 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:03:05.032 No valid GPT data, bailing 00:03:05.292 02:05:32 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:05.292 02:05:32 -- scripts/common.sh@393 -- # pt= 00:03:05.292 02:05:32 -- scripts/common.sh@394 -- # return 1 00:03:05.292 02:05:32 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:03:05.292 02:05:32 -- setup/common.sh@76 -- # local dev=nvme0n1 00:03:05.292 02:05:32 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:03:05.292 02:05:32 -- setup/common.sh@80 -- # echo 1000204886016 00:03:05.292 02:05:32 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:03:05.292 02:05:32 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:03:05.292 02:05:32 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:03:05.292 02:05:32 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:03:05.293 02:05:32 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:03:05.293 02:05:32 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:03:05.293 02:05:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:05.293 02:05:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:05.293 02:05:32 -- common/autotest_common.sh@10 -- # set +x 00:03:05.293 ************************************ 00:03:05.293 START TEST nvme_mount 00:03:05.293 ************************************ 00:03:05.293 02:05:32 -- common/autotest_common.sh@1114 -- # nvme_mount 00:03:05.293 02:05:32 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:03:05.293 02:05:32 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:03:05.293 02:05:32 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:05.293 02:05:32 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:05.293 02:05:32 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:03:05.293 02:05:32 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:05.293 02:05:32 -- setup/common.sh@40 -- # local part_no=1 00:03:05.293 02:05:32 -- setup/common.sh@41 -- # local size=1073741824 00:03:05.293 02:05:32 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:05.293 02:05:32 -- setup/common.sh@44 -- # parts=() 00:03:05.293 02:05:32 -- setup/common.sh@44 -- # local parts 00:03:05.293 02:05:32 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:05.293 02:05:32 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:05.293 02:05:32 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:05.293 02:05:32 -- setup/common.sh@46 -- # (( part++ )) 00:03:05.293 02:05:32 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:05.293 02:05:32 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:05.293 02:05:32 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:05.293 02:05:32 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:03:06.231 Creating new GPT entries in memory. 00:03:06.231 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:06.231 other utilities. 00:03:06.231 02:05:33 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:06.231 02:05:33 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:06.231 02:05:33 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:06.231 02:05:33 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:06.231 02:05:33 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:07.172 Creating new GPT entries in memory. 00:03:07.172 The operation has completed successfully. 00:03:07.172 02:05:34 -- setup/common.sh@57 -- # (( part++ )) 00:03:07.172 02:05:34 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:07.172 02:05:34 -- setup/common.sh@62 -- # wait 1972469 00:03:07.172 02:05:34 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:07.172 02:05:34 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:03:07.172 02:05:34 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:07.172 02:05:34 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:03:07.172 02:05:34 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:03:07.172 02:05:34 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:07.435 02:05:34 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:07.435 02:05:34 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:07.435 02:05:34 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:03:07.435 02:05:34 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:07.435 02:05:34 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:07.435 02:05:34 -- setup/devices.sh@53 -- # local found=0 00:03:07.435 02:05:34 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:07.435 02:05:34 -- setup/devices.sh@56 -- # : 00:03:07.435 02:05:34 -- setup/devices.sh@59 -- # local pci status 00:03:07.435 02:05:34 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:07.435 02:05:34 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:07.435 02:05:34 -- setup/devices.sh@47 -- # setup output config 00:03:07.435 02:05:34 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:07.435 02:05:34 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:08.374 02:05:36 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:08.374 02:05:36 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:03:08.374 02:05:36 -- setup/devices.sh@63 -- # found=1 00:03:08.374 02:05:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:08.374 02:05:36 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:08.374 02:05:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:08.374 02:05:36 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:08.374 02:05:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:08.374 02:05:36 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:08.374 02:05:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:08.374 02:05:36 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:08.374 02:05:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:08.374 02:05:36 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:08.374 02:05:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:08.374 02:05:36 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:08.374 02:05:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:08.374 02:05:36 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:08.374 02:05:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:08.374 02:05:36 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:08.374 02:05:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:08.374 02:05:36 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:08.374 02:05:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:08.374 02:05:36 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:08.374 02:05:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:08.374 02:05:36 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:08.374 02:05:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:08.374 02:05:36 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:08.374 02:05:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:08.374 02:05:36 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:08.374 02:05:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:08.374 02:05:36 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:08.374 02:05:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:08.374 02:05:36 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:08.374 02:05:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:08.374 02:05:36 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:08.374 02:05:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:08.636 02:05:36 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:08.636 02:05:36 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:08.636 02:05:36 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:08.636 02:05:36 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:08.636 02:05:36 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:08.636 02:05:36 -- setup/devices.sh@110 -- # cleanup_nvme 00:03:08.636 02:05:36 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:08.636 02:05:36 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:08.636 02:05:36 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:08.636 02:05:36 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:08.636 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:08.636 02:05:36 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:08.636 02:05:36 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:08.895 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:08.895 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:08.895 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:08.895 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:08.895 02:05:36 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:03:08.895 02:05:36 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:03:08.895 02:05:36 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:08.895 02:05:36 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:03:08.895 02:05:36 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:03:08.895 02:05:36 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:08.895 02:05:36 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:08.895 02:05:36 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:08.895 02:05:36 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:03:08.895 02:05:36 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:08.895 02:05:36 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:08.895 02:05:36 -- setup/devices.sh@53 -- # local found=0 00:03:08.895 02:05:36 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:08.895 02:05:36 -- setup/devices.sh@56 -- # : 00:03:08.895 02:05:36 -- setup/devices.sh@59 -- # local pci status 00:03:08.895 02:05:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:08.895 02:05:36 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:08.895 02:05:36 -- setup/devices.sh@47 -- # setup output config 00:03:08.895 02:05:36 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:08.895 02:05:36 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:10.280 02:05:37 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:10.280 02:05:37 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:03:10.280 02:05:37 -- setup/devices.sh@63 -- # found=1 00:03:10.280 02:05:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.280 02:05:37 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:10.280 02:05:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.280 02:05:37 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:10.280 02:05:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.280 02:05:37 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:10.280 02:05:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.280 02:05:37 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:10.280 02:05:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.280 02:05:37 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:10.280 02:05:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.280 02:05:37 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:10.280 02:05:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.280 02:05:37 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:10.280 02:05:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.280 02:05:37 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:10.280 02:05:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.280 02:05:37 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:10.280 02:05:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.280 02:05:37 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:10.280 02:05:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.280 02:05:37 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:10.280 02:05:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.280 02:05:37 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:10.280 02:05:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.280 02:05:37 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:10.280 02:05:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.280 02:05:37 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:10.280 02:05:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.280 02:05:37 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:10.280 02:05:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.280 02:05:37 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:10.280 02:05:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.280 02:05:37 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:10.280 02:05:37 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:10.280 02:05:37 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:10.280 02:05:37 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:10.280 02:05:37 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:10.280 02:05:37 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:10.280 02:05:37 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:03:10.280 02:05:37 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:10.280 02:05:37 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:03:10.280 02:05:37 -- setup/devices.sh@50 -- # local mount_point= 00:03:10.280 02:05:37 -- setup/devices.sh@51 -- # local test_file= 00:03:10.280 02:05:37 -- setup/devices.sh@53 -- # local found=0 00:03:10.280 02:05:37 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:10.280 02:05:37 -- setup/devices.sh@59 -- # local pci status 00:03:10.280 02:05:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:10.280 02:05:37 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:10.280 02:05:37 -- setup/devices.sh@47 -- # setup output config 00:03:10.280 02:05:37 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:10.280 02:05:37 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:11.214 02:05:38 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.214 02:05:38 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:03:11.214 02:05:38 -- setup/devices.sh@63 -- # found=1 00:03:11.214 02:05:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.214 02:05:38 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.214 02:05:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.214 02:05:38 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.214 02:05:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.214 02:05:38 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.214 02:05:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.214 02:05:38 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.214 02:05:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.214 02:05:38 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.214 02:05:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.214 02:05:38 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.214 02:05:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.214 02:05:38 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.214 02:05:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.214 02:05:38 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.214 02:05:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.214 02:05:38 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.214 02:05:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.214 02:05:38 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.214 02:05:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.214 02:05:38 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.214 02:05:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.214 02:05:38 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.214 02:05:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.214 02:05:38 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.214 02:05:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.214 02:05:38 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.214 02:05:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.214 02:05:38 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.214 02:05:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.214 02:05:38 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:11.214 02:05:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:11.473 02:05:39 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:11.473 02:05:39 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:11.473 02:05:39 -- setup/devices.sh@68 -- # return 0 00:03:11.473 02:05:39 -- setup/devices.sh@128 -- # cleanup_nvme 00:03:11.473 02:05:39 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:11.473 02:05:39 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:11.473 02:05:39 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:11.473 02:05:39 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:11.473 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:11.473 00:03:11.473 real 0m6.338s 00:03:11.473 user 0m1.473s 00:03:11.473 sys 0m2.455s 00:03:11.473 02:05:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:11.473 02:05:39 -- common/autotest_common.sh@10 -- # set +x 00:03:11.473 ************************************ 00:03:11.473 END TEST nvme_mount 00:03:11.473 ************************************ 00:03:11.473 02:05:39 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:03:11.473 02:05:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:11.473 02:05:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:11.473 02:05:39 -- common/autotest_common.sh@10 -- # set +x 00:03:11.473 ************************************ 00:03:11.473 START TEST dm_mount 00:03:11.473 ************************************ 00:03:11.473 02:05:39 -- common/autotest_common.sh@1114 -- # dm_mount 00:03:11.473 02:05:39 -- setup/devices.sh@144 -- # pv=nvme0n1 00:03:11.473 02:05:39 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:03:11.473 02:05:39 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:03:11.473 02:05:39 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:03:11.473 02:05:39 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:11.473 02:05:39 -- setup/common.sh@40 -- # local part_no=2 00:03:11.473 02:05:39 -- setup/common.sh@41 -- # local size=1073741824 00:03:11.473 02:05:39 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:11.473 02:05:39 -- setup/common.sh@44 -- # parts=() 00:03:11.473 02:05:39 -- setup/common.sh@44 -- # local parts 00:03:11.473 02:05:39 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:11.473 02:05:39 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:11.473 02:05:39 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:11.473 02:05:39 -- setup/common.sh@46 -- # (( part++ )) 00:03:11.473 02:05:39 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:11.473 02:05:39 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:11.473 02:05:39 -- setup/common.sh@46 -- # (( part++ )) 00:03:11.473 02:05:39 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:11.473 02:05:39 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:11.473 02:05:39 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:11.473 02:05:39 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:03:12.848 Creating new GPT entries in memory. 00:03:12.848 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:12.848 other utilities. 00:03:12.848 02:05:40 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:12.848 02:05:40 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:12.848 02:05:40 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:12.848 02:05:40 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:12.848 02:05:40 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:13.784 Creating new GPT entries in memory. 00:03:13.784 The operation has completed successfully. 00:03:13.784 02:05:41 -- setup/common.sh@57 -- # (( part++ )) 00:03:13.784 02:05:41 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:13.784 02:05:41 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:13.784 02:05:41 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:13.784 02:05:41 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:03:14.722 The operation has completed successfully. 00:03:14.722 02:05:42 -- setup/common.sh@57 -- # (( part++ )) 00:03:14.722 02:05:42 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:14.722 02:05:42 -- setup/common.sh@62 -- # wait 1974930 00:03:14.722 02:05:42 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:03:14.722 02:05:42 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:14.722 02:05:42 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:14.722 02:05:42 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:03:14.722 02:05:42 -- setup/devices.sh@160 -- # for t in {1..5} 00:03:14.722 02:05:42 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:14.722 02:05:42 -- setup/devices.sh@161 -- # break 00:03:14.722 02:05:42 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:14.722 02:05:42 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:03:14.722 02:05:42 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:03:14.722 02:05:42 -- setup/devices.sh@166 -- # dm=dm-0 00:03:14.722 02:05:42 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:03:14.722 02:05:42 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:03:14.722 02:05:42 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:14.722 02:05:42 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:03:14.722 02:05:42 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:14.722 02:05:42 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:14.722 02:05:42 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:03:14.722 02:05:42 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:14.722 02:05:42 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:14.722 02:05:42 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:14.722 02:05:42 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:03:14.722 02:05:42 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:14.722 02:05:42 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:14.722 02:05:42 -- setup/devices.sh@53 -- # local found=0 00:03:14.722 02:05:42 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:14.722 02:05:42 -- setup/devices.sh@56 -- # : 00:03:14.722 02:05:42 -- setup/devices.sh@59 -- # local pci status 00:03:14.722 02:05:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:14.722 02:05:42 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:14.722 02:05:42 -- setup/devices.sh@47 -- # setup output config 00:03:14.722 02:05:42 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:14.722 02:05:42 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:15.658 02:05:43 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:15.658 02:05:43 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:03:15.658 02:05:43 -- setup/devices.sh@63 -- # found=1 00:03:15.658 02:05:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:15.658 02:05:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:15.658 02:05:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:15.918 02:05:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:15.918 02:05:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:15.918 02:05:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:15.918 02:05:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:15.918 02:05:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:15.918 02:05:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:15.918 02:05:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:15.918 02:05:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:15.918 02:05:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:15.918 02:05:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:15.918 02:05:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:15.918 02:05:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:15.918 02:05:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:15.918 02:05:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:15.918 02:05:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:15.918 02:05:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:15.918 02:05:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:15.918 02:05:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:15.918 02:05:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:15.918 02:05:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:15.918 02:05:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:15.918 02:05:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:15.918 02:05:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:15.918 02:05:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:15.918 02:05:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:15.918 02:05:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:15.918 02:05:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:15.918 02:05:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:15.918 02:05:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:15.918 02:05:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:15.918 02:05:43 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:15.918 02:05:43 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:03:15.918 02:05:43 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:15.918 02:05:43 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:15.918 02:05:43 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:15.918 02:05:43 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:15.918 02:05:43 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:03:15.918 02:05:43 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:15.918 02:05:43 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:03:15.918 02:05:43 -- setup/devices.sh@50 -- # local mount_point= 00:03:15.918 02:05:43 -- setup/devices.sh@51 -- # local test_file= 00:03:15.918 02:05:43 -- setup/devices.sh@53 -- # local found=0 00:03:15.918 02:05:43 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:15.918 02:05:43 -- setup/devices.sh@59 -- # local pci status 00:03:15.918 02:05:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:15.918 02:05:43 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:15.918 02:05:43 -- setup/devices.sh@47 -- # setup output config 00:03:15.919 02:05:43 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:15.919 02:05:43 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:17.297 02:05:44 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:17.297 02:05:44 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:03:17.297 02:05:44 -- setup/devices.sh@63 -- # found=1 00:03:17.297 02:05:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:17.297 02:05:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:17.297 02:05:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:17.297 02:05:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:17.297 02:05:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:17.297 02:05:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:17.297 02:05:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:17.297 02:05:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:17.297 02:05:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:17.297 02:05:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:17.297 02:05:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:17.297 02:05:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:17.297 02:05:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:17.297 02:05:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:17.297 02:05:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:17.297 02:05:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:17.297 02:05:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:17.297 02:05:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:17.297 02:05:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:17.297 02:05:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:17.297 02:05:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:17.297 02:05:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:17.297 02:05:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:17.297 02:05:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:17.297 02:05:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:17.297 02:05:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:17.297 02:05:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:17.297 02:05:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:17.297 02:05:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:17.297 02:05:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:17.297 02:05:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:17.297 02:05:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:17.297 02:05:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:17.297 02:05:44 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:17.297 02:05:44 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:17.297 02:05:44 -- setup/devices.sh@68 -- # return 0 00:03:17.297 02:05:44 -- setup/devices.sh@187 -- # cleanup_dm 00:03:17.297 02:05:44 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:17.297 02:05:44 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:17.297 02:05:44 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:03:17.297 02:05:45 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:17.297 02:05:45 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:03:17.297 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:17.297 02:05:45 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:17.297 02:05:45 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:03:17.297 00:03:17.297 real 0m5.845s 00:03:17.297 user 0m1.034s 00:03:17.297 sys 0m1.693s 00:03:17.297 02:05:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:17.297 02:05:45 -- common/autotest_common.sh@10 -- # set +x 00:03:17.297 ************************************ 00:03:17.297 END TEST dm_mount 00:03:17.297 ************************************ 00:03:17.297 02:05:45 -- setup/devices.sh@1 -- # cleanup 00:03:17.297 02:05:45 -- setup/devices.sh@11 -- # cleanup_nvme 00:03:17.297 02:05:45 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:17.297 02:05:45 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:17.297 02:05:45 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:17.297 02:05:45 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:17.297 02:05:45 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:17.559 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:17.559 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:17.559 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:17.559 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:17.559 02:05:45 -- setup/devices.sh@12 -- # cleanup_dm 00:03:17.559 02:05:45 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:17.559 02:05:45 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:17.559 02:05:45 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:17.559 02:05:45 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:17.559 02:05:45 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:03:17.559 02:05:45 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:03:17.821 00:03:17.821 real 0m14.151s 00:03:17.821 user 0m3.248s 00:03:17.821 sys 0m5.151s 00:03:17.821 02:05:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:17.821 02:05:45 -- common/autotest_common.sh@10 -- # set +x 00:03:17.821 ************************************ 00:03:17.821 END TEST devices 00:03:17.821 ************************************ 00:03:17.821 00:03:17.821 real 0m43.297s 00:03:17.821 user 0m12.725s 00:03:17.821 sys 0m19.125s 00:03:17.821 02:05:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:17.821 02:05:45 -- common/autotest_common.sh@10 -- # set +x 00:03:17.821 ************************************ 00:03:17.821 END TEST setup.sh 00:03:17.821 ************************************ 00:03:17.821 02:05:45 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:18.756 Hugepages 00:03:18.756 node hugesize free / total 00:03:18.756 node0 1048576kB 0 / 0 00:03:18.756 node0 2048kB 2048 / 2048 00:03:18.756 node1 1048576kB 0 / 0 00:03:18.756 node1 2048kB 0 / 0 00:03:18.756 00:03:18.756 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:18.756 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:03:18.756 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:03:18.756 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:03:18.756 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:03:19.014 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:03:19.014 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:03:19.014 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:03:19.014 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:03:19.014 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:03:19.014 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:03:19.014 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:03:19.015 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:03:19.015 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:03:19.015 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:03:19.015 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:03:19.015 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:03:19.015 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:03:19.015 02:05:46 -- spdk/autotest.sh@128 -- # uname -s 00:03:19.015 02:05:46 -- spdk/autotest.sh@128 -- # [[ Linux == Linux ]] 00:03:19.015 02:05:46 -- spdk/autotest.sh@130 -- # nvme_namespace_revert 00:03:19.015 02:05:46 -- common/autotest_common.sh@1526 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:20.391 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:20.391 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:20.391 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:20.391 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:20.391 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:20.391 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:20.391 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:20.391 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:20.391 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:20.391 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:20.391 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:20.391 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:20.391 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:20.391 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:20.391 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:20.391 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:21.330 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:21.330 02:05:48 -- common/autotest_common.sh@1527 -- # sleep 1 00:03:22.267 02:05:49 -- common/autotest_common.sh@1528 -- # bdfs=() 00:03:22.267 02:05:49 -- common/autotest_common.sh@1528 -- # local bdfs 00:03:22.267 02:05:49 -- common/autotest_common.sh@1529 -- # bdfs=($(get_nvme_bdfs)) 00:03:22.267 02:05:49 -- common/autotest_common.sh@1529 -- # get_nvme_bdfs 00:03:22.267 02:05:49 -- common/autotest_common.sh@1508 -- # bdfs=() 00:03:22.267 02:05:49 -- common/autotest_common.sh@1508 -- # local bdfs 00:03:22.267 02:05:49 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:22.267 02:05:49 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:22.267 02:05:49 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:03:22.267 02:05:50 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:03:22.267 02:05:50 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:03:22.267 02:05:50 -- common/autotest_common.sh@1531 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:23.645 Waiting for block devices as requested 00:03:23.645 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:03:23.645 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:23.905 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:23.905 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:23.905 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:24.164 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:24.164 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:24.164 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:24.164 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:03:24.423 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:24.423 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:24.423 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:24.423 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:24.682 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:24.682 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:24.682 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:24.682 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:03:24.940 02:05:52 -- common/autotest_common.sh@1533 -- # for bdf in "${bdfs[@]}" 00:03:24.940 02:05:52 -- common/autotest_common.sh@1534 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:03:24.940 02:05:52 -- common/autotest_common.sh@1497 -- # readlink -f /sys/class/nvme/nvme0 00:03:24.940 02:05:52 -- common/autotest_common.sh@1497 -- # grep 0000:88:00.0/nvme/nvme 00:03:24.940 02:05:52 -- common/autotest_common.sh@1497 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:03:24.940 02:05:52 -- common/autotest_common.sh@1498 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:03:24.940 02:05:52 -- common/autotest_common.sh@1502 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:03:24.940 02:05:52 -- common/autotest_common.sh@1502 -- # printf '%s\n' nvme0 00:03:24.940 02:05:52 -- common/autotest_common.sh@1534 -- # nvme_ctrlr=/dev/nvme0 00:03:24.940 02:05:52 -- common/autotest_common.sh@1535 -- # [[ -z /dev/nvme0 ]] 00:03:24.940 02:05:52 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:03:24.940 02:05:52 -- common/autotest_common.sh@1540 -- # grep oacs 00:03:24.940 02:05:52 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:03:24.940 02:05:52 -- common/autotest_common.sh@1540 -- # oacs=' 0xf' 00:03:24.940 02:05:52 -- common/autotest_common.sh@1541 -- # oacs_ns_manage=8 00:03:24.940 02:05:52 -- common/autotest_common.sh@1543 -- # [[ 8 -ne 0 ]] 00:03:24.940 02:05:52 -- common/autotest_common.sh@1549 -- # nvme id-ctrl /dev/nvme0 00:03:24.940 02:05:52 -- common/autotest_common.sh@1549 -- # grep unvmcap 00:03:24.940 02:05:52 -- common/autotest_common.sh@1549 -- # cut -d: -f2 00:03:24.940 02:05:52 -- common/autotest_common.sh@1549 -- # unvmcap=' 0' 00:03:24.940 02:05:52 -- common/autotest_common.sh@1550 -- # [[ 0 -eq 0 ]] 00:03:24.940 02:05:52 -- common/autotest_common.sh@1552 -- # continue 00:03:24.940 02:05:52 -- spdk/autotest.sh@133 -- # timing_exit pre_cleanup 00:03:24.940 02:05:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:24.940 02:05:52 -- common/autotest_common.sh@10 -- # set +x 00:03:24.940 02:05:52 -- spdk/autotest.sh@136 -- # timing_enter afterboot 00:03:24.940 02:05:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:24.940 02:05:52 -- common/autotest_common.sh@10 -- # set +x 00:03:24.940 02:05:52 -- spdk/autotest.sh@137 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:26.317 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:26.317 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:26.317 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:26.317 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:26.317 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:26.317 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:26.317 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:26.317 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:26.317 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:26.317 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:26.317 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:26.317 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:26.317 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:26.317 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:26.317 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:26.317 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:27.254 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:27.254 02:05:54 -- spdk/autotest.sh@138 -- # timing_exit afterboot 00:03:27.254 02:05:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:27.254 02:05:54 -- common/autotest_common.sh@10 -- # set +x 00:03:27.254 02:05:54 -- spdk/autotest.sh@142 -- # opal_revert_cleanup 00:03:27.254 02:05:54 -- common/autotest_common.sh@1586 -- # mapfile -t bdfs 00:03:27.254 02:05:54 -- common/autotest_common.sh@1586 -- # get_nvme_bdfs_by_id 0x0a54 00:03:27.254 02:05:54 -- common/autotest_common.sh@1572 -- # bdfs=() 00:03:27.254 02:05:54 -- common/autotest_common.sh@1572 -- # local bdfs 00:03:27.254 02:05:54 -- common/autotest_common.sh@1574 -- # get_nvme_bdfs 00:03:27.254 02:05:54 -- common/autotest_common.sh@1508 -- # bdfs=() 00:03:27.254 02:05:54 -- common/autotest_common.sh@1508 -- # local bdfs 00:03:27.254 02:05:54 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:27.254 02:05:54 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:27.254 02:05:54 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:03:27.254 02:05:54 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:03:27.254 02:05:54 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:03:27.254 02:05:54 -- common/autotest_common.sh@1574 -- # for bdf in $(get_nvme_bdfs) 00:03:27.254 02:05:54 -- common/autotest_common.sh@1575 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:03:27.254 02:05:54 -- common/autotest_common.sh@1575 -- # device=0x0a54 00:03:27.254 02:05:54 -- common/autotest_common.sh@1576 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:03:27.254 02:05:54 -- common/autotest_common.sh@1577 -- # bdfs+=($bdf) 00:03:27.254 02:05:54 -- common/autotest_common.sh@1581 -- # printf '%s\n' 0000:88:00.0 00:03:27.254 02:05:54 -- common/autotest_common.sh@1587 -- # [[ -z 0000:88:00.0 ]] 00:03:27.254 02:05:54 -- common/autotest_common.sh@1592 -- # spdk_tgt_pid=1980225 00:03:27.254 02:05:54 -- common/autotest_common.sh@1591 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:03:27.254 02:05:54 -- common/autotest_common.sh@1593 -- # waitforlisten 1980225 00:03:27.254 02:05:54 -- common/autotest_common.sh@829 -- # '[' -z 1980225 ']' 00:03:27.255 02:05:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:03:27.255 02:05:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:27.255 02:05:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:03:27.255 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:03:27.255 02:05:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:27.255 02:05:54 -- common/autotest_common.sh@10 -- # set +x 00:03:27.255 [2024-12-08 02:05:55.030085] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:27.255 [2024-12-08 02:05:55.030159] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1980225 ] 00:03:27.512 EAL: No free 2048 kB hugepages reported on node 1 00:03:27.512 [2024-12-08 02:05:55.092032] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:27.512 [2024-12-08 02:05:55.205314] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:27.512 [2024-12-08 02:05:55.205490] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:28.446 02:05:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:03:28.446 02:05:56 -- common/autotest_common.sh@862 -- # return 0 00:03:28.446 02:05:56 -- common/autotest_common.sh@1595 -- # bdf_id=0 00:03:28.446 02:05:56 -- common/autotest_common.sh@1596 -- # for bdf in "${bdfs[@]}" 00:03:28.446 02:05:56 -- common/autotest_common.sh@1597 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:03:31.723 nvme0n1 00:03:31.723 02:05:59 -- common/autotest_common.sh@1599 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:03:31.723 [2024-12-08 02:05:59.341515] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:03:31.723 [2024-12-08 02:05:59.341581] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:03:31.723 request: 00:03:31.724 { 00:03:31.724 "nvme_ctrlr_name": "nvme0", 00:03:31.724 "password": "test", 00:03:31.724 "method": "bdev_nvme_opal_revert", 00:03:31.724 "req_id": 1 00:03:31.724 } 00:03:31.724 Got JSON-RPC error response 00:03:31.724 response: 00:03:31.724 { 00:03:31.724 "code": -32603, 00:03:31.724 "message": "Internal error" 00:03:31.724 } 00:03:31.724 02:05:59 -- common/autotest_common.sh@1599 -- # true 00:03:31.724 02:05:59 -- common/autotest_common.sh@1600 -- # (( ++bdf_id )) 00:03:31.724 02:05:59 -- common/autotest_common.sh@1603 -- # killprocess 1980225 00:03:31.724 02:05:59 -- common/autotest_common.sh@936 -- # '[' -z 1980225 ']' 00:03:31.724 02:05:59 -- common/autotest_common.sh@940 -- # kill -0 1980225 00:03:31.724 02:05:59 -- common/autotest_common.sh@941 -- # uname 00:03:31.724 02:05:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:03:31.724 02:05:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1980225 00:03:31.724 02:05:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:03:31.724 02:05:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:03:31.724 02:05:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1980225' 00:03:31.724 killing process with pid 1980225 00:03:31.724 02:05:59 -- common/autotest_common.sh@955 -- # kill 1980225 00:03:31.724 02:05:59 -- common/autotest_common.sh@960 -- # wait 1980225 00:03:33.617 02:06:01 -- spdk/autotest.sh@148 -- # '[' 0 -eq 1 ']' 00:03:33.617 02:06:01 -- spdk/autotest.sh@152 -- # '[' 1 -eq 1 ']' 00:03:33.617 02:06:01 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:03:33.617 02:06:01 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:03:33.617 02:06:01 -- spdk/autotest.sh@160 -- # timing_enter lib 00:03:33.617 02:06:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:33.617 02:06:01 -- common/autotest_common.sh@10 -- # set +x 00:03:33.617 02:06:01 -- spdk/autotest.sh@162 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:03:33.617 02:06:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:33.617 02:06:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:33.617 02:06:01 -- common/autotest_common.sh@10 -- # set +x 00:03:33.617 ************************************ 00:03:33.617 START TEST env 00:03:33.617 ************************************ 00:03:33.617 02:06:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:03:33.617 * Looking for test storage... 00:03:33.617 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:03:33.617 02:06:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:33.617 02:06:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:33.617 02:06:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:33.617 02:06:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:33.617 02:06:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:33.617 02:06:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:33.617 02:06:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:33.617 02:06:01 -- scripts/common.sh@335 -- # IFS=.-: 00:03:33.617 02:06:01 -- scripts/common.sh@335 -- # read -ra ver1 00:03:33.617 02:06:01 -- scripts/common.sh@336 -- # IFS=.-: 00:03:33.617 02:06:01 -- scripts/common.sh@336 -- # read -ra ver2 00:03:33.617 02:06:01 -- scripts/common.sh@337 -- # local 'op=<' 00:03:33.617 02:06:01 -- scripts/common.sh@339 -- # ver1_l=2 00:03:33.617 02:06:01 -- scripts/common.sh@340 -- # ver2_l=1 00:03:33.617 02:06:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:33.617 02:06:01 -- scripts/common.sh@343 -- # case "$op" in 00:03:33.617 02:06:01 -- scripts/common.sh@344 -- # : 1 00:03:33.617 02:06:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:33.617 02:06:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:33.617 02:06:01 -- scripts/common.sh@364 -- # decimal 1 00:03:33.617 02:06:01 -- scripts/common.sh@352 -- # local d=1 00:03:33.617 02:06:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:33.617 02:06:01 -- scripts/common.sh@354 -- # echo 1 00:03:33.617 02:06:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:33.617 02:06:01 -- scripts/common.sh@365 -- # decimal 2 00:03:33.617 02:06:01 -- scripts/common.sh@352 -- # local d=2 00:03:33.617 02:06:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:33.617 02:06:01 -- scripts/common.sh@354 -- # echo 2 00:03:33.617 02:06:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:33.617 02:06:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:33.617 02:06:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:33.617 02:06:01 -- scripts/common.sh@367 -- # return 0 00:03:33.617 02:06:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:33.617 02:06:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:33.617 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:33.617 --rc genhtml_branch_coverage=1 00:03:33.617 --rc genhtml_function_coverage=1 00:03:33.617 --rc genhtml_legend=1 00:03:33.617 --rc geninfo_all_blocks=1 00:03:33.617 --rc geninfo_unexecuted_blocks=1 00:03:33.617 00:03:33.617 ' 00:03:33.617 02:06:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:33.617 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:33.617 --rc genhtml_branch_coverage=1 00:03:33.617 --rc genhtml_function_coverage=1 00:03:33.617 --rc genhtml_legend=1 00:03:33.617 --rc geninfo_all_blocks=1 00:03:33.617 --rc geninfo_unexecuted_blocks=1 00:03:33.617 00:03:33.617 ' 00:03:33.617 02:06:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:33.617 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:33.617 --rc genhtml_branch_coverage=1 00:03:33.617 --rc genhtml_function_coverage=1 00:03:33.617 --rc genhtml_legend=1 00:03:33.617 --rc geninfo_all_blocks=1 00:03:33.617 --rc geninfo_unexecuted_blocks=1 00:03:33.617 00:03:33.617 ' 00:03:33.617 02:06:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:33.617 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:33.617 --rc genhtml_branch_coverage=1 00:03:33.617 --rc genhtml_function_coverage=1 00:03:33.617 --rc genhtml_legend=1 00:03:33.617 --rc geninfo_all_blocks=1 00:03:33.617 --rc geninfo_unexecuted_blocks=1 00:03:33.617 00:03:33.617 ' 00:03:33.617 02:06:01 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:03:33.617 02:06:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:33.617 02:06:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:33.617 02:06:01 -- common/autotest_common.sh@10 -- # set +x 00:03:33.617 ************************************ 00:03:33.617 START TEST env_memory 00:03:33.617 ************************************ 00:03:33.618 02:06:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:03:33.618 00:03:33.618 00:03:33.618 CUnit - A unit testing framework for C - Version 2.1-3 00:03:33.618 http://cunit.sourceforge.net/ 00:03:33.618 00:03:33.618 00:03:33.618 Suite: memory 00:03:33.618 Test: alloc and free memory map ...[2024-12-08 02:06:01.353567] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:03:33.618 passed 00:03:33.618 Test: mem map translation ...[2024-12-08 02:06:01.374390] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:03:33.618 [2024-12-08 02:06:01.374414] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:03:33.618 [2024-12-08 02:06:01.374467] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:03:33.618 [2024-12-08 02:06:01.374489] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:03:33.877 passed 00:03:33.877 Test: mem map registration ...[2024-12-08 02:06:01.417105] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:03:33.877 [2024-12-08 02:06:01.417126] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:03:33.877 passed 00:03:33.877 Test: mem map adjacent registrations ...passed 00:03:33.877 00:03:33.877 Run Summary: Type Total Ran Passed Failed Inactive 00:03:33.877 suites 1 1 n/a 0 0 00:03:33.877 tests 4 4 4 0 0 00:03:33.877 asserts 152 152 152 0 n/a 00:03:33.877 00:03:33.877 Elapsed time = 0.145 seconds 00:03:33.877 00:03:33.877 real 0m0.151s 00:03:33.877 user 0m0.145s 00:03:33.877 sys 0m0.005s 00:03:33.877 02:06:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:33.877 02:06:01 -- common/autotest_common.sh@10 -- # set +x 00:03:33.877 ************************************ 00:03:33.877 END TEST env_memory 00:03:33.877 ************************************ 00:03:33.877 02:06:01 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:03:33.877 02:06:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:33.877 02:06:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:33.877 02:06:01 -- common/autotest_common.sh@10 -- # set +x 00:03:33.877 ************************************ 00:03:33.877 START TEST env_vtophys 00:03:33.877 ************************************ 00:03:33.877 02:06:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:03:33.877 EAL: lib.eal log level changed from notice to debug 00:03:33.877 EAL: Detected lcore 0 as core 0 on socket 0 00:03:33.877 EAL: Detected lcore 1 as core 1 on socket 0 00:03:33.877 EAL: Detected lcore 2 as core 2 on socket 0 00:03:33.877 EAL: Detected lcore 3 as core 3 on socket 0 00:03:33.877 EAL: Detected lcore 4 as core 4 on socket 0 00:03:33.877 EAL: Detected lcore 5 as core 5 on socket 0 00:03:33.877 EAL: Detected lcore 6 as core 8 on socket 0 00:03:33.877 EAL: Detected lcore 7 as core 9 on socket 0 00:03:33.877 EAL: Detected lcore 8 as core 10 on socket 0 00:03:33.877 EAL: Detected lcore 9 as core 11 on socket 0 00:03:33.877 EAL: Detected lcore 10 as core 12 on socket 0 00:03:33.877 EAL: Detected lcore 11 as core 13 on socket 0 00:03:33.877 EAL: Detected lcore 12 as core 0 on socket 1 00:03:33.877 EAL: Detected lcore 13 as core 1 on socket 1 00:03:33.877 EAL: Detected lcore 14 as core 2 on socket 1 00:03:33.877 EAL: Detected lcore 15 as core 3 on socket 1 00:03:33.877 EAL: Detected lcore 16 as core 4 on socket 1 00:03:33.877 EAL: Detected lcore 17 as core 5 on socket 1 00:03:33.877 EAL: Detected lcore 18 as core 8 on socket 1 00:03:33.877 EAL: Detected lcore 19 as core 9 on socket 1 00:03:33.877 EAL: Detected lcore 20 as core 10 on socket 1 00:03:33.877 EAL: Detected lcore 21 as core 11 on socket 1 00:03:33.877 EAL: Detected lcore 22 as core 12 on socket 1 00:03:33.877 EAL: Detected lcore 23 as core 13 on socket 1 00:03:33.877 EAL: Detected lcore 24 as core 0 on socket 0 00:03:33.877 EAL: Detected lcore 25 as core 1 on socket 0 00:03:33.877 EAL: Detected lcore 26 as core 2 on socket 0 00:03:33.877 EAL: Detected lcore 27 as core 3 on socket 0 00:03:33.877 EAL: Detected lcore 28 as core 4 on socket 0 00:03:33.877 EAL: Detected lcore 29 as core 5 on socket 0 00:03:33.877 EAL: Detected lcore 30 as core 8 on socket 0 00:03:33.877 EAL: Detected lcore 31 as core 9 on socket 0 00:03:33.877 EAL: Detected lcore 32 as core 10 on socket 0 00:03:33.877 EAL: Detected lcore 33 as core 11 on socket 0 00:03:33.877 EAL: Detected lcore 34 as core 12 on socket 0 00:03:33.877 EAL: Detected lcore 35 as core 13 on socket 0 00:03:33.877 EAL: Detected lcore 36 as core 0 on socket 1 00:03:33.877 EAL: Detected lcore 37 as core 1 on socket 1 00:03:33.877 EAL: Detected lcore 38 as core 2 on socket 1 00:03:33.877 EAL: Detected lcore 39 as core 3 on socket 1 00:03:33.877 EAL: Detected lcore 40 as core 4 on socket 1 00:03:33.877 EAL: Detected lcore 41 as core 5 on socket 1 00:03:33.877 EAL: Detected lcore 42 as core 8 on socket 1 00:03:33.877 EAL: Detected lcore 43 as core 9 on socket 1 00:03:33.877 EAL: Detected lcore 44 as core 10 on socket 1 00:03:33.877 EAL: Detected lcore 45 as core 11 on socket 1 00:03:33.877 EAL: Detected lcore 46 as core 12 on socket 1 00:03:33.877 EAL: Detected lcore 47 as core 13 on socket 1 00:03:33.877 EAL: Maximum logical cores by configuration: 128 00:03:33.877 EAL: Detected CPU lcores: 48 00:03:33.877 EAL: Detected NUMA nodes: 2 00:03:33.877 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:03:33.877 EAL: Detected shared linkage of DPDK 00:03:33.877 EAL: No shared files mode enabled, IPC will be disabled 00:03:33.877 EAL: Bus pci wants IOVA as 'DC' 00:03:33.877 EAL: Buses did not request a specific IOVA mode. 00:03:33.877 EAL: IOMMU is available, selecting IOVA as VA mode. 00:03:33.877 EAL: Selected IOVA mode 'VA' 00:03:33.877 EAL: No free 2048 kB hugepages reported on node 1 00:03:33.877 EAL: Probing VFIO support... 00:03:33.877 EAL: IOMMU type 1 (Type 1) is supported 00:03:33.877 EAL: IOMMU type 7 (sPAPR) is not supported 00:03:33.877 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:03:33.877 EAL: VFIO support initialized 00:03:33.877 EAL: Ask a virtual area of 0x2e000 bytes 00:03:33.877 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:03:33.877 EAL: Setting up physically contiguous memory... 00:03:33.877 EAL: Setting maximum number of open files to 524288 00:03:33.877 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:03:33.877 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:03:33.877 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:03:33.877 EAL: Ask a virtual area of 0x61000 bytes 00:03:33.877 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:03:33.877 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:33.877 EAL: Ask a virtual area of 0x400000000 bytes 00:03:33.877 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:03:33.877 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:03:33.877 EAL: Ask a virtual area of 0x61000 bytes 00:03:33.877 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:03:33.877 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:33.877 EAL: Ask a virtual area of 0x400000000 bytes 00:03:33.877 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:03:33.877 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:03:33.877 EAL: Ask a virtual area of 0x61000 bytes 00:03:33.877 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:03:33.877 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:33.877 EAL: Ask a virtual area of 0x400000000 bytes 00:03:33.877 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:03:33.877 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:03:33.877 EAL: Ask a virtual area of 0x61000 bytes 00:03:33.877 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:03:33.877 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:33.877 EAL: Ask a virtual area of 0x400000000 bytes 00:03:33.877 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:03:33.877 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:03:33.877 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:03:33.877 EAL: Ask a virtual area of 0x61000 bytes 00:03:33.877 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:03:33.878 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:33.878 EAL: Ask a virtual area of 0x400000000 bytes 00:03:33.878 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:03:33.878 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:03:33.878 EAL: Ask a virtual area of 0x61000 bytes 00:03:33.878 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:03:33.878 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:33.878 EAL: Ask a virtual area of 0x400000000 bytes 00:03:33.878 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:03:33.878 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:03:33.878 EAL: Ask a virtual area of 0x61000 bytes 00:03:33.878 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:03:33.878 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:33.878 EAL: Ask a virtual area of 0x400000000 bytes 00:03:33.878 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:03:33.878 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:03:33.878 EAL: Ask a virtual area of 0x61000 bytes 00:03:33.878 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:03:33.878 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:33.878 EAL: Ask a virtual area of 0x400000000 bytes 00:03:33.878 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:03:33.878 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:03:33.878 EAL: Hugepages will be freed exactly as allocated. 00:03:33.878 EAL: No shared files mode enabled, IPC is disabled 00:03:33.878 EAL: No shared files mode enabled, IPC is disabled 00:03:33.878 EAL: TSC frequency is ~2700000 KHz 00:03:33.878 EAL: Main lcore 0 is ready (tid=7fa46da5ba00;cpuset=[0]) 00:03:33.878 EAL: Trying to obtain current memory policy. 00:03:33.878 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:33.878 EAL: Restoring previous memory policy: 0 00:03:33.878 EAL: request: mp_malloc_sync 00:03:33.878 EAL: No shared files mode enabled, IPC is disabled 00:03:33.878 EAL: Heap on socket 0 was expanded by 2MB 00:03:33.878 EAL: No shared files mode enabled, IPC is disabled 00:03:33.878 EAL: No PCI address specified using 'addr=' in: bus=pci 00:03:33.878 EAL: Mem event callback 'spdk:(nil)' registered 00:03:33.878 00:03:33.878 00:03:33.878 CUnit - A unit testing framework for C - Version 2.1-3 00:03:33.878 http://cunit.sourceforge.net/ 00:03:33.878 00:03:33.878 00:03:33.878 Suite: components_suite 00:03:33.878 Test: vtophys_malloc_test ...passed 00:03:33.878 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:03:33.878 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:33.878 EAL: Restoring previous memory policy: 4 00:03:33.878 EAL: Calling mem event callback 'spdk:(nil)' 00:03:33.878 EAL: request: mp_malloc_sync 00:03:33.878 EAL: No shared files mode enabled, IPC is disabled 00:03:33.878 EAL: Heap on socket 0 was expanded by 4MB 00:03:33.878 EAL: Calling mem event callback 'spdk:(nil)' 00:03:33.878 EAL: request: mp_malloc_sync 00:03:33.878 EAL: No shared files mode enabled, IPC is disabled 00:03:33.878 EAL: Heap on socket 0 was shrunk by 4MB 00:03:33.878 EAL: Trying to obtain current memory policy. 00:03:33.878 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:33.878 EAL: Restoring previous memory policy: 4 00:03:33.878 EAL: Calling mem event callback 'spdk:(nil)' 00:03:33.878 EAL: request: mp_malloc_sync 00:03:33.878 EAL: No shared files mode enabled, IPC is disabled 00:03:33.878 EAL: Heap on socket 0 was expanded by 6MB 00:03:33.878 EAL: Calling mem event callback 'spdk:(nil)' 00:03:33.878 EAL: request: mp_malloc_sync 00:03:33.878 EAL: No shared files mode enabled, IPC is disabled 00:03:33.878 EAL: Heap on socket 0 was shrunk by 6MB 00:03:33.878 EAL: Trying to obtain current memory policy. 00:03:33.878 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:33.878 EAL: Restoring previous memory policy: 4 00:03:33.878 EAL: Calling mem event callback 'spdk:(nil)' 00:03:33.878 EAL: request: mp_malloc_sync 00:03:33.878 EAL: No shared files mode enabled, IPC is disabled 00:03:33.878 EAL: Heap on socket 0 was expanded by 10MB 00:03:33.878 EAL: Calling mem event callback 'spdk:(nil)' 00:03:33.878 EAL: request: mp_malloc_sync 00:03:33.878 EAL: No shared files mode enabled, IPC is disabled 00:03:33.878 EAL: Heap on socket 0 was shrunk by 10MB 00:03:33.878 EAL: Trying to obtain current memory policy. 00:03:33.878 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:33.878 EAL: Restoring previous memory policy: 4 00:03:33.878 EAL: Calling mem event callback 'spdk:(nil)' 00:03:33.878 EAL: request: mp_malloc_sync 00:03:33.878 EAL: No shared files mode enabled, IPC is disabled 00:03:33.878 EAL: Heap on socket 0 was expanded by 18MB 00:03:33.878 EAL: Calling mem event callback 'spdk:(nil)' 00:03:33.878 EAL: request: mp_malloc_sync 00:03:33.878 EAL: No shared files mode enabled, IPC is disabled 00:03:33.878 EAL: Heap on socket 0 was shrunk by 18MB 00:03:33.878 EAL: Trying to obtain current memory policy. 00:03:33.878 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:33.878 EAL: Restoring previous memory policy: 4 00:03:33.878 EAL: Calling mem event callback 'spdk:(nil)' 00:03:33.878 EAL: request: mp_malloc_sync 00:03:33.878 EAL: No shared files mode enabled, IPC is disabled 00:03:33.878 EAL: Heap on socket 0 was expanded by 34MB 00:03:33.878 EAL: Calling mem event callback 'spdk:(nil)' 00:03:33.878 EAL: request: mp_malloc_sync 00:03:33.878 EAL: No shared files mode enabled, IPC is disabled 00:03:33.878 EAL: Heap on socket 0 was shrunk by 34MB 00:03:33.878 EAL: Trying to obtain current memory policy. 00:03:33.878 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:33.878 EAL: Restoring previous memory policy: 4 00:03:33.878 EAL: Calling mem event callback 'spdk:(nil)' 00:03:33.878 EAL: request: mp_malloc_sync 00:03:33.878 EAL: No shared files mode enabled, IPC is disabled 00:03:33.878 EAL: Heap on socket 0 was expanded by 66MB 00:03:33.878 EAL: Calling mem event callback 'spdk:(nil)' 00:03:33.878 EAL: request: mp_malloc_sync 00:03:33.878 EAL: No shared files mode enabled, IPC is disabled 00:03:33.878 EAL: Heap on socket 0 was shrunk by 66MB 00:03:33.878 EAL: Trying to obtain current memory policy. 00:03:33.878 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:34.136 EAL: Restoring previous memory policy: 4 00:03:34.136 EAL: Calling mem event callback 'spdk:(nil)' 00:03:34.136 EAL: request: mp_malloc_sync 00:03:34.136 EAL: No shared files mode enabled, IPC is disabled 00:03:34.136 EAL: Heap on socket 0 was expanded by 130MB 00:03:34.136 EAL: Calling mem event callback 'spdk:(nil)' 00:03:34.136 EAL: request: mp_malloc_sync 00:03:34.136 EAL: No shared files mode enabled, IPC is disabled 00:03:34.136 EAL: Heap on socket 0 was shrunk by 130MB 00:03:34.136 EAL: Trying to obtain current memory policy. 00:03:34.136 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:34.136 EAL: Restoring previous memory policy: 4 00:03:34.136 EAL: Calling mem event callback 'spdk:(nil)' 00:03:34.136 EAL: request: mp_malloc_sync 00:03:34.136 EAL: No shared files mode enabled, IPC is disabled 00:03:34.136 EAL: Heap on socket 0 was expanded by 258MB 00:03:34.136 EAL: Calling mem event callback 'spdk:(nil)' 00:03:34.136 EAL: request: mp_malloc_sync 00:03:34.136 EAL: No shared files mode enabled, IPC is disabled 00:03:34.136 EAL: Heap on socket 0 was shrunk by 258MB 00:03:34.136 EAL: Trying to obtain current memory policy. 00:03:34.136 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:34.393 EAL: Restoring previous memory policy: 4 00:03:34.393 EAL: Calling mem event callback 'spdk:(nil)' 00:03:34.393 EAL: request: mp_malloc_sync 00:03:34.393 EAL: No shared files mode enabled, IPC is disabled 00:03:34.393 EAL: Heap on socket 0 was expanded by 514MB 00:03:34.394 EAL: Calling mem event callback 'spdk:(nil)' 00:03:34.651 EAL: request: mp_malloc_sync 00:03:34.651 EAL: No shared files mode enabled, IPC is disabled 00:03:34.651 EAL: Heap on socket 0 was shrunk by 514MB 00:03:34.651 EAL: Trying to obtain current memory policy. 00:03:34.651 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:34.909 EAL: Restoring previous memory policy: 4 00:03:34.909 EAL: Calling mem event callback 'spdk:(nil)' 00:03:34.909 EAL: request: mp_malloc_sync 00:03:34.909 EAL: No shared files mode enabled, IPC is disabled 00:03:34.909 EAL: Heap on socket 0 was expanded by 1026MB 00:03:35.167 EAL: Calling mem event callback 'spdk:(nil)' 00:03:35.426 EAL: request: mp_malloc_sync 00:03:35.426 EAL: No shared files mode enabled, IPC is disabled 00:03:35.426 EAL: Heap on socket 0 was shrunk by 1026MB 00:03:35.426 passed 00:03:35.426 00:03:35.426 Run Summary: Type Total Ran Passed Failed Inactive 00:03:35.426 suites 1 1 n/a 0 0 00:03:35.426 tests 2 2 2 0 0 00:03:35.426 asserts 497 497 497 0 n/a 00:03:35.426 00:03:35.426 Elapsed time = 1.375 seconds 00:03:35.426 EAL: Calling mem event callback 'spdk:(nil)' 00:03:35.426 EAL: request: mp_malloc_sync 00:03:35.426 EAL: No shared files mode enabled, IPC is disabled 00:03:35.426 EAL: Heap on socket 0 was shrunk by 2MB 00:03:35.426 EAL: No shared files mode enabled, IPC is disabled 00:03:35.426 EAL: No shared files mode enabled, IPC is disabled 00:03:35.426 EAL: No shared files mode enabled, IPC is disabled 00:03:35.426 00:03:35.426 real 0m1.495s 00:03:35.426 user 0m0.841s 00:03:35.426 sys 0m0.619s 00:03:35.426 02:06:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:35.426 02:06:02 -- common/autotest_common.sh@10 -- # set +x 00:03:35.426 ************************************ 00:03:35.426 END TEST env_vtophys 00:03:35.426 ************************************ 00:03:35.426 02:06:03 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:03:35.426 02:06:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:35.426 02:06:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:35.426 02:06:03 -- common/autotest_common.sh@10 -- # set +x 00:03:35.426 ************************************ 00:03:35.426 START TEST env_pci 00:03:35.426 ************************************ 00:03:35.426 02:06:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:03:35.426 00:03:35.426 00:03:35.426 CUnit - A unit testing framework for C - Version 2.1-3 00:03:35.426 http://cunit.sourceforge.net/ 00:03:35.426 00:03:35.426 00:03:35.426 Suite: pci 00:03:35.426 Test: pci_hook ...[2024-12-08 02:06:03.037963] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 1981377 has claimed it 00:03:35.426 EAL: Cannot find device (10000:00:01.0) 00:03:35.426 EAL: Failed to attach device on primary process 00:03:35.426 passed 00:03:35.426 00:03:35.426 Run Summary: Type Total Ran Passed Failed Inactive 00:03:35.426 suites 1 1 n/a 0 0 00:03:35.426 tests 1 1 1 0 0 00:03:35.426 asserts 25 25 25 0 n/a 00:03:35.426 00:03:35.426 Elapsed time = 0.021 seconds 00:03:35.426 00:03:35.426 real 0m0.035s 00:03:35.426 user 0m0.015s 00:03:35.426 sys 0m0.021s 00:03:35.426 02:06:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:35.426 02:06:03 -- common/autotest_common.sh@10 -- # set +x 00:03:35.426 ************************************ 00:03:35.426 END TEST env_pci 00:03:35.426 ************************************ 00:03:35.426 02:06:03 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:03:35.426 02:06:03 -- env/env.sh@15 -- # uname 00:03:35.426 02:06:03 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:03:35.426 02:06:03 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:03:35.426 02:06:03 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:03:35.426 02:06:03 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:03:35.426 02:06:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:35.426 02:06:03 -- common/autotest_common.sh@10 -- # set +x 00:03:35.426 ************************************ 00:03:35.426 START TEST env_dpdk_post_init 00:03:35.426 ************************************ 00:03:35.426 02:06:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:03:35.426 EAL: Detected CPU lcores: 48 00:03:35.426 EAL: Detected NUMA nodes: 2 00:03:35.426 EAL: Detected shared linkage of DPDK 00:03:35.426 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:03:35.426 EAL: Selected IOVA mode 'VA' 00:03:35.426 EAL: No free 2048 kB hugepages reported on node 1 00:03:35.426 EAL: VFIO support initialized 00:03:35.426 TELEMETRY: No legacy callbacks, legacy socket not created 00:03:35.426 EAL: Using IOMMU type 1 (Type 1) 00:03:35.685 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:03:35.685 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:03:35.685 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:03:35.685 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:03:35.685 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:03:35.685 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:03:35.685 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:03:35.685 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:03:35.685 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:03:35.685 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:03:35.685 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:03:35.685 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:03:35.685 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:03:35.685 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:03:35.685 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:03:35.685 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:03:36.620 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:03:39.900 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:03:39.900 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:03:39.900 Starting DPDK initialization... 00:03:39.900 Starting SPDK post initialization... 00:03:39.900 SPDK NVMe probe 00:03:39.900 Attaching to 0000:88:00.0 00:03:39.900 Attached to 0000:88:00.0 00:03:39.900 Cleaning up... 00:03:39.900 00:03:39.900 real 0m4.400s 00:03:39.900 user 0m3.288s 00:03:39.900 sys 0m0.168s 00:03:39.900 02:06:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:39.900 02:06:07 -- common/autotest_common.sh@10 -- # set +x 00:03:39.900 ************************************ 00:03:39.900 END TEST env_dpdk_post_init 00:03:39.900 ************************************ 00:03:39.900 02:06:07 -- env/env.sh@26 -- # uname 00:03:39.900 02:06:07 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:03:39.900 02:06:07 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:03:39.900 02:06:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:39.900 02:06:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:39.900 02:06:07 -- common/autotest_common.sh@10 -- # set +x 00:03:39.900 ************************************ 00:03:39.900 START TEST env_mem_callbacks 00:03:39.900 ************************************ 00:03:39.900 02:06:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:03:39.900 EAL: Detected CPU lcores: 48 00:03:39.900 EAL: Detected NUMA nodes: 2 00:03:39.900 EAL: Detected shared linkage of DPDK 00:03:39.900 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:03:39.900 EAL: Selected IOVA mode 'VA' 00:03:39.900 EAL: No free 2048 kB hugepages reported on node 1 00:03:39.900 EAL: VFIO support initialized 00:03:39.900 TELEMETRY: No legacy callbacks, legacy socket not created 00:03:39.900 00:03:39.900 00:03:39.900 CUnit - A unit testing framework for C - Version 2.1-3 00:03:39.900 http://cunit.sourceforge.net/ 00:03:39.900 00:03:39.900 00:03:39.900 Suite: memory 00:03:39.900 Test: test ... 00:03:39.900 register 0x200000200000 2097152 00:03:39.900 malloc 3145728 00:03:39.900 register 0x200000400000 4194304 00:03:39.900 buf 0x200000500000 len 3145728 PASSED 00:03:39.900 malloc 64 00:03:39.900 buf 0x2000004fff40 len 64 PASSED 00:03:39.900 malloc 4194304 00:03:39.900 register 0x200000800000 6291456 00:03:39.900 buf 0x200000a00000 len 4194304 PASSED 00:03:39.900 free 0x200000500000 3145728 00:03:39.900 free 0x2000004fff40 64 00:03:39.900 unregister 0x200000400000 4194304 PASSED 00:03:39.900 free 0x200000a00000 4194304 00:03:39.900 unregister 0x200000800000 6291456 PASSED 00:03:39.900 malloc 8388608 00:03:39.900 register 0x200000400000 10485760 00:03:39.900 buf 0x200000600000 len 8388608 PASSED 00:03:39.900 free 0x200000600000 8388608 00:03:39.900 unregister 0x200000400000 10485760 PASSED 00:03:39.900 passed 00:03:39.900 00:03:39.900 Run Summary: Type Total Ran Passed Failed Inactive 00:03:39.900 suites 1 1 n/a 0 0 00:03:39.900 tests 1 1 1 0 0 00:03:39.900 asserts 15 15 15 0 n/a 00:03:39.900 00:03:39.900 Elapsed time = 0.005 seconds 00:03:39.900 00:03:39.900 real 0m0.049s 00:03:39.900 user 0m0.018s 00:03:39.900 sys 0m0.030s 00:03:39.900 02:06:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:39.900 02:06:07 -- common/autotest_common.sh@10 -- # set +x 00:03:39.900 ************************************ 00:03:39.900 END TEST env_mem_callbacks 00:03:39.900 ************************************ 00:03:39.900 00:03:39.900 real 0m6.412s 00:03:39.900 user 0m4.443s 00:03:39.900 sys 0m1.019s 00:03:39.900 02:06:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:39.900 02:06:07 -- common/autotest_common.sh@10 -- # set +x 00:03:39.900 ************************************ 00:03:39.900 END TEST env 00:03:39.900 ************************************ 00:03:39.900 02:06:07 -- spdk/autotest.sh@163 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:03:39.900 02:06:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:39.900 02:06:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:39.900 02:06:07 -- common/autotest_common.sh@10 -- # set +x 00:03:39.900 ************************************ 00:03:39.900 START TEST rpc 00:03:39.900 ************************************ 00:03:39.900 02:06:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:03:39.900 * Looking for test storage... 00:03:39.900 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:03:39.900 02:06:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:39.900 02:06:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:39.900 02:06:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:40.161 02:06:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:40.161 02:06:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:40.161 02:06:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:40.161 02:06:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:40.161 02:06:07 -- scripts/common.sh@335 -- # IFS=.-: 00:03:40.161 02:06:07 -- scripts/common.sh@335 -- # read -ra ver1 00:03:40.161 02:06:07 -- scripts/common.sh@336 -- # IFS=.-: 00:03:40.161 02:06:07 -- scripts/common.sh@336 -- # read -ra ver2 00:03:40.161 02:06:07 -- scripts/common.sh@337 -- # local 'op=<' 00:03:40.161 02:06:07 -- scripts/common.sh@339 -- # ver1_l=2 00:03:40.161 02:06:07 -- scripts/common.sh@340 -- # ver2_l=1 00:03:40.161 02:06:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:40.161 02:06:07 -- scripts/common.sh@343 -- # case "$op" in 00:03:40.161 02:06:07 -- scripts/common.sh@344 -- # : 1 00:03:40.161 02:06:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:40.161 02:06:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:40.161 02:06:07 -- scripts/common.sh@364 -- # decimal 1 00:03:40.161 02:06:07 -- scripts/common.sh@352 -- # local d=1 00:03:40.161 02:06:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:40.161 02:06:07 -- scripts/common.sh@354 -- # echo 1 00:03:40.161 02:06:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:40.161 02:06:07 -- scripts/common.sh@365 -- # decimal 2 00:03:40.161 02:06:07 -- scripts/common.sh@352 -- # local d=2 00:03:40.161 02:06:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:40.161 02:06:07 -- scripts/common.sh@354 -- # echo 2 00:03:40.161 02:06:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:40.161 02:06:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:40.161 02:06:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:40.161 02:06:07 -- scripts/common.sh@367 -- # return 0 00:03:40.161 02:06:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:40.161 02:06:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:40.161 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:40.161 --rc genhtml_branch_coverage=1 00:03:40.161 --rc genhtml_function_coverage=1 00:03:40.161 --rc genhtml_legend=1 00:03:40.161 --rc geninfo_all_blocks=1 00:03:40.161 --rc geninfo_unexecuted_blocks=1 00:03:40.161 00:03:40.161 ' 00:03:40.161 02:06:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:40.161 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:40.161 --rc genhtml_branch_coverage=1 00:03:40.161 --rc genhtml_function_coverage=1 00:03:40.161 --rc genhtml_legend=1 00:03:40.161 --rc geninfo_all_blocks=1 00:03:40.161 --rc geninfo_unexecuted_blocks=1 00:03:40.161 00:03:40.161 ' 00:03:40.161 02:06:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:40.161 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:40.161 --rc genhtml_branch_coverage=1 00:03:40.161 --rc genhtml_function_coverage=1 00:03:40.161 --rc genhtml_legend=1 00:03:40.161 --rc geninfo_all_blocks=1 00:03:40.161 --rc geninfo_unexecuted_blocks=1 00:03:40.161 00:03:40.161 ' 00:03:40.161 02:06:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:40.161 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:40.161 --rc genhtml_branch_coverage=1 00:03:40.161 --rc genhtml_function_coverage=1 00:03:40.161 --rc genhtml_legend=1 00:03:40.161 --rc geninfo_all_blocks=1 00:03:40.161 --rc geninfo_unexecuted_blocks=1 00:03:40.161 00:03:40.161 ' 00:03:40.161 02:06:07 -- rpc/rpc.sh@65 -- # spdk_pid=1982292 00:03:40.161 02:06:07 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:03:40.161 02:06:07 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:03:40.161 02:06:07 -- rpc/rpc.sh@67 -- # waitforlisten 1982292 00:03:40.161 02:06:07 -- common/autotest_common.sh@829 -- # '[' -z 1982292 ']' 00:03:40.161 02:06:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:03:40.161 02:06:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:40.161 02:06:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:03:40.161 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:03:40.161 02:06:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:40.161 02:06:07 -- common/autotest_common.sh@10 -- # set +x 00:03:40.161 [2024-12-08 02:06:07.804300] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:40.161 [2024-12-08 02:06:07.804404] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1982292 ] 00:03:40.161 EAL: No free 2048 kB hugepages reported on node 1 00:03:40.161 [2024-12-08 02:06:07.870851] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:40.460 [2024-12-08 02:06:07.994117] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:40.460 [2024-12-08 02:06:07.994261] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:03:40.460 [2024-12-08 02:06:07.994282] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 1982292' to capture a snapshot of events at runtime. 00:03:40.460 [2024-12-08 02:06:07.994294] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid1982292 for offline analysis/debug. 00:03:40.460 [2024-12-08 02:06:07.994320] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:41.054 02:06:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:03:41.054 02:06:08 -- common/autotest_common.sh@862 -- # return 0 00:03:41.054 02:06:08 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:03:41.054 02:06:08 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:03:41.054 02:06:08 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:03:41.054 02:06:08 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:03:41.054 02:06:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:41.054 02:06:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:41.054 02:06:08 -- common/autotest_common.sh@10 -- # set +x 00:03:41.054 ************************************ 00:03:41.054 START TEST rpc_integrity 00:03:41.054 ************************************ 00:03:41.054 02:06:08 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:03:41.054 02:06:08 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:03:41.054 02:06:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:41.054 02:06:08 -- common/autotest_common.sh@10 -- # set +x 00:03:41.054 02:06:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:41.054 02:06:08 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:03:41.054 02:06:08 -- rpc/rpc.sh@13 -- # jq length 00:03:41.054 02:06:08 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:03:41.054 02:06:08 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:03:41.054 02:06:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:41.054 02:06:08 -- common/autotest_common.sh@10 -- # set +x 00:03:41.313 02:06:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:41.313 02:06:08 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:03:41.313 02:06:08 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:03:41.313 02:06:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:41.313 02:06:08 -- common/autotest_common.sh@10 -- # set +x 00:03:41.313 02:06:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:41.313 02:06:08 -- rpc/rpc.sh@16 -- # bdevs='[ 00:03:41.313 { 00:03:41.313 "name": "Malloc0", 00:03:41.313 "aliases": [ 00:03:41.313 "f52c5244-7ab0-4554-805b-ebfefed71e8a" 00:03:41.313 ], 00:03:41.313 "product_name": "Malloc disk", 00:03:41.313 "block_size": 512, 00:03:41.313 "num_blocks": 16384, 00:03:41.313 "uuid": "f52c5244-7ab0-4554-805b-ebfefed71e8a", 00:03:41.313 "assigned_rate_limits": { 00:03:41.313 "rw_ios_per_sec": 0, 00:03:41.313 "rw_mbytes_per_sec": 0, 00:03:41.313 "r_mbytes_per_sec": 0, 00:03:41.313 "w_mbytes_per_sec": 0 00:03:41.313 }, 00:03:41.313 "claimed": false, 00:03:41.313 "zoned": false, 00:03:41.313 "supported_io_types": { 00:03:41.313 "read": true, 00:03:41.313 "write": true, 00:03:41.313 "unmap": true, 00:03:41.313 "write_zeroes": true, 00:03:41.313 "flush": true, 00:03:41.313 "reset": true, 00:03:41.313 "compare": false, 00:03:41.313 "compare_and_write": false, 00:03:41.313 "abort": true, 00:03:41.313 "nvme_admin": false, 00:03:41.313 "nvme_io": false 00:03:41.313 }, 00:03:41.313 "memory_domains": [ 00:03:41.313 { 00:03:41.313 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:41.313 "dma_device_type": 2 00:03:41.313 } 00:03:41.313 ], 00:03:41.313 "driver_specific": {} 00:03:41.313 } 00:03:41.313 ]' 00:03:41.313 02:06:08 -- rpc/rpc.sh@17 -- # jq length 00:03:41.313 02:06:08 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:03:41.313 02:06:08 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:03:41.313 02:06:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:41.313 02:06:08 -- common/autotest_common.sh@10 -- # set +x 00:03:41.313 [2024-12-08 02:06:08.893034] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:03:41.313 [2024-12-08 02:06:08.893085] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:03:41.313 [2024-12-08 02:06:08.893109] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x865cb0 00:03:41.313 [2024-12-08 02:06:08.893124] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:03:41.313 [2024-12-08 02:06:08.894597] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:03:41.313 [2024-12-08 02:06:08.894624] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:03:41.313 Passthru0 00:03:41.313 02:06:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:41.313 02:06:08 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:03:41.313 02:06:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:41.313 02:06:08 -- common/autotest_common.sh@10 -- # set +x 00:03:41.313 02:06:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:41.313 02:06:08 -- rpc/rpc.sh@20 -- # bdevs='[ 00:03:41.313 { 00:03:41.313 "name": "Malloc0", 00:03:41.313 "aliases": [ 00:03:41.313 "f52c5244-7ab0-4554-805b-ebfefed71e8a" 00:03:41.314 ], 00:03:41.314 "product_name": "Malloc disk", 00:03:41.314 "block_size": 512, 00:03:41.314 "num_blocks": 16384, 00:03:41.314 "uuid": "f52c5244-7ab0-4554-805b-ebfefed71e8a", 00:03:41.314 "assigned_rate_limits": { 00:03:41.314 "rw_ios_per_sec": 0, 00:03:41.314 "rw_mbytes_per_sec": 0, 00:03:41.314 "r_mbytes_per_sec": 0, 00:03:41.314 "w_mbytes_per_sec": 0 00:03:41.314 }, 00:03:41.314 "claimed": true, 00:03:41.314 "claim_type": "exclusive_write", 00:03:41.314 "zoned": false, 00:03:41.314 "supported_io_types": { 00:03:41.314 "read": true, 00:03:41.314 "write": true, 00:03:41.314 "unmap": true, 00:03:41.314 "write_zeroes": true, 00:03:41.314 "flush": true, 00:03:41.314 "reset": true, 00:03:41.314 "compare": false, 00:03:41.314 "compare_and_write": false, 00:03:41.314 "abort": true, 00:03:41.314 "nvme_admin": false, 00:03:41.314 "nvme_io": false 00:03:41.314 }, 00:03:41.314 "memory_domains": [ 00:03:41.314 { 00:03:41.314 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:41.314 "dma_device_type": 2 00:03:41.314 } 00:03:41.314 ], 00:03:41.314 "driver_specific": {} 00:03:41.314 }, 00:03:41.314 { 00:03:41.314 "name": "Passthru0", 00:03:41.314 "aliases": [ 00:03:41.314 "399b7f1b-a389-57ab-be9b-ae0774efeadc" 00:03:41.314 ], 00:03:41.314 "product_name": "passthru", 00:03:41.314 "block_size": 512, 00:03:41.314 "num_blocks": 16384, 00:03:41.314 "uuid": "399b7f1b-a389-57ab-be9b-ae0774efeadc", 00:03:41.314 "assigned_rate_limits": { 00:03:41.314 "rw_ios_per_sec": 0, 00:03:41.314 "rw_mbytes_per_sec": 0, 00:03:41.314 "r_mbytes_per_sec": 0, 00:03:41.314 "w_mbytes_per_sec": 0 00:03:41.314 }, 00:03:41.314 "claimed": false, 00:03:41.314 "zoned": false, 00:03:41.314 "supported_io_types": { 00:03:41.314 "read": true, 00:03:41.314 "write": true, 00:03:41.314 "unmap": true, 00:03:41.314 "write_zeroes": true, 00:03:41.314 "flush": true, 00:03:41.314 "reset": true, 00:03:41.314 "compare": false, 00:03:41.314 "compare_and_write": false, 00:03:41.314 "abort": true, 00:03:41.314 "nvme_admin": false, 00:03:41.314 "nvme_io": false 00:03:41.314 }, 00:03:41.314 "memory_domains": [ 00:03:41.314 { 00:03:41.314 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:41.314 "dma_device_type": 2 00:03:41.314 } 00:03:41.314 ], 00:03:41.314 "driver_specific": { 00:03:41.314 "passthru": { 00:03:41.314 "name": "Passthru0", 00:03:41.314 "base_bdev_name": "Malloc0" 00:03:41.314 } 00:03:41.314 } 00:03:41.314 } 00:03:41.314 ]' 00:03:41.314 02:06:08 -- rpc/rpc.sh@21 -- # jq length 00:03:41.314 02:06:08 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:03:41.314 02:06:08 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:03:41.314 02:06:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:41.314 02:06:08 -- common/autotest_common.sh@10 -- # set +x 00:03:41.314 02:06:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:41.314 02:06:08 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:03:41.314 02:06:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:41.314 02:06:08 -- common/autotest_common.sh@10 -- # set +x 00:03:41.314 02:06:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:41.314 02:06:08 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:03:41.314 02:06:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:41.314 02:06:08 -- common/autotest_common.sh@10 -- # set +x 00:03:41.314 02:06:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:41.314 02:06:08 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:03:41.314 02:06:08 -- rpc/rpc.sh@26 -- # jq length 00:03:41.314 02:06:09 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:03:41.314 00:03:41.314 real 0m0.226s 00:03:41.314 user 0m0.150s 00:03:41.314 sys 0m0.018s 00:03:41.314 02:06:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:41.314 02:06:09 -- common/autotest_common.sh@10 -- # set +x 00:03:41.314 ************************************ 00:03:41.314 END TEST rpc_integrity 00:03:41.314 ************************************ 00:03:41.314 02:06:09 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:03:41.314 02:06:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:41.314 02:06:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:41.314 02:06:09 -- common/autotest_common.sh@10 -- # set +x 00:03:41.314 ************************************ 00:03:41.314 START TEST rpc_plugins 00:03:41.314 ************************************ 00:03:41.314 02:06:09 -- common/autotest_common.sh@1114 -- # rpc_plugins 00:03:41.314 02:06:09 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:03:41.314 02:06:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:41.314 02:06:09 -- common/autotest_common.sh@10 -- # set +x 00:03:41.314 02:06:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:41.314 02:06:09 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:03:41.314 02:06:09 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:03:41.314 02:06:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:41.314 02:06:09 -- common/autotest_common.sh@10 -- # set +x 00:03:41.314 02:06:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:41.314 02:06:09 -- rpc/rpc.sh@31 -- # bdevs='[ 00:03:41.314 { 00:03:41.314 "name": "Malloc1", 00:03:41.314 "aliases": [ 00:03:41.314 "93eb0e00-b860-4525-9854-8e21d7d034a6" 00:03:41.314 ], 00:03:41.314 "product_name": "Malloc disk", 00:03:41.314 "block_size": 4096, 00:03:41.314 "num_blocks": 256, 00:03:41.314 "uuid": "93eb0e00-b860-4525-9854-8e21d7d034a6", 00:03:41.314 "assigned_rate_limits": { 00:03:41.314 "rw_ios_per_sec": 0, 00:03:41.314 "rw_mbytes_per_sec": 0, 00:03:41.314 "r_mbytes_per_sec": 0, 00:03:41.314 "w_mbytes_per_sec": 0 00:03:41.314 }, 00:03:41.314 "claimed": false, 00:03:41.314 "zoned": false, 00:03:41.314 "supported_io_types": { 00:03:41.314 "read": true, 00:03:41.314 "write": true, 00:03:41.314 "unmap": true, 00:03:41.314 "write_zeroes": true, 00:03:41.314 "flush": true, 00:03:41.314 "reset": true, 00:03:41.314 "compare": false, 00:03:41.314 "compare_and_write": false, 00:03:41.314 "abort": true, 00:03:41.314 "nvme_admin": false, 00:03:41.314 "nvme_io": false 00:03:41.314 }, 00:03:41.314 "memory_domains": [ 00:03:41.314 { 00:03:41.314 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:41.314 "dma_device_type": 2 00:03:41.314 } 00:03:41.314 ], 00:03:41.314 "driver_specific": {} 00:03:41.314 } 00:03:41.314 ]' 00:03:41.314 02:06:09 -- rpc/rpc.sh@32 -- # jq length 00:03:41.573 02:06:09 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:03:41.573 02:06:09 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:03:41.573 02:06:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:41.573 02:06:09 -- common/autotest_common.sh@10 -- # set +x 00:03:41.573 02:06:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:41.573 02:06:09 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:03:41.573 02:06:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:41.573 02:06:09 -- common/autotest_common.sh@10 -- # set +x 00:03:41.573 02:06:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:41.573 02:06:09 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:03:41.573 02:06:09 -- rpc/rpc.sh@36 -- # jq length 00:03:41.573 02:06:09 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:03:41.573 00:03:41.573 real 0m0.111s 00:03:41.573 user 0m0.068s 00:03:41.573 sys 0m0.014s 00:03:41.573 02:06:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:41.573 02:06:09 -- common/autotest_common.sh@10 -- # set +x 00:03:41.573 ************************************ 00:03:41.573 END TEST rpc_plugins 00:03:41.573 ************************************ 00:03:41.573 02:06:09 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:03:41.573 02:06:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:41.573 02:06:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:41.573 02:06:09 -- common/autotest_common.sh@10 -- # set +x 00:03:41.573 ************************************ 00:03:41.573 START TEST rpc_trace_cmd_test 00:03:41.573 ************************************ 00:03:41.573 02:06:09 -- common/autotest_common.sh@1114 -- # rpc_trace_cmd_test 00:03:41.573 02:06:09 -- rpc/rpc.sh@40 -- # local info 00:03:41.573 02:06:09 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:03:41.573 02:06:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:41.573 02:06:09 -- common/autotest_common.sh@10 -- # set +x 00:03:41.573 02:06:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:41.573 02:06:09 -- rpc/rpc.sh@42 -- # info='{ 00:03:41.573 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid1982292", 00:03:41.573 "tpoint_group_mask": "0x8", 00:03:41.573 "iscsi_conn": { 00:03:41.573 "mask": "0x2", 00:03:41.573 "tpoint_mask": "0x0" 00:03:41.573 }, 00:03:41.573 "scsi": { 00:03:41.573 "mask": "0x4", 00:03:41.573 "tpoint_mask": "0x0" 00:03:41.573 }, 00:03:41.573 "bdev": { 00:03:41.573 "mask": "0x8", 00:03:41.573 "tpoint_mask": "0xffffffffffffffff" 00:03:41.573 }, 00:03:41.573 "nvmf_rdma": { 00:03:41.573 "mask": "0x10", 00:03:41.573 "tpoint_mask": "0x0" 00:03:41.573 }, 00:03:41.573 "nvmf_tcp": { 00:03:41.573 "mask": "0x20", 00:03:41.573 "tpoint_mask": "0x0" 00:03:41.573 }, 00:03:41.573 "ftl": { 00:03:41.573 "mask": "0x40", 00:03:41.573 "tpoint_mask": "0x0" 00:03:41.573 }, 00:03:41.573 "blobfs": { 00:03:41.573 "mask": "0x80", 00:03:41.573 "tpoint_mask": "0x0" 00:03:41.573 }, 00:03:41.573 "dsa": { 00:03:41.573 "mask": "0x200", 00:03:41.573 "tpoint_mask": "0x0" 00:03:41.573 }, 00:03:41.573 "thread": { 00:03:41.573 "mask": "0x400", 00:03:41.573 "tpoint_mask": "0x0" 00:03:41.573 }, 00:03:41.573 "nvme_pcie": { 00:03:41.573 "mask": "0x800", 00:03:41.573 "tpoint_mask": "0x0" 00:03:41.573 }, 00:03:41.573 "iaa": { 00:03:41.573 "mask": "0x1000", 00:03:41.573 "tpoint_mask": "0x0" 00:03:41.573 }, 00:03:41.573 "nvme_tcp": { 00:03:41.573 "mask": "0x2000", 00:03:41.573 "tpoint_mask": "0x0" 00:03:41.573 }, 00:03:41.573 "bdev_nvme": { 00:03:41.573 "mask": "0x4000", 00:03:41.573 "tpoint_mask": "0x0" 00:03:41.573 } 00:03:41.573 }' 00:03:41.573 02:06:09 -- rpc/rpc.sh@43 -- # jq length 00:03:41.573 02:06:09 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:03:41.573 02:06:09 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:03:41.573 02:06:09 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:03:41.573 02:06:09 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:03:41.573 02:06:09 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:03:41.573 02:06:09 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:03:41.573 02:06:09 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:03:41.573 02:06:09 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:03:41.832 02:06:09 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:03:41.832 00:03:41.832 real 0m0.196s 00:03:41.832 user 0m0.170s 00:03:41.832 sys 0m0.020s 00:03:41.832 02:06:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:41.832 02:06:09 -- common/autotest_common.sh@10 -- # set +x 00:03:41.832 ************************************ 00:03:41.832 END TEST rpc_trace_cmd_test 00:03:41.832 ************************************ 00:03:41.832 02:06:09 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:03:41.832 02:06:09 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:03:41.832 02:06:09 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:03:41.832 02:06:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:41.832 02:06:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:41.832 02:06:09 -- common/autotest_common.sh@10 -- # set +x 00:03:41.832 ************************************ 00:03:41.832 START TEST rpc_daemon_integrity 00:03:41.832 ************************************ 00:03:41.832 02:06:09 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:03:41.832 02:06:09 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:03:41.832 02:06:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:41.832 02:06:09 -- common/autotest_common.sh@10 -- # set +x 00:03:41.832 02:06:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:41.832 02:06:09 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:03:41.832 02:06:09 -- rpc/rpc.sh@13 -- # jq length 00:03:41.832 02:06:09 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:03:41.832 02:06:09 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:03:41.832 02:06:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:41.832 02:06:09 -- common/autotest_common.sh@10 -- # set +x 00:03:41.832 02:06:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:41.832 02:06:09 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:03:41.832 02:06:09 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:03:41.832 02:06:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:41.832 02:06:09 -- common/autotest_common.sh@10 -- # set +x 00:03:41.832 02:06:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:41.832 02:06:09 -- rpc/rpc.sh@16 -- # bdevs='[ 00:03:41.832 { 00:03:41.832 "name": "Malloc2", 00:03:41.832 "aliases": [ 00:03:41.832 "8edd11a7-72d4-4368-aed9-5cb024dd05d8" 00:03:41.832 ], 00:03:41.832 "product_name": "Malloc disk", 00:03:41.832 "block_size": 512, 00:03:41.832 "num_blocks": 16384, 00:03:41.832 "uuid": "8edd11a7-72d4-4368-aed9-5cb024dd05d8", 00:03:41.832 "assigned_rate_limits": { 00:03:41.832 "rw_ios_per_sec": 0, 00:03:41.832 "rw_mbytes_per_sec": 0, 00:03:41.832 "r_mbytes_per_sec": 0, 00:03:41.832 "w_mbytes_per_sec": 0 00:03:41.832 }, 00:03:41.832 "claimed": false, 00:03:41.832 "zoned": false, 00:03:41.832 "supported_io_types": { 00:03:41.832 "read": true, 00:03:41.832 "write": true, 00:03:41.832 "unmap": true, 00:03:41.832 "write_zeroes": true, 00:03:41.832 "flush": true, 00:03:41.832 "reset": true, 00:03:41.832 "compare": false, 00:03:41.832 "compare_and_write": false, 00:03:41.832 "abort": true, 00:03:41.832 "nvme_admin": false, 00:03:41.832 "nvme_io": false 00:03:41.832 }, 00:03:41.832 "memory_domains": [ 00:03:41.832 { 00:03:41.832 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:41.832 "dma_device_type": 2 00:03:41.832 } 00:03:41.832 ], 00:03:41.832 "driver_specific": {} 00:03:41.832 } 00:03:41.832 ]' 00:03:41.832 02:06:09 -- rpc/rpc.sh@17 -- # jq length 00:03:41.832 02:06:09 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:03:41.832 02:06:09 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:03:41.832 02:06:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:41.832 02:06:09 -- common/autotest_common.sh@10 -- # set +x 00:03:41.832 [2024-12-08 02:06:09.490790] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:03:41.832 [2024-12-08 02:06:09.490863] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:03:41.832 [2024-12-08 02:06:09.490887] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x867590 00:03:41.832 [2024-12-08 02:06:09.490904] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:03:41.832 [2024-12-08 02:06:09.492258] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:03:41.832 [2024-12-08 02:06:09.492287] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:03:41.832 Passthru0 00:03:41.832 02:06:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:41.832 02:06:09 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:03:41.832 02:06:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:41.832 02:06:09 -- common/autotest_common.sh@10 -- # set +x 00:03:41.832 02:06:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:41.832 02:06:09 -- rpc/rpc.sh@20 -- # bdevs='[ 00:03:41.832 { 00:03:41.832 "name": "Malloc2", 00:03:41.832 "aliases": [ 00:03:41.832 "8edd11a7-72d4-4368-aed9-5cb024dd05d8" 00:03:41.832 ], 00:03:41.832 "product_name": "Malloc disk", 00:03:41.832 "block_size": 512, 00:03:41.832 "num_blocks": 16384, 00:03:41.832 "uuid": "8edd11a7-72d4-4368-aed9-5cb024dd05d8", 00:03:41.832 "assigned_rate_limits": { 00:03:41.832 "rw_ios_per_sec": 0, 00:03:41.832 "rw_mbytes_per_sec": 0, 00:03:41.832 "r_mbytes_per_sec": 0, 00:03:41.832 "w_mbytes_per_sec": 0 00:03:41.832 }, 00:03:41.832 "claimed": true, 00:03:41.832 "claim_type": "exclusive_write", 00:03:41.832 "zoned": false, 00:03:41.832 "supported_io_types": { 00:03:41.832 "read": true, 00:03:41.832 "write": true, 00:03:41.832 "unmap": true, 00:03:41.832 "write_zeroes": true, 00:03:41.832 "flush": true, 00:03:41.832 "reset": true, 00:03:41.832 "compare": false, 00:03:41.832 "compare_and_write": false, 00:03:41.832 "abort": true, 00:03:41.832 "nvme_admin": false, 00:03:41.832 "nvme_io": false 00:03:41.832 }, 00:03:41.832 "memory_domains": [ 00:03:41.832 { 00:03:41.832 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:41.832 "dma_device_type": 2 00:03:41.832 } 00:03:41.832 ], 00:03:41.832 "driver_specific": {} 00:03:41.832 }, 00:03:41.832 { 00:03:41.832 "name": "Passthru0", 00:03:41.832 "aliases": [ 00:03:41.832 "d7c81e59-a3e8-574f-89b6-97b175d63dc5" 00:03:41.832 ], 00:03:41.832 "product_name": "passthru", 00:03:41.832 "block_size": 512, 00:03:41.832 "num_blocks": 16384, 00:03:41.832 "uuid": "d7c81e59-a3e8-574f-89b6-97b175d63dc5", 00:03:41.832 "assigned_rate_limits": { 00:03:41.832 "rw_ios_per_sec": 0, 00:03:41.832 "rw_mbytes_per_sec": 0, 00:03:41.832 "r_mbytes_per_sec": 0, 00:03:41.832 "w_mbytes_per_sec": 0 00:03:41.832 }, 00:03:41.832 "claimed": false, 00:03:41.832 "zoned": false, 00:03:41.832 "supported_io_types": { 00:03:41.832 "read": true, 00:03:41.832 "write": true, 00:03:41.832 "unmap": true, 00:03:41.832 "write_zeroes": true, 00:03:41.832 "flush": true, 00:03:41.832 "reset": true, 00:03:41.832 "compare": false, 00:03:41.832 "compare_and_write": false, 00:03:41.832 "abort": true, 00:03:41.832 "nvme_admin": false, 00:03:41.833 "nvme_io": false 00:03:41.833 }, 00:03:41.833 "memory_domains": [ 00:03:41.833 { 00:03:41.833 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:41.833 "dma_device_type": 2 00:03:41.833 } 00:03:41.833 ], 00:03:41.833 "driver_specific": { 00:03:41.833 "passthru": { 00:03:41.833 "name": "Passthru0", 00:03:41.833 "base_bdev_name": "Malloc2" 00:03:41.833 } 00:03:41.833 } 00:03:41.833 } 00:03:41.833 ]' 00:03:41.833 02:06:09 -- rpc/rpc.sh@21 -- # jq length 00:03:41.833 02:06:09 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:03:41.833 02:06:09 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:03:41.833 02:06:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:41.833 02:06:09 -- common/autotest_common.sh@10 -- # set +x 00:03:41.833 02:06:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:41.833 02:06:09 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:03:41.833 02:06:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:41.833 02:06:09 -- common/autotest_common.sh@10 -- # set +x 00:03:41.833 02:06:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:41.833 02:06:09 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:03:41.833 02:06:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:41.833 02:06:09 -- common/autotest_common.sh@10 -- # set +x 00:03:41.833 02:06:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:41.833 02:06:09 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:03:41.833 02:06:09 -- rpc/rpc.sh@26 -- # jq length 00:03:41.833 02:06:09 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:03:41.833 00:03:41.833 real 0m0.224s 00:03:41.833 user 0m0.148s 00:03:41.833 sys 0m0.018s 00:03:41.833 02:06:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:41.833 02:06:09 -- common/autotest_common.sh@10 -- # set +x 00:03:41.833 ************************************ 00:03:41.833 END TEST rpc_daemon_integrity 00:03:41.833 ************************************ 00:03:42.091 02:06:09 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:03:42.091 02:06:09 -- rpc/rpc.sh@84 -- # killprocess 1982292 00:03:42.091 02:06:09 -- common/autotest_common.sh@936 -- # '[' -z 1982292 ']' 00:03:42.091 02:06:09 -- common/autotest_common.sh@940 -- # kill -0 1982292 00:03:42.091 02:06:09 -- common/autotest_common.sh@941 -- # uname 00:03:42.091 02:06:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:03:42.091 02:06:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1982292 00:03:42.091 02:06:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:03:42.091 02:06:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:03:42.091 02:06:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1982292' 00:03:42.091 killing process with pid 1982292 00:03:42.091 02:06:09 -- common/autotest_common.sh@955 -- # kill 1982292 00:03:42.091 02:06:09 -- common/autotest_common.sh@960 -- # wait 1982292 00:03:42.349 00:03:42.349 real 0m2.506s 00:03:42.349 user 0m3.176s 00:03:42.349 sys 0m0.574s 00:03:42.349 02:06:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:42.349 02:06:10 -- common/autotest_common.sh@10 -- # set +x 00:03:42.349 ************************************ 00:03:42.349 END TEST rpc 00:03:42.349 ************************************ 00:03:42.608 02:06:10 -- spdk/autotest.sh@164 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:03:42.608 02:06:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:42.608 02:06:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:42.608 02:06:10 -- common/autotest_common.sh@10 -- # set +x 00:03:42.608 ************************************ 00:03:42.608 START TEST rpc_client 00:03:42.608 ************************************ 00:03:42.608 02:06:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:03:42.608 * Looking for test storage... 00:03:42.608 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:03:42.608 02:06:10 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:42.608 02:06:10 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:42.608 02:06:10 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:42.608 02:06:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:42.608 02:06:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:42.608 02:06:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:42.608 02:06:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:42.608 02:06:10 -- scripts/common.sh@335 -- # IFS=.-: 00:03:42.608 02:06:10 -- scripts/common.sh@335 -- # read -ra ver1 00:03:42.608 02:06:10 -- scripts/common.sh@336 -- # IFS=.-: 00:03:42.608 02:06:10 -- scripts/common.sh@336 -- # read -ra ver2 00:03:42.608 02:06:10 -- scripts/common.sh@337 -- # local 'op=<' 00:03:42.608 02:06:10 -- scripts/common.sh@339 -- # ver1_l=2 00:03:42.608 02:06:10 -- scripts/common.sh@340 -- # ver2_l=1 00:03:42.608 02:06:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:42.608 02:06:10 -- scripts/common.sh@343 -- # case "$op" in 00:03:42.608 02:06:10 -- scripts/common.sh@344 -- # : 1 00:03:42.608 02:06:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:42.608 02:06:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:42.608 02:06:10 -- scripts/common.sh@364 -- # decimal 1 00:03:42.608 02:06:10 -- scripts/common.sh@352 -- # local d=1 00:03:42.608 02:06:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:42.608 02:06:10 -- scripts/common.sh@354 -- # echo 1 00:03:42.608 02:06:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:42.608 02:06:10 -- scripts/common.sh@365 -- # decimal 2 00:03:42.608 02:06:10 -- scripts/common.sh@352 -- # local d=2 00:03:42.608 02:06:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:42.608 02:06:10 -- scripts/common.sh@354 -- # echo 2 00:03:42.608 02:06:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:42.608 02:06:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:42.608 02:06:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:42.608 02:06:10 -- scripts/common.sh@367 -- # return 0 00:03:42.608 02:06:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:42.608 02:06:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:42.608 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:42.608 --rc genhtml_branch_coverage=1 00:03:42.608 --rc genhtml_function_coverage=1 00:03:42.608 --rc genhtml_legend=1 00:03:42.608 --rc geninfo_all_blocks=1 00:03:42.608 --rc geninfo_unexecuted_blocks=1 00:03:42.608 00:03:42.608 ' 00:03:42.608 02:06:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:42.608 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:42.608 --rc genhtml_branch_coverage=1 00:03:42.608 --rc genhtml_function_coverage=1 00:03:42.608 --rc genhtml_legend=1 00:03:42.608 --rc geninfo_all_blocks=1 00:03:42.608 --rc geninfo_unexecuted_blocks=1 00:03:42.608 00:03:42.608 ' 00:03:42.608 02:06:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:42.608 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:42.608 --rc genhtml_branch_coverage=1 00:03:42.608 --rc genhtml_function_coverage=1 00:03:42.608 --rc genhtml_legend=1 00:03:42.608 --rc geninfo_all_blocks=1 00:03:42.608 --rc geninfo_unexecuted_blocks=1 00:03:42.608 00:03:42.608 ' 00:03:42.608 02:06:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:42.608 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:42.608 --rc genhtml_branch_coverage=1 00:03:42.608 --rc genhtml_function_coverage=1 00:03:42.608 --rc genhtml_legend=1 00:03:42.608 --rc geninfo_all_blocks=1 00:03:42.608 --rc geninfo_unexecuted_blocks=1 00:03:42.608 00:03:42.608 ' 00:03:42.608 02:06:10 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:03:42.608 OK 00:03:42.608 02:06:10 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:03:42.608 00:03:42.608 real 0m0.164s 00:03:42.608 user 0m0.109s 00:03:42.608 sys 0m0.063s 00:03:42.608 02:06:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:42.608 02:06:10 -- common/autotest_common.sh@10 -- # set +x 00:03:42.608 ************************************ 00:03:42.608 END TEST rpc_client 00:03:42.608 ************************************ 00:03:42.608 02:06:10 -- spdk/autotest.sh@165 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:03:42.608 02:06:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:42.608 02:06:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:42.608 02:06:10 -- common/autotest_common.sh@10 -- # set +x 00:03:42.608 ************************************ 00:03:42.608 START TEST json_config 00:03:42.608 ************************************ 00:03:42.608 02:06:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:03:42.608 02:06:10 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:42.608 02:06:10 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:42.608 02:06:10 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:42.868 02:06:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:42.868 02:06:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:42.868 02:06:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:42.868 02:06:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:42.868 02:06:10 -- scripts/common.sh@335 -- # IFS=.-: 00:03:42.868 02:06:10 -- scripts/common.sh@335 -- # read -ra ver1 00:03:42.868 02:06:10 -- scripts/common.sh@336 -- # IFS=.-: 00:03:42.868 02:06:10 -- scripts/common.sh@336 -- # read -ra ver2 00:03:42.868 02:06:10 -- scripts/common.sh@337 -- # local 'op=<' 00:03:42.868 02:06:10 -- scripts/common.sh@339 -- # ver1_l=2 00:03:42.868 02:06:10 -- scripts/common.sh@340 -- # ver2_l=1 00:03:42.868 02:06:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:42.868 02:06:10 -- scripts/common.sh@343 -- # case "$op" in 00:03:42.868 02:06:10 -- scripts/common.sh@344 -- # : 1 00:03:42.868 02:06:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:42.868 02:06:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:42.868 02:06:10 -- scripts/common.sh@364 -- # decimal 1 00:03:42.868 02:06:10 -- scripts/common.sh@352 -- # local d=1 00:03:42.868 02:06:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:42.868 02:06:10 -- scripts/common.sh@354 -- # echo 1 00:03:42.868 02:06:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:42.868 02:06:10 -- scripts/common.sh@365 -- # decimal 2 00:03:42.868 02:06:10 -- scripts/common.sh@352 -- # local d=2 00:03:42.868 02:06:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:42.868 02:06:10 -- scripts/common.sh@354 -- # echo 2 00:03:42.868 02:06:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:42.868 02:06:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:42.868 02:06:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:42.868 02:06:10 -- scripts/common.sh@367 -- # return 0 00:03:42.868 02:06:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:42.868 02:06:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:42.868 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:42.868 --rc genhtml_branch_coverage=1 00:03:42.868 --rc genhtml_function_coverage=1 00:03:42.868 --rc genhtml_legend=1 00:03:42.868 --rc geninfo_all_blocks=1 00:03:42.868 --rc geninfo_unexecuted_blocks=1 00:03:42.868 00:03:42.868 ' 00:03:42.868 02:06:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:42.868 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:42.868 --rc genhtml_branch_coverage=1 00:03:42.868 --rc genhtml_function_coverage=1 00:03:42.868 --rc genhtml_legend=1 00:03:42.868 --rc geninfo_all_blocks=1 00:03:42.868 --rc geninfo_unexecuted_blocks=1 00:03:42.868 00:03:42.868 ' 00:03:42.868 02:06:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:42.868 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:42.868 --rc genhtml_branch_coverage=1 00:03:42.868 --rc genhtml_function_coverage=1 00:03:42.868 --rc genhtml_legend=1 00:03:42.868 --rc geninfo_all_blocks=1 00:03:42.868 --rc geninfo_unexecuted_blocks=1 00:03:42.868 00:03:42.868 ' 00:03:42.868 02:06:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:42.868 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:42.868 --rc genhtml_branch_coverage=1 00:03:42.868 --rc genhtml_function_coverage=1 00:03:42.868 --rc genhtml_legend=1 00:03:42.868 --rc geninfo_all_blocks=1 00:03:42.868 --rc geninfo_unexecuted_blocks=1 00:03:42.868 00:03:42.868 ' 00:03:42.868 02:06:10 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:03:42.868 02:06:10 -- nvmf/common.sh@7 -- # uname -s 00:03:42.868 02:06:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:03:42.868 02:06:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:03:42.868 02:06:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:03:42.868 02:06:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:03:42.868 02:06:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:03:42.868 02:06:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:03:42.868 02:06:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:03:42.868 02:06:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:03:42.868 02:06:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:03:42.868 02:06:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:03:42.868 02:06:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:03:42.868 02:06:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:03:42.868 02:06:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:03:42.868 02:06:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:03:42.868 02:06:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:03:42.868 02:06:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:03:42.868 02:06:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:03:42.868 02:06:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:03:42.868 02:06:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:03:42.869 02:06:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:42.869 02:06:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:42.869 02:06:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:42.869 02:06:10 -- paths/export.sh@5 -- # export PATH 00:03:42.869 02:06:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:42.869 02:06:10 -- nvmf/common.sh@46 -- # : 0 00:03:42.869 02:06:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:03:42.869 02:06:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:03:42.869 02:06:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:03:42.869 02:06:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:03:42.869 02:06:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:03:42.869 02:06:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:03:42.869 02:06:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:03:42.869 02:06:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:03:42.869 02:06:10 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:03:42.869 02:06:10 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:03:42.869 02:06:10 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:03:42.869 02:06:10 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:03:42.869 02:06:10 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:03:42.869 02:06:10 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:03:42.869 02:06:10 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:03:42.869 02:06:10 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:03:42.869 02:06:10 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:03:42.869 02:06:10 -- json_config/json_config.sh@32 -- # declare -A app_params 00:03:42.869 02:06:10 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:03:42.869 02:06:10 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:03:42.869 02:06:10 -- json_config/json_config.sh@43 -- # last_event_id=0 00:03:42.869 02:06:10 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:03:42.869 02:06:10 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:03:42.869 INFO: JSON configuration test init 00:03:42.869 02:06:10 -- json_config/json_config.sh@420 -- # json_config_test_init 00:03:42.869 02:06:10 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:03:42.869 02:06:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:42.869 02:06:10 -- common/autotest_common.sh@10 -- # set +x 00:03:42.869 02:06:10 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:03:42.869 02:06:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:42.869 02:06:10 -- common/autotest_common.sh@10 -- # set +x 00:03:42.869 02:06:10 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:03:42.869 02:06:10 -- json_config/json_config.sh@98 -- # local app=target 00:03:42.869 02:06:10 -- json_config/json_config.sh@99 -- # shift 00:03:42.869 02:06:10 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:03:42.869 02:06:10 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:03:42.869 02:06:10 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:03:42.869 02:06:10 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:03:42.869 02:06:10 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:03:42.869 02:06:10 -- json_config/json_config.sh@111 -- # app_pid[$app]=1983073 00:03:42.869 02:06:10 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:03:42.869 02:06:10 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:03:42.869 Waiting for target to run... 00:03:42.869 02:06:10 -- json_config/json_config.sh@114 -- # waitforlisten 1983073 /var/tmp/spdk_tgt.sock 00:03:42.869 02:06:10 -- common/autotest_common.sh@829 -- # '[' -z 1983073 ']' 00:03:42.869 02:06:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:03:42.869 02:06:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:42.869 02:06:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:03:42.869 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:03:42.869 02:06:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:42.869 02:06:10 -- common/autotest_common.sh@10 -- # set +x 00:03:42.869 [2024-12-08 02:06:10.546948] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:42.869 [2024-12-08 02:06:10.547045] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1983073 ] 00:03:42.869 EAL: No free 2048 kB hugepages reported on node 1 00:03:43.437 [2024-12-08 02:06:11.075748] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:43.437 [2024-12-08 02:06:11.178198] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:43.437 [2024-12-08 02:06:11.178402] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:44.003 02:06:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:03:44.003 02:06:11 -- common/autotest_common.sh@862 -- # return 0 00:03:44.003 02:06:11 -- json_config/json_config.sh@115 -- # echo '' 00:03:44.003 00:03:44.003 02:06:11 -- json_config/json_config.sh@322 -- # create_accel_config 00:03:44.003 02:06:11 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:03:44.003 02:06:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:44.003 02:06:11 -- common/autotest_common.sh@10 -- # set +x 00:03:44.003 02:06:11 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:03:44.003 02:06:11 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:03:44.003 02:06:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:44.003 02:06:11 -- common/autotest_common.sh@10 -- # set +x 00:03:44.003 02:06:11 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:03:44.003 02:06:11 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:03:44.003 02:06:11 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:03:47.287 02:06:14 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:03:47.287 02:06:14 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:03:47.287 02:06:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:47.287 02:06:14 -- common/autotest_common.sh@10 -- # set +x 00:03:47.287 02:06:14 -- json_config/json_config.sh@48 -- # local ret=0 00:03:47.287 02:06:14 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:03:47.287 02:06:14 -- json_config/json_config.sh@49 -- # local enabled_types 00:03:47.287 02:06:14 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:03:47.287 02:06:14 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:03:47.287 02:06:14 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:03:47.287 02:06:14 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:03:47.287 02:06:14 -- json_config/json_config.sh@51 -- # local get_types 00:03:47.287 02:06:14 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:03:47.287 02:06:14 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:03:47.287 02:06:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:47.287 02:06:14 -- common/autotest_common.sh@10 -- # set +x 00:03:47.287 02:06:14 -- json_config/json_config.sh@58 -- # return 0 00:03:47.287 02:06:14 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:03:47.288 02:06:14 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:03:47.288 02:06:14 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:03:47.288 02:06:14 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:03:47.288 02:06:14 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:03:47.288 02:06:14 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:03:47.288 02:06:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:47.288 02:06:15 -- common/autotest_common.sh@10 -- # set +x 00:03:47.288 02:06:15 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:03:47.288 02:06:15 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:03:47.288 02:06:15 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:03:47.288 02:06:15 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:03:47.288 02:06:15 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:03:47.545 MallocForNvmf0 00:03:47.545 02:06:15 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:03:47.545 02:06:15 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:03:47.801 MallocForNvmf1 00:03:47.801 02:06:15 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:03:47.801 02:06:15 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:03:48.058 [2024-12-08 02:06:15.741233] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:03:48.058 02:06:15 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:03:48.058 02:06:15 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:03:48.315 02:06:16 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:03:48.315 02:06:16 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:03:48.573 02:06:16 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:03:48.573 02:06:16 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:03:48.831 02:06:16 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:03:48.831 02:06:16 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:03:49.088 [2024-12-08 02:06:16.740575] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:03:49.088 02:06:16 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:03:49.088 02:06:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:49.088 02:06:16 -- common/autotest_common.sh@10 -- # set +x 00:03:49.089 02:06:16 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:03:49.089 02:06:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:49.089 02:06:16 -- common/autotest_common.sh@10 -- # set +x 00:03:49.089 02:06:16 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:03:49.089 02:06:16 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:03:49.089 02:06:16 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:03:49.346 MallocBdevForConfigChangeCheck 00:03:49.346 02:06:17 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:03:49.346 02:06:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:49.346 02:06:17 -- common/autotest_common.sh@10 -- # set +x 00:03:49.346 02:06:17 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:03:49.346 02:06:17 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:03:49.911 02:06:17 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:03:49.911 INFO: shutting down applications... 00:03:49.912 02:06:17 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:03:49.912 02:06:17 -- json_config/json_config.sh@431 -- # json_config_clear target 00:03:49.912 02:06:17 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:03:49.912 02:06:17 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:03:51.284 Calling clear_iscsi_subsystem 00:03:51.284 Calling clear_nvmf_subsystem 00:03:51.284 Calling clear_nbd_subsystem 00:03:51.284 Calling clear_ublk_subsystem 00:03:51.284 Calling clear_vhost_blk_subsystem 00:03:51.284 Calling clear_vhost_scsi_subsystem 00:03:51.284 Calling clear_scheduler_subsystem 00:03:51.284 Calling clear_bdev_subsystem 00:03:51.284 Calling clear_accel_subsystem 00:03:51.284 Calling clear_vmd_subsystem 00:03:51.284 Calling clear_sock_subsystem 00:03:51.284 Calling clear_iobuf_subsystem 00:03:51.541 02:06:19 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:03:51.541 02:06:19 -- json_config/json_config.sh@396 -- # count=100 00:03:51.541 02:06:19 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:03:51.541 02:06:19 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:03:51.541 02:06:19 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:03:51.541 02:06:19 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:03:51.798 02:06:19 -- json_config/json_config.sh@398 -- # break 00:03:51.798 02:06:19 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:03:51.798 02:06:19 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:03:51.798 02:06:19 -- json_config/json_config.sh@120 -- # local app=target 00:03:51.798 02:06:19 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:03:51.798 02:06:19 -- json_config/json_config.sh@124 -- # [[ -n 1983073 ]] 00:03:51.798 02:06:19 -- json_config/json_config.sh@127 -- # kill -SIGINT 1983073 00:03:51.798 02:06:19 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:03:51.798 02:06:19 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:03:51.798 02:06:19 -- json_config/json_config.sh@130 -- # kill -0 1983073 00:03:51.798 02:06:19 -- json_config/json_config.sh@134 -- # sleep 0.5 00:03:52.367 02:06:19 -- json_config/json_config.sh@129 -- # (( i++ )) 00:03:52.367 02:06:19 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:03:52.367 02:06:19 -- json_config/json_config.sh@130 -- # kill -0 1983073 00:03:52.367 02:06:19 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:03:52.367 02:06:19 -- json_config/json_config.sh@132 -- # break 00:03:52.367 02:06:19 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:03:52.367 02:06:19 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:03:52.367 SPDK target shutdown done 00:03:52.367 02:06:19 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:03:52.367 INFO: relaunching applications... 00:03:52.367 02:06:19 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:52.367 02:06:19 -- json_config/json_config.sh@98 -- # local app=target 00:03:52.367 02:06:19 -- json_config/json_config.sh@99 -- # shift 00:03:52.367 02:06:19 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:03:52.367 02:06:19 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:03:52.367 02:06:19 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:03:52.367 02:06:19 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:03:52.367 02:06:19 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:03:52.367 02:06:19 -- json_config/json_config.sh@111 -- # app_pid[$app]=1984416 00:03:52.367 02:06:19 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:52.367 02:06:19 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:03:52.367 Waiting for target to run... 00:03:52.367 02:06:19 -- json_config/json_config.sh@114 -- # waitforlisten 1984416 /var/tmp/spdk_tgt.sock 00:03:52.367 02:06:19 -- common/autotest_common.sh@829 -- # '[' -z 1984416 ']' 00:03:52.367 02:06:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:03:52.367 02:06:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:52.367 02:06:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:03:52.367 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:03:52.367 02:06:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:52.367 02:06:19 -- common/autotest_common.sh@10 -- # set +x 00:03:52.367 [2024-12-08 02:06:19.992709] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:52.367 [2024-12-08 02:06:19.992808] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1984416 ] 00:03:52.367 EAL: No free 2048 kB hugepages reported on node 1 00:03:52.933 [2024-12-08 02:06:20.519906] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:52.933 [2024-12-08 02:06:20.624774] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:52.933 [2024-12-08 02:06:20.624979] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:56.212 [2024-12-08 02:06:23.658402] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:03:56.212 [2024-12-08 02:06:23.690924] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:03:56.212 02:06:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:03:56.212 02:06:23 -- common/autotest_common.sh@862 -- # return 0 00:03:56.212 02:06:23 -- json_config/json_config.sh@115 -- # echo '' 00:03:56.212 00:03:56.212 02:06:23 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:03:56.212 02:06:23 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:03:56.212 INFO: Checking if target configuration is the same... 00:03:56.212 02:06:23 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:56.212 02:06:23 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:03:56.212 02:06:23 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:03:56.212 + '[' 2 -ne 2 ']' 00:03:56.212 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:03:56.212 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:03:56.212 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:56.212 +++ basename /dev/fd/62 00:03:56.212 ++ mktemp /tmp/62.XXX 00:03:56.212 + tmp_file_1=/tmp/62.jbr 00:03:56.212 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:56.471 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:03:56.471 + tmp_file_2=/tmp/spdk_tgt_config.json.7Dl 00:03:56.471 + ret=0 00:03:56.471 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:03:56.729 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:03:56.729 + diff -u /tmp/62.jbr /tmp/spdk_tgt_config.json.7Dl 00:03:56.729 + echo 'INFO: JSON config files are the same' 00:03:56.729 INFO: JSON config files are the same 00:03:56.729 + rm /tmp/62.jbr /tmp/spdk_tgt_config.json.7Dl 00:03:56.729 + exit 0 00:03:56.729 02:06:24 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:03:56.729 02:06:24 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:03:56.729 INFO: changing configuration and checking if this can be detected... 00:03:56.729 02:06:24 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:03:56.729 02:06:24 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:03:56.987 02:06:24 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:56.987 02:06:24 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:03:56.987 02:06:24 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:03:56.987 + '[' 2 -ne 2 ']' 00:03:56.987 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:03:56.987 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:03:56.987 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:56.987 +++ basename /dev/fd/62 00:03:56.987 ++ mktemp /tmp/62.XXX 00:03:56.987 + tmp_file_1=/tmp/62.ulO 00:03:56.987 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:56.987 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:03:56.987 + tmp_file_2=/tmp/spdk_tgt_config.json.yC9 00:03:56.987 + ret=0 00:03:56.987 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:03:57.246 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:03:57.505 + diff -u /tmp/62.ulO /tmp/spdk_tgt_config.json.yC9 00:03:57.505 + ret=1 00:03:57.505 + echo '=== Start of file: /tmp/62.ulO ===' 00:03:57.505 + cat /tmp/62.ulO 00:03:57.505 + echo '=== End of file: /tmp/62.ulO ===' 00:03:57.505 + echo '' 00:03:57.505 + echo '=== Start of file: /tmp/spdk_tgt_config.json.yC9 ===' 00:03:57.505 + cat /tmp/spdk_tgt_config.json.yC9 00:03:57.505 + echo '=== End of file: /tmp/spdk_tgt_config.json.yC9 ===' 00:03:57.505 + echo '' 00:03:57.505 + rm /tmp/62.ulO /tmp/spdk_tgt_config.json.yC9 00:03:57.505 + exit 1 00:03:57.505 02:06:25 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:03:57.505 INFO: configuration change detected. 00:03:57.505 02:06:25 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:03:57.505 02:06:25 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:03:57.505 02:06:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:57.505 02:06:25 -- common/autotest_common.sh@10 -- # set +x 00:03:57.505 02:06:25 -- json_config/json_config.sh@360 -- # local ret=0 00:03:57.505 02:06:25 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:03:57.505 02:06:25 -- json_config/json_config.sh@370 -- # [[ -n 1984416 ]] 00:03:57.505 02:06:25 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:03:57.505 02:06:25 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:03:57.505 02:06:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:57.505 02:06:25 -- common/autotest_common.sh@10 -- # set +x 00:03:57.505 02:06:25 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:03:57.505 02:06:25 -- json_config/json_config.sh@246 -- # uname -s 00:03:57.505 02:06:25 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:03:57.505 02:06:25 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:03:57.505 02:06:25 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:03:57.505 02:06:25 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:03:57.505 02:06:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:57.505 02:06:25 -- common/autotest_common.sh@10 -- # set +x 00:03:57.505 02:06:25 -- json_config/json_config.sh@376 -- # killprocess 1984416 00:03:57.505 02:06:25 -- common/autotest_common.sh@936 -- # '[' -z 1984416 ']' 00:03:57.505 02:06:25 -- common/autotest_common.sh@940 -- # kill -0 1984416 00:03:57.505 02:06:25 -- common/autotest_common.sh@941 -- # uname 00:03:57.505 02:06:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:03:57.505 02:06:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1984416 00:03:57.505 02:06:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:03:57.505 02:06:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:03:57.505 02:06:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1984416' 00:03:57.505 killing process with pid 1984416 00:03:57.505 02:06:25 -- common/autotest_common.sh@955 -- # kill 1984416 00:03:57.505 02:06:25 -- common/autotest_common.sh@960 -- # wait 1984416 00:03:59.403 02:06:26 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:59.403 02:06:26 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:03:59.404 02:06:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:59.404 02:06:26 -- common/autotest_common.sh@10 -- # set +x 00:03:59.404 02:06:26 -- json_config/json_config.sh@381 -- # return 0 00:03:59.404 02:06:26 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:03:59.404 INFO: Success 00:03:59.404 00:03:59.404 real 0m16.487s 00:03:59.404 user 0m18.872s 00:03:59.404 sys 0m2.342s 00:03:59.404 02:06:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:59.404 02:06:26 -- common/autotest_common.sh@10 -- # set +x 00:03:59.404 ************************************ 00:03:59.404 END TEST json_config 00:03:59.404 ************************************ 00:03:59.404 02:06:26 -- spdk/autotest.sh@166 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:03:59.404 02:06:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:59.404 02:06:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:59.404 02:06:26 -- common/autotest_common.sh@10 -- # set +x 00:03:59.404 ************************************ 00:03:59.404 START TEST json_config_extra_key 00:03:59.404 ************************************ 00:03:59.404 02:06:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:03:59.404 02:06:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:59.404 02:06:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:59.404 02:06:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:59.404 02:06:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:59.404 02:06:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:59.404 02:06:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:59.404 02:06:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:59.404 02:06:26 -- scripts/common.sh@335 -- # IFS=.-: 00:03:59.404 02:06:26 -- scripts/common.sh@335 -- # read -ra ver1 00:03:59.404 02:06:26 -- scripts/common.sh@336 -- # IFS=.-: 00:03:59.404 02:06:26 -- scripts/common.sh@336 -- # read -ra ver2 00:03:59.404 02:06:26 -- scripts/common.sh@337 -- # local 'op=<' 00:03:59.404 02:06:26 -- scripts/common.sh@339 -- # ver1_l=2 00:03:59.404 02:06:26 -- scripts/common.sh@340 -- # ver2_l=1 00:03:59.404 02:06:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:59.404 02:06:26 -- scripts/common.sh@343 -- # case "$op" in 00:03:59.404 02:06:26 -- scripts/common.sh@344 -- # : 1 00:03:59.404 02:06:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:59.404 02:06:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:59.404 02:06:26 -- scripts/common.sh@364 -- # decimal 1 00:03:59.404 02:06:26 -- scripts/common.sh@352 -- # local d=1 00:03:59.404 02:06:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:59.404 02:06:26 -- scripts/common.sh@354 -- # echo 1 00:03:59.404 02:06:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:59.404 02:06:26 -- scripts/common.sh@365 -- # decimal 2 00:03:59.404 02:06:26 -- scripts/common.sh@352 -- # local d=2 00:03:59.404 02:06:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:59.404 02:06:26 -- scripts/common.sh@354 -- # echo 2 00:03:59.404 02:06:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:59.404 02:06:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:59.404 02:06:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:59.404 02:06:26 -- scripts/common.sh@367 -- # return 0 00:03:59.404 02:06:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:59.404 02:06:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:59.404 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:59.404 --rc genhtml_branch_coverage=1 00:03:59.404 --rc genhtml_function_coverage=1 00:03:59.404 --rc genhtml_legend=1 00:03:59.404 --rc geninfo_all_blocks=1 00:03:59.404 --rc geninfo_unexecuted_blocks=1 00:03:59.404 00:03:59.404 ' 00:03:59.404 02:06:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:59.404 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:59.404 --rc genhtml_branch_coverage=1 00:03:59.404 --rc genhtml_function_coverage=1 00:03:59.404 --rc genhtml_legend=1 00:03:59.404 --rc geninfo_all_blocks=1 00:03:59.404 --rc geninfo_unexecuted_blocks=1 00:03:59.404 00:03:59.404 ' 00:03:59.404 02:06:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:59.404 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:59.404 --rc genhtml_branch_coverage=1 00:03:59.404 --rc genhtml_function_coverage=1 00:03:59.404 --rc genhtml_legend=1 00:03:59.404 --rc geninfo_all_blocks=1 00:03:59.404 --rc geninfo_unexecuted_blocks=1 00:03:59.404 00:03:59.404 ' 00:03:59.404 02:06:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:59.404 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:59.404 --rc genhtml_branch_coverage=1 00:03:59.404 --rc genhtml_function_coverage=1 00:03:59.404 --rc genhtml_legend=1 00:03:59.404 --rc geninfo_all_blocks=1 00:03:59.404 --rc geninfo_unexecuted_blocks=1 00:03:59.404 00:03:59.404 ' 00:03:59.404 02:06:26 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:03:59.404 02:06:26 -- nvmf/common.sh@7 -- # uname -s 00:03:59.404 02:06:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:03:59.404 02:06:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:03:59.404 02:06:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:03:59.404 02:06:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:03:59.404 02:06:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:03:59.404 02:06:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:03:59.404 02:06:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:03:59.404 02:06:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:03:59.404 02:06:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:03:59.404 02:06:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:03:59.404 02:06:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:03:59.404 02:06:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:03:59.404 02:06:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:03:59.404 02:06:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:03:59.404 02:06:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:03:59.404 02:06:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:03:59.404 02:06:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:03:59.404 02:06:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:03:59.404 02:06:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:03:59.404 02:06:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:59.404 02:06:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:59.404 02:06:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:59.404 02:06:26 -- paths/export.sh@5 -- # export PATH 00:03:59.404 02:06:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:59.404 02:06:26 -- nvmf/common.sh@46 -- # : 0 00:03:59.404 02:06:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:03:59.404 02:06:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:03:59.404 02:06:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:03:59.404 02:06:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:03:59.404 02:06:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:03:59.404 02:06:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:03:59.404 02:06:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:03:59.404 02:06:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:03:59.404 02:06:26 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:03:59.404 02:06:26 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:03:59.404 02:06:26 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:03:59.404 02:06:26 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:03:59.404 02:06:26 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:03:59.404 02:06:26 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:03:59.404 02:06:26 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:03:59.404 02:06:26 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:03:59.404 02:06:26 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:03:59.404 02:06:26 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:03:59.404 INFO: launching applications... 00:03:59.404 02:06:26 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:03:59.404 02:06:26 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:03:59.404 02:06:26 -- json_config/json_config_extra_key.sh@25 -- # shift 00:03:59.404 02:06:26 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:03:59.404 02:06:26 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:03:59.404 02:06:26 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=1985364 00:03:59.405 02:06:26 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:03:59.405 02:06:26 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:03:59.405 Waiting for target to run... 00:03:59.405 02:06:26 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 1985364 /var/tmp/spdk_tgt.sock 00:03:59.405 02:06:26 -- common/autotest_common.sh@829 -- # '[' -z 1985364 ']' 00:03:59.405 02:06:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:03:59.405 02:06:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:59.405 02:06:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:03:59.405 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:03:59.405 02:06:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:59.405 02:06:26 -- common/autotest_common.sh@10 -- # set +x 00:03:59.405 [2024-12-08 02:06:27.032436] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:59.405 [2024-12-08 02:06:27.032514] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1985364 ] 00:03:59.405 EAL: No free 2048 kB hugepages reported on node 1 00:03:59.663 [2024-12-08 02:06:27.373917] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:59.921 [2024-12-08 02:06:27.462777] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:59.921 [2024-12-08 02:06:27.462936] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:00.488 02:06:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:00.488 02:06:27 -- common/autotest_common.sh@862 -- # return 0 00:04:00.488 02:06:27 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:04:00.488 00:04:00.488 02:06:27 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:04:00.488 INFO: shutting down applications... 00:04:00.488 02:06:27 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:04:00.488 02:06:27 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:04:00.488 02:06:27 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:04:00.488 02:06:27 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 1985364 ]] 00:04:00.488 02:06:27 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 1985364 00:04:00.488 02:06:27 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:04:00.488 02:06:27 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:00.488 02:06:27 -- json_config/json_config_extra_key.sh@50 -- # kill -0 1985364 00:04:00.488 02:06:27 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:04:00.747 02:06:28 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:04:00.747 02:06:28 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:00.747 02:06:28 -- json_config/json_config_extra_key.sh@50 -- # kill -0 1985364 00:04:00.747 02:06:28 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:04:00.747 02:06:28 -- json_config/json_config_extra_key.sh@52 -- # break 00:04:00.747 02:06:28 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:04:00.747 02:06:28 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:04:00.747 SPDK target shutdown done 00:04:00.747 02:06:28 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:04:00.747 Success 00:04:00.747 00:04:00.747 real 0m1.631s 00:04:00.747 user 0m1.630s 00:04:00.747 sys 0m0.447s 00:04:00.747 02:06:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:00.747 02:06:28 -- common/autotest_common.sh@10 -- # set +x 00:04:00.747 ************************************ 00:04:00.747 END TEST json_config_extra_key 00:04:00.747 ************************************ 00:04:00.747 02:06:28 -- spdk/autotest.sh@167 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:00.747 02:06:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:00.747 02:06:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:00.747 02:06:28 -- common/autotest_common.sh@10 -- # set +x 00:04:00.747 ************************************ 00:04:00.747 START TEST alias_rpc 00:04:00.747 ************************************ 00:04:00.747 02:06:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:01.007 * Looking for test storage... 00:04:01.007 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:04:01.007 02:06:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:01.007 02:06:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:01.007 02:06:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:01.007 02:06:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:01.007 02:06:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:01.007 02:06:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:01.007 02:06:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:01.007 02:06:28 -- scripts/common.sh@335 -- # IFS=.-: 00:04:01.007 02:06:28 -- scripts/common.sh@335 -- # read -ra ver1 00:04:01.007 02:06:28 -- scripts/common.sh@336 -- # IFS=.-: 00:04:01.007 02:06:28 -- scripts/common.sh@336 -- # read -ra ver2 00:04:01.007 02:06:28 -- scripts/common.sh@337 -- # local 'op=<' 00:04:01.007 02:06:28 -- scripts/common.sh@339 -- # ver1_l=2 00:04:01.007 02:06:28 -- scripts/common.sh@340 -- # ver2_l=1 00:04:01.007 02:06:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:01.007 02:06:28 -- scripts/common.sh@343 -- # case "$op" in 00:04:01.007 02:06:28 -- scripts/common.sh@344 -- # : 1 00:04:01.007 02:06:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:01.007 02:06:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:01.007 02:06:28 -- scripts/common.sh@364 -- # decimal 1 00:04:01.007 02:06:28 -- scripts/common.sh@352 -- # local d=1 00:04:01.007 02:06:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:01.007 02:06:28 -- scripts/common.sh@354 -- # echo 1 00:04:01.007 02:06:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:01.007 02:06:28 -- scripts/common.sh@365 -- # decimal 2 00:04:01.007 02:06:28 -- scripts/common.sh@352 -- # local d=2 00:04:01.007 02:06:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:01.007 02:06:28 -- scripts/common.sh@354 -- # echo 2 00:04:01.007 02:06:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:01.007 02:06:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:01.007 02:06:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:01.007 02:06:28 -- scripts/common.sh@367 -- # return 0 00:04:01.007 02:06:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:01.007 02:06:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:01.007 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:01.007 --rc genhtml_branch_coverage=1 00:04:01.007 --rc genhtml_function_coverage=1 00:04:01.007 --rc genhtml_legend=1 00:04:01.007 --rc geninfo_all_blocks=1 00:04:01.007 --rc geninfo_unexecuted_blocks=1 00:04:01.007 00:04:01.007 ' 00:04:01.007 02:06:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:01.007 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:01.007 --rc genhtml_branch_coverage=1 00:04:01.007 --rc genhtml_function_coverage=1 00:04:01.007 --rc genhtml_legend=1 00:04:01.007 --rc geninfo_all_blocks=1 00:04:01.007 --rc geninfo_unexecuted_blocks=1 00:04:01.007 00:04:01.007 ' 00:04:01.007 02:06:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:01.007 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:01.007 --rc genhtml_branch_coverage=1 00:04:01.007 --rc genhtml_function_coverage=1 00:04:01.007 --rc genhtml_legend=1 00:04:01.007 --rc geninfo_all_blocks=1 00:04:01.007 --rc geninfo_unexecuted_blocks=1 00:04:01.007 00:04:01.007 ' 00:04:01.007 02:06:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:01.007 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:01.007 --rc genhtml_branch_coverage=1 00:04:01.007 --rc genhtml_function_coverage=1 00:04:01.007 --rc genhtml_legend=1 00:04:01.007 --rc geninfo_all_blocks=1 00:04:01.007 --rc geninfo_unexecuted_blocks=1 00:04:01.007 00:04:01.007 ' 00:04:01.007 02:06:28 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:04:01.007 02:06:28 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=1985640 00:04:01.008 02:06:28 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:01.008 02:06:28 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 1985640 00:04:01.008 02:06:28 -- common/autotest_common.sh@829 -- # '[' -z 1985640 ']' 00:04:01.008 02:06:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:01.008 02:06:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:01.008 02:06:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:01.008 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:01.008 02:06:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:01.008 02:06:28 -- common/autotest_common.sh@10 -- # set +x 00:04:01.008 [2024-12-08 02:06:28.702291] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:01.008 [2024-12-08 02:06:28.702397] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1985640 ] 00:04:01.008 EAL: No free 2048 kB hugepages reported on node 1 00:04:01.008 [2024-12-08 02:06:28.761721] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:01.267 [2024-12-08 02:06:28.872556] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:01.267 [2024-12-08 02:06:28.872726] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:02.202 02:06:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:02.202 02:06:29 -- common/autotest_common.sh@862 -- # return 0 00:04:02.202 02:06:29 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:04:02.202 02:06:29 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 1985640 00:04:02.202 02:06:29 -- common/autotest_common.sh@936 -- # '[' -z 1985640 ']' 00:04:02.202 02:06:29 -- common/autotest_common.sh@940 -- # kill -0 1985640 00:04:02.202 02:06:29 -- common/autotest_common.sh@941 -- # uname 00:04:02.202 02:06:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:02.202 02:06:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1985640 00:04:02.459 02:06:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:02.459 02:06:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:02.459 02:06:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1985640' 00:04:02.459 killing process with pid 1985640 00:04:02.459 02:06:30 -- common/autotest_common.sh@955 -- # kill 1985640 00:04:02.459 02:06:30 -- common/autotest_common.sh@960 -- # wait 1985640 00:04:02.717 00:04:02.717 real 0m1.952s 00:04:02.717 user 0m2.251s 00:04:02.717 sys 0m0.490s 00:04:02.717 02:06:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:02.717 02:06:30 -- common/autotest_common.sh@10 -- # set +x 00:04:02.717 ************************************ 00:04:02.717 END TEST alias_rpc 00:04:02.717 ************************************ 00:04:02.717 02:06:30 -- spdk/autotest.sh@169 -- # [[ 0 -eq 0 ]] 00:04:02.717 02:06:30 -- spdk/autotest.sh@170 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:02.717 02:06:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:02.717 02:06:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:02.717 02:06:30 -- common/autotest_common.sh@10 -- # set +x 00:04:02.717 ************************************ 00:04:02.717 START TEST spdkcli_tcp 00:04:02.717 ************************************ 00:04:02.717 02:06:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:02.981 * Looking for test storage... 00:04:02.981 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:04:02.981 02:06:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:02.981 02:06:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:02.981 02:06:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:02.981 02:06:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:02.981 02:06:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:02.981 02:06:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:02.981 02:06:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:02.981 02:06:30 -- scripts/common.sh@335 -- # IFS=.-: 00:04:02.981 02:06:30 -- scripts/common.sh@335 -- # read -ra ver1 00:04:02.981 02:06:30 -- scripts/common.sh@336 -- # IFS=.-: 00:04:02.981 02:06:30 -- scripts/common.sh@336 -- # read -ra ver2 00:04:02.981 02:06:30 -- scripts/common.sh@337 -- # local 'op=<' 00:04:02.981 02:06:30 -- scripts/common.sh@339 -- # ver1_l=2 00:04:02.981 02:06:30 -- scripts/common.sh@340 -- # ver2_l=1 00:04:02.981 02:06:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:02.981 02:06:30 -- scripts/common.sh@343 -- # case "$op" in 00:04:02.981 02:06:30 -- scripts/common.sh@344 -- # : 1 00:04:02.981 02:06:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:02.981 02:06:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:02.981 02:06:30 -- scripts/common.sh@364 -- # decimal 1 00:04:02.981 02:06:30 -- scripts/common.sh@352 -- # local d=1 00:04:02.981 02:06:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:02.981 02:06:30 -- scripts/common.sh@354 -- # echo 1 00:04:02.982 02:06:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:02.982 02:06:30 -- scripts/common.sh@365 -- # decimal 2 00:04:02.982 02:06:30 -- scripts/common.sh@352 -- # local d=2 00:04:02.982 02:06:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:02.982 02:06:30 -- scripts/common.sh@354 -- # echo 2 00:04:02.982 02:06:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:02.982 02:06:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:02.982 02:06:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:02.982 02:06:30 -- scripts/common.sh@367 -- # return 0 00:04:02.982 02:06:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:02.982 02:06:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:02.982 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:02.982 --rc genhtml_branch_coverage=1 00:04:02.982 --rc genhtml_function_coverage=1 00:04:02.982 --rc genhtml_legend=1 00:04:02.982 --rc geninfo_all_blocks=1 00:04:02.982 --rc geninfo_unexecuted_blocks=1 00:04:02.982 00:04:02.982 ' 00:04:02.982 02:06:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:02.982 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:02.982 --rc genhtml_branch_coverage=1 00:04:02.982 --rc genhtml_function_coverage=1 00:04:02.982 --rc genhtml_legend=1 00:04:02.982 --rc geninfo_all_blocks=1 00:04:02.982 --rc geninfo_unexecuted_blocks=1 00:04:02.982 00:04:02.982 ' 00:04:02.982 02:06:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:02.982 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:02.982 --rc genhtml_branch_coverage=1 00:04:02.982 --rc genhtml_function_coverage=1 00:04:02.982 --rc genhtml_legend=1 00:04:02.982 --rc geninfo_all_blocks=1 00:04:02.982 --rc geninfo_unexecuted_blocks=1 00:04:02.982 00:04:02.982 ' 00:04:02.982 02:06:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:02.982 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:02.982 --rc genhtml_branch_coverage=1 00:04:02.982 --rc genhtml_function_coverage=1 00:04:02.982 --rc genhtml_legend=1 00:04:02.982 --rc geninfo_all_blocks=1 00:04:02.982 --rc geninfo_unexecuted_blocks=1 00:04:02.982 00:04:02.982 ' 00:04:02.982 02:06:30 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:04:02.982 02:06:30 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:04:02.982 02:06:30 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:04:02.982 02:06:30 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:04:02.982 02:06:30 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:04:02.982 02:06:30 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:04:02.982 02:06:30 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:04:02.982 02:06:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:02.982 02:06:30 -- common/autotest_common.sh@10 -- # set +x 00:04:02.982 02:06:30 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=1985893 00:04:02.982 02:06:30 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:04:02.982 02:06:30 -- spdkcli/tcp.sh@27 -- # waitforlisten 1985893 00:04:02.982 02:06:30 -- common/autotest_common.sh@829 -- # '[' -z 1985893 ']' 00:04:02.982 02:06:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:02.982 02:06:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:02.982 02:06:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:02.982 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:02.982 02:06:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:02.982 02:06:30 -- common/autotest_common.sh@10 -- # set +x 00:04:02.982 [2024-12-08 02:06:30.680657] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:02.982 [2024-12-08 02:06:30.680744] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1985893 ] 00:04:02.982 EAL: No free 2048 kB hugepages reported on node 1 00:04:02.982 [2024-12-08 02:06:30.739038] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:03.240 [2024-12-08 02:06:30.850125] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:03.240 [2024-12-08 02:06:30.850347] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:03.240 [2024-12-08 02:06:30.850352] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:04.176 02:06:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:04.176 02:06:31 -- common/autotest_common.sh@862 -- # return 0 00:04:04.176 02:06:31 -- spdkcli/tcp.sh@31 -- # socat_pid=1986036 00:04:04.176 02:06:31 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:04:04.176 02:06:31 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:04:04.176 [ 00:04:04.176 "bdev_malloc_delete", 00:04:04.176 "bdev_malloc_create", 00:04:04.176 "bdev_null_resize", 00:04:04.176 "bdev_null_delete", 00:04:04.176 "bdev_null_create", 00:04:04.176 "bdev_nvme_cuse_unregister", 00:04:04.176 "bdev_nvme_cuse_register", 00:04:04.176 "bdev_opal_new_user", 00:04:04.176 "bdev_opal_set_lock_state", 00:04:04.176 "bdev_opal_delete", 00:04:04.176 "bdev_opal_get_info", 00:04:04.176 "bdev_opal_create", 00:04:04.176 "bdev_nvme_opal_revert", 00:04:04.176 "bdev_nvme_opal_init", 00:04:04.176 "bdev_nvme_send_cmd", 00:04:04.176 "bdev_nvme_get_path_iostat", 00:04:04.176 "bdev_nvme_get_mdns_discovery_info", 00:04:04.176 "bdev_nvme_stop_mdns_discovery", 00:04:04.176 "bdev_nvme_start_mdns_discovery", 00:04:04.176 "bdev_nvme_set_multipath_policy", 00:04:04.176 "bdev_nvme_set_preferred_path", 00:04:04.176 "bdev_nvme_get_io_paths", 00:04:04.176 "bdev_nvme_remove_error_injection", 00:04:04.176 "bdev_nvme_add_error_injection", 00:04:04.176 "bdev_nvme_get_discovery_info", 00:04:04.176 "bdev_nvme_stop_discovery", 00:04:04.176 "bdev_nvme_start_discovery", 00:04:04.176 "bdev_nvme_get_controller_health_info", 00:04:04.176 "bdev_nvme_disable_controller", 00:04:04.176 "bdev_nvme_enable_controller", 00:04:04.176 "bdev_nvme_reset_controller", 00:04:04.176 "bdev_nvme_get_transport_statistics", 00:04:04.176 "bdev_nvme_apply_firmware", 00:04:04.176 "bdev_nvme_detach_controller", 00:04:04.176 "bdev_nvme_get_controllers", 00:04:04.176 "bdev_nvme_attach_controller", 00:04:04.176 "bdev_nvme_set_hotplug", 00:04:04.176 "bdev_nvme_set_options", 00:04:04.176 "bdev_passthru_delete", 00:04:04.176 "bdev_passthru_create", 00:04:04.176 "bdev_lvol_grow_lvstore", 00:04:04.176 "bdev_lvol_get_lvols", 00:04:04.176 "bdev_lvol_get_lvstores", 00:04:04.176 "bdev_lvol_delete", 00:04:04.176 "bdev_lvol_set_read_only", 00:04:04.176 "bdev_lvol_resize", 00:04:04.176 "bdev_lvol_decouple_parent", 00:04:04.176 "bdev_lvol_inflate", 00:04:04.176 "bdev_lvol_rename", 00:04:04.176 "bdev_lvol_clone_bdev", 00:04:04.176 "bdev_lvol_clone", 00:04:04.176 "bdev_lvol_snapshot", 00:04:04.176 "bdev_lvol_create", 00:04:04.176 "bdev_lvol_delete_lvstore", 00:04:04.176 "bdev_lvol_rename_lvstore", 00:04:04.176 "bdev_lvol_create_lvstore", 00:04:04.176 "bdev_raid_set_options", 00:04:04.176 "bdev_raid_remove_base_bdev", 00:04:04.176 "bdev_raid_add_base_bdev", 00:04:04.176 "bdev_raid_delete", 00:04:04.176 "bdev_raid_create", 00:04:04.176 "bdev_raid_get_bdevs", 00:04:04.176 "bdev_error_inject_error", 00:04:04.176 "bdev_error_delete", 00:04:04.176 "bdev_error_create", 00:04:04.176 "bdev_split_delete", 00:04:04.176 "bdev_split_create", 00:04:04.176 "bdev_delay_delete", 00:04:04.176 "bdev_delay_create", 00:04:04.176 "bdev_delay_update_latency", 00:04:04.176 "bdev_zone_block_delete", 00:04:04.176 "bdev_zone_block_create", 00:04:04.176 "blobfs_create", 00:04:04.176 "blobfs_detect", 00:04:04.176 "blobfs_set_cache_size", 00:04:04.176 "bdev_aio_delete", 00:04:04.176 "bdev_aio_rescan", 00:04:04.176 "bdev_aio_create", 00:04:04.176 "bdev_ftl_set_property", 00:04:04.176 "bdev_ftl_get_properties", 00:04:04.176 "bdev_ftl_get_stats", 00:04:04.176 "bdev_ftl_unmap", 00:04:04.176 "bdev_ftl_unload", 00:04:04.176 "bdev_ftl_delete", 00:04:04.176 "bdev_ftl_load", 00:04:04.176 "bdev_ftl_create", 00:04:04.176 "bdev_virtio_attach_controller", 00:04:04.176 "bdev_virtio_scsi_get_devices", 00:04:04.176 "bdev_virtio_detach_controller", 00:04:04.176 "bdev_virtio_blk_set_hotplug", 00:04:04.176 "bdev_iscsi_delete", 00:04:04.176 "bdev_iscsi_create", 00:04:04.176 "bdev_iscsi_set_options", 00:04:04.176 "accel_error_inject_error", 00:04:04.176 "ioat_scan_accel_module", 00:04:04.176 "dsa_scan_accel_module", 00:04:04.176 "iaa_scan_accel_module", 00:04:04.176 "iscsi_set_options", 00:04:04.176 "iscsi_get_auth_groups", 00:04:04.176 "iscsi_auth_group_remove_secret", 00:04:04.176 "iscsi_auth_group_add_secret", 00:04:04.176 "iscsi_delete_auth_group", 00:04:04.176 "iscsi_create_auth_group", 00:04:04.176 "iscsi_set_discovery_auth", 00:04:04.176 "iscsi_get_options", 00:04:04.176 "iscsi_target_node_request_logout", 00:04:04.176 "iscsi_target_node_set_redirect", 00:04:04.176 "iscsi_target_node_set_auth", 00:04:04.176 "iscsi_target_node_add_lun", 00:04:04.176 "iscsi_get_connections", 00:04:04.176 "iscsi_portal_group_set_auth", 00:04:04.176 "iscsi_start_portal_group", 00:04:04.176 "iscsi_delete_portal_group", 00:04:04.176 "iscsi_create_portal_group", 00:04:04.176 "iscsi_get_portal_groups", 00:04:04.176 "iscsi_delete_target_node", 00:04:04.176 "iscsi_target_node_remove_pg_ig_maps", 00:04:04.176 "iscsi_target_node_add_pg_ig_maps", 00:04:04.176 "iscsi_create_target_node", 00:04:04.176 "iscsi_get_target_nodes", 00:04:04.176 "iscsi_delete_initiator_group", 00:04:04.176 "iscsi_initiator_group_remove_initiators", 00:04:04.176 "iscsi_initiator_group_add_initiators", 00:04:04.176 "iscsi_create_initiator_group", 00:04:04.176 "iscsi_get_initiator_groups", 00:04:04.176 "nvmf_set_crdt", 00:04:04.176 "nvmf_set_config", 00:04:04.176 "nvmf_set_max_subsystems", 00:04:04.176 "nvmf_subsystem_get_listeners", 00:04:04.176 "nvmf_subsystem_get_qpairs", 00:04:04.176 "nvmf_subsystem_get_controllers", 00:04:04.176 "nvmf_get_stats", 00:04:04.176 "nvmf_get_transports", 00:04:04.176 "nvmf_create_transport", 00:04:04.176 "nvmf_get_targets", 00:04:04.176 "nvmf_delete_target", 00:04:04.176 "nvmf_create_target", 00:04:04.176 "nvmf_subsystem_allow_any_host", 00:04:04.176 "nvmf_subsystem_remove_host", 00:04:04.176 "nvmf_subsystem_add_host", 00:04:04.176 "nvmf_subsystem_remove_ns", 00:04:04.176 "nvmf_subsystem_add_ns", 00:04:04.176 "nvmf_subsystem_listener_set_ana_state", 00:04:04.176 "nvmf_discovery_get_referrals", 00:04:04.176 "nvmf_discovery_remove_referral", 00:04:04.176 "nvmf_discovery_add_referral", 00:04:04.176 "nvmf_subsystem_remove_listener", 00:04:04.176 "nvmf_subsystem_add_listener", 00:04:04.176 "nvmf_delete_subsystem", 00:04:04.176 "nvmf_create_subsystem", 00:04:04.176 "nvmf_get_subsystems", 00:04:04.176 "env_dpdk_get_mem_stats", 00:04:04.176 "nbd_get_disks", 00:04:04.176 "nbd_stop_disk", 00:04:04.176 "nbd_start_disk", 00:04:04.176 "ublk_recover_disk", 00:04:04.176 "ublk_get_disks", 00:04:04.176 "ublk_stop_disk", 00:04:04.176 "ublk_start_disk", 00:04:04.176 "ublk_destroy_target", 00:04:04.176 "ublk_create_target", 00:04:04.176 "virtio_blk_create_transport", 00:04:04.176 "virtio_blk_get_transports", 00:04:04.176 "vhost_controller_set_coalescing", 00:04:04.176 "vhost_get_controllers", 00:04:04.176 "vhost_delete_controller", 00:04:04.176 "vhost_create_blk_controller", 00:04:04.176 "vhost_scsi_controller_remove_target", 00:04:04.176 "vhost_scsi_controller_add_target", 00:04:04.176 "vhost_start_scsi_controller", 00:04:04.176 "vhost_create_scsi_controller", 00:04:04.176 "thread_set_cpumask", 00:04:04.176 "framework_get_scheduler", 00:04:04.176 "framework_set_scheduler", 00:04:04.176 "framework_get_reactors", 00:04:04.176 "thread_get_io_channels", 00:04:04.176 "thread_get_pollers", 00:04:04.176 "thread_get_stats", 00:04:04.176 "framework_monitor_context_switch", 00:04:04.176 "spdk_kill_instance", 00:04:04.176 "log_enable_timestamps", 00:04:04.176 "log_get_flags", 00:04:04.176 "log_clear_flag", 00:04:04.176 "log_set_flag", 00:04:04.176 "log_get_level", 00:04:04.176 "log_set_level", 00:04:04.176 "log_get_print_level", 00:04:04.176 "log_set_print_level", 00:04:04.176 "framework_enable_cpumask_locks", 00:04:04.176 "framework_disable_cpumask_locks", 00:04:04.176 "framework_wait_init", 00:04:04.176 "framework_start_init", 00:04:04.176 "scsi_get_devices", 00:04:04.176 "bdev_get_histogram", 00:04:04.176 "bdev_enable_histogram", 00:04:04.176 "bdev_set_qos_limit", 00:04:04.176 "bdev_set_qd_sampling_period", 00:04:04.176 "bdev_get_bdevs", 00:04:04.176 "bdev_reset_iostat", 00:04:04.176 "bdev_get_iostat", 00:04:04.176 "bdev_examine", 00:04:04.177 "bdev_wait_for_examine", 00:04:04.177 "bdev_set_options", 00:04:04.177 "notify_get_notifications", 00:04:04.177 "notify_get_types", 00:04:04.177 "accel_get_stats", 00:04:04.177 "accel_set_options", 00:04:04.177 "accel_set_driver", 00:04:04.177 "accel_crypto_key_destroy", 00:04:04.177 "accel_crypto_keys_get", 00:04:04.177 "accel_crypto_key_create", 00:04:04.177 "accel_assign_opc", 00:04:04.177 "accel_get_module_info", 00:04:04.177 "accel_get_opc_assignments", 00:04:04.177 "vmd_rescan", 00:04:04.177 "vmd_remove_device", 00:04:04.177 "vmd_enable", 00:04:04.177 "sock_set_default_impl", 00:04:04.177 "sock_impl_set_options", 00:04:04.177 "sock_impl_get_options", 00:04:04.177 "iobuf_get_stats", 00:04:04.177 "iobuf_set_options", 00:04:04.177 "framework_get_pci_devices", 00:04:04.177 "framework_get_config", 00:04:04.177 "framework_get_subsystems", 00:04:04.177 "trace_get_info", 00:04:04.177 "trace_get_tpoint_group_mask", 00:04:04.177 "trace_disable_tpoint_group", 00:04:04.177 "trace_enable_tpoint_group", 00:04:04.177 "trace_clear_tpoint_mask", 00:04:04.177 "trace_set_tpoint_mask", 00:04:04.177 "spdk_get_version", 00:04:04.177 "rpc_get_methods" 00:04:04.177 ] 00:04:04.177 02:06:31 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:04:04.177 02:06:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:04.177 02:06:31 -- common/autotest_common.sh@10 -- # set +x 00:04:04.177 02:06:31 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:04:04.177 02:06:31 -- spdkcli/tcp.sh@38 -- # killprocess 1985893 00:04:04.177 02:06:31 -- common/autotest_common.sh@936 -- # '[' -z 1985893 ']' 00:04:04.177 02:06:31 -- common/autotest_common.sh@940 -- # kill -0 1985893 00:04:04.177 02:06:31 -- common/autotest_common.sh@941 -- # uname 00:04:04.177 02:06:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:04.177 02:06:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1985893 00:04:04.177 02:06:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:04.177 02:06:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:04.177 02:06:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1985893' 00:04:04.177 killing process with pid 1985893 00:04:04.177 02:06:31 -- common/autotest_common.sh@955 -- # kill 1985893 00:04:04.177 02:06:31 -- common/autotest_common.sh@960 -- # wait 1985893 00:04:04.744 00:04:04.744 real 0m1.900s 00:04:04.744 user 0m3.566s 00:04:04.744 sys 0m0.515s 00:04:04.744 02:06:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:04.744 02:06:32 -- common/autotest_common.sh@10 -- # set +x 00:04:04.744 ************************************ 00:04:04.744 END TEST spdkcli_tcp 00:04:04.744 ************************************ 00:04:04.744 02:06:32 -- spdk/autotest.sh@173 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:04.744 02:06:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:04.744 02:06:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:04.744 02:06:32 -- common/autotest_common.sh@10 -- # set +x 00:04:04.744 ************************************ 00:04:04.744 START TEST dpdk_mem_utility 00:04:04.744 ************************************ 00:04:04.744 02:06:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:04.744 * Looking for test storage... 00:04:04.744 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:04:04.744 02:06:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:04.744 02:06:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:04.744 02:06:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:05.002 02:06:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:05.002 02:06:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:05.002 02:06:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:05.002 02:06:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:05.002 02:06:32 -- scripts/common.sh@335 -- # IFS=.-: 00:04:05.002 02:06:32 -- scripts/common.sh@335 -- # read -ra ver1 00:04:05.002 02:06:32 -- scripts/common.sh@336 -- # IFS=.-: 00:04:05.002 02:06:32 -- scripts/common.sh@336 -- # read -ra ver2 00:04:05.002 02:06:32 -- scripts/common.sh@337 -- # local 'op=<' 00:04:05.002 02:06:32 -- scripts/common.sh@339 -- # ver1_l=2 00:04:05.002 02:06:32 -- scripts/common.sh@340 -- # ver2_l=1 00:04:05.002 02:06:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:05.002 02:06:32 -- scripts/common.sh@343 -- # case "$op" in 00:04:05.002 02:06:32 -- scripts/common.sh@344 -- # : 1 00:04:05.002 02:06:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:05.002 02:06:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:05.002 02:06:32 -- scripts/common.sh@364 -- # decimal 1 00:04:05.002 02:06:32 -- scripts/common.sh@352 -- # local d=1 00:04:05.002 02:06:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:05.002 02:06:32 -- scripts/common.sh@354 -- # echo 1 00:04:05.002 02:06:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:05.002 02:06:32 -- scripts/common.sh@365 -- # decimal 2 00:04:05.002 02:06:32 -- scripts/common.sh@352 -- # local d=2 00:04:05.002 02:06:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:05.002 02:06:32 -- scripts/common.sh@354 -- # echo 2 00:04:05.002 02:06:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:05.002 02:06:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:05.002 02:06:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:05.002 02:06:32 -- scripts/common.sh@367 -- # return 0 00:04:05.002 02:06:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:05.003 02:06:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:05.003 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:05.003 --rc genhtml_branch_coverage=1 00:04:05.003 --rc genhtml_function_coverage=1 00:04:05.003 --rc genhtml_legend=1 00:04:05.003 --rc geninfo_all_blocks=1 00:04:05.003 --rc geninfo_unexecuted_blocks=1 00:04:05.003 00:04:05.003 ' 00:04:05.003 02:06:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:05.003 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:05.003 --rc genhtml_branch_coverage=1 00:04:05.003 --rc genhtml_function_coverage=1 00:04:05.003 --rc genhtml_legend=1 00:04:05.003 --rc geninfo_all_blocks=1 00:04:05.003 --rc geninfo_unexecuted_blocks=1 00:04:05.003 00:04:05.003 ' 00:04:05.003 02:06:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:05.003 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:05.003 --rc genhtml_branch_coverage=1 00:04:05.003 --rc genhtml_function_coverage=1 00:04:05.003 --rc genhtml_legend=1 00:04:05.003 --rc geninfo_all_blocks=1 00:04:05.003 --rc geninfo_unexecuted_blocks=1 00:04:05.003 00:04:05.003 ' 00:04:05.003 02:06:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:05.003 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:05.003 --rc genhtml_branch_coverage=1 00:04:05.003 --rc genhtml_function_coverage=1 00:04:05.003 --rc genhtml_legend=1 00:04:05.003 --rc geninfo_all_blocks=1 00:04:05.003 --rc geninfo_unexecuted_blocks=1 00:04:05.003 00:04:05.003 ' 00:04:05.003 02:06:32 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:05.003 02:06:32 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=1986241 00:04:05.003 02:06:32 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:05.003 02:06:32 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 1986241 00:04:05.003 02:06:32 -- common/autotest_common.sh@829 -- # '[' -z 1986241 ']' 00:04:05.003 02:06:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:05.003 02:06:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:05.003 02:06:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:05.003 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:05.003 02:06:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:05.003 02:06:32 -- common/autotest_common.sh@10 -- # set +x 00:04:05.003 [2024-12-08 02:06:32.604424] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:05.003 [2024-12-08 02:06:32.604508] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1986241 ] 00:04:05.003 EAL: No free 2048 kB hugepages reported on node 1 00:04:05.003 [2024-12-08 02:06:32.660867] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:05.003 [2024-12-08 02:06:32.772185] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:05.003 [2024-12-08 02:06:32.772376] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:05.936 02:06:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:05.936 02:06:33 -- common/autotest_common.sh@862 -- # return 0 00:04:05.936 02:06:33 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:04:05.936 02:06:33 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:04:05.936 02:06:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:05.936 02:06:33 -- common/autotest_common.sh@10 -- # set +x 00:04:05.936 { 00:04:05.936 "filename": "/tmp/spdk_mem_dump.txt" 00:04:05.936 } 00:04:05.936 02:06:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:05.937 02:06:33 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:05.937 DPDK memory size 814.000000 MiB in 1 heap(s) 00:04:05.937 1 heaps totaling size 814.000000 MiB 00:04:05.937 size: 814.000000 MiB heap id: 0 00:04:05.937 end heaps---------- 00:04:05.937 8 mempools totaling size 598.116089 MiB 00:04:05.937 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:04:05.937 size: 158.602051 MiB name: PDU_data_out_Pool 00:04:05.937 size: 84.521057 MiB name: bdev_io_1986241 00:04:05.937 size: 51.011292 MiB name: evtpool_1986241 00:04:05.937 size: 50.003479 MiB name: msgpool_1986241 00:04:05.937 size: 21.763794 MiB name: PDU_Pool 00:04:05.937 size: 19.513306 MiB name: SCSI_TASK_Pool 00:04:05.937 size: 0.026123 MiB name: Session_Pool 00:04:05.937 end mempools------- 00:04:05.937 6 memzones totaling size 4.142822 MiB 00:04:05.937 size: 1.000366 MiB name: RG_ring_0_1986241 00:04:05.937 size: 1.000366 MiB name: RG_ring_1_1986241 00:04:05.937 size: 1.000366 MiB name: RG_ring_4_1986241 00:04:05.937 size: 1.000366 MiB name: RG_ring_5_1986241 00:04:05.937 size: 0.125366 MiB name: RG_ring_2_1986241 00:04:05.937 size: 0.015991 MiB name: RG_ring_3_1986241 00:04:05.937 end memzones------- 00:04:05.937 02:06:33 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:04:05.937 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:04:05.937 list of free elements. size: 12.519348 MiB 00:04:05.937 element at address: 0x200000400000 with size: 1.999512 MiB 00:04:05.937 element at address: 0x200018e00000 with size: 0.999878 MiB 00:04:05.937 element at address: 0x200019000000 with size: 0.999878 MiB 00:04:05.937 element at address: 0x200003e00000 with size: 0.996277 MiB 00:04:05.937 element at address: 0x200031c00000 with size: 0.994446 MiB 00:04:05.937 element at address: 0x200013800000 with size: 0.978699 MiB 00:04:05.937 element at address: 0x200007000000 with size: 0.959839 MiB 00:04:05.937 element at address: 0x200019200000 with size: 0.936584 MiB 00:04:05.937 element at address: 0x200000200000 with size: 0.841614 MiB 00:04:05.937 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:04:05.937 element at address: 0x20000b200000 with size: 0.490723 MiB 00:04:05.937 element at address: 0x200000800000 with size: 0.487793 MiB 00:04:05.937 element at address: 0x200019400000 with size: 0.485657 MiB 00:04:05.937 element at address: 0x200027e00000 with size: 0.410034 MiB 00:04:05.937 element at address: 0x200003a00000 with size: 0.355530 MiB 00:04:05.937 list of standard malloc elements. size: 199.218079 MiB 00:04:05.937 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:04:05.937 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:04:05.937 element at address: 0x200018efff80 with size: 1.000122 MiB 00:04:05.937 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:04:05.937 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:04:05.937 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:04:05.937 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:04:05.937 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:04:05.937 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:04:05.937 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:04:05.937 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:04:05.937 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:04:05.937 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:04:05.937 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:04:05.937 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:04:05.937 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:04:05.937 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:04:05.937 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:04:05.937 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:04:05.937 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:04:05.937 element at address: 0x200003adb300 with size: 0.000183 MiB 00:04:05.937 element at address: 0x200003adb500 with size: 0.000183 MiB 00:04:05.937 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:04:05.937 element at address: 0x200003affa80 with size: 0.000183 MiB 00:04:05.937 element at address: 0x200003affb40 with size: 0.000183 MiB 00:04:05.937 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:04:05.937 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:04:05.937 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:04:05.937 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:04:05.937 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:04:05.937 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:04:05.937 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:04:05.937 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:04:05.937 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:04:05.937 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:04:05.937 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:04:05.937 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:04:05.937 element at address: 0x200027e69040 with size: 0.000183 MiB 00:04:05.937 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:04:05.937 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:04:05.937 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:04:05.937 list of memzone associated elements. size: 602.262573 MiB 00:04:05.937 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:04:05.937 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:04:05.937 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:04:05.937 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:04:05.937 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:04:05.937 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_1986241_0 00:04:05.937 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:04:05.937 associated memzone info: size: 48.002930 MiB name: MP_evtpool_1986241_0 00:04:05.937 element at address: 0x200003fff380 with size: 48.003052 MiB 00:04:05.937 associated memzone info: size: 48.002930 MiB name: MP_msgpool_1986241_0 00:04:05.937 element at address: 0x2000195be940 with size: 20.255554 MiB 00:04:05.937 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:04:05.937 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:04:05.937 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:04:05.937 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:04:05.937 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_1986241 00:04:05.937 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:04:05.937 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_1986241 00:04:05.937 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:04:05.937 associated memzone info: size: 1.007996 MiB name: MP_evtpool_1986241 00:04:05.937 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:04:05.937 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:04:05.937 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:04:05.937 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:04:05.937 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:04:05.937 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:04:05.937 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:04:05.937 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:04:05.937 element at address: 0x200003eff180 with size: 1.000488 MiB 00:04:05.937 associated memzone info: size: 1.000366 MiB name: RG_ring_0_1986241 00:04:05.937 element at address: 0x200003affc00 with size: 1.000488 MiB 00:04:05.937 associated memzone info: size: 1.000366 MiB name: RG_ring_1_1986241 00:04:05.937 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:04:05.937 associated memzone info: size: 1.000366 MiB name: RG_ring_4_1986241 00:04:05.937 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:04:05.937 associated memzone info: size: 1.000366 MiB name: RG_ring_5_1986241 00:04:05.937 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:04:05.937 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_1986241 00:04:05.937 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:04:05.937 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:04:05.937 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:04:05.937 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:04:05.937 element at address: 0x20001947c540 with size: 0.250488 MiB 00:04:05.937 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:04:05.937 element at address: 0x200003adf880 with size: 0.125488 MiB 00:04:05.937 associated memzone info: size: 0.125366 MiB name: RG_ring_2_1986241 00:04:05.937 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:04:05.937 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:04:05.937 element at address: 0x200027e69100 with size: 0.023743 MiB 00:04:05.937 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:04:05.937 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:04:05.937 associated memzone info: size: 0.015991 MiB name: RG_ring_3_1986241 00:04:05.937 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:04:05.937 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:04:05.937 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:04:05.937 associated memzone info: size: 0.000183 MiB name: MP_msgpool_1986241 00:04:05.937 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:04:05.937 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_1986241 00:04:05.937 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:04:05.937 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:04:05.937 02:06:33 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:04:05.937 02:06:33 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 1986241 00:04:05.937 02:06:33 -- common/autotest_common.sh@936 -- # '[' -z 1986241 ']' 00:04:05.938 02:06:33 -- common/autotest_common.sh@940 -- # kill -0 1986241 00:04:05.938 02:06:33 -- common/autotest_common.sh@941 -- # uname 00:04:05.938 02:06:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:05.938 02:06:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1986241 00:04:05.938 02:06:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:05.938 02:06:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:05.938 02:06:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1986241' 00:04:05.938 killing process with pid 1986241 00:04:05.938 02:06:33 -- common/autotest_common.sh@955 -- # kill 1986241 00:04:05.938 02:06:33 -- common/autotest_common.sh@960 -- # wait 1986241 00:04:06.504 00:04:06.504 real 0m1.749s 00:04:06.504 user 0m1.889s 00:04:06.504 sys 0m0.466s 00:04:06.504 02:06:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:06.504 02:06:34 -- common/autotest_common.sh@10 -- # set +x 00:04:06.504 ************************************ 00:04:06.504 END TEST dpdk_mem_utility 00:04:06.504 ************************************ 00:04:06.504 02:06:34 -- spdk/autotest.sh@174 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:06.504 02:06:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:06.504 02:06:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:06.504 02:06:34 -- common/autotest_common.sh@10 -- # set +x 00:04:06.504 ************************************ 00:04:06.504 START TEST event 00:04:06.504 ************************************ 00:04:06.504 02:06:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:06.504 * Looking for test storage... 00:04:06.504 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:04:06.504 02:06:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:06.504 02:06:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:06.504 02:06:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:06.763 02:06:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:06.763 02:06:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:06.763 02:06:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:06.763 02:06:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:06.763 02:06:34 -- scripts/common.sh@335 -- # IFS=.-: 00:04:06.763 02:06:34 -- scripts/common.sh@335 -- # read -ra ver1 00:04:06.763 02:06:34 -- scripts/common.sh@336 -- # IFS=.-: 00:04:06.763 02:06:34 -- scripts/common.sh@336 -- # read -ra ver2 00:04:06.763 02:06:34 -- scripts/common.sh@337 -- # local 'op=<' 00:04:06.763 02:06:34 -- scripts/common.sh@339 -- # ver1_l=2 00:04:06.763 02:06:34 -- scripts/common.sh@340 -- # ver2_l=1 00:04:06.763 02:06:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:06.763 02:06:34 -- scripts/common.sh@343 -- # case "$op" in 00:04:06.763 02:06:34 -- scripts/common.sh@344 -- # : 1 00:04:06.763 02:06:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:06.763 02:06:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:06.763 02:06:34 -- scripts/common.sh@364 -- # decimal 1 00:04:06.763 02:06:34 -- scripts/common.sh@352 -- # local d=1 00:04:06.763 02:06:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:06.763 02:06:34 -- scripts/common.sh@354 -- # echo 1 00:04:06.763 02:06:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:06.763 02:06:34 -- scripts/common.sh@365 -- # decimal 2 00:04:06.763 02:06:34 -- scripts/common.sh@352 -- # local d=2 00:04:06.763 02:06:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:06.763 02:06:34 -- scripts/common.sh@354 -- # echo 2 00:04:06.763 02:06:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:06.763 02:06:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:06.763 02:06:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:06.763 02:06:34 -- scripts/common.sh@367 -- # return 0 00:04:06.763 02:06:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:06.763 02:06:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:06.763 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:06.763 --rc genhtml_branch_coverage=1 00:04:06.763 --rc genhtml_function_coverage=1 00:04:06.763 --rc genhtml_legend=1 00:04:06.763 --rc geninfo_all_blocks=1 00:04:06.763 --rc geninfo_unexecuted_blocks=1 00:04:06.763 00:04:06.763 ' 00:04:06.763 02:06:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:06.763 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:06.763 --rc genhtml_branch_coverage=1 00:04:06.763 --rc genhtml_function_coverage=1 00:04:06.763 --rc genhtml_legend=1 00:04:06.763 --rc geninfo_all_blocks=1 00:04:06.763 --rc geninfo_unexecuted_blocks=1 00:04:06.763 00:04:06.763 ' 00:04:06.763 02:06:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:06.763 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:06.763 --rc genhtml_branch_coverage=1 00:04:06.763 --rc genhtml_function_coverage=1 00:04:06.763 --rc genhtml_legend=1 00:04:06.763 --rc geninfo_all_blocks=1 00:04:06.763 --rc geninfo_unexecuted_blocks=1 00:04:06.763 00:04:06.763 ' 00:04:06.763 02:06:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:06.763 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:06.764 --rc genhtml_branch_coverage=1 00:04:06.764 --rc genhtml_function_coverage=1 00:04:06.764 --rc genhtml_legend=1 00:04:06.764 --rc geninfo_all_blocks=1 00:04:06.764 --rc geninfo_unexecuted_blocks=1 00:04:06.764 00:04:06.764 ' 00:04:06.764 02:06:34 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:04:06.764 02:06:34 -- bdev/nbd_common.sh@6 -- # set -e 00:04:06.764 02:06:34 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:06.764 02:06:34 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:04:06.764 02:06:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:06.764 02:06:34 -- common/autotest_common.sh@10 -- # set +x 00:04:06.764 ************************************ 00:04:06.764 START TEST event_perf 00:04:06.764 ************************************ 00:04:06.764 02:06:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:06.764 Running I/O for 1 seconds...[2024-12-08 02:06:34.342496] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:06.764 [2024-12-08 02:06:34.342587] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1986569 ] 00:04:06.764 EAL: No free 2048 kB hugepages reported on node 1 00:04:06.764 [2024-12-08 02:06:34.404590] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:06.764 [2024-12-08 02:06:34.523215] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:06.764 [2024-12-08 02:06:34.523301] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:06.764 [2024-12-08 02:06:34.523304] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:06.764 [2024-12-08 02:06:34.523241] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:08.138 Running I/O for 1 seconds... 00:04:08.138 lcore 0: 236163 00:04:08.138 lcore 1: 236162 00:04:08.138 lcore 2: 236161 00:04:08.138 lcore 3: 236162 00:04:08.138 done. 00:04:08.138 00:04:08.138 real 0m1.322s 00:04:08.138 user 0m4.232s 00:04:08.138 sys 0m0.084s 00:04:08.138 02:06:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:08.138 02:06:35 -- common/autotest_common.sh@10 -- # set +x 00:04:08.138 ************************************ 00:04:08.138 END TEST event_perf 00:04:08.138 ************************************ 00:04:08.138 02:06:35 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:08.138 02:06:35 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:08.138 02:06:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:08.138 02:06:35 -- common/autotest_common.sh@10 -- # set +x 00:04:08.138 ************************************ 00:04:08.138 START TEST event_reactor 00:04:08.138 ************************************ 00:04:08.138 02:06:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:08.138 [2024-12-08 02:06:35.694352] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:08.138 [2024-12-08 02:06:35.694440] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1986732 ] 00:04:08.138 EAL: No free 2048 kB hugepages reported on node 1 00:04:08.138 [2024-12-08 02:06:35.757676] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:08.138 [2024-12-08 02:06:35.871388] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:09.511 test_start 00:04:09.511 oneshot 00:04:09.511 tick 100 00:04:09.511 tick 100 00:04:09.511 tick 250 00:04:09.511 tick 100 00:04:09.511 tick 100 00:04:09.511 tick 250 00:04:09.511 tick 500 00:04:09.511 tick 100 00:04:09.511 tick 100 00:04:09.511 tick 100 00:04:09.511 tick 250 00:04:09.511 tick 100 00:04:09.511 tick 100 00:04:09.511 test_end 00:04:09.511 00:04:09.511 real 0m1.316s 00:04:09.511 user 0m1.224s 00:04:09.511 sys 0m0.086s 00:04:09.511 02:06:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:09.511 02:06:36 -- common/autotest_common.sh@10 -- # set +x 00:04:09.511 ************************************ 00:04:09.511 END TEST event_reactor 00:04:09.511 ************************************ 00:04:09.511 02:06:37 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:09.511 02:06:37 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:09.511 02:06:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:09.511 02:06:37 -- common/autotest_common.sh@10 -- # set +x 00:04:09.512 ************************************ 00:04:09.512 START TEST event_reactor_perf 00:04:09.512 ************************************ 00:04:09.512 02:06:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:09.512 [2024-12-08 02:06:37.039291] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:09.512 [2024-12-08 02:06:37.039384] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1986888 ] 00:04:09.512 EAL: No free 2048 kB hugepages reported on node 1 00:04:09.512 [2024-12-08 02:06:37.104186] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:09.512 [2024-12-08 02:06:37.217914] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:10.886 test_start 00:04:10.886 test_end 00:04:10.886 Performance: 349840 events per second 00:04:10.886 00:04:10.886 real 0m1.318s 00:04:10.886 user 0m1.224s 00:04:10.886 sys 0m0.088s 00:04:10.886 02:06:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:10.886 02:06:38 -- common/autotest_common.sh@10 -- # set +x 00:04:10.886 ************************************ 00:04:10.886 END TEST event_reactor_perf 00:04:10.886 ************************************ 00:04:10.886 02:06:38 -- event/event.sh@49 -- # uname -s 00:04:10.886 02:06:38 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:04:10.886 02:06:38 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:10.886 02:06:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:10.886 02:06:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:10.886 02:06:38 -- common/autotest_common.sh@10 -- # set +x 00:04:10.886 ************************************ 00:04:10.886 START TEST event_scheduler 00:04:10.886 ************************************ 00:04:10.886 02:06:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:10.886 * Looking for test storage... 00:04:10.886 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:04:10.886 02:06:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:10.886 02:06:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:10.886 02:06:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:10.886 02:06:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:10.886 02:06:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:10.886 02:06:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:10.886 02:06:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:10.886 02:06:38 -- scripts/common.sh@335 -- # IFS=.-: 00:04:10.886 02:06:38 -- scripts/common.sh@335 -- # read -ra ver1 00:04:10.886 02:06:38 -- scripts/common.sh@336 -- # IFS=.-: 00:04:10.886 02:06:38 -- scripts/common.sh@336 -- # read -ra ver2 00:04:10.886 02:06:38 -- scripts/common.sh@337 -- # local 'op=<' 00:04:10.886 02:06:38 -- scripts/common.sh@339 -- # ver1_l=2 00:04:10.886 02:06:38 -- scripts/common.sh@340 -- # ver2_l=1 00:04:10.886 02:06:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:10.886 02:06:38 -- scripts/common.sh@343 -- # case "$op" in 00:04:10.886 02:06:38 -- scripts/common.sh@344 -- # : 1 00:04:10.886 02:06:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:10.886 02:06:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:10.886 02:06:38 -- scripts/common.sh@364 -- # decimal 1 00:04:10.886 02:06:38 -- scripts/common.sh@352 -- # local d=1 00:04:10.886 02:06:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:10.886 02:06:38 -- scripts/common.sh@354 -- # echo 1 00:04:10.886 02:06:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:10.886 02:06:38 -- scripts/common.sh@365 -- # decimal 2 00:04:10.886 02:06:38 -- scripts/common.sh@352 -- # local d=2 00:04:10.886 02:06:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:10.886 02:06:38 -- scripts/common.sh@354 -- # echo 2 00:04:10.886 02:06:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:10.886 02:06:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:10.886 02:06:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:10.886 02:06:38 -- scripts/common.sh@367 -- # return 0 00:04:10.886 02:06:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:10.886 02:06:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:10.886 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:10.886 --rc genhtml_branch_coverage=1 00:04:10.886 --rc genhtml_function_coverage=1 00:04:10.886 --rc genhtml_legend=1 00:04:10.886 --rc geninfo_all_blocks=1 00:04:10.886 --rc geninfo_unexecuted_blocks=1 00:04:10.886 00:04:10.886 ' 00:04:10.886 02:06:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:10.886 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:10.886 --rc genhtml_branch_coverage=1 00:04:10.886 --rc genhtml_function_coverage=1 00:04:10.886 --rc genhtml_legend=1 00:04:10.886 --rc geninfo_all_blocks=1 00:04:10.886 --rc geninfo_unexecuted_blocks=1 00:04:10.886 00:04:10.886 ' 00:04:10.886 02:06:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:10.886 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:10.886 --rc genhtml_branch_coverage=1 00:04:10.886 --rc genhtml_function_coverage=1 00:04:10.886 --rc genhtml_legend=1 00:04:10.886 --rc geninfo_all_blocks=1 00:04:10.886 --rc geninfo_unexecuted_blocks=1 00:04:10.886 00:04:10.886 ' 00:04:10.886 02:06:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:10.886 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:10.886 --rc genhtml_branch_coverage=1 00:04:10.886 --rc genhtml_function_coverage=1 00:04:10.886 --rc genhtml_legend=1 00:04:10.886 --rc geninfo_all_blocks=1 00:04:10.886 --rc geninfo_unexecuted_blocks=1 00:04:10.886 00:04:10.886 ' 00:04:10.886 02:06:38 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:04:10.886 02:06:38 -- scheduler/scheduler.sh@35 -- # scheduler_pid=1987075 00:04:10.886 02:06:38 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:04:10.887 02:06:38 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:04:10.887 02:06:38 -- scheduler/scheduler.sh@37 -- # waitforlisten 1987075 00:04:10.887 02:06:38 -- common/autotest_common.sh@829 -- # '[' -z 1987075 ']' 00:04:10.887 02:06:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:10.887 02:06:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:10.887 02:06:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:10.887 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:10.887 02:06:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:10.887 02:06:38 -- common/autotest_common.sh@10 -- # set +x 00:04:10.887 [2024-12-08 02:06:38.549264] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:10.887 [2024-12-08 02:06:38.549340] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1987075 ] 00:04:10.887 EAL: No free 2048 kB hugepages reported on node 1 00:04:10.887 [2024-12-08 02:06:38.606971] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:11.145 [2024-12-08 02:06:38.723747] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:11.145 [2024-12-08 02:06:38.723819] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:11.145 [2024-12-08 02:06:38.723852] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:11.145 [2024-12-08 02:06:38.723855] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:11.145 02:06:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:11.145 02:06:38 -- common/autotest_common.sh@862 -- # return 0 00:04:11.145 02:06:38 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:04:11.145 02:06:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.145 02:06:38 -- common/autotest_common.sh@10 -- # set +x 00:04:11.145 POWER: Env isn't set yet! 00:04:11.145 POWER: Attempting to initialise ACPI cpufreq power management... 00:04:11.145 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:04:11.145 POWER: Cannot get available frequencies of lcore 0 00:04:11.145 POWER: Attempting to initialise PSTAT power management... 00:04:11.145 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:04:11.145 POWER: Initialized successfully for lcore 0 power management 00:04:11.145 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:04:11.145 POWER: Initialized successfully for lcore 1 power management 00:04:11.145 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:04:11.145 POWER: Initialized successfully for lcore 2 power management 00:04:11.145 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:04:11.145 POWER: Initialized successfully for lcore 3 power management 00:04:11.145 [2024-12-08 02:06:38.844728] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:04:11.145 [2024-12-08 02:06:38.844747] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:04:11.145 [2024-12-08 02:06:38.844758] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:04:11.145 02:06:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.145 02:06:38 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:04:11.145 02:06:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.145 02:06:38 -- common/autotest_common.sh@10 -- # set +x 00:04:11.403 [2024-12-08 02:06:38.949482] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:04:11.403 02:06:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.403 02:06:38 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:04:11.403 02:06:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:11.403 02:06:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:11.403 02:06:38 -- common/autotest_common.sh@10 -- # set +x 00:04:11.403 ************************************ 00:04:11.403 START TEST scheduler_create_thread 00:04:11.403 ************************************ 00:04:11.403 02:06:38 -- common/autotest_common.sh@1114 -- # scheduler_create_thread 00:04:11.403 02:06:38 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:04:11.403 02:06:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.403 02:06:38 -- common/autotest_common.sh@10 -- # set +x 00:04:11.403 2 00:04:11.403 02:06:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.403 02:06:38 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:04:11.403 02:06:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.403 02:06:38 -- common/autotest_common.sh@10 -- # set +x 00:04:11.403 3 00:04:11.403 02:06:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.403 02:06:38 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:04:11.403 02:06:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.403 02:06:38 -- common/autotest_common.sh@10 -- # set +x 00:04:11.403 4 00:04:11.403 02:06:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.403 02:06:38 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:04:11.403 02:06:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.403 02:06:38 -- common/autotest_common.sh@10 -- # set +x 00:04:11.403 5 00:04:11.403 02:06:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.403 02:06:39 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:04:11.403 02:06:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.403 02:06:39 -- common/autotest_common.sh@10 -- # set +x 00:04:11.403 6 00:04:11.403 02:06:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.403 02:06:39 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:04:11.403 02:06:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.403 02:06:39 -- common/autotest_common.sh@10 -- # set +x 00:04:11.403 7 00:04:11.403 02:06:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.403 02:06:39 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:04:11.404 02:06:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.404 02:06:39 -- common/autotest_common.sh@10 -- # set +x 00:04:11.404 8 00:04:11.404 02:06:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.404 02:06:39 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:04:11.404 02:06:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.404 02:06:39 -- common/autotest_common.sh@10 -- # set +x 00:04:11.404 9 00:04:11.404 02:06:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.404 02:06:39 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:04:11.404 02:06:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.404 02:06:39 -- common/autotest_common.sh@10 -- # set +x 00:04:11.404 10 00:04:11.404 02:06:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.404 02:06:39 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:04:11.404 02:06:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.404 02:06:39 -- common/autotest_common.sh@10 -- # set +x 00:04:11.404 02:06:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.404 02:06:39 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:04:11.404 02:06:39 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:04:11.404 02:06:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.404 02:06:39 -- common/autotest_common.sh@10 -- # set +x 00:04:11.404 02:06:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.404 02:06:39 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:04:11.404 02:06:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.404 02:06:39 -- common/autotest_common.sh@10 -- # set +x 00:04:12.774 02:06:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:12.774 02:06:40 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:04:12.774 02:06:40 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:04:12.774 02:06:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:12.774 02:06:40 -- common/autotest_common.sh@10 -- # set +x 00:04:14.224 02:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:14.224 00:04:14.224 real 0m2.621s 00:04:14.224 user 0m0.011s 00:04:14.224 sys 0m0.003s 00:04:14.224 02:06:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:14.224 02:06:41 -- common/autotest_common.sh@10 -- # set +x 00:04:14.224 ************************************ 00:04:14.224 END TEST scheduler_create_thread 00:04:14.224 ************************************ 00:04:14.224 02:06:41 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:04:14.224 02:06:41 -- scheduler/scheduler.sh@46 -- # killprocess 1987075 00:04:14.224 02:06:41 -- common/autotest_common.sh@936 -- # '[' -z 1987075 ']' 00:04:14.224 02:06:41 -- common/autotest_common.sh@940 -- # kill -0 1987075 00:04:14.224 02:06:41 -- common/autotest_common.sh@941 -- # uname 00:04:14.224 02:06:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:14.224 02:06:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1987075 00:04:14.224 02:06:41 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:04:14.224 02:06:41 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:04:14.224 02:06:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1987075' 00:04:14.224 killing process with pid 1987075 00:04:14.224 02:06:41 -- common/autotest_common.sh@955 -- # kill 1987075 00:04:14.224 02:06:41 -- common/autotest_common.sh@960 -- # wait 1987075 00:04:14.482 [2024-12-08 02:06:42.057066] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:04:14.482 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:04:14.482 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:04:14.482 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:04:14.482 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:04:14.482 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:04:14.482 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:04:14.482 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:04:14.482 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:04:14.741 00:04:14.741 real 0m3.946s 00:04:14.741 user 0m6.032s 00:04:14.741 sys 0m0.324s 00:04:14.741 02:06:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:14.741 02:06:42 -- common/autotest_common.sh@10 -- # set +x 00:04:14.741 ************************************ 00:04:14.741 END TEST event_scheduler 00:04:14.741 ************************************ 00:04:14.741 02:06:42 -- event/event.sh@51 -- # modprobe -n nbd 00:04:14.741 02:06:42 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:04:14.741 02:06:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:14.741 02:06:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:14.741 02:06:42 -- common/autotest_common.sh@10 -- # set +x 00:04:14.741 ************************************ 00:04:14.741 START TEST app_repeat 00:04:14.741 ************************************ 00:04:14.741 02:06:42 -- common/autotest_common.sh@1114 -- # app_repeat_test 00:04:14.741 02:06:42 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:14.741 02:06:42 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:14.741 02:06:42 -- event/event.sh@13 -- # local nbd_list 00:04:14.741 02:06:42 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:14.741 02:06:42 -- event/event.sh@14 -- # local bdev_list 00:04:14.741 02:06:42 -- event/event.sh@15 -- # local repeat_times=4 00:04:14.741 02:06:42 -- event/event.sh@17 -- # modprobe nbd 00:04:14.741 02:06:42 -- event/event.sh@19 -- # repeat_pid=1987669 00:04:14.741 02:06:42 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:04:14.741 02:06:42 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:04:14.741 02:06:42 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 1987669' 00:04:14.741 Process app_repeat pid: 1987669 00:04:14.741 02:06:42 -- event/event.sh@23 -- # for i in {0..2} 00:04:14.741 02:06:42 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:04:14.741 spdk_app_start Round 0 00:04:14.741 02:06:42 -- event/event.sh@25 -- # waitforlisten 1987669 /var/tmp/spdk-nbd.sock 00:04:14.741 02:06:42 -- common/autotest_common.sh@829 -- # '[' -z 1987669 ']' 00:04:14.741 02:06:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:14.741 02:06:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:14.742 02:06:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:14.742 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:14.742 02:06:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:14.742 02:06:42 -- common/autotest_common.sh@10 -- # set +x 00:04:14.742 [2024-12-08 02:06:42.380573] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:14.742 [2024-12-08 02:06:42.380658] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1987669 ] 00:04:14.742 EAL: No free 2048 kB hugepages reported on node 1 00:04:14.742 [2024-12-08 02:06:42.444172] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:15.000 [2024-12-08 02:06:42.557633] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:15.000 [2024-12-08 02:06:42.557639] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:15.943 02:06:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:15.943 02:06:43 -- common/autotest_common.sh@862 -- # return 0 00:04:15.943 02:06:43 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:15.943 Malloc0 00:04:15.943 02:06:43 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:16.203 Malloc1 00:04:16.203 02:06:43 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:16.203 02:06:43 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:16.203 02:06:43 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:16.203 02:06:43 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:16.203 02:06:43 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:16.203 02:06:43 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:16.203 02:06:43 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:16.203 02:06:43 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:16.203 02:06:43 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:16.203 02:06:43 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:16.203 02:06:43 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:16.203 02:06:43 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:16.203 02:06:43 -- bdev/nbd_common.sh@12 -- # local i 00:04:16.203 02:06:43 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:16.203 02:06:43 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:16.203 02:06:43 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:16.460 /dev/nbd0 00:04:16.460 02:06:44 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:16.460 02:06:44 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:16.460 02:06:44 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:16.460 02:06:44 -- common/autotest_common.sh@867 -- # local i 00:04:16.460 02:06:44 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:16.460 02:06:44 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:16.460 02:06:44 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:16.460 02:06:44 -- common/autotest_common.sh@871 -- # break 00:04:16.460 02:06:44 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:16.460 02:06:44 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:16.460 02:06:44 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:16.460 1+0 records in 00:04:16.460 1+0 records out 00:04:16.460 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000159126 s, 25.7 MB/s 00:04:16.460 02:06:44 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:16.460 02:06:44 -- common/autotest_common.sh@884 -- # size=4096 00:04:16.460 02:06:44 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:16.460 02:06:44 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:16.460 02:06:44 -- common/autotest_common.sh@887 -- # return 0 00:04:16.460 02:06:44 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:16.460 02:06:44 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:16.460 02:06:44 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:16.718 /dev/nbd1 00:04:16.718 02:06:44 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:16.718 02:06:44 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:16.718 02:06:44 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:16.718 02:06:44 -- common/autotest_common.sh@867 -- # local i 00:04:16.718 02:06:44 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:16.718 02:06:44 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:16.718 02:06:44 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:16.718 02:06:44 -- common/autotest_common.sh@871 -- # break 00:04:16.718 02:06:44 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:16.718 02:06:44 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:16.718 02:06:44 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:16.718 1+0 records in 00:04:16.718 1+0 records out 00:04:16.718 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000217414 s, 18.8 MB/s 00:04:16.718 02:06:44 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:16.718 02:06:44 -- common/autotest_common.sh@884 -- # size=4096 00:04:16.718 02:06:44 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:16.718 02:06:44 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:16.718 02:06:44 -- common/autotest_common.sh@887 -- # return 0 00:04:16.718 02:06:44 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:16.718 02:06:44 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:16.718 02:06:44 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:16.718 02:06:44 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:16.718 02:06:44 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:16.976 02:06:44 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:16.976 { 00:04:16.976 "nbd_device": "/dev/nbd0", 00:04:16.976 "bdev_name": "Malloc0" 00:04:16.976 }, 00:04:16.976 { 00:04:16.976 "nbd_device": "/dev/nbd1", 00:04:16.976 "bdev_name": "Malloc1" 00:04:16.976 } 00:04:16.976 ]' 00:04:16.976 02:06:44 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:16.976 { 00:04:16.976 "nbd_device": "/dev/nbd0", 00:04:16.976 "bdev_name": "Malloc0" 00:04:16.976 }, 00:04:16.976 { 00:04:16.976 "nbd_device": "/dev/nbd1", 00:04:16.976 "bdev_name": "Malloc1" 00:04:16.976 } 00:04:16.976 ]' 00:04:16.976 02:06:44 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:17.234 /dev/nbd1' 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:17.234 /dev/nbd1' 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@65 -- # count=2 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@95 -- # count=2 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:17.234 256+0 records in 00:04:17.234 256+0 records out 00:04:17.234 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00512399 s, 205 MB/s 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:17.234 256+0 records in 00:04:17.234 256+0 records out 00:04:17.234 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229123 s, 45.8 MB/s 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:17.234 256+0 records in 00:04:17.234 256+0 records out 00:04:17.234 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221228 s, 47.4 MB/s 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@51 -- # local i 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:17.234 02:06:44 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:17.492 02:06:45 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:17.492 02:06:45 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:17.492 02:06:45 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:17.492 02:06:45 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:17.492 02:06:45 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:17.492 02:06:45 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:17.492 02:06:45 -- bdev/nbd_common.sh@41 -- # break 00:04:17.492 02:06:45 -- bdev/nbd_common.sh@45 -- # return 0 00:04:17.492 02:06:45 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:17.492 02:06:45 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:17.749 02:06:45 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:17.749 02:06:45 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:17.749 02:06:45 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:17.749 02:06:45 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:17.749 02:06:45 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:17.749 02:06:45 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:17.749 02:06:45 -- bdev/nbd_common.sh@41 -- # break 00:04:17.749 02:06:45 -- bdev/nbd_common.sh@45 -- # return 0 00:04:17.749 02:06:45 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:17.749 02:06:45 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:17.749 02:06:45 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:18.006 02:06:45 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:18.006 02:06:45 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:18.006 02:06:45 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:18.006 02:06:45 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:18.006 02:06:45 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:18.006 02:06:45 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:18.006 02:06:45 -- bdev/nbd_common.sh@65 -- # true 00:04:18.006 02:06:45 -- bdev/nbd_common.sh@65 -- # count=0 00:04:18.006 02:06:45 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:18.006 02:06:45 -- bdev/nbd_common.sh@104 -- # count=0 00:04:18.006 02:06:45 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:18.006 02:06:45 -- bdev/nbd_common.sh@109 -- # return 0 00:04:18.006 02:06:45 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:18.281 02:06:45 -- event/event.sh@35 -- # sleep 3 00:04:18.539 [2024-12-08 02:06:46.262297] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:18.796 [2024-12-08 02:06:46.375569] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:18.796 [2024-12-08 02:06:46.375569] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:18.796 [2024-12-08 02:06:46.437170] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:18.796 [2024-12-08 02:06:46.437258] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:21.323 02:06:48 -- event/event.sh@23 -- # for i in {0..2} 00:04:21.323 02:06:48 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:04:21.323 spdk_app_start Round 1 00:04:21.323 02:06:48 -- event/event.sh@25 -- # waitforlisten 1987669 /var/tmp/spdk-nbd.sock 00:04:21.323 02:06:48 -- common/autotest_common.sh@829 -- # '[' -z 1987669 ']' 00:04:21.323 02:06:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:21.323 02:06:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:21.323 02:06:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:21.323 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:21.323 02:06:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:21.323 02:06:48 -- common/autotest_common.sh@10 -- # set +x 00:04:21.581 02:06:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:21.581 02:06:49 -- common/autotest_common.sh@862 -- # return 0 00:04:21.581 02:06:49 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:21.839 Malloc0 00:04:21.839 02:06:49 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:22.098 Malloc1 00:04:22.098 02:06:49 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:22.098 02:06:49 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:22.098 02:06:49 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:22.098 02:06:49 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:22.098 02:06:49 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:22.098 02:06:49 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:22.098 02:06:49 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:22.098 02:06:49 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:22.098 02:06:49 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:22.098 02:06:49 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:22.098 02:06:49 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:22.098 02:06:49 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:22.098 02:06:49 -- bdev/nbd_common.sh@12 -- # local i 00:04:22.098 02:06:49 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:22.098 02:06:49 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:22.098 02:06:49 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:22.356 /dev/nbd0 00:04:22.356 02:06:50 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:22.356 02:06:50 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:22.356 02:06:50 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:22.356 02:06:50 -- common/autotest_common.sh@867 -- # local i 00:04:22.356 02:06:50 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:22.356 02:06:50 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:22.356 02:06:50 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:22.356 02:06:50 -- common/autotest_common.sh@871 -- # break 00:04:22.356 02:06:50 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:22.356 02:06:50 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:22.356 02:06:50 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:22.356 1+0 records in 00:04:22.356 1+0 records out 00:04:22.356 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000231642 s, 17.7 MB/s 00:04:22.356 02:06:50 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:22.356 02:06:50 -- common/autotest_common.sh@884 -- # size=4096 00:04:22.356 02:06:50 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:22.356 02:06:50 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:22.356 02:06:50 -- common/autotest_common.sh@887 -- # return 0 00:04:22.356 02:06:50 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:22.356 02:06:50 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:22.356 02:06:50 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:22.614 /dev/nbd1 00:04:22.614 02:06:50 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:22.614 02:06:50 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:22.614 02:06:50 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:22.614 02:06:50 -- common/autotest_common.sh@867 -- # local i 00:04:22.614 02:06:50 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:22.614 02:06:50 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:22.614 02:06:50 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:22.614 02:06:50 -- common/autotest_common.sh@871 -- # break 00:04:22.614 02:06:50 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:22.614 02:06:50 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:22.614 02:06:50 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:22.614 1+0 records in 00:04:22.614 1+0 records out 00:04:22.614 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00021587 s, 19.0 MB/s 00:04:22.615 02:06:50 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:22.615 02:06:50 -- common/autotest_common.sh@884 -- # size=4096 00:04:22.615 02:06:50 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:22.615 02:06:50 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:22.615 02:06:50 -- common/autotest_common.sh@887 -- # return 0 00:04:22.615 02:06:50 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:22.615 02:06:50 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:22.615 02:06:50 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:22.615 02:06:50 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:22.615 02:06:50 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:22.872 02:06:50 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:22.872 { 00:04:22.872 "nbd_device": "/dev/nbd0", 00:04:22.872 "bdev_name": "Malloc0" 00:04:22.872 }, 00:04:22.872 { 00:04:22.872 "nbd_device": "/dev/nbd1", 00:04:22.872 "bdev_name": "Malloc1" 00:04:22.872 } 00:04:22.872 ]' 00:04:22.872 02:06:50 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:22.872 { 00:04:22.872 "nbd_device": "/dev/nbd0", 00:04:22.872 "bdev_name": "Malloc0" 00:04:22.872 }, 00:04:22.872 { 00:04:22.872 "nbd_device": "/dev/nbd1", 00:04:22.872 "bdev_name": "Malloc1" 00:04:22.872 } 00:04:22.872 ]' 00:04:22.872 02:06:50 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:22.872 02:06:50 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:22.872 /dev/nbd1' 00:04:22.872 02:06:50 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:22.872 /dev/nbd1' 00:04:22.872 02:06:50 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:22.872 02:06:50 -- bdev/nbd_common.sh@65 -- # count=2 00:04:22.872 02:06:50 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:22.872 02:06:50 -- bdev/nbd_common.sh@95 -- # count=2 00:04:22.872 02:06:50 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:22.872 02:06:50 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:22.872 02:06:50 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:22.872 02:06:50 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:22.872 02:06:50 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:22.872 02:06:50 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:22.872 02:06:50 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:22.872 02:06:50 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:22.872 256+0 records in 00:04:22.872 256+0 records out 00:04:22.873 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00521189 s, 201 MB/s 00:04:22.873 02:06:50 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:23.130 02:06:50 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:23.130 256+0 records in 00:04:23.130 256+0 records out 00:04:23.130 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206875 s, 50.7 MB/s 00:04:23.130 02:06:50 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:23.130 02:06:50 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:23.130 256+0 records in 00:04:23.130 256+0 records out 00:04:23.130 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244845 s, 42.8 MB/s 00:04:23.131 02:06:50 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:23.131 02:06:50 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:23.131 02:06:50 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:23.131 02:06:50 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:23.131 02:06:50 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:23.131 02:06:50 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:23.131 02:06:50 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:23.131 02:06:50 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:23.131 02:06:50 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:23.131 02:06:50 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:23.131 02:06:50 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:23.131 02:06:50 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:23.131 02:06:50 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:23.131 02:06:50 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:23.131 02:06:50 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:23.131 02:06:50 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:23.131 02:06:50 -- bdev/nbd_common.sh@51 -- # local i 00:04:23.131 02:06:50 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:23.131 02:06:50 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:23.389 02:06:50 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:23.389 02:06:50 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:23.389 02:06:50 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:23.389 02:06:50 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:23.389 02:06:50 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:23.389 02:06:50 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:23.389 02:06:50 -- bdev/nbd_common.sh@41 -- # break 00:04:23.389 02:06:50 -- bdev/nbd_common.sh@45 -- # return 0 00:04:23.389 02:06:50 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:23.389 02:06:50 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:23.647 02:06:51 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:23.647 02:06:51 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:23.647 02:06:51 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:23.647 02:06:51 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:23.647 02:06:51 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:23.647 02:06:51 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:23.647 02:06:51 -- bdev/nbd_common.sh@41 -- # break 00:04:23.647 02:06:51 -- bdev/nbd_common.sh@45 -- # return 0 00:04:23.647 02:06:51 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:23.647 02:06:51 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:23.647 02:06:51 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:23.906 02:06:51 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:23.906 02:06:51 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:23.906 02:06:51 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:23.906 02:06:51 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:23.906 02:06:51 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:23.906 02:06:51 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:23.906 02:06:51 -- bdev/nbd_common.sh@65 -- # true 00:04:23.906 02:06:51 -- bdev/nbd_common.sh@65 -- # count=0 00:04:23.906 02:06:51 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:23.906 02:06:51 -- bdev/nbd_common.sh@104 -- # count=0 00:04:23.906 02:06:51 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:23.906 02:06:51 -- bdev/nbd_common.sh@109 -- # return 0 00:04:23.906 02:06:51 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:24.164 02:06:51 -- event/event.sh@35 -- # sleep 3 00:04:24.422 [2024-12-08 02:06:52.135118] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:24.680 [2024-12-08 02:06:52.252740] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:24.680 [2024-12-08 02:06:52.252744] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:24.680 [2024-12-08 02:06:52.314202] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:24.680 [2024-12-08 02:06:52.314285] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:27.205 02:06:54 -- event/event.sh@23 -- # for i in {0..2} 00:04:27.205 02:06:54 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:04:27.205 spdk_app_start Round 2 00:04:27.205 02:06:54 -- event/event.sh@25 -- # waitforlisten 1987669 /var/tmp/spdk-nbd.sock 00:04:27.205 02:06:54 -- common/autotest_common.sh@829 -- # '[' -z 1987669 ']' 00:04:27.205 02:06:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:27.205 02:06:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:27.205 02:06:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:27.205 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:27.205 02:06:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:27.205 02:06:54 -- common/autotest_common.sh@10 -- # set +x 00:04:27.463 02:06:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:27.463 02:06:55 -- common/autotest_common.sh@862 -- # return 0 00:04:27.463 02:06:55 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:27.720 Malloc0 00:04:27.721 02:06:55 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:27.979 Malloc1 00:04:27.979 02:06:55 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:27.979 02:06:55 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:27.979 02:06:55 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:27.979 02:06:55 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:27.979 02:06:55 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:27.979 02:06:55 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:27.979 02:06:55 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:27.979 02:06:55 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:27.979 02:06:55 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:27.979 02:06:55 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:27.979 02:06:55 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:27.979 02:06:55 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:27.979 02:06:55 -- bdev/nbd_common.sh@12 -- # local i 00:04:27.979 02:06:55 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:27.979 02:06:55 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:27.979 02:06:55 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:28.236 /dev/nbd0 00:04:28.236 02:06:55 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:28.236 02:06:55 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:28.236 02:06:55 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:28.236 02:06:55 -- common/autotest_common.sh@867 -- # local i 00:04:28.236 02:06:55 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:28.236 02:06:55 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:28.236 02:06:55 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:28.236 02:06:55 -- common/autotest_common.sh@871 -- # break 00:04:28.236 02:06:55 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:28.236 02:06:55 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:28.236 02:06:55 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:28.236 1+0 records in 00:04:28.236 1+0 records out 00:04:28.236 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000208231 s, 19.7 MB/s 00:04:28.236 02:06:55 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:28.236 02:06:55 -- common/autotest_common.sh@884 -- # size=4096 00:04:28.236 02:06:55 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:28.236 02:06:55 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:28.236 02:06:55 -- common/autotest_common.sh@887 -- # return 0 00:04:28.236 02:06:55 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:28.236 02:06:55 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:28.236 02:06:55 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:28.493 /dev/nbd1 00:04:28.493 02:06:56 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:28.493 02:06:56 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:28.493 02:06:56 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:28.493 02:06:56 -- common/autotest_common.sh@867 -- # local i 00:04:28.493 02:06:56 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:28.493 02:06:56 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:28.493 02:06:56 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:28.493 02:06:56 -- common/autotest_common.sh@871 -- # break 00:04:28.493 02:06:56 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:28.493 02:06:56 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:28.493 02:06:56 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:28.493 1+0 records in 00:04:28.493 1+0 records out 00:04:28.493 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00019246 s, 21.3 MB/s 00:04:28.493 02:06:56 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:28.493 02:06:56 -- common/autotest_common.sh@884 -- # size=4096 00:04:28.493 02:06:56 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:28.494 02:06:56 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:28.494 02:06:56 -- common/autotest_common.sh@887 -- # return 0 00:04:28.494 02:06:56 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:28.494 02:06:56 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:28.494 02:06:56 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:28.494 02:06:56 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:28.494 02:06:56 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:28.751 02:06:56 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:28.751 { 00:04:28.751 "nbd_device": "/dev/nbd0", 00:04:28.751 "bdev_name": "Malloc0" 00:04:28.751 }, 00:04:28.751 { 00:04:28.751 "nbd_device": "/dev/nbd1", 00:04:28.751 "bdev_name": "Malloc1" 00:04:28.751 } 00:04:28.751 ]' 00:04:28.751 02:06:56 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:28.751 { 00:04:28.751 "nbd_device": "/dev/nbd0", 00:04:28.751 "bdev_name": "Malloc0" 00:04:28.751 }, 00:04:28.751 { 00:04:28.751 "nbd_device": "/dev/nbd1", 00:04:28.751 "bdev_name": "Malloc1" 00:04:28.751 } 00:04:28.751 ]' 00:04:28.751 02:06:56 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:28.751 02:06:56 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:28.751 /dev/nbd1' 00:04:28.751 02:06:56 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:28.751 /dev/nbd1' 00:04:28.751 02:06:56 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:28.751 02:06:56 -- bdev/nbd_common.sh@65 -- # count=2 00:04:28.751 02:06:56 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:28.751 02:06:56 -- bdev/nbd_common.sh@95 -- # count=2 00:04:28.751 02:06:56 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:28.751 02:06:56 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:28.751 02:06:56 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:28.751 02:06:56 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:28.751 02:06:56 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:28.751 02:06:56 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:28.751 02:06:56 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:28.751 02:06:56 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:28.751 256+0 records in 00:04:28.752 256+0 records out 00:04:28.752 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00510874 s, 205 MB/s 00:04:28.752 02:06:56 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:28.752 02:06:56 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:29.010 256+0 records in 00:04:29.010 256+0 records out 00:04:29.010 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022806 s, 46.0 MB/s 00:04:29.010 02:06:56 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:29.010 02:06:56 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:29.010 256+0 records in 00:04:29.010 256+0 records out 00:04:29.010 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021473 s, 48.8 MB/s 00:04:29.010 02:06:56 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:29.010 02:06:56 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:29.010 02:06:56 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:29.010 02:06:56 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:29.010 02:06:56 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:29.010 02:06:56 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:29.010 02:06:56 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:29.010 02:06:56 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:29.010 02:06:56 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:29.010 02:06:56 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:29.010 02:06:56 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:29.010 02:06:56 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:29.010 02:06:56 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:29.010 02:06:56 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:29.010 02:06:56 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:29.010 02:06:56 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:29.010 02:06:56 -- bdev/nbd_common.sh@51 -- # local i 00:04:29.010 02:06:56 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:29.010 02:06:56 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:29.267 02:06:56 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:29.267 02:06:56 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:29.267 02:06:56 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:29.267 02:06:56 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:29.267 02:06:56 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:29.267 02:06:56 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:29.267 02:06:56 -- bdev/nbd_common.sh@41 -- # break 00:04:29.267 02:06:56 -- bdev/nbd_common.sh@45 -- # return 0 00:04:29.267 02:06:56 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:29.267 02:06:56 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:29.524 02:06:57 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:29.524 02:06:57 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:29.524 02:06:57 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:29.524 02:06:57 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:29.524 02:06:57 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:29.524 02:06:57 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:29.524 02:06:57 -- bdev/nbd_common.sh@41 -- # break 00:04:29.524 02:06:57 -- bdev/nbd_common.sh@45 -- # return 0 00:04:29.524 02:06:57 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:29.524 02:06:57 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:29.524 02:06:57 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:29.781 02:06:57 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:29.781 02:06:57 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:29.781 02:06:57 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:29.781 02:06:57 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:29.781 02:06:57 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:29.781 02:06:57 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:29.781 02:06:57 -- bdev/nbd_common.sh@65 -- # true 00:04:29.781 02:06:57 -- bdev/nbd_common.sh@65 -- # count=0 00:04:29.781 02:06:57 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:29.781 02:06:57 -- bdev/nbd_common.sh@104 -- # count=0 00:04:29.781 02:06:57 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:29.781 02:06:57 -- bdev/nbd_common.sh@109 -- # return 0 00:04:29.781 02:06:57 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:30.038 02:06:57 -- event/event.sh@35 -- # sleep 3 00:04:30.296 [2024-12-08 02:06:57.969941] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:30.552 [2024-12-08 02:06:58.083766] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:30.552 [2024-12-08 02:06:58.083768] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:30.552 [2024-12-08 02:06:58.145368] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:30.552 [2024-12-08 02:06:58.145451] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:33.080 02:07:00 -- event/event.sh@38 -- # waitforlisten 1987669 /var/tmp/spdk-nbd.sock 00:04:33.080 02:07:00 -- common/autotest_common.sh@829 -- # '[' -z 1987669 ']' 00:04:33.080 02:07:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:33.080 02:07:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:33.080 02:07:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:33.080 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:33.080 02:07:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:33.080 02:07:00 -- common/autotest_common.sh@10 -- # set +x 00:04:33.338 02:07:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:33.338 02:07:00 -- common/autotest_common.sh@862 -- # return 0 00:04:33.338 02:07:00 -- event/event.sh@39 -- # killprocess 1987669 00:04:33.338 02:07:00 -- common/autotest_common.sh@936 -- # '[' -z 1987669 ']' 00:04:33.339 02:07:00 -- common/autotest_common.sh@940 -- # kill -0 1987669 00:04:33.339 02:07:00 -- common/autotest_common.sh@941 -- # uname 00:04:33.339 02:07:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:33.339 02:07:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1987669 00:04:33.339 02:07:00 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:33.339 02:07:00 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:33.339 02:07:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1987669' 00:04:33.339 killing process with pid 1987669 00:04:33.339 02:07:00 -- common/autotest_common.sh@955 -- # kill 1987669 00:04:33.339 02:07:00 -- common/autotest_common.sh@960 -- # wait 1987669 00:04:33.597 spdk_app_start is called in Round 0. 00:04:33.597 Shutdown signal received, stop current app iteration 00:04:33.597 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:04:33.597 spdk_app_start is called in Round 1. 00:04:33.597 Shutdown signal received, stop current app iteration 00:04:33.597 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:04:33.597 spdk_app_start is called in Round 2. 00:04:33.597 Shutdown signal received, stop current app iteration 00:04:33.597 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:04:33.597 spdk_app_start is called in Round 3. 00:04:33.597 Shutdown signal received, stop current app iteration 00:04:33.597 02:07:01 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:04:33.597 02:07:01 -- event/event.sh@42 -- # return 0 00:04:33.597 00:04:33.597 real 0m18.892s 00:04:33.597 user 0m41.187s 00:04:33.598 sys 0m3.140s 00:04:33.598 02:07:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:33.598 02:07:01 -- common/autotest_common.sh@10 -- # set +x 00:04:33.598 ************************************ 00:04:33.598 END TEST app_repeat 00:04:33.598 ************************************ 00:04:33.598 02:07:01 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:04:33.598 02:07:01 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:04:33.598 02:07:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:33.598 02:07:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:33.598 02:07:01 -- common/autotest_common.sh@10 -- # set +x 00:04:33.598 ************************************ 00:04:33.598 START TEST cpu_locks 00:04:33.598 ************************************ 00:04:33.598 02:07:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:04:33.598 * Looking for test storage... 00:04:33.598 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:04:33.598 02:07:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:33.598 02:07:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:33.598 02:07:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:33.857 02:07:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:33.857 02:07:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:33.857 02:07:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:33.857 02:07:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:33.857 02:07:01 -- scripts/common.sh@335 -- # IFS=.-: 00:04:33.857 02:07:01 -- scripts/common.sh@335 -- # read -ra ver1 00:04:33.857 02:07:01 -- scripts/common.sh@336 -- # IFS=.-: 00:04:33.857 02:07:01 -- scripts/common.sh@336 -- # read -ra ver2 00:04:33.857 02:07:01 -- scripts/common.sh@337 -- # local 'op=<' 00:04:33.857 02:07:01 -- scripts/common.sh@339 -- # ver1_l=2 00:04:33.857 02:07:01 -- scripts/common.sh@340 -- # ver2_l=1 00:04:33.857 02:07:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:33.857 02:07:01 -- scripts/common.sh@343 -- # case "$op" in 00:04:33.857 02:07:01 -- scripts/common.sh@344 -- # : 1 00:04:33.857 02:07:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:33.857 02:07:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:33.857 02:07:01 -- scripts/common.sh@364 -- # decimal 1 00:04:33.857 02:07:01 -- scripts/common.sh@352 -- # local d=1 00:04:33.857 02:07:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:33.857 02:07:01 -- scripts/common.sh@354 -- # echo 1 00:04:33.857 02:07:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:33.857 02:07:01 -- scripts/common.sh@365 -- # decimal 2 00:04:33.857 02:07:01 -- scripts/common.sh@352 -- # local d=2 00:04:33.857 02:07:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:33.857 02:07:01 -- scripts/common.sh@354 -- # echo 2 00:04:33.857 02:07:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:33.857 02:07:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:33.857 02:07:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:33.857 02:07:01 -- scripts/common.sh@367 -- # return 0 00:04:33.857 02:07:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:33.857 02:07:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:33.857 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:33.857 --rc genhtml_branch_coverage=1 00:04:33.857 --rc genhtml_function_coverage=1 00:04:33.857 --rc genhtml_legend=1 00:04:33.857 --rc geninfo_all_blocks=1 00:04:33.857 --rc geninfo_unexecuted_blocks=1 00:04:33.857 00:04:33.857 ' 00:04:33.857 02:07:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:33.857 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:33.857 --rc genhtml_branch_coverage=1 00:04:33.857 --rc genhtml_function_coverage=1 00:04:33.857 --rc genhtml_legend=1 00:04:33.857 --rc geninfo_all_blocks=1 00:04:33.857 --rc geninfo_unexecuted_blocks=1 00:04:33.857 00:04:33.857 ' 00:04:33.857 02:07:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:33.857 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:33.857 --rc genhtml_branch_coverage=1 00:04:33.857 --rc genhtml_function_coverage=1 00:04:33.857 --rc genhtml_legend=1 00:04:33.857 --rc geninfo_all_blocks=1 00:04:33.857 --rc geninfo_unexecuted_blocks=1 00:04:33.857 00:04:33.857 ' 00:04:33.857 02:07:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:33.857 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:33.857 --rc genhtml_branch_coverage=1 00:04:33.857 --rc genhtml_function_coverage=1 00:04:33.857 --rc genhtml_legend=1 00:04:33.857 --rc geninfo_all_blocks=1 00:04:33.857 --rc geninfo_unexecuted_blocks=1 00:04:33.857 00:04:33.857 ' 00:04:33.857 02:07:01 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:04:33.857 02:07:01 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:04:33.857 02:07:01 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:04:33.857 02:07:01 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:04:33.857 02:07:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:33.857 02:07:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:33.857 02:07:01 -- common/autotest_common.sh@10 -- # set +x 00:04:33.857 ************************************ 00:04:33.857 START TEST default_locks 00:04:33.857 ************************************ 00:04:33.857 02:07:01 -- common/autotest_common.sh@1114 -- # default_locks 00:04:33.857 02:07:01 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=1990221 00:04:33.857 02:07:01 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:33.857 02:07:01 -- event/cpu_locks.sh@47 -- # waitforlisten 1990221 00:04:33.857 02:07:01 -- common/autotest_common.sh@829 -- # '[' -z 1990221 ']' 00:04:33.857 02:07:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:33.857 02:07:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:33.857 02:07:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:33.857 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:33.857 02:07:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:33.857 02:07:01 -- common/autotest_common.sh@10 -- # set +x 00:04:33.857 [2024-12-08 02:07:01.457964] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:33.857 [2024-12-08 02:07:01.458063] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1990221 ] 00:04:33.857 EAL: No free 2048 kB hugepages reported on node 1 00:04:33.857 [2024-12-08 02:07:01.515715] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:33.857 [2024-12-08 02:07:01.627123] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:33.857 [2024-12-08 02:07:01.627312] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:34.805 02:07:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:34.805 02:07:02 -- common/autotest_common.sh@862 -- # return 0 00:04:34.805 02:07:02 -- event/cpu_locks.sh@49 -- # locks_exist 1990221 00:04:34.805 02:07:02 -- event/cpu_locks.sh@22 -- # lslocks -p 1990221 00:04:34.805 02:07:02 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:35.062 lslocks: write error 00:04:35.062 02:07:02 -- event/cpu_locks.sh@50 -- # killprocess 1990221 00:04:35.062 02:07:02 -- common/autotest_common.sh@936 -- # '[' -z 1990221 ']' 00:04:35.063 02:07:02 -- common/autotest_common.sh@940 -- # kill -0 1990221 00:04:35.063 02:07:02 -- common/autotest_common.sh@941 -- # uname 00:04:35.321 02:07:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:35.321 02:07:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1990221 00:04:35.321 02:07:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:35.321 02:07:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:35.321 02:07:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1990221' 00:04:35.321 killing process with pid 1990221 00:04:35.321 02:07:02 -- common/autotest_common.sh@955 -- # kill 1990221 00:04:35.321 02:07:02 -- common/autotest_common.sh@960 -- # wait 1990221 00:04:35.579 02:07:03 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 1990221 00:04:35.579 02:07:03 -- common/autotest_common.sh@650 -- # local es=0 00:04:35.579 02:07:03 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 1990221 00:04:35.579 02:07:03 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:04:35.579 02:07:03 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:35.579 02:07:03 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:04:35.579 02:07:03 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:35.579 02:07:03 -- common/autotest_common.sh@653 -- # waitforlisten 1990221 00:04:35.579 02:07:03 -- common/autotest_common.sh@829 -- # '[' -z 1990221 ']' 00:04:35.579 02:07:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:35.579 02:07:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:35.579 02:07:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:35.579 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:35.579 02:07:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:35.579 02:07:03 -- common/autotest_common.sh@10 -- # set +x 00:04:35.579 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (1990221) - No such process 00:04:35.579 ERROR: process (pid: 1990221) is no longer running 00:04:35.579 02:07:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:35.579 02:07:03 -- common/autotest_common.sh@862 -- # return 1 00:04:35.579 02:07:03 -- common/autotest_common.sh@653 -- # es=1 00:04:35.579 02:07:03 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:35.579 02:07:03 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:04:35.579 02:07:03 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:35.579 02:07:03 -- event/cpu_locks.sh@54 -- # no_locks 00:04:35.579 02:07:03 -- event/cpu_locks.sh@26 -- # lock_files=() 00:04:35.579 02:07:03 -- event/cpu_locks.sh@26 -- # local lock_files 00:04:35.579 02:07:03 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:04:35.579 00:04:35.579 real 0m1.943s 00:04:35.579 user 0m2.080s 00:04:35.579 sys 0m0.586s 00:04:35.579 02:07:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:35.579 02:07:03 -- common/autotest_common.sh@10 -- # set +x 00:04:35.579 ************************************ 00:04:35.579 END TEST default_locks 00:04:35.579 ************************************ 00:04:35.839 02:07:03 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:04:35.839 02:07:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:35.839 02:07:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:35.839 02:07:03 -- common/autotest_common.sh@10 -- # set +x 00:04:35.839 ************************************ 00:04:35.839 START TEST default_locks_via_rpc 00:04:35.839 ************************************ 00:04:35.839 02:07:03 -- common/autotest_common.sh@1114 -- # default_locks_via_rpc 00:04:35.839 02:07:03 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=1990421 00:04:35.839 02:07:03 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:35.839 02:07:03 -- event/cpu_locks.sh@63 -- # waitforlisten 1990421 00:04:35.839 02:07:03 -- common/autotest_common.sh@829 -- # '[' -z 1990421 ']' 00:04:35.839 02:07:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:35.839 02:07:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:35.839 02:07:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:35.839 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:35.839 02:07:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:35.839 02:07:03 -- common/autotest_common.sh@10 -- # set +x 00:04:35.839 [2024-12-08 02:07:03.432609] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:35.839 [2024-12-08 02:07:03.432695] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1990421 ] 00:04:35.839 EAL: No free 2048 kB hugepages reported on node 1 00:04:35.839 [2024-12-08 02:07:03.494670] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:35.839 [2024-12-08 02:07:03.605116] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:35.839 [2024-12-08 02:07:03.605309] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:36.775 02:07:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:36.776 02:07:04 -- common/autotest_common.sh@862 -- # return 0 00:04:36.776 02:07:04 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:04:36.776 02:07:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:36.776 02:07:04 -- common/autotest_common.sh@10 -- # set +x 00:04:36.776 02:07:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:36.776 02:07:04 -- event/cpu_locks.sh@67 -- # no_locks 00:04:36.776 02:07:04 -- event/cpu_locks.sh@26 -- # lock_files=() 00:04:36.776 02:07:04 -- event/cpu_locks.sh@26 -- # local lock_files 00:04:36.776 02:07:04 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:04:36.776 02:07:04 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:04:36.776 02:07:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:36.776 02:07:04 -- common/autotest_common.sh@10 -- # set +x 00:04:36.776 02:07:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:36.776 02:07:04 -- event/cpu_locks.sh@71 -- # locks_exist 1990421 00:04:36.776 02:07:04 -- event/cpu_locks.sh@22 -- # lslocks -p 1990421 00:04:36.776 02:07:04 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:37.034 02:07:04 -- event/cpu_locks.sh@73 -- # killprocess 1990421 00:04:37.034 02:07:04 -- common/autotest_common.sh@936 -- # '[' -z 1990421 ']' 00:04:37.034 02:07:04 -- common/autotest_common.sh@940 -- # kill -0 1990421 00:04:37.034 02:07:04 -- common/autotest_common.sh@941 -- # uname 00:04:37.034 02:07:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:37.034 02:07:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1990421 00:04:37.034 02:07:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:37.034 02:07:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:37.034 02:07:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1990421' 00:04:37.034 killing process with pid 1990421 00:04:37.034 02:07:04 -- common/autotest_common.sh@955 -- # kill 1990421 00:04:37.034 02:07:04 -- common/autotest_common.sh@960 -- # wait 1990421 00:04:37.600 00:04:37.600 real 0m1.754s 00:04:37.600 user 0m1.888s 00:04:37.600 sys 0m0.551s 00:04:37.600 02:07:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:37.600 02:07:05 -- common/autotest_common.sh@10 -- # set +x 00:04:37.600 ************************************ 00:04:37.600 END TEST default_locks_via_rpc 00:04:37.600 ************************************ 00:04:37.600 02:07:05 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:04:37.600 02:07:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:37.600 02:07:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:37.600 02:07:05 -- common/autotest_common.sh@10 -- # set +x 00:04:37.600 ************************************ 00:04:37.600 START TEST non_locking_app_on_locked_coremask 00:04:37.600 ************************************ 00:04:37.600 02:07:05 -- common/autotest_common.sh@1114 -- # non_locking_app_on_locked_coremask 00:04:37.600 02:07:05 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=1990695 00:04:37.600 02:07:05 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:37.600 02:07:05 -- event/cpu_locks.sh@81 -- # waitforlisten 1990695 /var/tmp/spdk.sock 00:04:37.600 02:07:05 -- common/autotest_common.sh@829 -- # '[' -z 1990695 ']' 00:04:37.600 02:07:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:37.600 02:07:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:37.600 02:07:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:37.600 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:37.600 02:07:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:37.600 02:07:05 -- common/autotest_common.sh@10 -- # set +x 00:04:37.600 [2024-12-08 02:07:05.214069] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:37.600 [2024-12-08 02:07:05.214149] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1990695 ] 00:04:37.600 EAL: No free 2048 kB hugepages reported on node 1 00:04:37.600 [2024-12-08 02:07:05.270740] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:37.858 [2024-12-08 02:07:05.380692] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:37.858 [2024-12-08 02:07:05.380854] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:38.422 02:07:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:38.422 02:07:06 -- common/autotest_common.sh@862 -- # return 0 00:04:38.422 02:07:06 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=1990833 00:04:38.422 02:07:06 -- event/cpu_locks.sh@85 -- # waitforlisten 1990833 /var/tmp/spdk2.sock 00:04:38.422 02:07:06 -- common/autotest_common.sh@829 -- # '[' -z 1990833 ']' 00:04:38.422 02:07:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:38.422 02:07:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:38.422 02:07:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:38.422 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:38.422 02:07:06 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:04:38.422 02:07:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:38.422 02:07:06 -- common/autotest_common.sh@10 -- # set +x 00:04:38.679 [2024-12-08 02:07:06.222120] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:38.679 [2024-12-08 02:07:06.222206] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1990833 ] 00:04:38.679 EAL: No free 2048 kB hugepages reported on node 1 00:04:38.679 [2024-12-08 02:07:06.304062] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:04:38.679 [2024-12-08 02:07:06.304103] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:38.937 [2024-12-08 02:07:06.532565] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:38.937 [2024-12-08 02:07:06.532752] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:39.501 02:07:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:39.501 02:07:07 -- common/autotest_common.sh@862 -- # return 0 00:04:39.501 02:07:07 -- event/cpu_locks.sh@87 -- # locks_exist 1990695 00:04:39.501 02:07:07 -- event/cpu_locks.sh@22 -- # lslocks -p 1990695 00:04:39.501 02:07:07 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:39.758 lslocks: write error 00:04:39.758 02:07:07 -- event/cpu_locks.sh@89 -- # killprocess 1990695 00:04:39.758 02:07:07 -- common/autotest_common.sh@936 -- # '[' -z 1990695 ']' 00:04:39.758 02:07:07 -- common/autotest_common.sh@940 -- # kill -0 1990695 00:04:39.758 02:07:07 -- common/autotest_common.sh@941 -- # uname 00:04:39.758 02:07:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:39.758 02:07:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1990695 00:04:40.016 02:07:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:40.016 02:07:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:40.016 02:07:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1990695' 00:04:40.016 killing process with pid 1990695 00:04:40.016 02:07:07 -- common/autotest_common.sh@955 -- # kill 1990695 00:04:40.016 02:07:07 -- common/autotest_common.sh@960 -- # wait 1990695 00:04:40.949 02:07:08 -- event/cpu_locks.sh@90 -- # killprocess 1990833 00:04:40.949 02:07:08 -- common/autotest_common.sh@936 -- # '[' -z 1990833 ']' 00:04:40.949 02:07:08 -- common/autotest_common.sh@940 -- # kill -0 1990833 00:04:40.949 02:07:08 -- common/autotest_common.sh@941 -- # uname 00:04:40.949 02:07:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:40.949 02:07:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1990833 00:04:40.949 02:07:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:40.949 02:07:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:40.949 02:07:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1990833' 00:04:40.949 killing process with pid 1990833 00:04:40.949 02:07:08 -- common/autotest_common.sh@955 -- # kill 1990833 00:04:40.949 02:07:08 -- common/autotest_common.sh@960 -- # wait 1990833 00:04:41.206 00:04:41.206 real 0m3.801s 00:04:41.206 user 0m4.187s 00:04:41.206 sys 0m1.021s 00:04:41.206 02:07:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:41.206 02:07:08 -- common/autotest_common.sh@10 -- # set +x 00:04:41.206 ************************************ 00:04:41.206 END TEST non_locking_app_on_locked_coremask 00:04:41.206 ************************************ 00:04:41.465 02:07:08 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:04:41.466 02:07:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:41.466 02:07:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:41.466 02:07:08 -- common/autotest_common.sh@10 -- # set +x 00:04:41.466 ************************************ 00:04:41.466 START TEST locking_app_on_unlocked_coremask 00:04:41.466 ************************************ 00:04:41.466 02:07:08 -- common/autotest_common.sh@1114 -- # locking_app_on_unlocked_coremask 00:04:41.466 02:07:08 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=1991161 00:04:41.466 02:07:08 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:04:41.466 02:07:08 -- event/cpu_locks.sh@99 -- # waitforlisten 1991161 /var/tmp/spdk.sock 00:04:41.466 02:07:08 -- common/autotest_common.sh@829 -- # '[' -z 1991161 ']' 00:04:41.466 02:07:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:41.466 02:07:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:41.466 02:07:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:41.466 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:41.466 02:07:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:41.466 02:07:08 -- common/autotest_common.sh@10 -- # set +x 00:04:41.466 [2024-12-08 02:07:09.042459] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:41.466 [2024-12-08 02:07:09.042562] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1991161 ] 00:04:41.466 EAL: No free 2048 kB hugepages reported on node 1 00:04:41.466 [2024-12-08 02:07:09.104174] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:04:41.466 [2024-12-08 02:07:09.104222] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:41.466 [2024-12-08 02:07:09.217710] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:41.466 [2024-12-08 02:07:09.217875] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:42.400 02:07:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:42.400 02:07:10 -- common/autotest_common.sh@862 -- # return 0 00:04:42.400 02:07:10 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=1991292 00:04:42.400 02:07:10 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:04:42.400 02:07:10 -- event/cpu_locks.sh@103 -- # waitforlisten 1991292 /var/tmp/spdk2.sock 00:04:42.400 02:07:10 -- common/autotest_common.sh@829 -- # '[' -z 1991292 ']' 00:04:42.400 02:07:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:42.400 02:07:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:42.400 02:07:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:42.400 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:42.400 02:07:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:42.400 02:07:10 -- common/autotest_common.sh@10 -- # set +x 00:04:42.400 [2024-12-08 02:07:10.062210] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:42.400 [2024-12-08 02:07:10.062285] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1991292 ] 00:04:42.400 EAL: No free 2048 kB hugepages reported on node 1 00:04:42.400 [2024-12-08 02:07:10.153203] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:42.658 [2024-12-08 02:07:10.398814] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:42.658 [2024-12-08 02:07:10.398992] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:43.592 02:07:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:43.592 02:07:11 -- common/autotest_common.sh@862 -- # return 0 00:04:43.592 02:07:11 -- event/cpu_locks.sh@105 -- # locks_exist 1991292 00:04:43.592 02:07:11 -- event/cpu_locks.sh@22 -- # lslocks -p 1991292 00:04:43.592 02:07:11 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:43.851 lslocks: write error 00:04:43.851 02:07:11 -- event/cpu_locks.sh@107 -- # killprocess 1991161 00:04:43.851 02:07:11 -- common/autotest_common.sh@936 -- # '[' -z 1991161 ']' 00:04:43.851 02:07:11 -- common/autotest_common.sh@940 -- # kill -0 1991161 00:04:43.851 02:07:11 -- common/autotest_common.sh@941 -- # uname 00:04:43.851 02:07:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:43.851 02:07:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1991161 00:04:43.851 02:07:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:43.851 02:07:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:43.851 02:07:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1991161' 00:04:43.851 killing process with pid 1991161 00:04:43.851 02:07:11 -- common/autotest_common.sh@955 -- # kill 1991161 00:04:43.851 02:07:11 -- common/autotest_common.sh@960 -- # wait 1991161 00:04:44.786 02:07:12 -- event/cpu_locks.sh@108 -- # killprocess 1991292 00:04:44.786 02:07:12 -- common/autotest_common.sh@936 -- # '[' -z 1991292 ']' 00:04:44.786 02:07:12 -- common/autotest_common.sh@940 -- # kill -0 1991292 00:04:44.786 02:07:12 -- common/autotest_common.sh@941 -- # uname 00:04:44.786 02:07:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:44.786 02:07:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1991292 00:04:44.786 02:07:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:44.786 02:07:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:44.786 02:07:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1991292' 00:04:44.786 killing process with pid 1991292 00:04:44.786 02:07:12 -- common/autotest_common.sh@955 -- # kill 1991292 00:04:44.786 02:07:12 -- common/autotest_common.sh@960 -- # wait 1991292 00:04:45.382 00:04:45.382 real 0m3.964s 00:04:45.382 user 0m4.325s 00:04:45.382 sys 0m1.136s 00:04:45.382 02:07:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:45.382 02:07:12 -- common/autotest_common.sh@10 -- # set +x 00:04:45.382 ************************************ 00:04:45.382 END TEST locking_app_on_unlocked_coremask 00:04:45.382 ************************************ 00:04:45.382 02:07:12 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:04:45.382 02:07:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:45.382 02:07:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:45.382 02:07:12 -- common/autotest_common.sh@10 -- # set +x 00:04:45.382 ************************************ 00:04:45.382 START TEST locking_app_on_locked_coremask 00:04:45.382 ************************************ 00:04:45.382 02:07:12 -- common/autotest_common.sh@1114 -- # locking_app_on_locked_coremask 00:04:45.382 02:07:12 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=1991722 00:04:45.382 02:07:12 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:45.382 02:07:12 -- event/cpu_locks.sh@116 -- # waitforlisten 1991722 /var/tmp/spdk.sock 00:04:45.382 02:07:12 -- common/autotest_common.sh@829 -- # '[' -z 1991722 ']' 00:04:45.382 02:07:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:45.382 02:07:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:45.382 02:07:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:45.382 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:45.382 02:07:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:45.382 02:07:12 -- common/autotest_common.sh@10 -- # set +x 00:04:45.382 [2024-12-08 02:07:13.036223] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:45.382 [2024-12-08 02:07:13.036317] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1991722 ] 00:04:45.382 EAL: No free 2048 kB hugepages reported on node 1 00:04:45.382 [2024-12-08 02:07:13.098180] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:45.668 [2024-12-08 02:07:13.214381] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:45.668 [2024-12-08 02:07:13.214589] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:46.234 02:07:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:46.234 02:07:13 -- common/autotest_common.sh@862 -- # return 0 00:04:46.234 02:07:13 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=1991866 00:04:46.234 02:07:13 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:04:46.234 02:07:13 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 1991866 /var/tmp/spdk2.sock 00:04:46.234 02:07:13 -- common/autotest_common.sh@650 -- # local es=0 00:04:46.234 02:07:13 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 1991866 /var/tmp/spdk2.sock 00:04:46.234 02:07:13 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:04:46.234 02:07:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:46.234 02:07:13 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:04:46.234 02:07:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:46.234 02:07:13 -- common/autotest_common.sh@653 -- # waitforlisten 1991866 /var/tmp/spdk2.sock 00:04:46.234 02:07:13 -- common/autotest_common.sh@829 -- # '[' -z 1991866 ']' 00:04:46.234 02:07:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:46.234 02:07:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:46.234 02:07:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:46.234 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:46.234 02:07:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:46.234 02:07:13 -- common/autotest_common.sh@10 -- # set +x 00:04:46.491 [2024-12-08 02:07:14.026945] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:46.491 [2024-12-08 02:07:14.027037] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1991866 ] 00:04:46.491 EAL: No free 2048 kB hugepages reported on node 1 00:04:46.491 [2024-12-08 02:07:14.121940] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 1991722 has claimed it. 00:04:46.491 [2024-12-08 02:07:14.122007] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:04:47.055 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (1991866) - No such process 00:04:47.056 ERROR: process (pid: 1991866) is no longer running 00:04:47.056 02:07:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:47.056 02:07:14 -- common/autotest_common.sh@862 -- # return 1 00:04:47.056 02:07:14 -- common/autotest_common.sh@653 -- # es=1 00:04:47.056 02:07:14 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:47.056 02:07:14 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:04:47.056 02:07:14 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:47.056 02:07:14 -- event/cpu_locks.sh@122 -- # locks_exist 1991722 00:04:47.056 02:07:14 -- event/cpu_locks.sh@22 -- # lslocks -p 1991722 00:04:47.056 02:07:14 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:47.313 lslocks: write error 00:04:47.313 02:07:14 -- event/cpu_locks.sh@124 -- # killprocess 1991722 00:04:47.313 02:07:14 -- common/autotest_common.sh@936 -- # '[' -z 1991722 ']' 00:04:47.313 02:07:14 -- common/autotest_common.sh@940 -- # kill -0 1991722 00:04:47.313 02:07:14 -- common/autotest_common.sh@941 -- # uname 00:04:47.313 02:07:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:47.313 02:07:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1991722 00:04:47.313 02:07:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:47.313 02:07:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:47.313 02:07:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1991722' 00:04:47.313 killing process with pid 1991722 00:04:47.313 02:07:14 -- common/autotest_common.sh@955 -- # kill 1991722 00:04:47.313 02:07:14 -- common/autotest_common.sh@960 -- # wait 1991722 00:04:47.876 00:04:47.876 real 0m2.436s 00:04:47.876 user 0m2.785s 00:04:47.876 sys 0m0.626s 00:04:47.876 02:07:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:47.876 02:07:15 -- common/autotest_common.sh@10 -- # set +x 00:04:47.876 ************************************ 00:04:47.876 END TEST locking_app_on_locked_coremask 00:04:47.876 ************************************ 00:04:47.876 02:07:15 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:04:47.876 02:07:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:47.877 02:07:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:47.877 02:07:15 -- common/autotest_common.sh@10 -- # set +x 00:04:47.877 ************************************ 00:04:47.877 START TEST locking_overlapped_coremask 00:04:47.877 ************************************ 00:04:47.877 02:07:15 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask 00:04:47.877 02:07:15 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=1992036 00:04:47.877 02:07:15 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:04:47.877 02:07:15 -- event/cpu_locks.sh@133 -- # waitforlisten 1992036 /var/tmp/spdk.sock 00:04:47.877 02:07:15 -- common/autotest_common.sh@829 -- # '[' -z 1992036 ']' 00:04:47.877 02:07:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:47.877 02:07:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:47.877 02:07:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:47.877 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:47.877 02:07:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:47.877 02:07:15 -- common/autotest_common.sh@10 -- # set +x 00:04:47.877 [2024-12-08 02:07:15.499726] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:47.877 [2024-12-08 02:07:15.499823] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1992036 ] 00:04:47.877 EAL: No free 2048 kB hugepages reported on node 1 00:04:47.877 [2024-12-08 02:07:15.560876] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:04:48.134 [2024-12-08 02:07:15.676680] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:48.134 [2024-12-08 02:07:15.676915] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:48.134 [2024-12-08 02:07:15.676971] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:48.134 [2024-12-08 02:07:15.676989] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:48.698 02:07:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:48.698 02:07:16 -- common/autotest_common.sh@862 -- # return 0 00:04:48.698 02:07:16 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=1992180 00:04:48.698 02:07:16 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:04:48.698 02:07:16 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 1992180 /var/tmp/spdk2.sock 00:04:48.698 02:07:16 -- common/autotest_common.sh@650 -- # local es=0 00:04:48.698 02:07:16 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 1992180 /var/tmp/spdk2.sock 00:04:48.698 02:07:16 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:04:48.698 02:07:16 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:48.698 02:07:16 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:04:48.698 02:07:16 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:48.698 02:07:16 -- common/autotest_common.sh@653 -- # waitforlisten 1992180 /var/tmp/spdk2.sock 00:04:48.698 02:07:16 -- common/autotest_common.sh@829 -- # '[' -z 1992180 ']' 00:04:48.698 02:07:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:48.698 02:07:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:48.698 02:07:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:48.698 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:48.698 02:07:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:48.698 02:07:16 -- common/autotest_common.sh@10 -- # set +x 00:04:48.955 [2024-12-08 02:07:16.483278] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:48.955 [2024-12-08 02:07:16.483369] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1992180 ] 00:04:48.955 EAL: No free 2048 kB hugepages reported on node 1 00:04:48.955 [2024-12-08 02:07:16.570907] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 1992036 has claimed it. 00:04:48.955 [2024-12-08 02:07:16.570972] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:04:49.520 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (1992180) - No such process 00:04:49.520 ERROR: process (pid: 1992180) is no longer running 00:04:49.520 02:07:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:49.520 02:07:17 -- common/autotest_common.sh@862 -- # return 1 00:04:49.520 02:07:17 -- common/autotest_common.sh@653 -- # es=1 00:04:49.520 02:07:17 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:49.520 02:07:17 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:04:49.520 02:07:17 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:49.520 02:07:17 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:04:49.520 02:07:17 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:04:49.520 02:07:17 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:04:49.520 02:07:17 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:04:49.520 02:07:17 -- event/cpu_locks.sh@141 -- # killprocess 1992036 00:04:49.520 02:07:17 -- common/autotest_common.sh@936 -- # '[' -z 1992036 ']' 00:04:49.520 02:07:17 -- common/autotest_common.sh@940 -- # kill -0 1992036 00:04:49.520 02:07:17 -- common/autotest_common.sh@941 -- # uname 00:04:49.520 02:07:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:49.520 02:07:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1992036 00:04:49.520 02:07:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:49.520 02:07:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:49.520 02:07:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1992036' 00:04:49.520 killing process with pid 1992036 00:04:49.520 02:07:17 -- common/autotest_common.sh@955 -- # kill 1992036 00:04:49.520 02:07:17 -- common/autotest_common.sh@960 -- # wait 1992036 00:04:50.085 00:04:50.085 real 0m2.240s 00:04:50.085 user 0m6.317s 00:04:50.085 sys 0m0.473s 00:04:50.085 02:07:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:50.085 02:07:17 -- common/autotest_common.sh@10 -- # set +x 00:04:50.085 ************************************ 00:04:50.085 END TEST locking_overlapped_coremask 00:04:50.085 ************************************ 00:04:50.085 02:07:17 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:04:50.085 02:07:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:50.085 02:07:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:50.085 02:07:17 -- common/autotest_common.sh@10 -- # set +x 00:04:50.085 ************************************ 00:04:50.085 START TEST locking_overlapped_coremask_via_rpc 00:04:50.085 ************************************ 00:04:50.085 02:07:17 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask_via_rpc 00:04:50.085 02:07:17 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=1992346 00:04:50.085 02:07:17 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:04:50.085 02:07:17 -- event/cpu_locks.sh@149 -- # waitforlisten 1992346 /var/tmp/spdk.sock 00:04:50.085 02:07:17 -- common/autotest_common.sh@829 -- # '[' -z 1992346 ']' 00:04:50.085 02:07:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:50.085 02:07:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:50.085 02:07:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:50.085 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:50.085 02:07:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:50.085 02:07:17 -- common/autotest_common.sh@10 -- # set +x 00:04:50.085 [2024-12-08 02:07:17.768990] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:50.085 [2024-12-08 02:07:17.769095] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1992346 ] 00:04:50.085 EAL: No free 2048 kB hugepages reported on node 1 00:04:50.085 [2024-12-08 02:07:17.828838] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:04:50.085 [2024-12-08 02:07:17.828884] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:04:50.343 [2024-12-08 02:07:17.944878] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:50.343 [2024-12-08 02:07:17.945117] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:50.343 [2024-12-08 02:07:17.945196] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:50.343 [2024-12-08 02:07:17.945199] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:51.277 02:07:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:51.277 02:07:18 -- common/autotest_common.sh@862 -- # return 0 00:04:51.277 02:07:18 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=1992486 00:04:51.277 02:07:18 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:04:51.277 02:07:18 -- event/cpu_locks.sh@153 -- # waitforlisten 1992486 /var/tmp/spdk2.sock 00:04:51.277 02:07:18 -- common/autotest_common.sh@829 -- # '[' -z 1992486 ']' 00:04:51.277 02:07:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:51.277 02:07:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:51.277 02:07:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:51.277 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:51.277 02:07:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:51.277 02:07:18 -- common/autotest_common.sh@10 -- # set +x 00:04:51.277 [2024-12-08 02:07:18.754681] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:51.277 [2024-12-08 02:07:18.754772] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1992486 ] 00:04:51.277 EAL: No free 2048 kB hugepages reported on node 1 00:04:51.277 [2024-12-08 02:07:18.842727] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:04:51.277 [2024-12-08 02:07:18.842771] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:04:51.277 [2024-12-08 02:07:19.056796] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:51.277 [2024-12-08 02:07:19.057023] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:51.536 [2024-12-08 02:07:19.060634] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:04:51.536 [2024-12-08 02:07:19.060637] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:52.103 02:07:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:52.103 02:07:19 -- common/autotest_common.sh@862 -- # return 0 00:04:52.103 02:07:19 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:04:52.103 02:07:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:52.103 02:07:19 -- common/autotest_common.sh@10 -- # set +x 00:04:52.103 02:07:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:52.103 02:07:19 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:04:52.103 02:07:19 -- common/autotest_common.sh@650 -- # local es=0 00:04:52.103 02:07:19 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:04:52.103 02:07:19 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:04:52.103 02:07:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:52.103 02:07:19 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:04:52.103 02:07:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:52.103 02:07:19 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:04:52.103 02:07:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:52.103 02:07:19 -- common/autotest_common.sh@10 -- # set +x 00:04:52.103 [2024-12-08 02:07:19.703650] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 1992346 has claimed it. 00:04:52.103 request: 00:04:52.103 { 00:04:52.103 "method": "framework_enable_cpumask_locks", 00:04:52.103 "req_id": 1 00:04:52.103 } 00:04:52.103 Got JSON-RPC error response 00:04:52.103 response: 00:04:52.103 { 00:04:52.103 "code": -32603, 00:04:52.103 "message": "Failed to claim CPU core: 2" 00:04:52.103 } 00:04:52.103 02:07:19 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:04:52.103 02:07:19 -- common/autotest_common.sh@653 -- # es=1 00:04:52.103 02:07:19 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:52.103 02:07:19 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:04:52.103 02:07:19 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:52.103 02:07:19 -- event/cpu_locks.sh@158 -- # waitforlisten 1992346 /var/tmp/spdk.sock 00:04:52.103 02:07:19 -- common/autotest_common.sh@829 -- # '[' -z 1992346 ']' 00:04:52.103 02:07:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:52.103 02:07:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:52.103 02:07:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:52.103 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:52.103 02:07:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:52.103 02:07:19 -- common/autotest_common.sh@10 -- # set +x 00:04:52.362 02:07:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:52.362 02:07:19 -- common/autotest_common.sh@862 -- # return 0 00:04:52.362 02:07:19 -- event/cpu_locks.sh@159 -- # waitforlisten 1992486 /var/tmp/spdk2.sock 00:04:52.362 02:07:19 -- common/autotest_common.sh@829 -- # '[' -z 1992486 ']' 00:04:52.362 02:07:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:52.362 02:07:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:52.362 02:07:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:52.362 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:52.362 02:07:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:52.362 02:07:19 -- common/autotest_common.sh@10 -- # set +x 00:04:52.620 02:07:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:52.620 02:07:20 -- common/autotest_common.sh@862 -- # return 0 00:04:52.620 02:07:20 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:04:52.620 02:07:20 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:04:52.620 02:07:20 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:04:52.620 02:07:20 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:04:52.620 00:04:52.620 real 0m2.515s 00:04:52.620 user 0m1.249s 00:04:52.620 sys 0m0.201s 00:04:52.620 02:07:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:52.620 02:07:20 -- common/autotest_common.sh@10 -- # set +x 00:04:52.620 ************************************ 00:04:52.620 END TEST locking_overlapped_coremask_via_rpc 00:04:52.620 ************************************ 00:04:52.620 02:07:20 -- event/cpu_locks.sh@174 -- # cleanup 00:04:52.620 02:07:20 -- event/cpu_locks.sh@15 -- # [[ -z 1992346 ]] 00:04:52.620 02:07:20 -- event/cpu_locks.sh@15 -- # killprocess 1992346 00:04:52.620 02:07:20 -- common/autotest_common.sh@936 -- # '[' -z 1992346 ']' 00:04:52.620 02:07:20 -- common/autotest_common.sh@940 -- # kill -0 1992346 00:04:52.620 02:07:20 -- common/autotest_common.sh@941 -- # uname 00:04:52.620 02:07:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:52.620 02:07:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1992346 00:04:52.620 02:07:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:52.620 02:07:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:52.620 02:07:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1992346' 00:04:52.620 killing process with pid 1992346 00:04:52.620 02:07:20 -- common/autotest_common.sh@955 -- # kill 1992346 00:04:52.620 02:07:20 -- common/autotest_common.sh@960 -- # wait 1992346 00:04:53.187 02:07:20 -- event/cpu_locks.sh@16 -- # [[ -z 1992486 ]] 00:04:53.187 02:07:20 -- event/cpu_locks.sh@16 -- # killprocess 1992486 00:04:53.187 02:07:20 -- common/autotest_common.sh@936 -- # '[' -z 1992486 ']' 00:04:53.187 02:07:20 -- common/autotest_common.sh@940 -- # kill -0 1992486 00:04:53.187 02:07:20 -- common/autotest_common.sh@941 -- # uname 00:04:53.187 02:07:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:53.187 02:07:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1992486 00:04:53.187 02:07:20 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:04:53.187 02:07:20 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:04:53.187 02:07:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1992486' 00:04:53.187 killing process with pid 1992486 00:04:53.187 02:07:20 -- common/autotest_common.sh@955 -- # kill 1992486 00:04:53.187 02:07:20 -- common/autotest_common.sh@960 -- # wait 1992486 00:04:53.755 02:07:21 -- event/cpu_locks.sh@18 -- # rm -f 00:04:53.755 02:07:21 -- event/cpu_locks.sh@1 -- # cleanup 00:04:53.755 02:07:21 -- event/cpu_locks.sh@15 -- # [[ -z 1992346 ]] 00:04:53.755 02:07:21 -- event/cpu_locks.sh@15 -- # killprocess 1992346 00:04:53.755 02:07:21 -- common/autotest_common.sh@936 -- # '[' -z 1992346 ']' 00:04:53.755 02:07:21 -- common/autotest_common.sh@940 -- # kill -0 1992346 00:04:53.755 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1992346) - No such process 00:04:53.755 02:07:21 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1992346 is not found' 00:04:53.755 Process with pid 1992346 is not found 00:04:53.755 02:07:21 -- event/cpu_locks.sh@16 -- # [[ -z 1992486 ]] 00:04:53.755 02:07:21 -- event/cpu_locks.sh@16 -- # killprocess 1992486 00:04:53.755 02:07:21 -- common/autotest_common.sh@936 -- # '[' -z 1992486 ']' 00:04:53.755 02:07:21 -- common/autotest_common.sh@940 -- # kill -0 1992486 00:04:53.755 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1992486) - No such process 00:04:53.755 02:07:21 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1992486 is not found' 00:04:53.755 Process with pid 1992486 is not found 00:04:53.755 02:07:21 -- event/cpu_locks.sh@18 -- # rm -f 00:04:53.755 00:04:53.755 real 0m19.964s 00:04:53.755 user 0m35.519s 00:04:53.755 sys 0m5.423s 00:04:53.755 02:07:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:53.755 02:07:21 -- common/autotest_common.sh@10 -- # set +x 00:04:53.755 ************************************ 00:04:53.755 END TEST cpu_locks 00:04:53.755 ************************************ 00:04:53.755 00:04:53.755 real 0m47.068s 00:04:53.755 user 1m29.571s 00:04:53.755 sys 0m9.337s 00:04:53.755 02:07:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:53.755 02:07:21 -- common/autotest_common.sh@10 -- # set +x 00:04:53.755 ************************************ 00:04:53.755 END TEST event 00:04:53.755 ************************************ 00:04:53.755 02:07:21 -- spdk/autotest.sh@175 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:04:53.755 02:07:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:53.755 02:07:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:53.755 02:07:21 -- common/autotest_common.sh@10 -- # set +x 00:04:53.755 ************************************ 00:04:53.755 START TEST thread 00:04:53.755 ************************************ 00:04:53.755 02:07:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:04:53.755 * Looking for test storage... 00:04:53.755 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:04:53.755 02:07:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:53.755 02:07:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:53.755 02:07:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:53.755 02:07:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:53.755 02:07:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:53.755 02:07:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:53.755 02:07:21 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:53.755 02:07:21 -- scripts/common.sh@335 -- # IFS=.-: 00:04:53.755 02:07:21 -- scripts/common.sh@335 -- # read -ra ver1 00:04:53.755 02:07:21 -- scripts/common.sh@336 -- # IFS=.-: 00:04:53.755 02:07:21 -- scripts/common.sh@336 -- # read -ra ver2 00:04:53.755 02:07:21 -- scripts/common.sh@337 -- # local 'op=<' 00:04:53.755 02:07:21 -- scripts/common.sh@339 -- # ver1_l=2 00:04:53.755 02:07:21 -- scripts/common.sh@340 -- # ver2_l=1 00:04:53.755 02:07:21 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:53.755 02:07:21 -- scripts/common.sh@343 -- # case "$op" in 00:04:53.755 02:07:21 -- scripts/common.sh@344 -- # : 1 00:04:53.755 02:07:21 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:53.755 02:07:21 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:53.755 02:07:21 -- scripts/common.sh@364 -- # decimal 1 00:04:53.755 02:07:21 -- scripts/common.sh@352 -- # local d=1 00:04:53.755 02:07:21 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:53.755 02:07:21 -- scripts/common.sh@354 -- # echo 1 00:04:53.755 02:07:21 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:53.755 02:07:21 -- scripts/common.sh@365 -- # decimal 2 00:04:53.755 02:07:21 -- scripts/common.sh@352 -- # local d=2 00:04:53.755 02:07:21 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:53.755 02:07:21 -- scripts/common.sh@354 -- # echo 2 00:04:53.755 02:07:21 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:53.755 02:07:21 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:53.755 02:07:21 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:53.755 02:07:21 -- scripts/common.sh@367 -- # return 0 00:04:53.755 02:07:21 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:53.755 02:07:21 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:53.755 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:53.755 --rc genhtml_branch_coverage=1 00:04:53.755 --rc genhtml_function_coverage=1 00:04:53.755 --rc genhtml_legend=1 00:04:53.755 --rc geninfo_all_blocks=1 00:04:53.755 --rc geninfo_unexecuted_blocks=1 00:04:53.755 00:04:53.755 ' 00:04:53.755 02:07:21 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:53.755 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:53.755 --rc genhtml_branch_coverage=1 00:04:53.755 --rc genhtml_function_coverage=1 00:04:53.755 --rc genhtml_legend=1 00:04:53.755 --rc geninfo_all_blocks=1 00:04:53.755 --rc geninfo_unexecuted_blocks=1 00:04:53.755 00:04:53.755 ' 00:04:53.755 02:07:21 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:53.755 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:53.755 --rc genhtml_branch_coverage=1 00:04:53.755 --rc genhtml_function_coverage=1 00:04:53.755 --rc genhtml_legend=1 00:04:53.755 --rc geninfo_all_blocks=1 00:04:53.755 --rc geninfo_unexecuted_blocks=1 00:04:53.755 00:04:53.755 ' 00:04:53.755 02:07:21 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:53.755 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:53.755 --rc genhtml_branch_coverage=1 00:04:53.755 --rc genhtml_function_coverage=1 00:04:53.755 --rc genhtml_legend=1 00:04:53.755 --rc geninfo_all_blocks=1 00:04:53.755 --rc geninfo_unexecuted_blocks=1 00:04:53.755 00:04:53.755 ' 00:04:53.755 02:07:21 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:04:53.755 02:07:21 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:04:53.755 02:07:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:53.755 02:07:21 -- common/autotest_common.sh@10 -- # set +x 00:04:53.755 ************************************ 00:04:53.755 START TEST thread_poller_perf 00:04:53.755 ************************************ 00:04:53.755 02:07:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:04:53.755 [2024-12-08 02:07:21.441603] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:53.755 [2024-12-08 02:07:21.441685] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1992940 ] 00:04:53.755 EAL: No free 2048 kB hugepages reported on node 1 00:04:53.755 [2024-12-08 02:07:21.503769] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:54.014 [2024-12-08 02:07:21.622463] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:54.014 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:04:55.389 [2024-12-08T01:07:23.170Z] ====================================== 00:04:55.389 [2024-12-08T01:07:23.170Z] busy:2716843169 (cyc) 00:04:55.389 [2024-12-08T01:07:23.170Z] total_run_count: 280000 00:04:55.389 [2024-12-08T01:07:23.170Z] tsc_hz: 2700000000 (cyc) 00:04:55.389 [2024-12-08T01:07:23.170Z] ====================================== 00:04:55.389 [2024-12-08T01:07:23.170Z] poller_cost: 9703 (cyc), 3593 (nsec) 00:04:55.389 00:04:55.389 real 0m1.324s 00:04:55.389 user 0m1.233s 00:04:55.389 sys 0m0.084s 00:04:55.389 02:07:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:55.389 02:07:22 -- common/autotest_common.sh@10 -- # set +x 00:04:55.389 ************************************ 00:04:55.389 END TEST thread_poller_perf 00:04:55.389 ************************************ 00:04:55.389 02:07:22 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:04:55.389 02:07:22 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:04:55.389 02:07:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:55.389 02:07:22 -- common/autotest_common.sh@10 -- # set +x 00:04:55.389 ************************************ 00:04:55.389 START TEST thread_poller_perf 00:04:55.389 ************************************ 00:04:55.389 02:07:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:04:55.389 [2024-12-08 02:07:22.793312] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:55.389 [2024-12-08 02:07:22.793402] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1993151 ] 00:04:55.389 EAL: No free 2048 kB hugepages reported on node 1 00:04:55.389 [2024-12-08 02:07:22.855859] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:55.389 [2024-12-08 02:07:22.968844] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:55.389 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:04:56.324 [2024-12-08T01:07:24.106Z] ====================================== 00:04:56.325 [2024-12-08T01:07:24.106Z] busy:2703323566 (cyc) 00:04:56.325 [2024-12-08T01:07:24.106Z] total_run_count: 3827000 00:04:56.325 [2024-12-08T01:07:24.106Z] tsc_hz: 2700000000 (cyc) 00:04:56.325 [2024-12-08T01:07:24.106Z] ====================================== 00:04:56.325 [2024-12-08T01:07:24.106Z] poller_cost: 706 (cyc), 261 (nsec) 00:04:56.325 00:04:56.325 real 0m1.315s 00:04:56.325 user 0m1.229s 00:04:56.325 sys 0m0.078s 00:04:56.325 02:07:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:56.325 02:07:24 -- common/autotest_common.sh@10 -- # set +x 00:04:56.325 ************************************ 00:04:56.325 END TEST thread_poller_perf 00:04:56.325 ************************************ 00:04:56.584 02:07:24 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:04:56.584 00:04:56.584 real 0m2.838s 00:04:56.584 user 0m2.586s 00:04:56.584 sys 0m0.254s 00:04:56.584 02:07:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:56.584 02:07:24 -- common/autotest_common.sh@10 -- # set +x 00:04:56.584 ************************************ 00:04:56.584 END TEST thread 00:04:56.584 ************************************ 00:04:56.584 02:07:24 -- spdk/autotest.sh@176 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:04:56.584 02:07:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:56.584 02:07:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:56.584 02:07:24 -- common/autotest_common.sh@10 -- # set +x 00:04:56.584 ************************************ 00:04:56.584 START TEST accel 00:04:56.584 ************************************ 00:04:56.584 02:07:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:04:56.584 * Looking for test storage... 00:04:56.584 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:04:56.584 02:07:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:56.584 02:07:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:56.584 02:07:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:56.584 02:07:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:56.584 02:07:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:56.584 02:07:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:56.584 02:07:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:56.584 02:07:24 -- scripts/common.sh@335 -- # IFS=.-: 00:04:56.584 02:07:24 -- scripts/common.sh@335 -- # read -ra ver1 00:04:56.584 02:07:24 -- scripts/common.sh@336 -- # IFS=.-: 00:04:56.584 02:07:24 -- scripts/common.sh@336 -- # read -ra ver2 00:04:56.584 02:07:24 -- scripts/common.sh@337 -- # local 'op=<' 00:04:56.584 02:07:24 -- scripts/common.sh@339 -- # ver1_l=2 00:04:56.584 02:07:24 -- scripts/common.sh@340 -- # ver2_l=1 00:04:56.584 02:07:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:56.584 02:07:24 -- scripts/common.sh@343 -- # case "$op" in 00:04:56.584 02:07:24 -- scripts/common.sh@344 -- # : 1 00:04:56.584 02:07:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:56.584 02:07:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:56.584 02:07:24 -- scripts/common.sh@364 -- # decimal 1 00:04:56.584 02:07:24 -- scripts/common.sh@352 -- # local d=1 00:04:56.584 02:07:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:56.584 02:07:24 -- scripts/common.sh@354 -- # echo 1 00:04:56.584 02:07:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:56.584 02:07:24 -- scripts/common.sh@365 -- # decimal 2 00:04:56.584 02:07:24 -- scripts/common.sh@352 -- # local d=2 00:04:56.584 02:07:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:56.584 02:07:24 -- scripts/common.sh@354 -- # echo 2 00:04:56.584 02:07:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:56.584 02:07:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:56.584 02:07:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:56.584 02:07:24 -- scripts/common.sh@367 -- # return 0 00:04:56.584 02:07:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:56.585 02:07:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:56.585 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:56.585 --rc genhtml_branch_coverage=1 00:04:56.585 --rc genhtml_function_coverage=1 00:04:56.585 --rc genhtml_legend=1 00:04:56.585 --rc geninfo_all_blocks=1 00:04:56.585 --rc geninfo_unexecuted_blocks=1 00:04:56.585 00:04:56.585 ' 00:04:56.585 02:07:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:56.585 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:56.585 --rc genhtml_branch_coverage=1 00:04:56.585 --rc genhtml_function_coverage=1 00:04:56.585 --rc genhtml_legend=1 00:04:56.585 --rc geninfo_all_blocks=1 00:04:56.585 --rc geninfo_unexecuted_blocks=1 00:04:56.585 00:04:56.585 ' 00:04:56.585 02:07:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:56.585 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:56.585 --rc genhtml_branch_coverage=1 00:04:56.585 --rc genhtml_function_coverage=1 00:04:56.585 --rc genhtml_legend=1 00:04:56.585 --rc geninfo_all_blocks=1 00:04:56.585 --rc geninfo_unexecuted_blocks=1 00:04:56.585 00:04:56.585 ' 00:04:56.585 02:07:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:56.585 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:56.585 --rc genhtml_branch_coverage=1 00:04:56.585 --rc genhtml_function_coverage=1 00:04:56.585 --rc genhtml_legend=1 00:04:56.585 --rc geninfo_all_blocks=1 00:04:56.585 --rc geninfo_unexecuted_blocks=1 00:04:56.585 00:04:56.585 ' 00:04:56.585 02:07:24 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:04:56.585 02:07:24 -- accel/accel.sh@74 -- # get_expected_opcs 00:04:56.585 02:07:24 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:04:56.585 02:07:24 -- accel/accel.sh@59 -- # spdk_tgt_pid=1993357 00:04:56.585 02:07:24 -- accel/accel.sh@60 -- # waitforlisten 1993357 00:04:56.585 02:07:24 -- common/autotest_common.sh@829 -- # '[' -z 1993357 ']' 00:04:56.585 02:07:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:56.585 02:07:24 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:04:56.585 02:07:24 -- accel/accel.sh@58 -- # build_accel_config 00:04:56.585 02:07:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:56.585 02:07:24 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:56.585 02:07:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:56.585 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:56.585 02:07:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:56.585 02:07:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:56.585 02:07:24 -- common/autotest_common.sh@10 -- # set +x 00:04:56.585 02:07:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:56.585 02:07:24 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:56.585 02:07:24 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:56.585 02:07:24 -- accel/accel.sh@41 -- # local IFS=, 00:04:56.585 02:07:24 -- accel/accel.sh@42 -- # jq -r . 00:04:56.585 [2024-12-08 02:07:24.328373] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:56.585 [2024-12-08 02:07:24.328448] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1993357 ] 00:04:56.585 EAL: No free 2048 kB hugepages reported on node 1 00:04:56.844 [2024-12-08 02:07:24.388492] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:56.844 [2024-12-08 02:07:24.502330] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:56.844 [2024-12-08 02:07:24.502521] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:57.778 02:07:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:57.778 02:07:25 -- common/autotest_common.sh@862 -- # return 0 00:04:57.778 02:07:25 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:04:57.778 02:07:25 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:04:57.778 02:07:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:57.778 02:07:25 -- common/autotest_common.sh@10 -- # set +x 00:04:57.778 02:07:25 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:04:57.778 02:07:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:57.778 02:07:25 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:57.778 02:07:25 -- accel/accel.sh@64 -- # IFS== 00:04:57.778 02:07:25 -- accel/accel.sh@64 -- # read -r opc module 00:04:57.778 02:07:25 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:57.778 02:07:25 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:57.778 02:07:25 -- accel/accel.sh@64 -- # IFS== 00:04:57.778 02:07:25 -- accel/accel.sh@64 -- # read -r opc module 00:04:57.778 02:07:25 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:57.778 02:07:25 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:57.778 02:07:25 -- accel/accel.sh@64 -- # IFS== 00:04:57.778 02:07:25 -- accel/accel.sh@64 -- # read -r opc module 00:04:57.778 02:07:25 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:57.778 02:07:25 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:57.778 02:07:25 -- accel/accel.sh@64 -- # IFS== 00:04:57.778 02:07:25 -- accel/accel.sh@64 -- # read -r opc module 00:04:57.778 02:07:25 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:57.778 02:07:25 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:57.778 02:07:25 -- accel/accel.sh@64 -- # IFS== 00:04:57.778 02:07:25 -- accel/accel.sh@64 -- # read -r opc module 00:04:57.778 02:07:25 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:57.778 02:07:25 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:57.778 02:07:25 -- accel/accel.sh@64 -- # IFS== 00:04:57.778 02:07:25 -- accel/accel.sh@64 -- # read -r opc module 00:04:57.778 02:07:25 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:57.778 02:07:25 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:57.778 02:07:25 -- accel/accel.sh@64 -- # IFS== 00:04:57.778 02:07:25 -- accel/accel.sh@64 -- # read -r opc module 00:04:57.778 02:07:25 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:57.778 02:07:25 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:57.778 02:07:25 -- accel/accel.sh@64 -- # IFS== 00:04:57.778 02:07:25 -- accel/accel.sh@64 -- # read -r opc module 00:04:57.778 02:07:25 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:57.778 02:07:25 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:57.778 02:07:25 -- accel/accel.sh@64 -- # IFS== 00:04:57.778 02:07:25 -- accel/accel.sh@64 -- # read -r opc module 00:04:57.778 02:07:25 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:57.778 02:07:25 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:57.778 02:07:25 -- accel/accel.sh@64 -- # IFS== 00:04:57.778 02:07:25 -- accel/accel.sh@64 -- # read -r opc module 00:04:57.778 02:07:25 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:57.778 02:07:25 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:57.778 02:07:25 -- accel/accel.sh@64 -- # IFS== 00:04:57.778 02:07:25 -- accel/accel.sh@64 -- # read -r opc module 00:04:57.778 02:07:25 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:57.778 02:07:25 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:57.778 02:07:25 -- accel/accel.sh@64 -- # IFS== 00:04:57.778 02:07:25 -- accel/accel.sh@64 -- # read -r opc module 00:04:57.778 02:07:25 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:57.778 02:07:25 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:57.778 02:07:25 -- accel/accel.sh@64 -- # IFS== 00:04:57.778 02:07:25 -- accel/accel.sh@64 -- # read -r opc module 00:04:57.778 02:07:25 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:57.778 02:07:25 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:04:57.778 02:07:25 -- accel/accel.sh@64 -- # IFS== 00:04:57.778 02:07:25 -- accel/accel.sh@64 -- # read -r opc module 00:04:57.778 02:07:25 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:04:57.778 02:07:25 -- accel/accel.sh@67 -- # killprocess 1993357 00:04:57.778 02:07:25 -- common/autotest_common.sh@936 -- # '[' -z 1993357 ']' 00:04:57.778 02:07:25 -- common/autotest_common.sh@940 -- # kill -0 1993357 00:04:57.778 02:07:25 -- common/autotest_common.sh@941 -- # uname 00:04:57.778 02:07:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:57.778 02:07:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1993357 00:04:57.778 02:07:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:57.778 02:07:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:57.778 02:07:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1993357' 00:04:57.778 killing process with pid 1993357 00:04:57.778 02:07:25 -- common/autotest_common.sh@955 -- # kill 1993357 00:04:57.778 02:07:25 -- common/autotest_common.sh@960 -- # wait 1993357 00:04:58.344 02:07:25 -- accel/accel.sh@68 -- # trap - ERR 00:04:58.344 02:07:25 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:04:58.344 02:07:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:04:58.344 02:07:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:58.344 02:07:25 -- common/autotest_common.sh@10 -- # set +x 00:04:58.344 02:07:25 -- common/autotest_common.sh@1114 -- # accel_perf -h 00:04:58.344 02:07:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:04:58.344 02:07:25 -- accel/accel.sh@12 -- # build_accel_config 00:04:58.344 02:07:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:58.344 02:07:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:58.344 02:07:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:58.344 02:07:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:58.344 02:07:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:58.344 02:07:25 -- accel/accel.sh@41 -- # local IFS=, 00:04:58.344 02:07:25 -- accel/accel.sh@42 -- # jq -r . 00:04:58.344 02:07:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:58.344 02:07:25 -- common/autotest_common.sh@10 -- # set +x 00:04:58.344 02:07:25 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:04:58.344 02:07:25 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:04:58.344 02:07:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:58.344 02:07:25 -- common/autotest_common.sh@10 -- # set +x 00:04:58.344 ************************************ 00:04:58.344 START TEST accel_missing_filename 00:04:58.344 ************************************ 00:04:58.344 02:07:25 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress 00:04:58.344 02:07:25 -- common/autotest_common.sh@650 -- # local es=0 00:04:58.344 02:07:25 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress 00:04:58.344 02:07:25 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:04:58.344 02:07:25 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:58.344 02:07:25 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:04:58.344 02:07:25 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:58.344 02:07:25 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress 00:04:58.344 02:07:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:04:58.344 02:07:25 -- accel/accel.sh@12 -- # build_accel_config 00:04:58.344 02:07:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:58.344 02:07:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:58.344 02:07:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:58.344 02:07:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:58.344 02:07:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:58.344 02:07:25 -- accel/accel.sh@41 -- # local IFS=, 00:04:58.344 02:07:25 -- accel/accel.sh@42 -- # jq -r . 00:04:58.344 [2024-12-08 02:07:25.899468] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:58.344 [2024-12-08 02:07:25.899569] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1993534 ] 00:04:58.344 EAL: No free 2048 kB hugepages reported on node 1 00:04:58.344 [2024-12-08 02:07:25.960753] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:58.344 [2024-12-08 02:07:26.079695] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:58.603 [2024-12-08 02:07:26.135859] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:04:58.603 [2024-12-08 02:07:26.221464] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:04:58.603 A filename is required. 00:04:58.603 02:07:26 -- common/autotest_common.sh@653 -- # es=234 00:04:58.603 02:07:26 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:58.603 02:07:26 -- common/autotest_common.sh@662 -- # es=106 00:04:58.603 02:07:26 -- common/autotest_common.sh@663 -- # case "$es" in 00:04:58.603 02:07:26 -- common/autotest_common.sh@670 -- # es=1 00:04:58.603 02:07:26 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:58.603 00:04:58.603 real 0m0.463s 00:04:58.603 user 0m0.355s 00:04:58.603 sys 0m0.138s 00:04:58.603 02:07:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:58.603 02:07:26 -- common/autotest_common.sh@10 -- # set +x 00:04:58.603 ************************************ 00:04:58.603 END TEST accel_missing_filename 00:04:58.603 ************************************ 00:04:58.603 02:07:26 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:04:58.603 02:07:26 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:04:58.603 02:07:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:58.603 02:07:26 -- common/autotest_common.sh@10 -- # set +x 00:04:58.603 ************************************ 00:04:58.603 START TEST accel_compress_verify 00:04:58.603 ************************************ 00:04:58.603 02:07:26 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:04:58.603 02:07:26 -- common/autotest_common.sh@650 -- # local es=0 00:04:58.603 02:07:26 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:04:58.603 02:07:26 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:04:58.603 02:07:26 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:58.603 02:07:26 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:04:58.603 02:07:26 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:58.603 02:07:26 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:04:58.603 02:07:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:04:58.603 02:07:26 -- accel/accel.sh@12 -- # build_accel_config 00:04:58.603 02:07:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:58.603 02:07:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:58.603 02:07:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:58.603 02:07:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:58.603 02:07:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:58.603 02:07:26 -- accel/accel.sh@41 -- # local IFS=, 00:04:58.603 02:07:26 -- accel/accel.sh@42 -- # jq -r . 00:04:58.861 [2024-12-08 02:07:26.386772] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:58.861 [2024-12-08 02:07:26.386860] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1993683 ] 00:04:58.861 EAL: No free 2048 kB hugepages reported on node 1 00:04:58.861 [2024-12-08 02:07:26.447397] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:58.861 [2024-12-08 02:07:26.564588] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:58.861 [2024-12-08 02:07:26.626399] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:04:59.119 [2024-12-08 02:07:26.714985] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:04:59.119 00:04:59.119 Compression does not support the verify option, aborting. 00:04:59.119 02:07:26 -- common/autotest_common.sh@653 -- # es=161 00:04:59.119 02:07:26 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:59.119 02:07:26 -- common/autotest_common.sh@662 -- # es=33 00:04:59.119 02:07:26 -- common/autotest_common.sh@663 -- # case "$es" in 00:04:59.120 02:07:26 -- common/autotest_common.sh@670 -- # es=1 00:04:59.120 02:07:26 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:59.120 00:04:59.120 real 0m0.470s 00:04:59.120 user 0m0.362s 00:04:59.120 sys 0m0.139s 00:04:59.120 02:07:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:59.120 02:07:26 -- common/autotest_common.sh@10 -- # set +x 00:04:59.120 ************************************ 00:04:59.120 END TEST accel_compress_verify 00:04:59.120 ************************************ 00:04:59.120 02:07:26 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:04:59.120 02:07:26 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:04:59.120 02:07:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:59.120 02:07:26 -- common/autotest_common.sh@10 -- # set +x 00:04:59.120 ************************************ 00:04:59.120 START TEST accel_wrong_workload 00:04:59.120 ************************************ 00:04:59.120 02:07:26 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w foobar 00:04:59.120 02:07:26 -- common/autotest_common.sh@650 -- # local es=0 00:04:59.120 02:07:26 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:04:59.120 02:07:26 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:04:59.120 02:07:26 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:59.120 02:07:26 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:04:59.120 02:07:26 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:59.120 02:07:26 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w foobar 00:04:59.120 02:07:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:04:59.120 02:07:26 -- accel/accel.sh@12 -- # build_accel_config 00:04:59.120 02:07:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:59.120 02:07:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:59.120 02:07:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:59.120 02:07:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:59.120 02:07:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:59.120 02:07:26 -- accel/accel.sh@41 -- # local IFS=, 00:04:59.120 02:07:26 -- accel/accel.sh@42 -- # jq -r . 00:04:59.120 Unsupported workload type: foobar 00:04:59.120 [2024-12-08 02:07:26.881247] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:04:59.120 accel_perf options: 00:04:59.120 [-h help message] 00:04:59.120 [-q queue depth per core] 00:04:59.120 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:04:59.120 [-T number of threads per core 00:04:59.120 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:04:59.120 [-t time in seconds] 00:04:59.120 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:04:59.120 [ dif_verify, , dif_generate, dif_generate_copy 00:04:59.120 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:04:59.120 [-l for compress/decompress workloads, name of uncompressed input file 00:04:59.120 [-S for crc32c workload, use this seed value (default 0) 00:04:59.120 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:04:59.120 [-f for fill workload, use this BYTE value (default 255) 00:04:59.120 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:04:59.120 [-y verify result if this switch is on] 00:04:59.120 [-a tasks to allocate per core (default: same value as -q)] 00:04:59.120 Can be used to spread operations across a wider range of memory. 00:04:59.120 02:07:26 -- common/autotest_common.sh@653 -- # es=1 00:04:59.120 02:07:26 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:59.120 02:07:26 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:04:59.120 02:07:26 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:59.120 00:04:59.120 real 0m0.022s 00:04:59.120 user 0m0.016s 00:04:59.120 sys 0m0.006s 00:04:59.120 02:07:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:59.120 02:07:26 -- common/autotest_common.sh@10 -- # set +x 00:04:59.120 ************************************ 00:04:59.120 END TEST accel_wrong_workload 00:04:59.120 ************************************ 00:04:59.379 Error: writing output failed: Broken pipe 00:04:59.379 02:07:26 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:04:59.379 02:07:26 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:04:59.379 02:07:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:59.379 02:07:26 -- common/autotest_common.sh@10 -- # set +x 00:04:59.379 ************************************ 00:04:59.379 START TEST accel_negative_buffers 00:04:59.379 ************************************ 00:04:59.379 02:07:26 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:04:59.379 02:07:26 -- common/autotest_common.sh@650 -- # local es=0 00:04:59.379 02:07:26 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:04:59.379 02:07:26 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:04:59.379 02:07:26 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:59.379 02:07:26 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:04:59.379 02:07:26 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:59.379 02:07:26 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w xor -y -x -1 00:04:59.379 02:07:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:04:59.379 02:07:26 -- accel/accel.sh@12 -- # build_accel_config 00:04:59.379 02:07:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:59.379 02:07:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:59.379 02:07:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:59.379 02:07:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:59.379 02:07:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:59.379 02:07:26 -- accel/accel.sh@41 -- # local IFS=, 00:04:59.379 02:07:26 -- accel/accel.sh@42 -- # jq -r . 00:04:59.379 -x option must be non-negative. 00:04:59.379 [2024-12-08 02:07:26.927469] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:04:59.379 accel_perf options: 00:04:59.379 [-h help message] 00:04:59.379 [-q queue depth per core] 00:04:59.379 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:04:59.379 [-T number of threads per core 00:04:59.379 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:04:59.379 [-t time in seconds] 00:04:59.379 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:04:59.379 [ dif_verify, , dif_generate, dif_generate_copy 00:04:59.379 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:04:59.379 [-l for compress/decompress workloads, name of uncompressed input file 00:04:59.379 [-S for crc32c workload, use this seed value (default 0) 00:04:59.379 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:04:59.379 [-f for fill workload, use this BYTE value (default 255) 00:04:59.379 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:04:59.379 [-y verify result if this switch is on] 00:04:59.379 [-a tasks to allocate per core (default: same value as -q)] 00:04:59.379 Can be used to spread operations across a wider range of memory. 00:04:59.379 02:07:26 -- common/autotest_common.sh@653 -- # es=1 00:04:59.379 02:07:26 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:59.379 02:07:26 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:04:59.379 02:07:26 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:59.379 00:04:59.379 real 0m0.025s 00:04:59.379 user 0m0.016s 00:04:59.379 sys 0m0.009s 00:04:59.379 02:07:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:59.379 02:07:26 -- common/autotest_common.sh@10 -- # set +x 00:04:59.379 ************************************ 00:04:59.379 END TEST accel_negative_buffers 00:04:59.379 ************************************ 00:04:59.379 Error: writing output failed: Broken pipe 00:04:59.379 02:07:26 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:04:59.379 02:07:26 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:04:59.379 02:07:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:59.379 02:07:26 -- common/autotest_common.sh@10 -- # set +x 00:04:59.379 ************************************ 00:04:59.379 START TEST accel_crc32c 00:04:59.379 ************************************ 00:04:59.379 02:07:26 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -S 32 -y 00:04:59.379 02:07:26 -- accel/accel.sh@16 -- # local accel_opc 00:04:59.379 02:07:26 -- accel/accel.sh@17 -- # local accel_module 00:04:59.379 02:07:26 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:04:59.379 02:07:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:04:59.379 02:07:26 -- accel/accel.sh@12 -- # build_accel_config 00:04:59.379 02:07:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:04:59.379 02:07:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:04:59.379 02:07:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:04:59.379 02:07:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:04:59.379 02:07:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:04:59.379 02:07:26 -- accel/accel.sh@41 -- # local IFS=, 00:04:59.379 02:07:26 -- accel/accel.sh@42 -- # jq -r . 00:04:59.379 [2024-12-08 02:07:26.970433] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:59.379 [2024-12-08 02:07:26.970491] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1993740 ] 00:04:59.379 EAL: No free 2048 kB hugepages reported on node 1 00:04:59.379 [2024-12-08 02:07:27.034239] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:59.379 [2024-12-08 02:07:27.152168] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:00.755 02:07:28 -- accel/accel.sh@18 -- # out=' 00:05:00.755 SPDK Configuration: 00:05:00.755 Core mask: 0x1 00:05:00.755 00:05:00.755 Accel Perf Configuration: 00:05:00.755 Workload Type: crc32c 00:05:00.755 CRC-32C seed: 32 00:05:00.755 Transfer size: 4096 bytes 00:05:00.755 Vector count 1 00:05:00.755 Module: software 00:05:00.755 Queue depth: 32 00:05:00.755 Allocate depth: 32 00:05:00.755 # threads/core: 1 00:05:00.755 Run time: 1 seconds 00:05:00.755 Verify: Yes 00:05:00.755 00:05:00.755 Running for 1 seconds... 00:05:00.755 00:05:00.755 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:00.755 ------------------------------------------------------------------------------------ 00:05:00.755 0,0 405376/s 1583 MiB/s 0 0 00:05:00.755 ==================================================================================== 00:05:00.755 Total 405376/s 1583 MiB/s 0 0' 00:05:00.755 02:07:28 -- accel/accel.sh@20 -- # IFS=: 00:05:00.755 02:07:28 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:00.755 02:07:28 -- accel/accel.sh@20 -- # read -r var val 00:05:00.755 02:07:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:00.755 02:07:28 -- accel/accel.sh@12 -- # build_accel_config 00:05:00.755 02:07:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:00.755 02:07:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:00.755 02:07:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:00.755 02:07:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:00.755 02:07:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:00.755 02:07:28 -- accel/accel.sh@41 -- # local IFS=, 00:05:00.755 02:07:28 -- accel/accel.sh@42 -- # jq -r . 00:05:00.755 [2024-12-08 02:07:28.434186] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:00.755 [2024-12-08 02:07:28.434266] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1994011 ] 00:05:00.755 EAL: No free 2048 kB hugepages reported on node 1 00:05:00.755 [2024-12-08 02:07:28.495234] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:01.022 [2024-12-08 02:07:28.612367] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:01.022 02:07:28 -- accel/accel.sh@21 -- # val= 00:05:01.022 02:07:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.022 02:07:28 -- accel/accel.sh@20 -- # IFS=: 00:05:01.022 02:07:28 -- accel/accel.sh@20 -- # read -r var val 00:05:01.022 02:07:28 -- accel/accel.sh@21 -- # val= 00:05:01.022 02:07:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.022 02:07:28 -- accel/accel.sh@20 -- # IFS=: 00:05:01.022 02:07:28 -- accel/accel.sh@20 -- # read -r var val 00:05:01.022 02:07:28 -- accel/accel.sh@21 -- # val=0x1 00:05:01.022 02:07:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.022 02:07:28 -- accel/accel.sh@20 -- # IFS=: 00:05:01.022 02:07:28 -- accel/accel.sh@20 -- # read -r var val 00:05:01.022 02:07:28 -- accel/accel.sh@21 -- # val= 00:05:01.022 02:07:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.022 02:07:28 -- accel/accel.sh@20 -- # IFS=: 00:05:01.022 02:07:28 -- accel/accel.sh@20 -- # read -r var val 00:05:01.022 02:07:28 -- accel/accel.sh@21 -- # val= 00:05:01.022 02:07:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.022 02:07:28 -- accel/accel.sh@20 -- # IFS=: 00:05:01.022 02:07:28 -- accel/accel.sh@20 -- # read -r var val 00:05:01.022 02:07:28 -- accel/accel.sh@21 -- # val=crc32c 00:05:01.022 02:07:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.022 02:07:28 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:01.022 02:07:28 -- accel/accel.sh@20 -- # IFS=: 00:05:01.022 02:07:28 -- accel/accel.sh@20 -- # read -r var val 00:05:01.022 02:07:28 -- accel/accel.sh@21 -- # val=32 00:05:01.022 02:07:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.022 02:07:28 -- accel/accel.sh@20 -- # IFS=: 00:05:01.022 02:07:28 -- accel/accel.sh@20 -- # read -r var val 00:05:01.022 02:07:28 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:01.022 02:07:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.022 02:07:28 -- accel/accel.sh@20 -- # IFS=: 00:05:01.022 02:07:28 -- accel/accel.sh@20 -- # read -r var val 00:05:01.022 02:07:28 -- accel/accel.sh@21 -- # val= 00:05:01.022 02:07:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.022 02:07:28 -- accel/accel.sh@20 -- # IFS=: 00:05:01.022 02:07:28 -- accel/accel.sh@20 -- # read -r var val 00:05:01.022 02:07:28 -- accel/accel.sh@21 -- # val=software 00:05:01.022 02:07:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.022 02:07:28 -- accel/accel.sh@23 -- # accel_module=software 00:05:01.022 02:07:28 -- accel/accel.sh@20 -- # IFS=: 00:05:01.022 02:07:28 -- accel/accel.sh@20 -- # read -r var val 00:05:01.022 02:07:28 -- accel/accel.sh@21 -- # val=32 00:05:01.022 02:07:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.022 02:07:28 -- accel/accel.sh@20 -- # IFS=: 00:05:01.022 02:07:28 -- accel/accel.sh@20 -- # read -r var val 00:05:01.022 02:07:28 -- accel/accel.sh@21 -- # val=32 00:05:01.022 02:07:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.022 02:07:28 -- accel/accel.sh@20 -- # IFS=: 00:05:01.022 02:07:28 -- accel/accel.sh@20 -- # read -r var val 00:05:01.022 02:07:28 -- accel/accel.sh@21 -- # val=1 00:05:01.022 02:07:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.022 02:07:28 -- accel/accel.sh@20 -- # IFS=: 00:05:01.022 02:07:28 -- accel/accel.sh@20 -- # read -r var val 00:05:01.022 02:07:28 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:01.022 02:07:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.022 02:07:28 -- accel/accel.sh@20 -- # IFS=: 00:05:01.022 02:07:28 -- accel/accel.sh@20 -- # read -r var val 00:05:01.022 02:07:28 -- accel/accel.sh@21 -- # val=Yes 00:05:01.022 02:07:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.022 02:07:28 -- accel/accel.sh@20 -- # IFS=: 00:05:01.022 02:07:28 -- accel/accel.sh@20 -- # read -r var val 00:05:01.022 02:07:28 -- accel/accel.sh@21 -- # val= 00:05:01.022 02:07:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.022 02:07:28 -- accel/accel.sh@20 -- # IFS=: 00:05:01.022 02:07:28 -- accel/accel.sh@20 -- # read -r var val 00:05:01.022 02:07:28 -- accel/accel.sh@21 -- # val= 00:05:01.022 02:07:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:01.022 02:07:28 -- accel/accel.sh@20 -- # IFS=: 00:05:01.022 02:07:28 -- accel/accel.sh@20 -- # read -r var val 00:05:02.398 02:07:29 -- accel/accel.sh@21 -- # val= 00:05:02.398 02:07:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:02.398 02:07:29 -- accel/accel.sh@20 -- # IFS=: 00:05:02.398 02:07:29 -- accel/accel.sh@20 -- # read -r var val 00:05:02.398 02:07:29 -- accel/accel.sh@21 -- # val= 00:05:02.398 02:07:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:02.398 02:07:29 -- accel/accel.sh@20 -- # IFS=: 00:05:02.398 02:07:29 -- accel/accel.sh@20 -- # read -r var val 00:05:02.398 02:07:29 -- accel/accel.sh@21 -- # val= 00:05:02.398 02:07:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:02.398 02:07:29 -- accel/accel.sh@20 -- # IFS=: 00:05:02.398 02:07:29 -- accel/accel.sh@20 -- # read -r var val 00:05:02.398 02:07:29 -- accel/accel.sh@21 -- # val= 00:05:02.398 02:07:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:02.398 02:07:29 -- accel/accel.sh@20 -- # IFS=: 00:05:02.398 02:07:29 -- accel/accel.sh@20 -- # read -r var val 00:05:02.398 02:07:29 -- accel/accel.sh@21 -- # val= 00:05:02.398 02:07:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:02.398 02:07:29 -- accel/accel.sh@20 -- # IFS=: 00:05:02.398 02:07:29 -- accel/accel.sh@20 -- # read -r var val 00:05:02.398 02:07:29 -- accel/accel.sh@21 -- # val= 00:05:02.398 02:07:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:02.398 02:07:29 -- accel/accel.sh@20 -- # IFS=: 00:05:02.398 02:07:29 -- accel/accel.sh@20 -- # read -r var val 00:05:02.398 02:07:29 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:02.398 02:07:29 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:02.398 02:07:29 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:02.398 00:05:02.398 real 0m2.937s 00:05:02.398 user 0m2.653s 00:05:02.398 sys 0m0.277s 00:05:02.398 02:07:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:02.398 02:07:29 -- common/autotest_common.sh@10 -- # set +x 00:05:02.398 ************************************ 00:05:02.398 END TEST accel_crc32c 00:05:02.398 ************************************ 00:05:02.398 02:07:29 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:05:02.398 02:07:29 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:02.398 02:07:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:02.398 02:07:29 -- common/autotest_common.sh@10 -- # set +x 00:05:02.398 ************************************ 00:05:02.398 START TEST accel_crc32c_C2 00:05:02.398 ************************************ 00:05:02.398 02:07:29 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -y -C 2 00:05:02.398 02:07:29 -- accel/accel.sh@16 -- # local accel_opc 00:05:02.398 02:07:29 -- accel/accel.sh@17 -- # local accel_module 00:05:02.398 02:07:29 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:02.398 02:07:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:02.398 02:07:29 -- accel/accel.sh@12 -- # build_accel_config 00:05:02.398 02:07:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:02.398 02:07:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:02.398 02:07:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:02.398 02:07:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:02.398 02:07:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:02.398 02:07:29 -- accel/accel.sh@41 -- # local IFS=, 00:05:02.398 02:07:29 -- accel/accel.sh@42 -- # jq -r . 00:05:02.398 [2024-12-08 02:07:29.935670] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:02.398 [2024-12-08 02:07:29.935749] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1994164 ] 00:05:02.398 EAL: No free 2048 kB hugepages reported on node 1 00:05:02.398 [2024-12-08 02:07:29.996600] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:02.398 [2024-12-08 02:07:30.118380] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:03.773 02:07:31 -- accel/accel.sh@18 -- # out=' 00:05:03.773 SPDK Configuration: 00:05:03.773 Core mask: 0x1 00:05:03.773 00:05:03.773 Accel Perf Configuration: 00:05:03.773 Workload Type: crc32c 00:05:03.773 CRC-32C seed: 0 00:05:03.773 Transfer size: 4096 bytes 00:05:03.773 Vector count 2 00:05:03.773 Module: software 00:05:03.773 Queue depth: 32 00:05:03.773 Allocate depth: 32 00:05:03.773 # threads/core: 1 00:05:03.773 Run time: 1 seconds 00:05:03.773 Verify: Yes 00:05:03.773 00:05:03.773 Running for 1 seconds... 00:05:03.773 00:05:03.773 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:03.773 ------------------------------------------------------------------------------------ 00:05:03.773 0,0 320448/s 2503 MiB/s 0 0 00:05:03.773 ==================================================================================== 00:05:03.773 Total 320448/s 1251 MiB/s 0 0' 00:05:03.773 02:07:31 -- accel/accel.sh@20 -- # IFS=: 00:05:03.773 02:07:31 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:03.773 02:07:31 -- accel/accel.sh@20 -- # read -r var val 00:05:03.773 02:07:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:03.773 02:07:31 -- accel/accel.sh@12 -- # build_accel_config 00:05:03.773 02:07:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:03.773 02:07:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:03.773 02:07:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:03.773 02:07:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:03.773 02:07:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:03.773 02:07:31 -- accel/accel.sh@41 -- # local IFS=, 00:05:03.773 02:07:31 -- accel/accel.sh@42 -- # jq -r . 00:05:03.773 [2024-12-08 02:07:31.416020] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:03.773 [2024-12-08 02:07:31.416102] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1994310 ] 00:05:03.773 EAL: No free 2048 kB hugepages reported on node 1 00:05:03.773 [2024-12-08 02:07:31.476403] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:04.032 [2024-12-08 02:07:31.592609] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:04.033 02:07:31 -- accel/accel.sh@21 -- # val= 00:05:04.033 02:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.033 02:07:31 -- accel/accel.sh@20 -- # IFS=: 00:05:04.033 02:07:31 -- accel/accel.sh@20 -- # read -r var val 00:05:04.033 02:07:31 -- accel/accel.sh@21 -- # val= 00:05:04.033 02:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.033 02:07:31 -- accel/accel.sh@20 -- # IFS=: 00:05:04.033 02:07:31 -- accel/accel.sh@20 -- # read -r var val 00:05:04.033 02:07:31 -- accel/accel.sh@21 -- # val=0x1 00:05:04.033 02:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.033 02:07:31 -- accel/accel.sh@20 -- # IFS=: 00:05:04.033 02:07:31 -- accel/accel.sh@20 -- # read -r var val 00:05:04.033 02:07:31 -- accel/accel.sh@21 -- # val= 00:05:04.033 02:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.033 02:07:31 -- accel/accel.sh@20 -- # IFS=: 00:05:04.033 02:07:31 -- accel/accel.sh@20 -- # read -r var val 00:05:04.033 02:07:31 -- accel/accel.sh@21 -- # val= 00:05:04.033 02:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.033 02:07:31 -- accel/accel.sh@20 -- # IFS=: 00:05:04.033 02:07:31 -- accel/accel.sh@20 -- # read -r var val 00:05:04.033 02:07:31 -- accel/accel.sh@21 -- # val=crc32c 00:05:04.033 02:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.033 02:07:31 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:04.033 02:07:31 -- accel/accel.sh@20 -- # IFS=: 00:05:04.033 02:07:31 -- accel/accel.sh@20 -- # read -r var val 00:05:04.033 02:07:31 -- accel/accel.sh@21 -- # val=0 00:05:04.033 02:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.033 02:07:31 -- accel/accel.sh@20 -- # IFS=: 00:05:04.033 02:07:31 -- accel/accel.sh@20 -- # read -r var val 00:05:04.033 02:07:31 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:04.033 02:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.033 02:07:31 -- accel/accel.sh@20 -- # IFS=: 00:05:04.033 02:07:31 -- accel/accel.sh@20 -- # read -r var val 00:05:04.033 02:07:31 -- accel/accel.sh@21 -- # val= 00:05:04.033 02:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.033 02:07:31 -- accel/accel.sh@20 -- # IFS=: 00:05:04.033 02:07:31 -- accel/accel.sh@20 -- # read -r var val 00:05:04.033 02:07:31 -- accel/accel.sh@21 -- # val=software 00:05:04.033 02:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.033 02:07:31 -- accel/accel.sh@23 -- # accel_module=software 00:05:04.033 02:07:31 -- accel/accel.sh@20 -- # IFS=: 00:05:04.033 02:07:31 -- accel/accel.sh@20 -- # read -r var val 00:05:04.033 02:07:31 -- accel/accel.sh@21 -- # val=32 00:05:04.033 02:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.033 02:07:31 -- accel/accel.sh@20 -- # IFS=: 00:05:04.033 02:07:31 -- accel/accel.sh@20 -- # read -r var val 00:05:04.033 02:07:31 -- accel/accel.sh@21 -- # val=32 00:05:04.033 02:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.033 02:07:31 -- accel/accel.sh@20 -- # IFS=: 00:05:04.033 02:07:31 -- accel/accel.sh@20 -- # read -r var val 00:05:04.033 02:07:31 -- accel/accel.sh@21 -- # val=1 00:05:04.033 02:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.033 02:07:31 -- accel/accel.sh@20 -- # IFS=: 00:05:04.033 02:07:31 -- accel/accel.sh@20 -- # read -r var val 00:05:04.033 02:07:31 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:04.033 02:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.033 02:07:31 -- accel/accel.sh@20 -- # IFS=: 00:05:04.033 02:07:31 -- accel/accel.sh@20 -- # read -r var val 00:05:04.033 02:07:31 -- accel/accel.sh@21 -- # val=Yes 00:05:04.033 02:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.033 02:07:31 -- accel/accel.sh@20 -- # IFS=: 00:05:04.033 02:07:31 -- accel/accel.sh@20 -- # read -r var val 00:05:04.033 02:07:31 -- accel/accel.sh@21 -- # val= 00:05:04.033 02:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.033 02:07:31 -- accel/accel.sh@20 -- # IFS=: 00:05:04.033 02:07:31 -- accel/accel.sh@20 -- # read -r var val 00:05:04.033 02:07:31 -- accel/accel.sh@21 -- # val= 00:05:04.033 02:07:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:04.033 02:07:31 -- accel/accel.sh@20 -- # IFS=: 00:05:04.033 02:07:31 -- accel/accel.sh@20 -- # read -r var val 00:05:05.409 02:07:32 -- accel/accel.sh@21 -- # val= 00:05:05.409 02:07:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:05.409 02:07:32 -- accel/accel.sh@20 -- # IFS=: 00:05:05.409 02:07:32 -- accel/accel.sh@20 -- # read -r var val 00:05:05.409 02:07:32 -- accel/accel.sh@21 -- # val= 00:05:05.409 02:07:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:05.409 02:07:32 -- accel/accel.sh@20 -- # IFS=: 00:05:05.409 02:07:32 -- accel/accel.sh@20 -- # read -r var val 00:05:05.409 02:07:32 -- accel/accel.sh@21 -- # val= 00:05:05.409 02:07:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:05.409 02:07:32 -- accel/accel.sh@20 -- # IFS=: 00:05:05.409 02:07:32 -- accel/accel.sh@20 -- # read -r var val 00:05:05.409 02:07:32 -- accel/accel.sh@21 -- # val= 00:05:05.409 02:07:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:05.409 02:07:32 -- accel/accel.sh@20 -- # IFS=: 00:05:05.409 02:07:32 -- accel/accel.sh@20 -- # read -r var val 00:05:05.409 02:07:32 -- accel/accel.sh@21 -- # val= 00:05:05.409 02:07:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:05.409 02:07:32 -- accel/accel.sh@20 -- # IFS=: 00:05:05.409 02:07:32 -- accel/accel.sh@20 -- # read -r var val 00:05:05.409 02:07:32 -- accel/accel.sh@21 -- # val= 00:05:05.409 02:07:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:05.409 02:07:32 -- accel/accel.sh@20 -- # IFS=: 00:05:05.409 02:07:32 -- accel/accel.sh@20 -- # read -r var val 00:05:05.409 02:07:32 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:05.409 02:07:32 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:05.409 02:07:32 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:05.409 00:05:05.409 real 0m2.942s 00:05:05.409 user 0m2.647s 00:05:05.409 sys 0m0.285s 00:05:05.409 02:07:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:05.409 02:07:32 -- common/autotest_common.sh@10 -- # set +x 00:05:05.409 ************************************ 00:05:05.409 END TEST accel_crc32c_C2 00:05:05.409 ************************************ 00:05:05.409 02:07:32 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:05:05.409 02:07:32 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:05.409 02:07:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:05.409 02:07:32 -- common/autotest_common.sh@10 -- # set +x 00:05:05.409 ************************************ 00:05:05.409 START TEST accel_copy 00:05:05.409 ************************************ 00:05:05.409 02:07:32 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy -y 00:05:05.409 02:07:32 -- accel/accel.sh@16 -- # local accel_opc 00:05:05.409 02:07:32 -- accel/accel.sh@17 -- # local accel_module 00:05:05.409 02:07:32 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:05:05.409 02:07:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:05.409 02:07:32 -- accel/accel.sh@12 -- # build_accel_config 00:05:05.409 02:07:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:05.409 02:07:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:05.409 02:07:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:05.409 02:07:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:05.409 02:07:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:05.409 02:07:32 -- accel/accel.sh@41 -- # local IFS=, 00:05:05.409 02:07:32 -- accel/accel.sh@42 -- # jq -r . 00:05:05.409 [2024-12-08 02:07:32.899271] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:05.410 [2024-12-08 02:07:32.899347] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1994591 ] 00:05:05.410 EAL: No free 2048 kB hugepages reported on node 1 00:05:05.410 [2024-12-08 02:07:32.962004] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:05.410 [2024-12-08 02:07:33.078998] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:06.780 02:07:34 -- accel/accel.sh@18 -- # out=' 00:05:06.780 SPDK Configuration: 00:05:06.780 Core mask: 0x1 00:05:06.780 00:05:06.780 Accel Perf Configuration: 00:05:06.780 Workload Type: copy 00:05:06.780 Transfer size: 4096 bytes 00:05:06.780 Vector count 1 00:05:06.780 Module: software 00:05:06.780 Queue depth: 32 00:05:06.780 Allocate depth: 32 00:05:06.780 # threads/core: 1 00:05:06.780 Run time: 1 seconds 00:05:06.780 Verify: Yes 00:05:06.780 00:05:06.780 Running for 1 seconds... 00:05:06.780 00:05:06.780 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:06.780 ------------------------------------------------------------------------------------ 00:05:06.780 0,0 278976/s 1089 MiB/s 0 0 00:05:06.780 ==================================================================================== 00:05:06.780 Total 278976/s 1089 MiB/s 0 0' 00:05:06.780 02:07:34 -- accel/accel.sh@20 -- # IFS=: 00:05:06.780 02:07:34 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:05:06.780 02:07:34 -- accel/accel.sh@20 -- # read -r var val 00:05:06.780 02:07:34 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:06.780 02:07:34 -- accel/accel.sh@12 -- # build_accel_config 00:05:06.780 02:07:34 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:06.780 02:07:34 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:06.780 02:07:34 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:06.780 02:07:34 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:06.780 02:07:34 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:06.780 02:07:34 -- accel/accel.sh@41 -- # local IFS=, 00:05:06.780 02:07:34 -- accel/accel.sh@42 -- # jq -r . 00:05:06.780 [2024-12-08 02:07:34.376530] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:06.780 [2024-12-08 02:07:34.376635] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1994740 ] 00:05:06.780 EAL: No free 2048 kB hugepages reported on node 1 00:05:06.780 [2024-12-08 02:07:34.437405] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:06.780 [2024-12-08 02:07:34.555516] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:07.039 02:07:34 -- accel/accel.sh@21 -- # val= 00:05:07.039 02:07:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.039 02:07:34 -- accel/accel.sh@20 -- # IFS=: 00:05:07.039 02:07:34 -- accel/accel.sh@20 -- # read -r var val 00:05:07.039 02:07:34 -- accel/accel.sh@21 -- # val= 00:05:07.039 02:07:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.039 02:07:34 -- accel/accel.sh@20 -- # IFS=: 00:05:07.039 02:07:34 -- accel/accel.sh@20 -- # read -r var val 00:05:07.039 02:07:34 -- accel/accel.sh@21 -- # val=0x1 00:05:07.039 02:07:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.039 02:07:34 -- accel/accel.sh@20 -- # IFS=: 00:05:07.039 02:07:34 -- accel/accel.sh@20 -- # read -r var val 00:05:07.039 02:07:34 -- accel/accel.sh@21 -- # val= 00:05:07.039 02:07:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.039 02:07:34 -- accel/accel.sh@20 -- # IFS=: 00:05:07.039 02:07:34 -- accel/accel.sh@20 -- # read -r var val 00:05:07.039 02:07:34 -- accel/accel.sh@21 -- # val= 00:05:07.039 02:07:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.039 02:07:34 -- accel/accel.sh@20 -- # IFS=: 00:05:07.039 02:07:34 -- accel/accel.sh@20 -- # read -r var val 00:05:07.039 02:07:34 -- accel/accel.sh@21 -- # val=copy 00:05:07.039 02:07:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.039 02:07:34 -- accel/accel.sh@24 -- # accel_opc=copy 00:05:07.039 02:07:34 -- accel/accel.sh@20 -- # IFS=: 00:05:07.039 02:07:34 -- accel/accel.sh@20 -- # read -r var val 00:05:07.039 02:07:34 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:07.039 02:07:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.039 02:07:34 -- accel/accel.sh@20 -- # IFS=: 00:05:07.039 02:07:34 -- accel/accel.sh@20 -- # read -r var val 00:05:07.039 02:07:34 -- accel/accel.sh@21 -- # val= 00:05:07.039 02:07:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.039 02:07:34 -- accel/accel.sh@20 -- # IFS=: 00:05:07.039 02:07:34 -- accel/accel.sh@20 -- # read -r var val 00:05:07.039 02:07:34 -- accel/accel.sh@21 -- # val=software 00:05:07.039 02:07:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.039 02:07:34 -- accel/accel.sh@23 -- # accel_module=software 00:05:07.039 02:07:34 -- accel/accel.sh@20 -- # IFS=: 00:05:07.039 02:07:34 -- accel/accel.sh@20 -- # read -r var val 00:05:07.039 02:07:34 -- accel/accel.sh@21 -- # val=32 00:05:07.039 02:07:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.039 02:07:34 -- accel/accel.sh@20 -- # IFS=: 00:05:07.039 02:07:34 -- accel/accel.sh@20 -- # read -r var val 00:05:07.039 02:07:34 -- accel/accel.sh@21 -- # val=32 00:05:07.039 02:07:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.039 02:07:34 -- accel/accel.sh@20 -- # IFS=: 00:05:07.039 02:07:34 -- accel/accel.sh@20 -- # read -r var val 00:05:07.039 02:07:34 -- accel/accel.sh@21 -- # val=1 00:05:07.039 02:07:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.039 02:07:34 -- accel/accel.sh@20 -- # IFS=: 00:05:07.039 02:07:34 -- accel/accel.sh@20 -- # read -r var val 00:05:07.039 02:07:34 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:07.039 02:07:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.039 02:07:34 -- accel/accel.sh@20 -- # IFS=: 00:05:07.039 02:07:34 -- accel/accel.sh@20 -- # read -r var val 00:05:07.039 02:07:34 -- accel/accel.sh@21 -- # val=Yes 00:05:07.039 02:07:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.039 02:07:34 -- accel/accel.sh@20 -- # IFS=: 00:05:07.039 02:07:34 -- accel/accel.sh@20 -- # read -r var val 00:05:07.039 02:07:34 -- accel/accel.sh@21 -- # val= 00:05:07.039 02:07:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.039 02:07:34 -- accel/accel.sh@20 -- # IFS=: 00:05:07.039 02:07:34 -- accel/accel.sh@20 -- # read -r var val 00:05:07.039 02:07:34 -- accel/accel.sh@21 -- # val= 00:05:07.039 02:07:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:07.039 02:07:34 -- accel/accel.sh@20 -- # IFS=: 00:05:07.039 02:07:34 -- accel/accel.sh@20 -- # read -r var val 00:05:08.409 02:07:35 -- accel/accel.sh@21 -- # val= 00:05:08.409 02:07:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:08.409 02:07:35 -- accel/accel.sh@20 -- # IFS=: 00:05:08.409 02:07:35 -- accel/accel.sh@20 -- # read -r var val 00:05:08.409 02:07:35 -- accel/accel.sh@21 -- # val= 00:05:08.409 02:07:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:08.409 02:07:35 -- accel/accel.sh@20 -- # IFS=: 00:05:08.409 02:07:35 -- accel/accel.sh@20 -- # read -r var val 00:05:08.409 02:07:35 -- accel/accel.sh@21 -- # val= 00:05:08.409 02:07:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:08.409 02:07:35 -- accel/accel.sh@20 -- # IFS=: 00:05:08.409 02:07:35 -- accel/accel.sh@20 -- # read -r var val 00:05:08.409 02:07:35 -- accel/accel.sh@21 -- # val= 00:05:08.409 02:07:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:08.409 02:07:35 -- accel/accel.sh@20 -- # IFS=: 00:05:08.409 02:07:35 -- accel/accel.sh@20 -- # read -r var val 00:05:08.409 02:07:35 -- accel/accel.sh@21 -- # val= 00:05:08.409 02:07:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:08.409 02:07:35 -- accel/accel.sh@20 -- # IFS=: 00:05:08.409 02:07:35 -- accel/accel.sh@20 -- # read -r var val 00:05:08.409 02:07:35 -- accel/accel.sh@21 -- # val= 00:05:08.409 02:07:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:08.409 02:07:35 -- accel/accel.sh@20 -- # IFS=: 00:05:08.409 02:07:35 -- accel/accel.sh@20 -- # read -r var val 00:05:08.409 02:07:35 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:08.409 02:07:35 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:05:08.409 02:07:35 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:08.409 00:05:08.409 real 0m2.954s 00:05:08.409 user 0m2.652s 00:05:08.409 sys 0m0.292s 00:05:08.409 02:07:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:08.409 02:07:35 -- common/autotest_common.sh@10 -- # set +x 00:05:08.409 ************************************ 00:05:08.409 END TEST accel_copy 00:05:08.409 ************************************ 00:05:08.409 02:07:35 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:08.409 02:07:35 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:05:08.409 02:07:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:08.409 02:07:35 -- common/autotest_common.sh@10 -- # set +x 00:05:08.409 ************************************ 00:05:08.409 START TEST accel_fill 00:05:08.409 ************************************ 00:05:08.409 02:07:35 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:08.409 02:07:35 -- accel/accel.sh@16 -- # local accel_opc 00:05:08.409 02:07:35 -- accel/accel.sh@17 -- # local accel_module 00:05:08.409 02:07:35 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:08.409 02:07:35 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:08.409 02:07:35 -- accel/accel.sh@12 -- # build_accel_config 00:05:08.409 02:07:35 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:08.409 02:07:35 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:08.409 02:07:35 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:08.409 02:07:35 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:08.409 02:07:35 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:08.409 02:07:35 -- accel/accel.sh@41 -- # local IFS=, 00:05:08.409 02:07:35 -- accel/accel.sh@42 -- # jq -r . 00:05:08.409 [2024-12-08 02:07:35.877064] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:08.409 [2024-12-08 02:07:35.877142] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1994907 ] 00:05:08.409 EAL: No free 2048 kB hugepages reported on node 1 00:05:08.409 [2024-12-08 02:07:35.939488] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:08.409 [2024-12-08 02:07:36.056424] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:09.782 02:07:37 -- accel/accel.sh@18 -- # out=' 00:05:09.782 SPDK Configuration: 00:05:09.782 Core mask: 0x1 00:05:09.782 00:05:09.782 Accel Perf Configuration: 00:05:09.782 Workload Type: fill 00:05:09.782 Fill pattern: 0x80 00:05:09.782 Transfer size: 4096 bytes 00:05:09.782 Vector count 1 00:05:09.782 Module: software 00:05:09.782 Queue depth: 64 00:05:09.782 Allocate depth: 64 00:05:09.782 # threads/core: 1 00:05:09.782 Run time: 1 seconds 00:05:09.782 Verify: Yes 00:05:09.782 00:05:09.782 Running for 1 seconds... 00:05:09.782 00:05:09.782 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:09.782 ------------------------------------------------------------------------------------ 00:05:09.782 0,0 404352/s 1579 MiB/s 0 0 00:05:09.782 ==================================================================================== 00:05:09.782 Total 404352/s 1579 MiB/s 0 0' 00:05:09.782 02:07:37 -- accel/accel.sh@20 -- # IFS=: 00:05:09.782 02:07:37 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:09.782 02:07:37 -- accel/accel.sh@20 -- # read -r var val 00:05:09.782 02:07:37 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:09.782 02:07:37 -- accel/accel.sh@12 -- # build_accel_config 00:05:09.782 02:07:37 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:09.782 02:07:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:09.782 02:07:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:09.782 02:07:37 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:09.782 02:07:37 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:09.782 02:07:37 -- accel/accel.sh@41 -- # local IFS=, 00:05:09.782 02:07:37 -- accel/accel.sh@42 -- # jq -r . 00:05:09.782 [2024-12-08 02:07:37.346774] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:09.782 [2024-12-08 02:07:37.346876] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1995139 ] 00:05:09.782 EAL: No free 2048 kB hugepages reported on node 1 00:05:09.782 [2024-12-08 02:07:37.410847] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:09.782 [2024-12-08 02:07:37.524895] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:10.041 02:07:37 -- accel/accel.sh@21 -- # val= 00:05:10.041 02:07:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.041 02:07:37 -- accel/accel.sh@20 -- # IFS=: 00:05:10.041 02:07:37 -- accel/accel.sh@20 -- # read -r var val 00:05:10.041 02:07:37 -- accel/accel.sh@21 -- # val= 00:05:10.041 02:07:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.041 02:07:37 -- accel/accel.sh@20 -- # IFS=: 00:05:10.041 02:07:37 -- accel/accel.sh@20 -- # read -r var val 00:05:10.041 02:07:37 -- accel/accel.sh@21 -- # val=0x1 00:05:10.041 02:07:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.041 02:07:37 -- accel/accel.sh@20 -- # IFS=: 00:05:10.041 02:07:37 -- accel/accel.sh@20 -- # read -r var val 00:05:10.041 02:07:37 -- accel/accel.sh@21 -- # val= 00:05:10.041 02:07:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.041 02:07:37 -- accel/accel.sh@20 -- # IFS=: 00:05:10.041 02:07:37 -- accel/accel.sh@20 -- # read -r var val 00:05:10.041 02:07:37 -- accel/accel.sh@21 -- # val= 00:05:10.041 02:07:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.041 02:07:37 -- accel/accel.sh@20 -- # IFS=: 00:05:10.041 02:07:37 -- accel/accel.sh@20 -- # read -r var val 00:05:10.041 02:07:37 -- accel/accel.sh@21 -- # val=fill 00:05:10.041 02:07:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.041 02:07:37 -- accel/accel.sh@24 -- # accel_opc=fill 00:05:10.041 02:07:37 -- accel/accel.sh@20 -- # IFS=: 00:05:10.041 02:07:37 -- accel/accel.sh@20 -- # read -r var val 00:05:10.041 02:07:37 -- accel/accel.sh@21 -- # val=0x80 00:05:10.041 02:07:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.041 02:07:37 -- accel/accel.sh@20 -- # IFS=: 00:05:10.041 02:07:37 -- accel/accel.sh@20 -- # read -r var val 00:05:10.041 02:07:37 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:10.041 02:07:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.041 02:07:37 -- accel/accel.sh@20 -- # IFS=: 00:05:10.041 02:07:37 -- accel/accel.sh@20 -- # read -r var val 00:05:10.041 02:07:37 -- accel/accel.sh@21 -- # val= 00:05:10.041 02:07:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.041 02:07:37 -- accel/accel.sh@20 -- # IFS=: 00:05:10.041 02:07:37 -- accel/accel.sh@20 -- # read -r var val 00:05:10.041 02:07:37 -- accel/accel.sh@21 -- # val=software 00:05:10.042 02:07:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.042 02:07:37 -- accel/accel.sh@23 -- # accel_module=software 00:05:10.042 02:07:37 -- accel/accel.sh@20 -- # IFS=: 00:05:10.042 02:07:37 -- accel/accel.sh@20 -- # read -r var val 00:05:10.042 02:07:37 -- accel/accel.sh@21 -- # val=64 00:05:10.042 02:07:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.042 02:07:37 -- accel/accel.sh@20 -- # IFS=: 00:05:10.042 02:07:37 -- accel/accel.sh@20 -- # read -r var val 00:05:10.042 02:07:37 -- accel/accel.sh@21 -- # val=64 00:05:10.042 02:07:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.042 02:07:37 -- accel/accel.sh@20 -- # IFS=: 00:05:10.042 02:07:37 -- accel/accel.sh@20 -- # read -r var val 00:05:10.042 02:07:37 -- accel/accel.sh@21 -- # val=1 00:05:10.042 02:07:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.042 02:07:37 -- accel/accel.sh@20 -- # IFS=: 00:05:10.042 02:07:37 -- accel/accel.sh@20 -- # read -r var val 00:05:10.042 02:07:37 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:10.042 02:07:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.042 02:07:37 -- accel/accel.sh@20 -- # IFS=: 00:05:10.042 02:07:37 -- accel/accel.sh@20 -- # read -r var val 00:05:10.042 02:07:37 -- accel/accel.sh@21 -- # val=Yes 00:05:10.042 02:07:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.042 02:07:37 -- accel/accel.sh@20 -- # IFS=: 00:05:10.042 02:07:37 -- accel/accel.sh@20 -- # read -r var val 00:05:10.042 02:07:37 -- accel/accel.sh@21 -- # val= 00:05:10.042 02:07:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.042 02:07:37 -- accel/accel.sh@20 -- # IFS=: 00:05:10.042 02:07:37 -- accel/accel.sh@20 -- # read -r var val 00:05:10.042 02:07:37 -- accel/accel.sh@21 -- # val= 00:05:10.042 02:07:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:10.042 02:07:37 -- accel/accel.sh@20 -- # IFS=: 00:05:10.042 02:07:37 -- accel/accel.sh@20 -- # read -r var val 00:05:11.417 02:07:38 -- accel/accel.sh@21 -- # val= 00:05:11.417 02:07:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:11.417 02:07:38 -- accel/accel.sh@20 -- # IFS=: 00:05:11.417 02:07:38 -- accel/accel.sh@20 -- # read -r var val 00:05:11.417 02:07:38 -- accel/accel.sh@21 -- # val= 00:05:11.417 02:07:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:11.417 02:07:38 -- accel/accel.sh@20 -- # IFS=: 00:05:11.417 02:07:38 -- accel/accel.sh@20 -- # read -r var val 00:05:11.417 02:07:38 -- accel/accel.sh@21 -- # val= 00:05:11.417 02:07:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:11.417 02:07:38 -- accel/accel.sh@20 -- # IFS=: 00:05:11.417 02:07:38 -- accel/accel.sh@20 -- # read -r var val 00:05:11.417 02:07:38 -- accel/accel.sh@21 -- # val= 00:05:11.417 02:07:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:11.417 02:07:38 -- accel/accel.sh@20 -- # IFS=: 00:05:11.417 02:07:38 -- accel/accel.sh@20 -- # read -r var val 00:05:11.417 02:07:38 -- accel/accel.sh@21 -- # val= 00:05:11.417 02:07:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:11.417 02:07:38 -- accel/accel.sh@20 -- # IFS=: 00:05:11.417 02:07:38 -- accel/accel.sh@20 -- # read -r var val 00:05:11.417 02:07:38 -- accel/accel.sh@21 -- # val= 00:05:11.417 02:07:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:11.417 02:07:38 -- accel/accel.sh@20 -- # IFS=: 00:05:11.417 02:07:38 -- accel/accel.sh@20 -- # read -r var val 00:05:11.417 02:07:38 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:11.417 02:07:38 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:05:11.417 02:07:38 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:11.417 00:05:11.417 real 0m2.935s 00:05:11.417 user 0m2.636s 00:05:11.417 sys 0m0.289s 00:05:11.417 02:07:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:11.417 02:07:38 -- common/autotest_common.sh@10 -- # set +x 00:05:11.417 ************************************ 00:05:11.417 END TEST accel_fill 00:05:11.417 ************************************ 00:05:11.417 02:07:38 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:05:11.417 02:07:38 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:11.417 02:07:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:11.417 02:07:38 -- common/autotest_common.sh@10 -- # set +x 00:05:11.417 ************************************ 00:05:11.417 START TEST accel_copy_crc32c 00:05:11.417 ************************************ 00:05:11.417 02:07:38 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y 00:05:11.417 02:07:38 -- accel/accel.sh@16 -- # local accel_opc 00:05:11.417 02:07:38 -- accel/accel.sh@17 -- # local accel_module 00:05:11.417 02:07:38 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:11.417 02:07:38 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:11.417 02:07:38 -- accel/accel.sh@12 -- # build_accel_config 00:05:11.417 02:07:38 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:11.417 02:07:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:11.417 02:07:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:11.417 02:07:38 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:11.417 02:07:38 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:11.417 02:07:38 -- accel/accel.sh@41 -- # local IFS=, 00:05:11.417 02:07:38 -- accel/accel.sh@42 -- # jq -r . 00:05:11.417 [2024-12-08 02:07:38.836577] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:11.417 [2024-12-08 02:07:38.836656] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1995335 ] 00:05:11.418 EAL: No free 2048 kB hugepages reported on node 1 00:05:11.418 [2024-12-08 02:07:38.897561] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:11.418 [2024-12-08 02:07:39.014066] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:12.792 02:07:40 -- accel/accel.sh@18 -- # out=' 00:05:12.792 SPDK Configuration: 00:05:12.792 Core mask: 0x1 00:05:12.792 00:05:12.792 Accel Perf Configuration: 00:05:12.792 Workload Type: copy_crc32c 00:05:12.792 CRC-32C seed: 0 00:05:12.792 Vector size: 4096 bytes 00:05:12.792 Transfer size: 4096 bytes 00:05:12.792 Vector count 1 00:05:12.792 Module: software 00:05:12.792 Queue depth: 32 00:05:12.792 Allocate depth: 32 00:05:12.792 # threads/core: 1 00:05:12.792 Run time: 1 seconds 00:05:12.792 Verify: Yes 00:05:12.792 00:05:12.792 Running for 1 seconds... 00:05:12.792 00:05:12.792 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:12.792 ------------------------------------------------------------------------------------ 00:05:12.792 0,0 216544/s 845 MiB/s 0 0 00:05:12.792 ==================================================================================== 00:05:12.792 Total 216544/s 845 MiB/s 0 0' 00:05:12.792 02:07:40 -- accel/accel.sh@20 -- # IFS=: 00:05:12.792 02:07:40 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:12.792 02:07:40 -- accel/accel.sh@20 -- # read -r var val 00:05:12.792 02:07:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:12.792 02:07:40 -- accel/accel.sh@12 -- # build_accel_config 00:05:12.792 02:07:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:12.792 02:07:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:12.792 02:07:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:12.792 02:07:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:12.792 02:07:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:12.792 02:07:40 -- accel/accel.sh@41 -- # local IFS=, 00:05:12.792 02:07:40 -- accel/accel.sh@42 -- # jq -r . 00:05:12.792 [2024-12-08 02:07:40.318044] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:12.792 [2024-12-08 02:07:40.318131] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1995475 ] 00:05:12.792 EAL: No free 2048 kB hugepages reported on node 1 00:05:12.792 [2024-12-08 02:07:40.379638] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:12.792 [2024-12-08 02:07:40.499662] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:12.792 02:07:40 -- accel/accel.sh@21 -- # val= 00:05:12.792 02:07:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.792 02:07:40 -- accel/accel.sh@20 -- # IFS=: 00:05:12.792 02:07:40 -- accel/accel.sh@20 -- # read -r var val 00:05:12.792 02:07:40 -- accel/accel.sh@21 -- # val= 00:05:12.792 02:07:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.792 02:07:40 -- accel/accel.sh@20 -- # IFS=: 00:05:12.792 02:07:40 -- accel/accel.sh@20 -- # read -r var val 00:05:12.792 02:07:40 -- accel/accel.sh@21 -- # val=0x1 00:05:12.792 02:07:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.792 02:07:40 -- accel/accel.sh@20 -- # IFS=: 00:05:12.792 02:07:40 -- accel/accel.sh@20 -- # read -r var val 00:05:12.792 02:07:40 -- accel/accel.sh@21 -- # val= 00:05:12.792 02:07:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.792 02:07:40 -- accel/accel.sh@20 -- # IFS=: 00:05:12.792 02:07:40 -- accel/accel.sh@20 -- # read -r var val 00:05:12.792 02:07:40 -- accel/accel.sh@21 -- # val= 00:05:12.792 02:07:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.792 02:07:40 -- accel/accel.sh@20 -- # IFS=: 00:05:12.792 02:07:40 -- accel/accel.sh@20 -- # read -r var val 00:05:12.792 02:07:40 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:12.792 02:07:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.792 02:07:40 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:12.792 02:07:40 -- accel/accel.sh@20 -- # IFS=: 00:05:12.792 02:07:40 -- accel/accel.sh@20 -- # read -r var val 00:05:12.792 02:07:40 -- accel/accel.sh@21 -- # val=0 00:05:12.792 02:07:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.792 02:07:40 -- accel/accel.sh@20 -- # IFS=: 00:05:12.792 02:07:40 -- accel/accel.sh@20 -- # read -r var val 00:05:12.792 02:07:40 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:12.792 02:07:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.792 02:07:40 -- accel/accel.sh@20 -- # IFS=: 00:05:12.792 02:07:40 -- accel/accel.sh@20 -- # read -r var val 00:05:12.792 02:07:40 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:12.792 02:07:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.792 02:07:40 -- accel/accel.sh@20 -- # IFS=: 00:05:12.792 02:07:40 -- accel/accel.sh@20 -- # read -r var val 00:05:12.792 02:07:40 -- accel/accel.sh@21 -- # val= 00:05:12.792 02:07:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.792 02:07:40 -- accel/accel.sh@20 -- # IFS=: 00:05:12.792 02:07:40 -- accel/accel.sh@20 -- # read -r var val 00:05:12.792 02:07:40 -- accel/accel.sh@21 -- # val=software 00:05:12.792 02:07:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.792 02:07:40 -- accel/accel.sh@23 -- # accel_module=software 00:05:12.792 02:07:40 -- accel/accel.sh@20 -- # IFS=: 00:05:12.792 02:07:40 -- accel/accel.sh@20 -- # read -r var val 00:05:12.792 02:07:40 -- accel/accel.sh@21 -- # val=32 00:05:12.792 02:07:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.792 02:07:40 -- accel/accel.sh@20 -- # IFS=: 00:05:12.792 02:07:40 -- accel/accel.sh@20 -- # read -r var val 00:05:12.792 02:07:40 -- accel/accel.sh@21 -- # val=32 00:05:12.792 02:07:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.792 02:07:40 -- accel/accel.sh@20 -- # IFS=: 00:05:12.792 02:07:40 -- accel/accel.sh@20 -- # read -r var val 00:05:12.792 02:07:40 -- accel/accel.sh@21 -- # val=1 00:05:12.793 02:07:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.793 02:07:40 -- accel/accel.sh@20 -- # IFS=: 00:05:12.793 02:07:40 -- accel/accel.sh@20 -- # read -r var val 00:05:12.793 02:07:40 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:12.793 02:07:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.793 02:07:40 -- accel/accel.sh@20 -- # IFS=: 00:05:12.793 02:07:40 -- accel/accel.sh@20 -- # read -r var val 00:05:12.793 02:07:40 -- accel/accel.sh@21 -- # val=Yes 00:05:12.793 02:07:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.793 02:07:40 -- accel/accel.sh@20 -- # IFS=: 00:05:12.793 02:07:40 -- accel/accel.sh@20 -- # read -r var val 00:05:12.793 02:07:40 -- accel/accel.sh@21 -- # val= 00:05:12.793 02:07:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.793 02:07:40 -- accel/accel.sh@20 -- # IFS=: 00:05:12.793 02:07:40 -- accel/accel.sh@20 -- # read -r var val 00:05:12.793 02:07:40 -- accel/accel.sh@21 -- # val= 00:05:12.793 02:07:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.793 02:07:40 -- accel/accel.sh@20 -- # IFS=: 00:05:12.793 02:07:40 -- accel/accel.sh@20 -- # read -r var val 00:05:14.166 02:07:41 -- accel/accel.sh@21 -- # val= 00:05:14.166 02:07:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:14.166 02:07:41 -- accel/accel.sh@20 -- # IFS=: 00:05:14.166 02:07:41 -- accel/accel.sh@20 -- # read -r var val 00:05:14.166 02:07:41 -- accel/accel.sh@21 -- # val= 00:05:14.166 02:07:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:14.166 02:07:41 -- accel/accel.sh@20 -- # IFS=: 00:05:14.166 02:07:41 -- accel/accel.sh@20 -- # read -r var val 00:05:14.166 02:07:41 -- accel/accel.sh@21 -- # val= 00:05:14.166 02:07:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:14.166 02:07:41 -- accel/accel.sh@20 -- # IFS=: 00:05:14.166 02:07:41 -- accel/accel.sh@20 -- # read -r var val 00:05:14.166 02:07:41 -- accel/accel.sh@21 -- # val= 00:05:14.166 02:07:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:14.166 02:07:41 -- accel/accel.sh@20 -- # IFS=: 00:05:14.166 02:07:41 -- accel/accel.sh@20 -- # read -r var val 00:05:14.166 02:07:41 -- accel/accel.sh@21 -- # val= 00:05:14.166 02:07:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:14.166 02:07:41 -- accel/accel.sh@20 -- # IFS=: 00:05:14.166 02:07:41 -- accel/accel.sh@20 -- # read -r var val 00:05:14.166 02:07:41 -- accel/accel.sh@21 -- # val= 00:05:14.166 02:07:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:14.166 02:07:41 -- accel/accel.sh@20 -- # IFS=: 00:05:14.166 02:07:41 -- accel/accel.sh@20 -- # read -r var val 00:05:14.166 02:07:41 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:14.166 02:07:41 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:14.166 02:07:41 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:14.166 00:05:14.166 real 0m2.966s 00:05:14.166 user 0m2.661s 00:05:14.166 sys 0m0.296s 00:05:14.166 02:07:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:14.166 02:07:41 -- common/autotest_common.sh@10 -- # set +x 00:05:14.166 ************************************ 00:05:14.167 END TEST accel_copy_crc32c 00:05:14.167 ************************************ 00:05:14.167 02:07:41 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:05:14.167 02:07:41 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:14.167 02:07:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:14.167 02:07:41 -- common/autotest_common.sh@10 -- # set +x 00:05:14.167 ************************************ 00:05:14.167 START TEST accel_copy_crc32c_C2 00:05:14.167 ************************************ 00:05:14.167 02:07:41 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:05:14.167 02:07:41 -- accel/accel.sh@16 -- # local accel_opc 00:05:14.167 02:07:41 -- accel/accel.sh@17 -- # local accel_module 00:05:14.167 02:07:41 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:14.167 02:07:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:14.167 02:07:41 -- accel/accel.sh@12 -- # build_accel_config 00:05:14.167 02:07:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:14.167 02:07:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:14.167 02:07:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:14.167 02:07:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:14.167 02:07:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:14.167 02:07:41 -- accel/accel.sh@41 -- # local IFS=, 00:05:14.167 02:07:41 -- accel/accel.sh@42 -- # jq -r . 00:05:14.167 [2024-12-08 02:07:41.826235] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:14.167 [2024-12-08 02:07:41.826319] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1995701 ] 00:05:14.167 EAL: No free 2048 kB hugepages reported on node 1 00:05:14.167 [2024-12-08 02:07:41.888024] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:14.425 [2024-12-08 02:07:42.007644] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:15.797 02:07:43 -- accel/accel.sh@18 -- # out=' 00:05:15.797 SPDK Configuration: 00:05:15.797 Core mask: 0x1 00:05:15.797 00:05:15.797 Accel Perf Configuration: 00:05:15.797 Workload Type: copy_crc32c 00:05:15.797 CRC-32C seed: 0 00:05:15.797 Vector size: 4096 bytes 00:05:15.797 Transfer size: 8192 bytes 00:05:15.797 Vector count 2 00:05:15.797 Module: software 00:05:15.797 Queue depth: 32 00:05:15.797 Allocate depth: 32 00:05:15.797 # threads/core: 1 00:05:15.797 Run time: 1 seconds 00:05:15.797 Verify: Yes 00:05:15.797 00:05:15.797 Running for 1 seconds... 00:05:15.797 00:05:15.797 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:15.797 ------------------------------------------------------------------------------------ 00:05:15.797 0,0 154848/s 1209 MiB/s 0 0 00:05:15.797 ==================================================================================== 00:05:15.797 Total 154848/s 604 MiB/s 0 0' 00:05:15.797 02:07:43 -- accel/accel.sh@20 -- # IFS=: 00:05:15.797 02:07:43 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:15.797 02:07:43 -- accel/accel.sh@20 -- # read -r var val 00:05:15.797 02:07:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:15.797 02:07:43 -- accel/accel.sh@12 -- # build_accel_config 00:05:15.797 02:07:43 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:15.797 02:07:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:15.797 02:07:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:15.797 02:07:43 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:15.797 02:07:43 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:15.797 02:07:43 -- accel/accel.sh@41 -- # local IFS=, 00:05:15.797 02:07:43 -- accel/accel.sh@42 -- # jq -r . 00:05:15.797 [2024-12-08 02:07:43.294785] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:15.797 [2024-12-08 02:07:43.294872] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1995903 ] 00:05:15.798 EAL: No free 2048 kB hugepages reported on node 1 00:05:15.798 [2024-12-08 02:07:43.355921] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:15.798 [2024-12-08 02:07:43.475836] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:15.798 02:07:43 -- accel/accel.sh@21 -- # val= 00:05:15.798 02:07:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.798 02:07:43 -- accel/accel.sh@20 -- # IFS=: 00:05:15.798 02:07:43 -- accel/accel.sh@20 -- # read -r var val 00:05:15.798 02:07:43 -- accel/accel.sh@21 -- # val= 00:05:15.798 02:07:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.798 02:07:43 -- accel/accel.sh@20 -- # IFS=: 00:05:15.798 02:07:43 -- accel/accel.sh@20 -- # read -r var val 00:05:15.798 02:07:43 -- accel/accel.sh@21 -- # val=0x1 00:05:15.798 02:07:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.798 02:07:43 -- accel/accel.sh@20 -- # IFS=: 00:05:15.798 02:07:43 -- accel/accel.sh@20 -- # read -r var val 00:05:15.798 02:07:43 -- accel/accel.sh@21 -- # val= 00:05:15.798 02:07:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.798 02:07:43 -- accel/accel.sh@20 -- # IFS=: 00:05:15.798 02:07:43 -- accel/accel.sh@20 -- # read -r var val 00:05:15.798 02:07:43 -- accel/accel.sh@21 -- # val= 00:05:15.798 02:07:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.798 02:07:43 -- accel/accel.sh@20 -- # IFS=: 00:05:15.798 02:07:43 -- accel/accel.sh@20 -- # read -r var val 00:05:15.798 02:07:43 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:15.798 02:07:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.798 02:07:43 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:15.798 02:07:43 -- accel/accel.sh@20 -- # IFS=: 00:05:15.798 02:07:43 -- accel/accel.sh@20 -- # read -r var val 00:05:15.798 02:07:43 -- accel/accel.sh@21 -- # val=0 00:05:15.798 02:07:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.798 02:07:43 -- accel/accel.sh@20 -- # IFS=: 00:05:15.798 02:07:43 -- accel/accel.sh@20 -- # read -r var val 00:05:15.798 02:07:43 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:15.798 02:07:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.798 02:07:43 -- accel/accel.sh@20 -- # IFS=: 00:05:15.798 02:07:43 -- accel/accel.sh@20 -- # read -r var val 00:05:15.798 02:07:43 -- accel/accel.sh@21 -- # val='8192 bytes' 00:05:15.798 02:07:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.798 02:07:43 -- accel/accel.sh@20 -- # IFS=: 00:05:15.798 02:07:43 -- accel/accel.sh@20 -- # read -r var val 00:05:15.798 02:07:43 -- accel/accel.sh@21 -- # val= 00:05:15.798 02:07:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.798 02:07:43 -- accel/accel.sh@20 -- # IFS=: 00:05:15.798 02:07:43 -- accel/accel.sh@20 -- # read -r var val 00:05:15.798 02:07:43 -- accel/accel.sh@21 -- # val=software 00:05:15.798 02:07:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.798 02:07:43 -- accel/accel.sh@23 -- # accel_module=software 00:05:15.798 02:07:43 -- accel/accel.sh@20 -- # IFS=: 00:05:15.798 02:07:43 -- accel/accel.sh@20 -- # read -r var val 00:05:15.798 02:07:43 -- accel/accel.sh@21 -- # val=32 00:05:15.798 02:07:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.798 02:07:43 -- accel/accel.sh@20 -- # IFS=: 00:05:15.798 02:07:43 -- accel/accel.sh@20 -- # read -r var val 00:05:15.798 02:07:43 -- accel/accel.sh@21 -- # val=32 00:05:15.798 02:07:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.798 02:07:43 -- accel/accel.sh@20 -- # IFS=: 00:05:15.798 02:07:43 -- accel/accel.sh@20 -- # read -r var val 00:05:15.798 02:07:43 -- accel/accel.sh@21 -- # val=1 00:05:15.798 02:07:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.798 02:07:43 -- accel/accel.sh@20 -- # IFS=: 00:05:15.798 02:07:43 -- accel/accel.sh@20 -- # read -r var val 00:05:15.798 02:07:43 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:15.798 02:07:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.798 02:07:43 -- accel/accel.sh@20 -- # IFS=: 00:05:15.798 02:07:43 -- accel/accel.sh@20 -- # read -r var val 00:05:15.798 02:07:43 -- accel/accel.sh@21 -- # val=Yes 00:05:15.798 02:07:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.798 02:07:43 -- accel/accel.sh@20 -- # IFS=: 00:05:15.798 02:07:43 -- accel/accel.sh@20 -- # read -r var val 00:05:15.798 02:07:43 -- accel/accel.sh@21 -- # val= 00:05:15.798 02:07:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.798 02:07:43 -- accel/accel.sh@20 -- # IFS=: 00:05:15.798 02:07:43 -- accel/accel.sh@20 -- # read -r var val 00:05:15.798 02:07:43 -- accel/accel.sh@21 -- # val= 00:05:15.798 02:07:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.798 02:07:43 -- accel/accel.sh@20 -- # IFS=: 00:05:15.798 02:07:43 -- accel/accel.sh@20 -- # read -r var val 00:05:17.172 02:07:44 -- accel/accel.sh@21 -- # val= 00:05:17.172 02:07:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:17.172 02:07:44 -- accel/accel.sh@20 -- # IFS=: 00:05:17.172 02:07:44 -- accel/accel.sh@20 -- # read -r var val 00:05:17.172 02:07:44 -- accel/accel.sh@21 -- # val= 00:05:17.172 02:07:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:17.172 02:07:44 -- accel/accel.sh@20 -- # IFS=: 00:05:17.172 02:07:44 -- accel/accel.sh@20 -- # read -r var val 00:05:17.172 02:07:44 -- accel/accel.sh@21 -- # val= 00:05:17.172 02:07:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:17.172 02:07:44 -- accel/accel.sh@20 -- # IFS=: 00:05:17.172 02:07:44 -- accel/accel.sh@20 -- # read -r var val 00:05:17.172 02:07:44 -- accel/accel.sh@21 -- # val= 00:05:17.172 02:07:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:17.172 02:07:44 -- accel/accel.sh@20 -- # IFS=: 00:05:17.172 02:07:44 -- accel/accel.sh@20 -- # read -r var val 00:05:17.172 02:07:44 -- accel/accel.sh@21 -- # val= 00:05:17.172 02:07:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:17.172 02:07:44 -- accel/accel.sh@20 -- # IFS=: 00:05:17.172 02:07:44 -- accel/accel.sh@20 -- # read -r var val 00:05:17.172 02:07:44 -- accel/accel.sh@21 -- # val= 00:05:17.172 02:07:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:17.172 02:07:44 -- accel/accel.sh@20 -- # IFS=: 00:05:17.172 02:07:44 -- accel/accel.sh@20 -- # read -r var val 00:05:17.172 02:07:44 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:17.172 02:07:44 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:17.172 02:07:44 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:17.172 00:05:17.172 real 0m2.954s 00:05:17.172 user 0m2.665s 00:05:17.172 sys 0m0.280s 00:05:17.172 02:07:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:17.172 02:07:44 -- common/autotest_common.sh@10 -- # set +x 00:05:17.172 ************************************ 00:05:17.172 END TEST accel_copy_crc32c_C2 00:05:17.172 ************************************ 00:05:17.172 02:07:44 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:05:17.172 02:07:44 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:17.172 02:07:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:17.172 02:07:44 -- common/autotest_common.sh@10 -- # set +x 00:05:17.172 ************************************ 00:05:17.172 START TEST accel_dualcast 00:05:17.172 ************************************ 00:05:17.172 02:07:44 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dualcast -y 00:05:17.172 02:07:44 -- accel/accel.sh@16 -- # local accel_opc 00:05:17.172 02:07:44 -- accel/accel.sh@17 -- # local accel_module 00:05:17.172 02:07:44 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:05:17.172 02:07:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:17.172 02:07:44 -- accel/accel.sh@12 -- # build_accel_config 00:05:17.172 02:07:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:17.172 02:07:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:17.172 02:07:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:17.172 02:07:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:17.172 02:07:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:17.172 02:07:44 -- accel/accel.sh@41 -- # local IFS=, 00:05:17.172 02:07:44 -- accel/accel.sh@42 -- # jq -r . 00:05:17.172 [2024-12-08 02:07:44.808111] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:17.172 [2024-12-08 02:07:44.808195] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1996062 ] 00:05:17.172 EAL: No free 2048 kB hugepages reported on node 1 00:05:17.172 [2024-12-08 02:07:44.869240] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:17.434 [2024-12-08 02:07:44.990421] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:18.864 02:07:46 -- accel/accel.sh@18 -- # out=' 00:05:18.864 SPDK Configuration: 00:05:18.864 Core mask: 0x1 00:05:18.864 00:05:18.864 Accel Perf Configuration: 00:05:18.864 Workload Type: dualcast 00:05:18.864 Transfer size: 4096 bytes 00:05:18.864 Vector count 1 00:05:18.864 Module: software 00:05:18.864 Queue depth: 32 00:05:18.864 Allocate depth: 32 00:05:18.864 # threads/core: 1 00:05:18.864 Run time: 1 seconds 00:05:18.864 Verify: Yes 00:05:18.864 00:05:18.864 Running for 1 seconds... 00:05:18.864 00:05:18.864 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:18.864 ------------------------------------------------------------------------------------ 00:05:18.864 0,0 298688/s 1166 MiB/s 0 0 00:05:18.864 ==================================================================================== 00:05:18.864 Total 298688/s 1166 MiB/s 0 0' 00:05:18.864 02:07:46 -- accel/accel.sh@20 -- # IFS=: 00:05:18.864 02:07:46 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:05:18.864 02:07:46 -- accel/accel.sh@20 -- # read -r var val 00:05:18.865 02:07:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:18.865 02:07:46 -- accel/accel.sh@12 -- # build_accel_config 00:05:18.865 02:07:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:18.865 02:07:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:18.865 02:07:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:18.865 02:07:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:18.865 02:07:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:18.865 02:07:46 -- accel/accel.sh@41 -- # local IFS=, 00:05:18.865 02:07:46 -- accel/accel.sh@42 -- # jq -r . 00:05:18.865 [2024-12-08 02:07:46.293973] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:18.865 [2024-12-08 02:07:46.294046] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1996206 ] 00:05:18.865 EAL: No free 2048 kB hugepages reported on node 1 00:05:18.865 [2024-12-08 02:07:46.358482] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:18.865 [2024-12-08 02:07:46.477775] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:18.865 02:07:46 -- accel/accel.sh@21 -- # val= 00:05:18.865 02:07:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.865 02:07:46 -- accel/accel.sh@20 -- # IFS=: 00:05:18.865 02:07:46 -- accel/accel.sh@20 -- # read -r var val 00:05:18.865 02:07:46 -- accel/accel.sh@21 -- # val= 00:05:18.865 02:07:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.865 02:07:46 -- accel/accel.sh@20 -- # IFS=: 00:05:18.865 02:07:46 -- accel/accel.sh@20 -- # read -r var val 00:05:18.865 02:07:46 -- accel/accel.sh@21 -- # val=0x1 00:05:18.865 02:07:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.865 02:07:46 -- accel/accel.sh@20 -- # IFS=: 00:05:18.865 02:07:46 -- accel/accel.sh@20 -- # read -r var val 00:05:18.865 02:07:46 -- accel/accel.sh@21 -- # val= 00:05:18.865 02:07:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.865 02:07:46 -- accel/accel.sh@20 -- # IFS=: 00:05:18.865 02:07:46 -- accel/accel.sh@20 -- # read -r var val 00:05:18.865 02:07:46 -- accel/accel.sh@21 -- # val= 00:05:18.865 02:07:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.865 02:07:46 -- accel/accel.sh@20 -- # IFS=: 00:05:18.865 02:07:46 -- accel/accel.sh@20 -- # read -r var val 00:05:18.865 02:07:46 -- accel/accel.sh@21 -- # val=dualcast 00:05:18.865 02:07:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.865 02:07:46 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:05:18.865 02:07:46 -- accel/accel.sh@20 -- # IFS=: 00:05:18.865 02:07:46 -- accel/accel.sh@20 -- # read -r var val 00:05:18.865 02:07:46 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:18.865 02:07:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.865 02:07:46 -- accel/accel.sh@20 -- # IFS=: 00:05:18.865 02:07:46 -- accel/accel.sh@20 -- # read -r var val 00:05:18.865 02:07:46 -- accel/accel.sh@21 -- # val= 00:05:18.865 02:07:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.865 02:07:46 -- accel/accel.sh@20 -- # IFS=: 00:05:18.865 02:07:46 -- accel/accel.sh@20 -- # read -r var val 00:05:18.865 02:07:46 -- accel/accel.sh@21 -- # val=software 00:05:18.865 02:07:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.865 02:07:46 -- accel/accel.sh@23 -- # accel_module=software 00:05:18.865 02:07:46 -- accel/accel.sh@20 -- # IFS=: 00:05:18.865 02:07:46 -- accel/accel.sh@20 -- # read -r var val 00:05:18.865 02:07:46 -- accel/accel.sh@21 -- # val=32 00:05:18.865 02:07:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.865 02:07:46 -- accel/accel.sh@20 -- # IFS=: 00:05:18.865 02:07:46 -- accel/accel.sh@20 -- # read -r var val 00:05:18.865 02:07:46 -- accel/accel.sh@21 -- # val=32 00:05:18.865 02:07:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.865 02:07:46 -- accel/accel.sh@20 -- # IFS=: 00:05:18.865 02:07:46 -- accel/accel.sh@20 -- # read -r var val 00:05:18.865 02:07:46 -- accel/accel.sh@21 -- # val=1 00:05:18.865 02:07:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.865 02:07:46 -- accel/accel.sh@20 -- # IFS=: 00:05:18.865 02:07:46 -- accel/accel.sh@20 -- # read -r var val 00:05:18.865 02:07:46 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:18.865 02:07:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.865 02:07:46 -- accel/accel.sh@20 -- # IFS=: 00:05:18.865 02:07:46 -- accel/accel.sh@20 -- # read -r var val 00:05:18.865 02:07:46 -- accel/accel.sh@21 -- # val=Yes 00:05:18.865 02:07:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.865 02:07:46 -- accel/accel.sh@20 -- # IFS=: 00:05:18.865 02:07:46 -- accel/accel.sh@20 -- # read -r var val 00:05:18.865 02:07:46 -- accel/accel.sh@21 -- # val= 00:05:18.865 02:07:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.865 02:07:46 -- accel/accel.sh@20 -- # IFS=: 00:05:18.865 02:07:46 -- accel/accel.sh@20 -- # read -r var val 00:05:18.865 02:07:46 -- accel/accel.sh@21 -- # val= 00:05:18.865 02:07:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.865 02:07:46 -- accel/accel.sh@20 -- # IFS=: 00:05:18.865 02:07:46 -- accel/accel.sh@20 -- # read -r var val 00:05:20.239 02:07:47 -- accel/accel.sh@21 -- # val= 00:05:20.239 02:07:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:20.239 02:07:47 -- accel/accel.sh@20 -- # IFS=: 00:05:20.239 02:07:47 -- accel/accel.sh@20 -- # read -r var val 00:05:20.239 02:07:47 -- accel/accel.sh@21 -- # val= 00:05:20.239 02:07:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:20.239 02:07:47 -- accel/accel.sh@20 -- # IFS=: 00:05:20.239 02:07:47 -- accel/accel.sh@20 -- # read -r var val 00:05:20.239 02:07:47 -- accel/accel.sh@21 -- # val= 00:05:20.239 02:07:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:20.239 02:07:47 -- accel/accel.sh@20 -- # IFS=: 00:05:20.239 02:07:47 -- accel/accel.sh@20 -- # read -r var val 00:05:20.239 02:07:47 -- accel/accel.sh@21 -- # val= 00:05:20.239 02:07:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:20.239 02:07:47 -- accel/accel.sh@20 -- # IFS=: 00:05:20.239 02:07:47 -- accel/accel.sh@20 -- # read -r var val 00:05:20.239 02:07:47 -- accel/accel.sh@21 -- # val= 00:05:20.239 02:07:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:20.239 02:07:47 -- accel/accel.sh@20 -- # IFS=: 00:05:20.239 02:07:47 -- accel/accel.sh@20 -- # read -r var val 00:05:20.239 02:07:47 -- accel/accel.sh@21 -- # val= 00:05:20.239 02:07:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:20.239 02:07:47 -- accel/accel.sh@20 -- # IFS=: 00:05:20.239 02:07:47 -- accel/accel.sh@20 -- # read -r var val 00:05:20.239 02:07:47 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:20.239 02:07:47 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:05:20.239 02:07:47 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:20.239 00:05:20.239 real 0m2.967s 00:05:20.239 user 0m2.662s 00:05:20.239 sys 0m0.295s 00:05:20.239 02:07:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:20.239 02:07:47 -- common/autotest_common.sh@10 -- # set +x 00:05:20.239 ************************************ 00:05:20.239 END TEST accel_dualcast 00:05:20.239 ************************************ 00:05:20.239 02:07:47 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:05:20.239 02:07:47 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:20.239 02:07:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:20.239 02:07:47 -- common/autotest_common.sh@10 -- # set +x 00:05:20.239 ************************************ 00:05:20.239 START TEST accel_compare 00:05:20.239 ************************************ 00:05:20.239 02:07:47 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compare -y 00:05:20.239 02:07:47 -- accel/accel.sh@16 -- # local accel_opc 00:05:20.239 02:07:47 -- accel/accel.sh@17 -- # local accel_module 00:05:20.239 02:07:47 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:05:20.239 02:07:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:20.239 02:07:47 -- accel/accel.sh@12 -- # build_accel_config 00:05:20.239 02:07:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:20.239 02:07:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:20.239 02:07:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:20.239 02:07:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:20.239 02:07:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:20.239 02:07:47 -- accel/accel.sh@41 -- # local IFS=, 00:05:20.239 02:07:47 -- accel/accel.sh@42 -- # jq -r . 00:05:20.239 [2024-12-08 02:07:47.800984] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:20.239 [2024-12-08 02:07:47.801067] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1996495 ] 00:05:20.239 EAL: No free 2048 kB hugepages reported on node 1 00:05:20.239 [2024-12-08 02:07:47.868088] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:20.239 [2024-12-08 02:07:47.989084] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:21.612 02:07:49 -- accel/accel.sh@18 -- # out=' 00:05:21.612 SPDK Configuration: 00:05:21.612 Core mask: 0x1 00:05:21.612 00:05:21.612 Accel Perf Configuration: 00:05:21.612 Workload Type: compare 00:05:21.612 Transfer size: 4096 bytes 00:05:21.612 Vector count 1 00:05:21.612 Module: software 00:05:21.612 Queue depth: 32 00:05:21.612 Allocate depth: 32 00:05:21.612 # threads/core: 1 00:05:21.612 Run time: 1 seconds 00:05:21.612 Verify: Yes 00:05:21.612 00:05:21.612 Running for 1 seconds... 00:05:21.612 00:05:21.613 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:21.613 ------------------------------------------------------------------------------------ 00:05:21.613 0,0 395680/s 1545 MiB/s 0 0 00:05:21.613 ==================================================================================== 00:05:21.613 Total 395680/s 1545 MiB/s 0 0' 00:05:21.613 02:07:49 -- accel/accel.sh@20 -- # IFS=: 00:05:21.613 02:07:49 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:05:21.613 02:07:49 -- accel/accel.sh@20 -- # read -r var val 00:05:21.613 02:07:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:21.613 02:07:49 -- accel/accel.sh@12 -- # build_accel_config 00:05:21.613 02:07:49 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:21.613 02:07:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:21.613 02:07:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:21.613 02:07:49 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:21.613 02:07:49 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:21.613 02:07:49 -- accel/accel.sh@41 -- # local IFS=, 00:05:21.613 02:07:49 -- accel/accel.sh@42 -- # jq -r . 00:05:21.613 [2024-12-08 02:07:49.292651] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:21.613 [2024-12-08 02:07:49.292737] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1996636 ] 00:05:21.613 EAL: No free 2048 kB hugepages reported on node 1 00:05:21.613 [2024-12-08 02:07:49.353472] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:21.869 [2024-12-08 02:07:49.474389] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:21.869 02:07:49 -- accel/accel.sh@21 -- # val= 00:05:21.869 02:07:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.870 02:07:49 -- accel/accel.sh@20 -- # IFS=: 00:05:21.870 02:07:49 -- accel/accel.sh@20 -- # read -r var val 00:05:21.870 02:07:49 -- accel/accel.sh@21 -- # val= 00:05:21.870 02:07:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.870 02:07:49 -- accel/accel.sh@20 -- # IFS=: 00:05:21.870 02:07:49 -- accel/accel.sh@20 -- # read -r var val 00:05:21.870 02:07:49 -- accel/accel.sh@21 -- # val=0x1 00:05:21.870 02:07:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.870 02:07:49 -- accel/accel.sh@20 -- # IFS=: 00:05:21.870 02:07:49 -- accel/accel.sh@20 -- # read -r var val 00:05:21.870 02:07:49 -- accel/accel.sh@21 -- # val= 00:05:21.870 02:07:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.870 02:07:49 -- accel/accel.sh@20 -- # IFS=: 00:05:21.870 02:07:49 -- accel/accel.sh@20 -- # read -r var val 00:05:21.870 02:07:49 -- accel/accel.sh@21 -- # val= 00:05:21.870 02:07:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.870 02:07:49 -- accel/accel.sh@20 -- # IFS=: 00:05:21.870 02:07:49 -- accel/accel.sh@20 -- # read -r var val 00:05:21.870 02:07:49 -- accel/accel.sh@21 -- # val=compare 00:05:21.870 02:07:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.870 02:07:49 -- accel/accel.sh@24 -- # accel_opc=compare 00:05:21.870 02:07:49 -- accel/accel.sh@20 -- # IFS=: 00:05:21.870 02:07:49 -- accel/accel.sh@20 -- # read -r var val 00:05:21.870 02:07:49 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:21.870 02:07:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.870 02:07:49 -- accel/accel.sh@20 -- # IFS=: 00:05:21.870 02:07:49 -- accel/accel.sh@20 -- # read -r var val 00:05:21.870 02:07:49 -- accel/accel.sh@21 -- # val= 00:05:21.870 02:07:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.870 02:07:49 -- accel/accel.sh@20 -- # IFS=: 00:05:21.870 02:07:49 -- accel/accel.sh@20 -- # read -r var val 00:05:21.870 02:07:49 -- accel/accel.sh@21 -- # val=software 00:05:21.870 02:07:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.870 02:07:49 -- accel/accel.sh@23 -- # accel_module=software 00:05:21.870 02:07:49 -- accel/accel.sh@20 -- # IFS=: 00:05:21.870 02:07:49 -- accel/accel.sh@20 -- # read -r var val 00:05:21.870 02:07:49 -- accel/accel.sh@21 -- # val=32 00:05:21.870 02:07:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.870 02:07:49 -- accel/accel.sh@20 -- # IFS=: 00:05:21.870 02:07:49 -- accel/accel.sh@20 -- # read -r var val 00:05:21.870 02:07:49 -- accel/accel.sh@21 -- # val=32 00:05:21.870 02:07:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.870 02:07:49 -- accel/accel.sh@20 -- # IFS=: 00:05:21.870 02:07:49 -- accel/accel.sh@20 -- # read -r var val 00:05:21.870 02:07:49 -- accel/accel.sh@21 -- # val=1 00:05:21.870 02:07:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.870 02:07:49 -- accel/accel.sh@20 -- # IFS=: 00:05:21.870 02:07:49 -- accel/accel.sh@20 -- # read -r var val 00:05:21.870 02:07:49 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:21.870 02:07:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.870 02:07:49 -- accel/accel.sh@20 -- # IFS=: 00:05:21.870 02:07:49 -- accel/accel.sh@20 -- # read -r var val 00:05:21.870 02:07:49 -- accel/accel.sh@21 -- # val=Yes 00:05:21.870 02:07:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.870 02:07:49 -- accel/accel.sh@20 -- # IFS=: 00:05:21.870 02:07:49 -- accel/accel.sh@20 -- # read -r var val 00:05:21.870 02:07:49 -- accel/accel.sh@21 -- # val= 00:05:21.870 02:07:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.870 02:07:49 -- accel/accel.sh@20 -- # IFS=: 00:05:21.870 02:07:49 -- accel/accel.sh@20 -- # read -r var val 00:05:21.870 02:07:49 -- accel/accel.sh@21 -- # val= 00:05:21.870 02:07:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.870 02:07:49 -- accel/accel.sh@20 -- # IFS=: 00:05:21.870 02:07:49 -- accel/accel.sh@20 -- # read -r var val 00:05:23.244 02:07:50 -- accel/accel.sh@21 -- # val= 00:05:23.244 02:07:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:23.244 02:07:50 -- accel/accel.sh@20 -- # IFS=: 00:05:23.244 02:07:50 -- accel/accel.sh@20 -- # read -r var val 00:05:23.244 02:07:50 -- accel/accel.sh@21 -- # val= 00:05:23.244 02:07:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:23.244 02:07:50 -- accel/accel.sh@20 -- # IFS=: 00:05:23.244 02:07:50 -- accel/accel.sh@20 -- # read -r var val 00:05:23.244 02:07:50 -- accel/accel.sh@21 -- # val= 00:05:23.244 02:07:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:23.244 02:07:50 -- accel/accel.sh@20 -- # IFS=: 00:05:23.244 02:07:50 -- accel/accel.sh@20 -- # read -r var val 00:05:23.244 02:07:50 -- accel/accel.sh@21 -- # val= 00:05:23.244 02:07:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:23.244 02:07:50 -- accel/accel.sh@20 -- # IFS=: 00:05:23.244 02:07:50 -- accel/accel.sh@20 -- # read -r var val 00:05:23.244 02:07:50 -- accel/accel.sh@21 -- # val= 00:05:23.244 02:07:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:23.244 02:07:50 -- accel/accel.sh@20 -- # IFS=: 00:05:23.244 02:07:50 -- accel/accel.sh@20 -- # read -r var val 00:05:23.244 02:07:50 -- accel/accel.sh@21 -- # val= 00:05:23.244 02:07:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:23.244 02:07:50 -- accel/accel.sh@20 -- # IFS=: 00:05:23.244 02:07:50 -- accel/accel.sh@20 -- # read -r var val 00:05:23.244 02:07:50 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:23.244 02:07:50 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:05:23.244 02:07:50 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:23.244 00:05:23.244 real 0m2.978s 00:05:23.244 user 0m2.673s 00:05:23.244 sys 0m0.294s 00:05:23.244 02:07:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:23.244 02:07:50 -- common/autotest_common.sh@10 -- # set +x 00:05:23.244 ************************************ 00:05:23.244 END TEST accel_compare 00:05:23.244 ************************************ 00:05:23.244 02:07:50 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:05:23.244 02:07:50 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:23.244 02:07:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:23.244 02:07:50 -- common/autotest_common.sh@10 -- # set +x 00:05:23.244 ************************************ 00:05:23.244 START TEST accel_xor 00:05:23.244 ************************************ 00:05:23.244 02:07:50 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y 00:05:23.244 02:07:50 -- accel/accel.sh@16 -- # local accel_opc 00:05:23.244 02:07:50 -- accel/accel.sh@17 -- # local accel_module 00:05:23.244 02:07:50 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:05:23.244 02:07:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:23.244 02:07:50 -- accel/accel.sh@12 -- # build_accel_config 00:05:23.244 02:07:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:23.244 02:07:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:23.244 02:07:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:23.244 02:07:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:23.244 02:07:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:23.244 02:07:50 -- accel/accel.sh@41 -- # local IFS=, 00:05:23.244 02:07:50 -- accel/accel.sh@42 -- # jq -r . 00:05:23.244 [2024-12-08 02:07:50.806762] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:23.244 [2024-12-08 02:07:50.806844] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1996795 ] 00:05:23.244 EAL: No free 2048 kB hugepages reported on node 1 00:05:23.244 [2024-12-08 02:07:50.868710] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:23.244 [2024-12-08 02:07:50.991922] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:24.616 02:07:52 -- accel/accel.sh@18 -- # out=' 00:05:24.616 SPDK Configuration: 00:05:24.616 Core mask: 0x1 00:05:24.616 00:05:24.616 Accel Perf Configuration: 00:05:24.616 Workload Type: xor 00:05:24.616 Source buffers: 2 00:05:24.616 Transfer size: 4096 bytes 00:05:24.616 Vector count 1 00:05:24.616 Module: software 00:05:24.616 Queue depth: 32 00:05:24.616 Allocate depth: 32 00:05:24.616 # threads/core: 1 00:05:24.616 Run time: 1 seconds 00:05:24.616 Verify: Yes 00:05:24.616 00:05:24.616 Running for 1 seconds... 00:05:24.616 00:05:24.616 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:24.616 ------------------------------------------------------------------------------------ 00:05:24.616 0,0 192224/s 750 MiB/s 0 0 00:05:24.616 ==================================================================================== 00:05:24.616 Total 192224/s 750 MiB/s 0 0' 00:05:24.616 02:07:52 -- accel/accel.sh@20 -- # IFS=: 00:05:24.616 02:07:52 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:05:24.616 02:07:52 -- accel/accel.sh@20 -- # read -r var val 00:05:24.616 02:07:52 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:24.616 02:07:52 -- accel/accel.sh@12 -- # build_accel_config 00:05:24.616 02:07:52 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:24.616 02:07:52 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:24.616 02:07:52 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:24.616 02:07:52 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:24.616 02:07:52 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:24.616 02:07:52 -- accel/accel.sh@41 -- # local IFS=, 00:05:24.617 02:07:52 -- accel/accel.sh@42 -- # jq -r . 00:05:24.617 [2024-12-08 02:07:52.280706] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:24.617 [2024-12-08 02:07:52.280789] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1997063 ] 00:05:24.617 EAL: No free 2048 kB hugepages reported on node 1 00:05:24.617 [2024-12-08 02:07:52.341613] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:24.875 [2024-12-08 02:07:52.460923] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:24.875 02:07:52 -- accel/accel.sh@21 -- # val= 00:05:24.875 02:07:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.875 02:07:52 -- accel/accel.sh@20 -- # IFS=: 00:05:24.875 02:07:52 -- accel/accel.sh@20 -- # read -r var val 00:05:24.875 02:07:52 -- accel/accel.sh@21 -- # val= 00:05:24.875 02:07:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.875 02:07:52 -- accel/accel.sh@20 -- # IFS=: 00:05:24.875 02:07:52 -- accel/accel.sh@20 -- # read -r var val 00:05:24.875 02:07:52 -- accel/accel.sh@21 -- # val=0x1 00:05:24.875 02:07:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.875 02:07:52 -- accel/accel.sh@20 -- # IFS=: 00:05:24.875 02:07:52 -- accel/accel.sh@20 -- # read -r var val 00:05:24.875 02:07:52 -- accel/accel.sh@21 -- # val= 00:05:24.875 02:07:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.875 02:07:52 -- accel/accel.sh@20 -- # IFS=: 00:05:24.875 02:07:52 -- accel/accel.sh@20 -- # read -r var val 00:05:24.875 02:07:52 -- accel/accel.sh@21 -- # val= 00:05:24.875 02:07:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.875 02:07:52 -- accel/accel.sh@20 -- # IFS=: 00:05:24.875 02:07:52 -- accel/accel.sh@20 -- # read -r var val 00:05:24.875 02:07:52 -- accel/accel.sh@21 -- # val=xor 00:05:24.875 02:07:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.875 02:07:52 -- accel/accel.sh@24 -- # accel_opc=xor 00:05:24.875 02:07:52 -- accel/accel.sh@20 -- # IFS=: 00:05:24.875 02:07:52 -- accel/accel.sh@20 -- # read -r var val 00:05:24.875 02:07:52 -- accel/accel.sh@21 -- # val=2 00:05:24.875 02:07:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.875 02:07:52 -- accel/accel.sh@20 -- # IFS=: 00:05:24.875 02:07:52 -- accel/accel.sh@20 -- # read -r var val 00:05:24.875 02:07:52 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:24.875 02:07:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.875 02:07:52 -- accel/accel.sh@20 -- # IFS=: 00:05:24.875 02:07:52 -- accel/accel.sh@20 -- # read -r var val 00:05:24.875 02:07:52 -- accel/accel.sh@21 -- # val= 00:05:24.875 02:07:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.875 02:07:52 -- accel/accel.sh@20 -- # IFS=: 00:05:24.875 02:07:52 -- accel/accel.sh@20 -- # read -r var val 00:05:24.875 02:07:52 -- accel/accel.sh@21 -- # val=software 00:05:24.875 02:07:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.875 02:07:52 -- accel/accel.sh@23 -- # accel_module=software 00:05:24.875 02:07:52 -- accel/accel.sh@20 -- # IFS=: 00:05:24.875 02:07:52 -- accel/accel.sh@20 -- # read -r var val 00:05:24.875 02:07:52 -- accel/accel.sh@21 -- # val=32 00:05:24.875 02:07:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.875 02:07:52 -- accel/accel.sh@20 -- # IFS=: 00:05:24.875 02:07:52 -- accel/accel.sh@20 -- # read -r var val 00:05:24.875 02:07:52 -- accel/accel.sh@21 -- # val=32 00:05:24.875 02:07:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.875 02:07:52 -- accel/accel.sh@20 -- # IFS=: 00:05:24.875 02:07:52 -- accel/accel.sh@20 -- # read -r var val 00:05:24.875 02:07:52 -- accel/accel.sh@21 -- # val=1 00:05:24.875 02:07:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.875 02:07:52 -- accel/accel.sh@20 -- # IFS=: 00:05:24.875 02:07:52 -- accel/accel.sh@20 -- # read -r var val 00:05:24.875 02:07:52 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:24.875 02:07:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.875 02:07:52 -- accel/accel.sh@20 -- # IFS=: 00:05:24.875 02:07:52 -- accel/accel.sh@20 -- # read -r var val 00:05:24.875 02:07:52 -- accel/accel.sh@21 -- # val=Yes 00:05:24.875 02:07:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.875 02:07:52 -- accel/accel.sh@20 -- # IFS=: 00:05:24.875 02:07:52 -- accel/accel.sh@20 -- # read -r var val 00:05:24.875 02:07:52 -- accel/accel.sh@21 -- # val= 00:05:24.875 02:07:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.875 02:07:52 -- accel/accel.sh@20 -- # IFS=: 00:05:24.875 02:07:52 -- accel/accel.sh@20 -- # read -r var val 00:05:24.875 02:07:52 -- accel/accel.sh@21 -- # val= 00:05:24.875 02:07:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.875 02:07:52 -- accel/accel.sh@20 -- # IFS=: 00:05:24.875 02:07:52 -- accel/accel.sh@20 -- # read -r var val 00:05:26.248 02:07:53 -- accel/accel.sh@21 -- # val= 00:05:26.248 02:07:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.248 02:07:53 -- accel/accel.sh@20 -- # IFS=: 00:05:26.248 02:07:53 -- accel/accel.sh@20 -- # read -r var val 00:05:26.248 02:07:53 -- accel/accel.sh@21 -- # val= 00:05:26.248 02:07:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.248 02:07:53 -- accel/accel.sh@20 -- # IFS=: 00:05:26.248 02:07:53 -- accel/accel.sh@20 -- # read -r var val 00:05:26.248 02:07:53 -- accel/accel.sh@21 -- # val= 00:05:26.248 02:07:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.248 02:07:53 -- accel/accel.sh@20 -- # IFS=: 00:05:26.248 02:07:53 -- accel/accel.sh@20 -- # read -r var val 00:05:26.248 02:07:53 -- accel/accel.sh@21 -- # val= 00:05:26.248 02:07:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.248 02:07:53 -- accel/accel.sh@20 -- # IFS=: 00:05:26.248 02:07:53 -- accel/accel.sh@20 -- # read -r var val 00:05:26.248 02:07:53 -- accel/accel.sh@21 -- # val= 00:05:26.248 02:07:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.248 02:07:53 -- accel/accel.sh@20 -- # IFS=: 00:05:26.248 02:07:53 -- accel/accel.sh@20 -- # read -r var val 00:05:26.248 02:07:53 -- accel/accel.sh@21 -- # val= 00:05:26.248 02:07:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.248 02:07:53 -- accel/accel.sh@20 -- # IFS=: 00:05:26.248 02:07:53 -- accel/accel.sh@20 -- # read -r var val 00:05:26.248 02:07:53 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:26.248 02:07:53 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:05:26.248 02:07:53 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:26.248 00:05:26.248 real 0m2.958s 00:05:26.248 user 0m2.663s 00:05:26.248 sys 0m0.285s 00:05:26.248 02:07:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:26.248 02:07:53 -- common/autotest_common.sh@10 -- # set +x 00:05:26.248 ************************************ 00:05:26.248 END TEST accel_xor 00:05:26.248 ************************************ 00:05:26.248 02:07:53 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:05:26.248 02:07:53 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:26.248 02:07:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:26.248 02:07:53 -- common/autotest_common.sh@10 -- # set +x 00:05:26.248 ************************************ 00:05:26.248 START TEST accel_xor 00:05:26.248 ************************************ 00:05:26.248 02:07:53 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y -x 3 00:05:26.248 02:07:53 -- accel/accel.sh@16 -- # local accel_opc 00:05:26.248 02:07:53 -- accel/accel.sh@17 -- # local accel_module 00:05:26.248 02:07:53 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:05:26.248 02:07:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:05:26.248 02:07:53 -- accel/accel.sh@12 -- # build_accel_config 00:05:26.248 02:07:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:26.248 02:07:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:26.248 02:07:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:26.248 02:07:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:26.248 02:07:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:26.248 02:07:53 -- accel/accel.sh@41 -- # local IFS=, 00:05:26.248 02:07:53 -- accel/accel.sh@42 -- # jq -r . 00:05:26.248 [2024-12-08 02:07:53.795499] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:26.248 [2024-12-08 02:07:53.795596] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1997223 ] 00:05:26.248 EAL: No free 2048 kB hugepages reported on node 1 00:05:26.248 [2024-12-08 02:07:53.859891] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:26.248 [2024-12-08 02:07:53.978532] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:27.621 02:07:55 -- accel/accel.sh@18 -- # out=' 00:05:27.621 SPDK Configuration: 00:05:27.621 Core mask: 0x1 00:05:27.621 00:05:27.621 Accel Perf Configuration: 00:05:27.621 Workload Type: xor 00:05:27.621 Source buffers: 3 00:05:27.621 Transfer size: 4096 bytes 00:05:27.621 Vector count 1 00:05:27.621 Module: software 00:05:27.621 Queue depth: 32 00:05:27.621 Allocate depth: 32 00:05:27.621 # threads/core: 1 00:05:27.621 Run time: 1 seconds 00:05:27.621 Verify: Yes 00:05:27.621 00:05:27.621 Running for 1 seconds... 00:05:27.621 00:05:27.621 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:27.621 ------------------------------------------------------------------------------------ 00:05:27.621 0,0 182272/s 712 MiB/s 0 0 00:05:27.621 ==================================================================================== 00:05:27.621 Total 182272/s 712 MiB/s 0 0' 00:05:27.621 02:07:55 -- accel/accel.sh@20 -- # IFS=: 00:05:27.621 02:07:55 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:05:27.621 02:07:55 -- accel/accel.sh@20 -- # read -r var val 00:05:27.621 02:07:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:05:27.621 02:07:55 -- accel/accel.sh@12 -- # build_accel_config 00:05:27.621 02:07:55 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:27.621 02:07:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:27.621 02:07:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:27.621 02:07:55 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:27.621 02:07:55 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:27.621 02:07:55 -- accel/accel.sh@41 -- # local IFS=, 00:05:27.621 02:07:55 -- accel/accel.sh@42 -- # jq -r . 00:05:27.621 [2024-12-08 02:07:55.283301] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:27.621 [2024-12-08 02:07:55.283385] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1997363 ] 00:05:27.621 EAL: No free 2048 kB hugepages reported on node 1 00:05:27.621 [2024-12-08 02:07:55.344310] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:27.878 [2024-12-08 02:07:55.468033] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:27.878 02:07:55 -- accel/accel.sh@21 -- # val= 00:05:27.878 02:07:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.878 02:07:55 -- accel/accel.sh@20 -- # IFS=: 00:05:27.878 02:07:55 -- accel/accel.sh@20 -- # read -r var val 00:05:27.878 02:07:55 -- accel/accel.sh@21 -- # val= 00:05:27.878 02:07:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.878 02:07:55 -- accel/accel.sh@20 -- # IFS=: 00:05:27.878 02:07:55 -- accel/accel.sh@20 -- # read -r var val 00:05:27.878 02:07:55 -- accel/accel.sh@21 -- # val=0x1 00:05:27.878 02:07:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.878 02:07:55 -- accel/accel.sh@20 -- # IFS=: 00:05:27.878 02:07:55 -- accel/accel.sh@20 -- # read -r var val 00:05:27.878 02:07:55 -- accel/accel.sh@21 -- # val= 00:05:27.878 02:07:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.878 02:07:55 -- accel/accel.sh@20 -- # IFS=: 00:05:27.878 02:07:55 -- accel/accel.sh@20 -- # read -r var val 00:05:27.878 02:07:55 -- accel/accel.sh@21 -- # val= 00:05:27.878 02:07:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.878 02:07:55 -- accel/accel.sh@20 -- # IFS=: 00:05:27.878 02:07:55 -- accel/accel.sh@20 -- # read -r var val 00:05:27.878 02:07:55 -- accel/accel.sh@21 -- # val=xor 00:05:27.878 02:07:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.878 02:07:55 -- accel/accel.sh@24 -- # accel_opc=xor 00:05:27.878 02:07:55 -- accel/accel.sh@20 -- # IFS=: 00:05:27.878 02:07:55 -- accel/accel.sh@20 -- # read -r var val 00:05:27.878 02:07:55 -- accel/accel.sh@21 -- # val=3 00:05:27.878 02:07:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.878 02:07:55 -- accel/accel.sh@20 -- # IFS=: 00:05:27.878 02:07:55 -- accel/accel.sh@20 -- # read -r var val 00:05:27.878 02:07:55 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:27.878 02:07:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.878 02:07:55 -- accel/accel.sh@20 -- # IFS=: 00:05:27.878 02:07:55 -- accel/accel.sh@20 -- # read -r var val 00:05:27.878 02:07:55 -- accel/accel.sh@21 -- # val= 00:05:27.878 02:07:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.878 02:07:55 -- accel/accel.sh@20 -- # IFS=: 00:05:27.878 02:07:55 -- accel/accel.sh@20 -- # read -r var val 00:05:27.878 02:07:55 -- accel/accel.sh@21 -- # val=software 00:05:27.878 02:07:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.879 02:07:55 -- accel/accel.sh@23 -- # accel_module=software 00:05:27.879 02:07:55 -- accel/accel.sh@20 -- # IFS=: 00:05:27.879 02:07:55 -- accel/accel.sh@20 -- # read -r var val 00:05:27.879 02:07:55 -- accel/accel.sh@21 -- # val=32 00:05:27.879 02:07:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.879 02:07:55 -- accel/accel.sh@20 -- # IFS=: 00:05:27.879 02:07:55 -- accel/accel.sh@20 -- # read -r var val 00:05:27.879 02:07:55 -- accel/accel.sh@21 -- # val=32 00:05:27.879 02:07:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.879 02:07:55 -- accel/accel.sh@20 -- # IFS=: 00:05:27.879 02:07:55 -- accel/accel.sh@20 -- # read -r var val 00:05:27.879 02:07:55 -- accel/accel.sh@21 -- # val=1 00:05:27.879 02:07:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.879 02:07:55 -- accel/accel.sh@20 -- # IFS=: 00:05:27.879 02:07:55 -- accel/accel.sh@20 -- # read -r var val 00:05:27.879 02:07:55 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:27.879 02:07:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.879 02:07:55 -- accel/accel.sh@20 -- # IFS=: 00:05:27.879 02:07:55 -- accel/accel.sh@20 -- # read -r var val 00:05:27.879 02:07:55 -- accel/accel.sh@21 -- # val=Yes 00:05:27.879 02:07:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.879 02:07:55 -- accel/accel.sh@20 -- # IFS=: 00:05:27.879 02:07:55 -- accel/accel.sh@20 -- # read -r var val 00:05:27.879 02:07:55 -- accel/accel.sh@21 -- # val= 00:05:27.879 02:07:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.879 02:07:55 -- accel/accel.sh@20 -- # IFS=: 00:05:27.879 02:07:55 -- accel/accel.sh@20 -- # read -r var val 00:05:27.879 02:07:55 -- accel/accel.sh@21 -- # val= 00:05:27.879 02:07:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.879 02:07:55 -- accel/accel.sh@20 -- # IFS=: 00:05:27.879 02:07:55 -- accel/accel.sh@20 -- # read -r var val 00:05:29.250 02:07:56 -- accel/accel.sh@21 -- # val= 00:05:29.250 02:07:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.250 02:07:56 -- accel/accel.sh@20 -- # IFS=: 00:05:29.250 02:07:56 -- accel/accel.sh@20 -- # read -r var val 00:05:29.250 02:07:56 -- accel/accel.sh@21 -- # val= 00:05:29.250 02:07:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.250 02:07:56 -- accel/accel.sh@20 -- # IFS=: 00:05:29.250 02:07:56 -- accel/accel.sh@20 -- # read -r var val 00:05:29.250 02:07:56 -- accel/accel.sh@21 -- # val= 00:05:29.250 02:07:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.250 02:07:56 -- accel/accel.sh@20 -- # IFS=: 00:05:29.250 02:07:56 -- accel/accel.sh@20 -- # read -r var val 00:05:29.250 02:07:56 -- accel/accel.sh@21 -- # val= 00:05:29.250 02:07:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.250 02:07:56 -- accel/accel.sh@20 -- # IFS=: 00:05:29.250 02:07:56 -- accel/accel.sh@20 -- # read -r var val 00:05:29.250 02:07:56 -- accel/accel.sh@21 -- # val= 00:05:29.250 02:07:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.250 02:07:56 -- accel/accel.sh@20 -- # IFS=: 00:05:29.250 02:07:56 -- accel/accel.sh@20 -- # read -r var val 00:05:29.250 02:07:56 -- accel/accel.sh@21 -- # val= 00:05:29.250 02:07:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.250 02:07:56 -- accel/accel.sh@20 -- # IFS=: 00:05:29.250 02:07:56 -- accel/accel.sh@20 -- # read -r var val 00:05:29.250 02:07:56 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:29.250 02:07:56 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:05:29.250 02:07:56 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:29.250 00:05:29.250 real 0m2.970s 00:05:29.250 user 0m2.666s 00:05:29.250 sys 0m0.294s 00:05:29.250 02:07:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:29.250 02:07:56 -- common/autotest_common.sh@10 -- # set +x 00:05:29.250 ************************************ 00:05:29.250 END TEST accel_xor 00:05:29.250 ************************************ 00:05:29.250 02:07:56 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:05:29.250 02:07:56 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:29.250 02:07:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:29.250 02:07:56 -- common/autotest_common.sh@10 -- # set +x 00:05:29.250 ************************************ 00:05:29.250 START TEST accel_dif_verify 00:05:29.250 ************************************ 00:05:29.250 02:07:56 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_verify 00:05:29.250 02:07:56 -- accel/accel.sh@16 -- # local accel_opc 00:05:29.250 02:07:56 -- accel/accel.sh@17 -- # local accel_module 00:05:29.250 02:07:56 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:05:29.250 02:07:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:05:29.250 02:07:56 -- accel/accel.sh@12 -- # build_accel_config 00:05:29.250 02:07:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:29.250 02:07:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:29.250 02:07:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:29.250 02:07:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:29.250 02:07:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:29.250 02:07:56 -- accel/accel.sh@41 -- # local IFS=, 00:05:29.250 02:07:56 -- accel/accel.sh@42 -- # jq -r . 00:05:29.250 [2024-12-08 02:07:56.789833] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:29.250 [2024-12-08 02:07:56.789915] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1997643 ] 00:05:29.250 EAL: No free 2048 kB hugepages reported on node 1 00:05:29.250 [2024-12-08 02:07:56.851209] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:29.250 [2024-12-08 02:07:56.970630] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:30.625 02:07:58 -- accel/accel.sh@18 -- # out=' 00:05:30.625 SPDK Configuration: 00:05:30.625 Core mask: 0x1 00:05:30.625 00:05:30.625 Accel Perf Configuration: 00:05:30.625 Workload Type: dif_verify 00:05:30.625 Vector size: 4096 bytes 00:05:30.625 Transfer size: 4096 bytes 00:05:30.625 Block size: 512 bytes 00:05:30.625 Metadata size: 8 bytes 00:05:30.625 Vector count 1 00:05:30.625 Module: software 00:05:30.625 Queue depth: 32 00:05:30.625 Allocate depth: 32 00:05:30.625 # threads/core: 1 00:05:30.625 Run time: 1 seconds 00:05:30.625 Verify: No 00:05:30.625 00:05:30.625 Running for 1 seconds... 00:05:30.625 00:05:30.625 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:30.625 ------------------------------------------------------------------------------------ 00:05:30.625 0,0 81728/s 324 MiB/s 0 0 00:05:30.625 ==================================================================================== 00:05:30.625 Total 81728/s 319 MiB/s 0 0' 00:05:30.625 02:07:58 -- accel/accel.sh@20 -- # IFS=: 00:05:30.625 02:07:58 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:05:30.625 02:07:58 -- accel/accel.sh@20 -- # read -r var val 00:05:30.625 02:07:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:05:30.625 02:07:58 -- accel/accel.sh@12 -- # build_accel_config 00:05:30.625 02:07:58 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:30.625 02:07:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:30.625 02:07:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:30.625 02:07:58 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:30.625 02:07:58 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:30.625 02:07:58 -- accel/accel.sh@41 -- # local IFS=, 00:05:30.625 02:07:58 -- accel/accel.sh@42 -- # jq -r . 00:05:30.625 [2024-12-08 02:07:58.258610] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:30.625 [2024-12-08 02:07:58.258698] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1997791 ] 00:05:30.625 EAL: No free 2048 kB hugepages reported on node 1 00:05:30.625 [2024-12-08 02:07:58.321589] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:30.884 [2024-12-08 02:07:58.442339] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:30.884 02:07:58 -- accel/accel.sh@21 -- # val= 00:05:30.884 02:07:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.884 02:07:58 -- accel/accel.sh@20 -- # IFS=: 00:05:30.884 02:07:58 -- accel/accel.sh@20 -- # read -r var val 00:05:30.884 02:07:58 -- accel/accel.sh@21 -- # val= 00:05:30.884 02:07:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.884 02:07:58 -- accel/accel.sh@20 -- # IFS=: 00:05:30.884 02:07:58 -- accel/accel.sh@20 -- # read -r var val 00:05:30.884 02:07:58 -- accel/accel.sh@21 -- # val=0x1 00:05:30.884 02:07:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.884 02:07:58 -- accel/accel.sh@20 -- # IFS=: 00:05:30.884 02:07:58 -- accel/accel.sh@20 -- # read -r var val 00:05:30.884 02:07:58 -- accel/accel.sh@21 -- # val= 00:05:30.884 02:07:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.884 02:07:58 -- accel/accel.sh@20 -- # IFS=: 00:05:30.884 02:07:58 -- accel/accel.sh@20 -- # read -r var val 00:05:30.884 02:07:58 -- accel/accel.sh@21 -- # val= 00:05:30.884 02:07:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.884 02:07:58 -- accel/accel.sh@20 -- # IFS=: 00:05:30.884 02:07:58 -- accel/accel.sh@20 -- # read -r var val 00:05:30.884 02:07:58 -- accel/accel.sh@21 -- # val=dif_verify 00:05:30.884 02:07:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.884 02:07:58 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:05:30.884 02:07:58 -- accel/accel.sh@20 -- # IFS=: 00:05:30.884 02:07:58 -- accel/accel.sh@20 -- # read -r var val 00:05:30.884 02:07:58 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:30.884 02:07:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.884 02:07:58 -- accel/accel.sh@20 -- # IFS=: 00:05:30.884 02:07:58 -- accel/accel.sh@20 -- # read -r var val 00:05:30.884 02:07:58 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:30.884 02:07:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.884 02:07:58 -- accel/accel.sh@20 -- # IFS=: 00:05:30.884 02:07:58 -- accel/accel.sh@20 -- # read -r var val 00:05:30.884 02:07:58 -- accel/accel.sh@21 -- # val='512 bytes' 00:05:30.884 02:07:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.884 02:07:58 -- accel/accel.sh@20 -- # IFS=: 00:05:30.884 02:07:58 -- accel/accel.sh@20 -- # read -r var val 00:05:30.884 02:07:58 -- accel/accel.sh@21 -- # val='8 bytes' 00:05:30.884 02:07:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.884 02:07:58 -- accel/accel.sh@20 -- # IFS=: 00:05:30.884 02:07:58 -- accel/accel.sh@20 -- # read -r var val 00:05:30.884 02:07:58 -- accel/accel.sh@21 -- # val= 00:05:30.884 02:07:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.884 02:07:58 -- accel/accel.sh@20 -- # IFS=: 00:05:30.884 02:07:58 -- accel/accel.sh@20 -- # read -r var val 00:05:30.884 02:07:58 -- accel/accel.sh@21 -- # val=software 00:05:30.884 02:07:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.884 02:07:58 -- accel/accel.sh@23 -- # accel_module=software 00:05:30.884 02:07:58 -- accel/accel.sh@20 -- # IFS=: 00:05:30.884 02:07:58 -- accel/accel.sh@20 -- # read -r var val 00:05:30.884 02:07:58 -- accel/accel.sh@21 -- # val=32 00:05:30.884 02:07:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.884 02:07:58 -- accel/accel.sh@20 -- # IFS=: 00:05:30.884 02:07:58 -- accel/accel.sh@20 -- # read -r var val 00:05:30.884 02:07:58 -- accel/accel.sh@21 -- # val=32 00:05:30.884 02:07:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.884 02:07:58 -- accel/accel.sh@20 -- # IFS=: 00:05:30.884 02:07:58 -- accel/accel.sh@20 -- # read -r var val 00:05:30.884 02:07:58 -- accel/accel.sh@21 -- # val=1 00:05:30.884 02:07:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.884 02:07:58 -- accel/accel.sh@20 -- # IFS=: 00:05:30.884 02:07:58 -- accel/accel.sh@20 -- # read -r var val 00:05:30.884 02:07:58 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:30.885 02:07:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.885 02:07:58 -- accel/accel.sh@20 -- # IFS=: 00:05:30.885 02:07:58 -- accel/accel.sh@20 -- # read -r var val 00:05:30.885 02:07:58 -- accel/accel.sh@21 -- # val=No 00:05:30.885 02:07:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.885 02:07:58 -- accel/accel.sh@20 -- # IFS=: 00:05:30.885 02:07:58 -- accel/accel.sh@20 -- # read -r var val 00:05:30.885 02:07:58 -- accel/accel.sh@21 -- # val= 00:05:30.885 02:07:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.885 02:07:58 -- accel/accel.sh@20 -- # IFS=: 00:05:30.885 02:07:58 -- accel/accel.sh@20 -- # read -r var val 00:05:30.885 02:07:58 -- accel/accel.sh@21 -- # val= 00:05:30.885 02:07:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.885 02:07:58 -- accel/accel.sh@20 -- # IFS=: 00:05:30.885 02:07:58 -- accel/accel.sh@20 -- # read -r var val 00:05:32.259 02:07:59 -- accel/accel.sh@21 -- # val= 00:05:32.259 02:07:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.259 02:07:59 -- accel/accel.sh@20 -- # IFS=: 00:05:32.259 02:07:59 -- accel/accel.sh@20 -- # read -r var val 00:05:32.259 02:07:59 -- accel/accel.sh@21 -- # val= 00:05:32.259 02:07:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.259 02:07:59 -- accel/accel.sh@20 -- # IFS=: 00:05:32.259 02:07:59 -- accel/accel.sh@20 -- # read -r var val 00:05:32.259 02:07:59 -- accel/accel.sh@21 -- # val= 00:05:32.259 02:07:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.259 02:07:59 -- accel/accel.sh@20 -- # IFS=: 00:05:32.259 02:07:59 -- accel/accel.sh@20 -- # read -r var val 00:05:32.259 02:07:59 -- accel/accel.sh@21 -- # val= 00:05:32.259 02:07:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.259 02:07:59 -- accel/accel.sh@20 -- # IFS=: 00:05:32.259 02:07:59 -- accel/accel.sh@20 -- # read -r var val 00:05:32.259 02:07:59 -- accel/accel.sh@21 -- # val= 00:05:32.259 02:07:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.259 02:07:59 -- accel/accel.sh@20 -- # IFS=: 00:05:32.259 02:07:59 -- accel/accel.sh@20 -- # read -r var val 00:05:32.259 02:07:59 -- accel/accel.sh@21 -- # val= 00:05:32.259 02:07:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.259 02:07:59 -- accel/accel.sh@20 -- # IFS=: 00:05:32.259 02:07:59 -- accel/accel.sh@20 -- # read -r var val 00:05:32.259 02:07:59 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:32.259 02:07:59 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:05:32.259 02:07:59 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:32.259 00:05:32.259 real 0m2.958s 00:05:32.259 user 0m2.663s 00:05:32.259 sys 0m0.288s 00:05:32.259 02:07:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:32.259 02:07:59 -- common/autotest_common.sh@10 -- # set +x 00:05:32.259 ************************************ 00:05:32.259 END TEST accel_dif_verify 00:05:32.259 ************************************ 00:05:32.259 02:07:59 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:05:32.259 02:07:59 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:32.259 02:07:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:32.259 02:07:59 -- common/autotest_common.sh@10 -- # set +x 00:05:32.259 ************************************ 00:05:32.259 START TEST accel_dif_generate 00:05:32.259 ************************************ 00:05:32.259 02:07:59 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate 00:05:32.259 02:07:59 -- accel/accel.sh@16 -- # local accel_opc 00:05:32.259 02:07:59 -- accel/accel.sh@17 -- # local accel_module 00:05:32.259 02:07:59 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:05:32.259 02:07:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:05:32.259 02:07:59 -- accel/accel.sh@12 -- # build_accel_config 00:05:32.259 02:07:59 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:32.259 02:07:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:32.259 02:07:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:32.259 02:07:59 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:32.259 02:07:59 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:32.259 02:07:59 -- accel/accel.sh@41 -- # local IFS=, 00:05:32.259 02:07:59 -- accel/accel.sh@42 -- # jq -r . 00:05:32.259 [2024-12-08 02:07:59.775818] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:32.260 [2024-12-08 02:07:59.775903] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1997950 ] 00:05:32.260 EAL: No free 2048 kB hugepages reported on node 1 00:05:32.260 [2024-12-08 02:07:59.836784] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:32.260 [2024-12-08 02:07:59.957580] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:33.634 02:08:01 -- accel/accel.sh@18 -- # out=' 00:05:33.634 SPDK Configuration: 00:05:33.634 Core mask: 0x1 00:05:33.634 00:05:33.634 Accel Perf Configuration: 00:05:33.634 Workload Type: dif_generate 00:05:33.634 Vector size: 4096 bytes 00:05:33.634 Transfer size: 4096 bytes 00:05:33.634 Block size: 512 bytes 00:05:33.634 Metadata size: 8 bytes 00:05:33.634 Vector count 1 00:05:33.634 Module: software 00:05:33.634 Queue depth: 32 00:05:33.634 Allocate depth: 32 00:05:33.634 # threads/core: 1 00:05:33.634 Run time: 1 seconds 00:05:33.634 Verify: No 00:05:33.634 00:05:33.634 Running for 1 seconds... 00:05:33.634 00:05:33.634 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:33.634 ------------------------------------------------------------------------------------ 00:05:33.634 0,0 96096/s 381 MiB/s 0 0 00:05:33.634 ==================================================================================== 00:05:33.634 Total 96096/s 375 MiB/s 0 0' 00:05:33.634 02:08:01 -- accel/accel.sh@20 -- # IFS=: 00:05:33.634 02:08:01 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:05:33.634 02:08:01 -- accel/accel.sh@20 -- # read -r var val 00:05:33.634 02:08:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:05:33.634 02:08:01 -- accel/accel.sh@12 -- # build_accel_config 00:05:33.634 02:08:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:33.634 02:08:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:33.634 02:08:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:33.634 02:08:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:33.634 02:08:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:33.634 02:08:01 -- accel/accel.sh@41 -- # local IFS=, 00:05:33.634 02:08:01 -- accel/accel.sh@42 -- # jq -r . 00:05:33.634 [2024-12-08 02:08:01.252716] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:33.634 [2024-12-08 02:08:01.252804] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1998209 ] 00:05:33.634 EAL: No free 2048 kB hugepages reported on node 1 00:05:33.634 [2024-12-08 02:08:01.314498] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:33.892 [2024-12-08 02:08:01.433601] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:33.892 02:08:01 -- accel/accel.sh@21 -- # val= 00:05:33.892 02:08:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.892 02:08:01 -- accel/accel.sh@20 -- # IFS=: 00:05:33.892 02:08:01 -- accel/accel.sh@20 -- # read -r var val 00:05:33.892 02:08:01 -- accel/accel.sh@21 -- # val= 00:05:33.892 02:08:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.892 02:08:01 -- accel/accel.sh@20 -- # IFS=: 00:05:33.892 02:08:01 -- accel/accel.sh@20 -- # read -r var val 00:05:33.892 02:08:01 -- accel/accel.sh@21 -- # val=0x1 00:05:33.892 02:08:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.892 02:08:01 -- accel/accel.sh@20 -- # IFS=: 00:05:33.892 02:08:01 -- accel/accel.sh@20 -- # read -r var val 00:05:33.892 02:08:01 -- accel/accel.sh@21 -- # val= 00:05:33.892 02:08:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.892 02:08:01 -- accel/accel.sh@20 -- # IFS=: 00:05:33.892 02:08:01 -- accel/accel.sh@20 -- # read -r var val 00:05:33.892 02:08:01 -- accel/accel.sh@21 -- # val= 00:05:33.892 02:08:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.892 02:08:01 -- accel/accel.sh@20 -- # IFS=: 00:05:33.892 02:08:01 -- accel/accel.sh@20 -- # read -r var val 00:05:33.892 02:08:01 -- accel/accel.sh@21 -- # val=dif_generate 00:05:33.892 02:08:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.892 02:08:01 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:05:33.892 02:08:01 -- accel/accel.sh@20 -- # IFS=: 00:05:33.892 02:08:01 -- accel/accel.sh@20 -- # read -r var val 00:05:33.892 02:08:01 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:33.892 02:08:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.892 02:08:01 -- accel/accel.sh@20 -- # IFS=: 00:05:33.892 02:08:01 -- accel/accel.sh@20 -- # read -r var val 00:05:33.892 02:08:01 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:33.892 02:08:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.892 02:08:01 -- accel/accel.sh@20 -- # IFS=: 00:05:33.892 02:08:01 -- accel/accel.sh@20 -- # read -r var val 00:05:33.892 02:08:01 -- accel/accel.sh@21 -- # val='512 bytes' 00:05:33.893 02:08:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.893 02:08:01 -- accel/accel.sh@20 -- # IFS=: 00:05:33.893 02:08:01 -- accel/accel.sh@20 -- # read -r var val 00:05:33.893 02:08:01 -- accel/accel.sh@21 -- # val='8 bytes' 00:05:33.893 02:08:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.893 02:08:01 -- accel/accel.sh@20 -- # IFS=: 00:05:33.893 02:08:01 -- accel/accel.sh@20 -- # read -r var val 00:05:33.893 02:08:01 -- accel/accel.sh@21 -- # val= 00:05:33.893 02:08:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.893 02:08:01 -- accel/accel.sh@20 -- # IFS=: 00:05:33.893 02:08:01 -- accel/accel.sh@20 -- # read -r var val 00:05:33.893 02:08:01 -- accel/accel.sh@21 -- # val=software 00:05:33.893 02:08:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.893 02:08:01 -- accel/accel.sh@23 -- # accel_module=software 00:05:33.893 02:08:01 -- accel/accel.sh@20 -- # IFS=: 00:05:33.893 02:08:01 -- accel/accel.sh@20 -- # read -r var val 00:05:33.893 02:08:01 -- accel/accel.sh@21 -- # val=32 00:05:33.893 02:08:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.893 02:08:01 -- accel/accel.sh@20 -- # IFS=: 00:05:33.893 02:08:01 -- accel/accel.sh@20 -- # read -r var val 00:05:33.893 02:08:01 -- accel/accel.sh@21 -- # val=32 00:05:33.893 02:08:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.893 02:08:01 -- accel/accel.sh@20 -- # IFS=: 00:05:33.893 02:08:01 -- accel/accel.sh@20 -- # read -r var val 00:05:33.893 02:08:01 -- accel/accel.sh@21 -- # val=1 00:05:33.893 02:08:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.893 02:08:01 -- accel/accel.sh@20 -- # IFS=: 00:05:33.893 02:08:01 -- accel/accel.sh@20 -- # read -r var val 00:05:33.893 02:08:01 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:33.893 02:08:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.893 02:08:01 -- accel/accel.sh@20 -- # IFS=: 00:05:33.893 02:08:01 -- accel/accel.sh@20 -- # read -r var val 00:05:33.893 02:08:01 -- accel/accel.sh@21 -- # val=No 00:05:33.893 02:08:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.893 02:08:01 -- accel/accel.sh@20 -- # IFS=: 00:05:33.893 02:08:01 -- accel/accel.sh@20 -- # read -r var val 00:05:33.893 02:08:01 -- accel/accel.sh@21 -- # val= 00:05:33.893 02:08:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.893 02:08:01 -- accel/accel.sh@20 -- # IFS=: 00:05:33.893 02:08:01 -- accel/accel.sh@20 -- # read -r var val 00:05:33.893 02:08:01 -- accel/accel.sh@21 -- # val= 00:05:33.893 02:08:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.893 02:08:01 -- accel/accel.sh@20 -- # IFS=: 00:05:33.893 02:08:01 -- accel/accel.sh@20 -- # read -r var val 00:05:35.268 02:08:02 -- accel/accel.sh@21 -- # val= 00:05:35.268 02:08:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.268 02:08:02 -- accel/accel.sh@20 -- # IFS=: 00:05:35.268 02:08:02 -- accel/accel.sh@20 -- # read -r var val 00:05:35.268 02:08:02 -- accel/accel.sh@21 -- # val= 00:05:35.268 02:08:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.268 02:08:02 -- accel/accel.sh@20 -- # IFS=: 00:05:35.268 02:08:02 -- accel/accel.sh@20 -- # read -r var val 00:05:35.268 02:08:02 -- accel/accel.sh@21 -- # val= 00:05:35.268 02:08:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.268 02:08:02 -- accel/accel.sh@20 -- # IFS=: 00:05:35.268 02:08:02 -- accel/accel.sh@20 -- # read -r var val 00:05:35.268 02:08:02 -- accel/accel.sh@21 -- # val= 00:05:35.268 02:08:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.268 02:08:02 -- accel/accel.sh@20 -- # IFS=: 00:05:35.268 02:08:02 -- accel/accel.sh@20 -- # read -r var val 00:05:35.268 02:08:02 -- accel/accel.sh@21 -- # val= 00:05:35.268 02:08:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.268 02:08:02 -- accel/accel.sh@20 -- # IFS=: 00:05:35.268 02:08:02 -- accel/accel.sh@20 -- # read -r var val 00:05:35.268 02:08:02 -- accel/accel.sh@21 -- # val= 00:05:35.268 02:08:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.268 02:08:02 -- accel/accel.sh@20 -- # IFS=: 00:05:35.269 02:08:02 -- accel/accel.sh@20 -- # read -r var val 00:05:35.269 02:08:02 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:35.269 02:08:02 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:05:35.269 02:08:02 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:35.269 00:05:35.269 real 0m2.952s 00:05:35.269 user 0m2.662s 00:05:35.269 sys 0m0.284s 00:05:35.269 02:08:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:35.269 02:08:02 -- common/autotest_common.sh@10 -- # set +x 00:05:35.269 ************************************ 00:05:35.269 END TEST accel_dif_generate 00:05:35.269 ************************************ 00:05:35.269 02:08:02 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:05:35.269 02:08:02 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:35.269 02:08:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:35.269 02:08:02 -- common/autotest_common.sh@10 -- # set +x 00:05:35.269 ************************************ 00:05:35.269 START TEST accel_dif_generate_copy 00:05:35.269 ************************************ 00:05:35.269 02:08:02 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate_copy 00:05:35.269 02:08:02 -- accel/accel.sh@16 -- # local accel_opc 00:05:35.269 02:08:02 -- accel/accel.sh@17 -- # local accel_module 00:05:35.269 02:08:02 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:05:35.269 02:08:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:05:35.269 02:08:02 -- accel/accel.sh@12 -- # build_accel_config 00:05:35.269 02:08:02 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:35.269 02:08:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:35.269 02:08:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:35.269 02:08:02 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:35.269 02:08:02 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:35.269 02:08:02 -- accel/accel.sh@41 -- # local IFS=, 00:05:35.269 02:08:02 -- accel/accel.sh@42 -- # jq -r . 00:05:35.269 [2024-12-08 02:08:02.750531] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:35.269 [2024-12-08 02:08:02.750621] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1998377 ] 00:05:35.269 EAL: No free 2048 kB hugepages reported on node 1 00:05:35.269 [2024-12-08 02:08:02.814862] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:35.269 [2024-12-08 02:08:02.933755] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:36.643 02:08:04 -- accel/accel.sh@18 -- # out=' 00:05:36.643 SPDK Configuration: 00:05:36.643 Core mask: 0x1 00:05:36.643 00:05:36.643 Accel Perf Configuration: 00:05:36.643 Workload Type: dif_generate_copy 00:05:36.643 Vector size: 4096 bytes 00:05:36.643 Transfer size: 4096 bytes 00:05:36.643 Vector count 1 00:05:36.643 Module: software 00:05:36.643 Queue depth: 32 00:05:36.643 Allocate depth: 32 00:05:36.643 # threads/core: 1 00:05:36.643 Run time: 1 seconds 00:05:36.643 Verify: No 00:05:36.643 00:05:36.643 Running for 1 seconds... 00:05:36.643 00:05:36.643 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:36.643 ------------------------------------------------------------------------------------ 00:05:36.643 0,0 75808/s 300 MiB/s 0 0 00:05:36.643 ==================================================================================== 00:05:36.643 Total 75808/s 296 MiB/s 0 0' 00:05:36.643 02:08:04 -- accel/accel.sh@20 -- # IFS=: 00:05:36.643 02:08:04 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:05:36.643 02:08:04 -- accel/accel.sh@20 -- # read -r var val 00:05:36.643 02:08:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:05:36.643 02:08:04 -- accel/accel.sh@12 -- # build_accel_config 00:05:36.643 02:08:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:36.643 02:08:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:36.643 02:08:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:36.643 02:08:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:36.643 02:08:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:36.643 02:08:04 -- accel/accel.sh@41 -- # local IFS=, 00:05:36.643 02:08:04 -- accel/accel.sh@42 -- # jq -r . 00:05:36.643 [2024-12-08 02:08:04.232077] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:36.643 [2024-12-08 02:08:04.232165] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1998518 ] 00:05:36.643 EAL: No free 2048 kB hugepages reported on node 1 00:05:36.643 [2024-12-08 02:08:04.294308] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:36.643 [2024-12-08 02:08:04.414112] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:36.902 02:08:04 -- accel/accel.sh@21 -- # val= 00:05:36.902 02:08:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.902 02:08:04 -- accel/accel.sh@20 -- # IFS=: 00:05:36.902 02:08:04 -- accel/accel.sh@20 -- # read -r var val 00:05:36.902 02:08:04 -- accel/accel.sh@21 -- # val= 00:05:36.902 02:08:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.902 02:08:04 -- accel/accel.sh@20 -- # IFS=: 00:05:36.902 02:08:04 -- accel/accel.sh@20 -- # read -r var val 00:05:36.902 02:08:04 -- accel/accel.sh@21 -- # val=0x1 00:05:36.902 02:08:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.902 02:08:04 -- accel/accel.sh@20 -- # IFS=: 00:05:36.902 02:08:04 -- accel/accel.sh@20 -- # read -r var val 00:05:36.902 02:08:04 -- accel/accel.sh@21 -- # val= 00:05:36.902 02:08:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.902 02:08:04 -- accel/accel.sh@20 -- # IFS=: 00:05:36.902 02:08:04 -- accel/accel.sh@20 -- # read -r var val 00:05:36.902 02:08:04 -- accel/accel.sh@21 -- # val= 00:05:36.902 02:08:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.902 02:08:04 -- accel/accel.sh@20 -- # IFS=: 00:05:36.902 02:08:04 -- accel/accel.sh@20 -- # read -r var val 00:05:36.902 02:08:04 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:05:36.902 02:08:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.903 02:08:04 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:05:36.903 02:08:04 -- accel/accel.sh@20 -- # IFS=: 00:05:36.903 02:08:04 -- accel/accel.sh@20 -- # read -r var val 00:05:36.903 02:08:04 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:36.903 02:08:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.903 02:08:04 -- accel/accel.sh@20 -- # IFS=: 00:05:36.903 02:08:04 -- accel/accel.sh@20 -- # read -r var val 00:05:36.903 02:08:04 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:36.903 02:08:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.903 02:08:04 -- accel/accel.sh@20 -- # IFS=: 00:05:36.903 02:08:04 -- accel/accel.sh@20 -- # read -r var val 00:05:36.903 02:08:04 -- accel/accel.sh@21 -- # val= 00:05:36.903 02:08:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.903 02:08:04 -- accel/accel.sh@20 -- # IFS=: 00:05:36.903 02:08:04 -- accel/accel.sh@20 -- # read -r var val 00:05:36.903 02:08:04 -- accel/accel.sh@21 -- # val=software 00:05:36.903 02:08:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.903 02:08:04 -- accel/accel.sh@23 -- # accel_module=software 00:05:36.903 02:08:04 -- accel/accel.sh@20 -- # IFS=: 00:05:36.903 02:08:04 -- accel/accel.sh@20 -- # read -r var val 00:05:36.903 02:08:04 -- accel/accel.sh@21 -- # val=32 00:05:36.903 02:08:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.903 02:08:04 -- accel/accel.sh@20 -- # IFS=: 00:05:36.903 02:08:04 -- accel/accel.sh@20 -- # read -r var val 00:05:36.903 02:08:04 -- accel/accel.sh@21 -- # val=32 00:05:36.903 02:08:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.903 02:08:04 -- accel/accel.sh@20 -- # IFS=: 00:05:36.903 02:08:04 -- accel/accel.sh@20 -- # read -r var val 00:05:36.903 02:08:04 -- accel/accel.sh@21 -- # val=1 00:05:36.903 02:08:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.903 02:08:04 -- accel/accel.sh@20 -- # IFS=: 00:05:36.903 02:08:04 -- accel/accel.sh@20 -- # read -r var val 00:05:36.903 02:08:04 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:36.903 02:08:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.903 02:08:04 -- accel/accel.sh@20 -- # IFS=: 00:05:36.903 02:08:04 -- accel/accel.sh@20 -- # read -r var val 00:05:36.903 02:08:04 -- accel/accel.sh@21 -- # val=No 00:05:36.903 02:08:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.903 02:08:04 -- accel/accel.sh@20 -- # IFS=: 00:05:36.903 02:08:04 -- accel/accel.sh@20 -- # read -r var val 00:05:36.903 02:08:04 -- accel/accel.sh@21 -- # val= 00:05:36.903 02:08:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.903 02:08:04 -- accel/accel.sh@20 -- # IFS=: 00:05:36.903 02:08:04 -- accel/accel.sh@20 -- # read -r var val 00:05:36.903 02:08:04 -- accel/accel.sh@21 -- # val= 00:05:36.903 02:08:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.903 02:08:04 -- accel/accel.sh@20 -- # IFS=: 00:05:36.903 02:08:04 -- accel/accel.sh@20 -- # read -r var val 00:05:38.281 02:08:05 -- accel/accel.sh@21 -- # val= 00:05:38.281 02:08:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.281 02:08:05 -- accel/accel.sh@20 -- # IFS=: 00:05:38.281 02:08:05 -- accel/accel.sh@20 -- # read -r var val 00:05:38.281 02:08:05 -- accel/accel.sh@21 -- # val= 00:05:38.281 02:08:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.281 02:08:05 -- accel/accel.sh@20 -- # IFS=: 00:05:38.281 02:08:05 -- accel/accel.sh@20 -- # read -r var val 00:05:38.281 02:08:05 -- accel/accel.sh@21 -- # val= 00:05:38.281 02:08:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.281 02:08:05 -- accel/accel.sh@20 -- # IFS=: 00:05:38.281 02:08:05 -- accel/accel.sh@20 -- # read -r var val 00:05:38.281 02:08:05 -- accel/accel.sh@21 -- # val= 00:05:38.281 02:08:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.281 02:08:05 -- accel/accel.sh@20 -- # IFS=: 00:05:38.281 02:08:05 -- accel/accel.sh@20 -- # read -r var val 00:05:38.281 02:08:05 -- accel/accel.sh@21 -- # val= 00:05:38.281 02:08:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.281 02:08:05 -- accel/accel.sh@20 -- # IFS=: 00:05:38.281 02:08:05 -- accel/accel.sh@20 -- # read -r var val 00:05:38.281 02:08:05 -- accel/accel.sh@21 -- # val= 00:05:38.281 02:08:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.281 02:08:05 -- accel/accel.sh@20 -- # IFS=: 00:05:38.281 02:08:05 -- accel/accel.sh@20 -- # read -r var val 00:05:38.281 02:08:05 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:38.281 02:08:05 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:05:38.281 02:08:05 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:38.281 00:05:38.281 real 0m2.965s 00:05:38.281 user 0m2.658s 00:05:38.281 sys 0m0.298s 00:05:38.281 02:08:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:38.281 02:08:05 -- common/autotest_common.sh@10 -- # set +x 00:05:38.281 ************************************ 00:05:38.281 END TEST accel_dif_generate_copy 00:05:38.281 ************************************ 00:05:38.281 02:08:05 -- accel/accel.sh@107 -- # [[ y == y ]] 00:05:38.281 02:08:05 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:38.281 02:08:05 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:38.281 02:08:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:38.281 02:08:05 -- common/autotest_common.sh@10 -- # set +x 00:05:38.281 ************************************ 00:05:38.281 START TEST accel_comp 00:05:38.281 ************************************ 00:05:38.281 02:08:05 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:38.281 02:08:05 -- accel/accel.sh@16 -- # local accel_opc 00:05:38.281 02:08:05 -- accel/accel.sh@17 -- # local accel_module 00:05:38.281 02:08:05 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:38.281 02:08:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:38.281 02:08:05 -- accel/accel.sh@12 -- # build_accel_config 00:05:38.281 02:08:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:38.281 02:08:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:38.281 02:08:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:38.281 02:08:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:38.281 02:08:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:38.281 02:08:05 -- accel/accel.sh@41 -- # local IFS=, 00:05:38.281 02:08:05 -- accel/accel.sh@42 -- # jq -r . 00:05:38.281 [2024-12-08 02:08:05.742386] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:38.281 [2024-12-08 02:08:05.742468] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1998751 ] 00:05:38.281 EAL: No free 2048 kB hugepages reported on node 1 00:05:38.281 [2024-12-08 02:08:05.805874] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:38.281 [2024-12-08 02:08:05.926622] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:39.655 02:08:07 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:39.655 00:05:39.655 SPDK Configuration: 00:05:39.655 Core mask: 0x1 00:05:39.655 00:05:39.655 Accel Perf Configuration: 00:05:39.655 Workload Type: compress 00:05:39.655 Transfer size: 4096 bytes 00:05:39.655 Vector count 1 00:05:39.655 Module: software 00:05:39.655 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:39.655 Queue depth: 32 00:05:39.655 Allocate depth: 32 00:05:39.655 # threads/core: 1 00:05:39.655 Run time: 1 seconds 00:05:39.655 Verify: No 00:05:39.655 00:05:39.655 Running for 1 seconds... 00:05:39.655 00:05:39.655 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:39.655 ------------------------------------------------------------------------------------ 00:05:39.655 0,0 31456/s 131 MiB/s 0 0 00:05:39.655 ==================================================================================== 00:05:39.655 Total 31456/s 122 MiB/s 0 0' 00:05:39.655 02:08:07 -- accel/accel.sh@20 -- # IFS=: 00:05:39.655 02:08:07 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:39.655 02:08:07 -- accel/accel.sh@20 -- # read -r var val 00:05:39.655 02:08:07 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:39.655 02:08:07 -- accel/accel.sh@12 -- # build_accel_config 00:05:39.655 02:08:07 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:39.655 02:08:07 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:39.655 02:08:07 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:39.655 02:08:07 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:39.655 02:08:07 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:39.655 02:08:07 -- accel/accel.sh@41 -- # local IFS=, 00:05:39.655 02:08:07 -- accel/accel.sh@42 -- # jq -r . 00:05:39.655 [2024-12-08 02:08:07.228897] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:39.655 [2024-12-08 02:08:07.228984] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1998940 ] 00:05:39.655 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.655 [2024-12-08 02:08:07.290357] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:39.655 [2024-12-08 02:08:07.411713] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:39.913 02:08:07 -- accel/accel.sh@21 -- # val= 00:05:39.913 02:08:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.913 02:08:07 -- accel/accel.sh@20 -- # IFS=: 00:05:39.913 02:08:07 -- accel/accel.sh@20 -- # read -r var val 00:05:39.913 02:08:07 -- accel/accel.sh@21 -- # val= 00:05:39.913 02:08:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.913 02:08:07 -- accel/accel.sh@20 -- # IFS=: 00:05:39.913 02:08:07 -- accel/accel.sh@20 -- # read -r var val 00:05:39.913 02:08:07 -- accel/accel.sh@21 -- # val= 00:05:39.913 02:08:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.913 02:08:07 -- accel/accel.sh@20 -- # IFS=: 00:05:39.913 02:08:07 -- accel/accel.sh@20 -- # read -r var val 00:05:39.913 02:08:07 -- accel/accel.sh@21 -- # val=0x1 00:05:39.913 02:08:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.913 02:08:07 -- accel/accel.sh@20 -- # IFS=: 00:05:39.913 02:08:07 -- accel/accel.sh@20 -- # read -r var val 00:05:39.913 02:08:07 -- accel/accel.sh@21 -- # val= 00:05:39.913 02:08:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.913 02:08:07 -- accel/accel.sh@20 -- # IFS=: 00:05:39.913 02:08:07 -- accel/accel.sh@20 -- # read -r var val 00:05:39.913 02:08:07 -- accel/accel.sh@21 -- # val= 00:05:39.913 02:08:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.913 02:08:07 -- accel/accel.sh@20 -- # IFS=: 00:05:39.913 02:08:07 -- accel/accel.sh@20 -- # read -r var val 00:05:39.913 02:08:07 -- accel/accel.sh@21 -- # val=compress 00:05:39.913 02:08:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.913 02:08:07 -- accel/accel.sh@24 -- # accel_opc=compress 00:05:39.913 02:08:07 -- accel/accel.sh@20 -- # IFS=: 00:05:39.913 02:08:07 -- accel/accel.sh@20 -- # read -r var val 00:05:39.913 02:08:07 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:39.913 02:08:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.913 02:08:07 -- accel/accel.sh@20 -- # IFS=: 00:05:39.913 02:08:07 -- accel/accel.sh@20 -- # read -r var val 00:05:39.913 02:08:07 -- accel/accel.sh@21 -- # val= 00:05:39.913 02:08:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.913 02:08:07 -- accel/accel.sh@20 -- # IFS=: 00:05:39.913 02:08:07 -- accel/accel.sh@20 -- # read -r var val 00:05:39.913 02:08:07 -- accel/accel.sh@21 -- # val=software 00:05:39.913 02:08:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.913 02:08:07 -- accel/accel.sh@23 -- # accel_module=software 00:05:39.913 02:08:07 -- accel/accel.sh@20 -- # IFS=: 00:05:39.913 02:08:07 -- accel/accel.sh@20 -- # read -r var val 00:05:39.913 02:08:07 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:39.913 02:08:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.913 02:08:07 -- accel/accel.sh@20 -- # IFS=: 00:05:39.913 02:08:07 -- accel/accel.sh@20 -- # read -r var val 00:05:39.913 02:08:07 -- accel/accel.sh@21 -- # val=32 00:05:39.913 02:08:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.913 02:08:07 -- accel/accel.sh@20 -- # IFS=: 00:05:39.913 02:08:07 -- accel/accel.sh@20 -- # read -r var val 00:05:39.913 02:08:07 -- accel/accel.sh@21 -- # val=32 00:05:39.913 02:08:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.913 02:08:07 -- accel/accel.sh@20 -- # IFS=: 00:05:39.913 02:08:07 -- accel/accel.sh@20 -- # read -r var val 00:05:39.913 02:08:07 -- accel/accel.sh@21 -- # val=1 00:05:39.913 02:08:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.913 02:08:07 -- accel/accel.sh@20 -- # IFS=: 00:05:39.913 02:08:07 -- accel/accel.sh@20 -- # read -r var val 00:05:39.913 02:08:07 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:39.913 02:08:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.913 02:08:07 -- accel/accel.sh@20 -- # IFS=: 00:05:39.913 02:08:07 -- accel/accel.sh@20 -- # read -r var val 00:05:39.913 02:08:07 -- accel/accel.sh@21 -- # val=No 00:05:39.913 02:08:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.913 02:08:07 -- accel/accel.sh@20 -- # IFS=: 00:05:39.913 02:08:07 -- accel/accel.sh@20 -- # read -r var val 00:05:39.913 02:08:07 -- accel/accel.sh@21 -- # val= 00:05:39.913 02:08:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.913 02:08:07 -- accel/accel.sh@20 -- # IFS=: 00:05:39.914 02:08:07 -- accel/accel.sh@20 -- # read -r var val 00:05:39.914 02:08:07 -- accel/accel.sh@21 -- # val= 00:05:39.914 02:08:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.914 02:08:07 -- accel/accel.sh@20 -- # IFS=: 00:05:39.914 02:08:07 -- accel/accel.sh@20 -- # read -r var val 00:05:41.288 02:08:08 -- accel/accel.sh@21 -- # val= 00:05:41.288 02:08:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.288 02:08:08 -- accel/accel.sh@20 -- # IFS=: 00:05:41.288 02:08:08 -- accel/accel.sh@20 -- # read -r var val 00:05:41.288 02:08:08 -- accel/accel.sh@21 -- # val= 00:05:41.288 02:08:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.288 02:08:08 -- accel/accel.sh@20 -- # IFS=: 00:05:41.288 02:08:08 -- accel/accel.sh@20 -- # read -r var val 00:05:41.288 02:08:08 -- accel/accel.sh@21 -- # val= 00:05:41.288 02:08:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.288 02:08:08 -- accel/accel.sh@20 -- # IFS=: 00:05:41.288 02:08:08 -- accel/accel.sh@20 -- # read -r var val 00:05:41.288 02:08:08 -- accel/accel.sh@21 -- # val= 00:05:41.288 02:08:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.288 02:08:08 -- accel/accel.sh@20 -- # IFS=: 00:05:41.288 02:08:08 -- accel/accel.sh@20 -- # read -r var val 00:05:41.288 02:08:08 -- accel/accel.sh@21 -- # val= 00:05:41.288 02:08:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.288 02:08:08 -- accel/accel.sh@20 -- # IFS=: 00:05:41.288 02:08:08 -- accel/accel.sh@20 -- # read -r var val 00:05:41.288 02:08:08 -- accel/accel.sh@21 -- # val= 00:05:41.288 02:08:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.288 02:08:08 -- accel/accel.sh@20 -- # IFS=: 00:05:41.288 02:08:08 -- accel/accel.sh@20 -- # read -r var val 00:05:41.288 02:08:08 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:41.288 02:08:08 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:05:41.288 02:08:08 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:41.288 00:05:41.288 real 0m2.969s 00:05:41.288 user 0m2.660s 00:05:41.288 sys 0m0.300s 00:05:41.288 02:08:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:41.288 02:08:08 -- common/autotest_common.sh@10 -- # set +x 00:05:41.288 ************************************ 00:05:41.288 END TEST accel_comp 00:05:41.288 ************************************ 00:05:41.288 02:08:08 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:41.288 02:08:08 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:41.288 02:08:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:41.288 02:08:08 -- common/autotest_common.sh@10 -- # set +x 00:05:41.288 ************************************ 00:05:41.288 START TEST accel_decomp 00:05:41.288 ************************************ 00:05:41.288 02:08:08 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:41.288 02:08:08 -- accel/accel.sh@16 -- # local accel_opc 00:05:41.288 02:08:08 -- accel/accel.sh@17 -- # local accel_module 00:05:41.288 02:08:08 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:41.288 02:08:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:41.288 02:08:08 -- accel/accel.sh@12 -- # build_accel_config 00:05:41.288 02:08:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:41.288 02:08:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:41.288 02:08:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:41.288 02:08:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:41.288 02:08:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:41.288 02:08:08 -- accel/accel.sh@41 -- # local IFS=, 00:05:41.288 02:08:08 -- accel/accel.sh@42 -- # jq -r . 00:05:41.288 [2024-12-08 02:08:08.736223] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:41.288 [2024-12-08 02:08:08.736307] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1999098 ] 00:05:41.288 EAL: No free 2048 kB hugepages reported on node 1 00:05:41.288 [2024-12-08 02:08:08.798297] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:41.288 [2024-12-08 02:08:08.919150] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:42.664 02:08:10 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:42.664 00:05:42.664 SPDK Configuration: 00:05:42.664 Core mask: 0x1 00:05:42.664 00:05:42.664 Accel Perf Configuration: 00:05:42.664 Workload Type: decompress 00:05:42.664 Transfer size: 4096 bytes 00:05:42.664 Vector count 1 00:05:42.664 Module: software 00:05:42.664 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:42.664 Queue depth: 32 00:05:42.664 Allocate depth: 32 00:05:42.664 # threads/core: 1 00:05:42.664 Run time: 1 seconds 00:05:42.664 Verify: Yes 00:05:42.664 00:05:42.664 Running for 1 seconds... 00:05:42.664 00:05:42.664 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:42.664 ------------------------------------------------------------------------------------ 00:05:42.664 0,0 55392/s 102 MiB/s 0 0 00:05:42.664 ==================================================================================== 00:05:42.664 Total 55392/s 216 MiB/s 0 0' 00:05:42.664 02:08:10 -- accel/accel.sh@20 -- # IFS=: 00:05:42.664 02:08:10 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:42.664 02:08:10 -- accel/accel.sh@20 -- # read -r var val 00:05:42.664 02:08:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:42.664 02:08:10 -- accel/accel.sh@12 -- # build_accel_config 00:05:42.664 02:08:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:42.664 02:08:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:42.664 02:08:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:42.664 02:08:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:42.664 02:08:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:42.664 02:08:10 -- accel/accel.sh@41 -- # local IFS=, 00:05:42.664 02:08:10 -- accel/accel.sh@42 -- # jq -r . 00:05:42.664 [2024-12-08 02:08:10.224235] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:42.664 [2024-12-08 02:08:10.224317] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1999258 ] 00:05:42.664 EAL: No free 2048 kB hugepages reported on node 1 00:05:42.664 [2024-12-08 02:08:10.287725] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:42.664 [2024-12-08 02:08:10.410177] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:42.922 02:08:10 -- accel/accel.sh@21 -- # val= 00:05:42.922 02:08:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.922 02:08:10 -- accel/accel.sh@20 -- # IFS=: 00:05:42.922 02:08:10 -- accel/accel.sh@20 -- # read -r var val 00:05:42.922 02:08:10 -- accel/accel.sh@21 -- # val= 00:05:42.922 02:08:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.922 02:08:10 -- accel/accel.sh@20 -- # IFS=: 00:05:42.922 02:08:10 -- accel/accel.sh@20 -- # read -r var val 00:05:42.922 02:08:10 -- accel/accel.sh@21 -- # val= 00:05:42.922 02:08:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.922 02:08:10 -- accel/accel.sh@20 -- # IFS=: 00:05:42.922 02:08:10 -- accel/accel.sh@20 -- # read -r var val 00:05:42.922 02:08:10 -- accel/accel.sh@21 -- # val=0x1 00:05:42.922 02:08:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.922 02:08:10 -- accel/accel.sh@20 -- # IFS=: 00:05:42.922 02:08:10 -- accel/accel.sh@20 -- # read -r var val 00:05:42.922 02:08:10 -- accel/accel.sh@21 -- # val= 00:05:42.922 02:08:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.922 02:08:10 -- accel/accel.sh@20 -- # IFS=: 00:05:42.922 02:08:10 -- accel/accel.sh@20 -- # read -r var val 00:05:42.922 02:08:10 -- accel/accel.sh@21 -- # val= 00:05:42.922 02:08:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.922 02:08:10 -- accel/accel.sh@20 -- # IFS=: 00:05:42.922 02:08:10 -- accel/accel.sh@20 -- # read -r var val 00:05:42.922 02:08:10 -- accel/accel.sh@21 -- # val=decompress 00:05:42.922 02:08:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.922 02:08:10 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:42.922 02:08:10 -- accel/accel.sh@20 -- # IFS=: 00:05:42.922 02:08:10 -- accel/accel.sh@20 -- # read -r var val 00:05:42.922 02:08:10 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:42.922 02:08:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.922 02:08:10 -- accel/accel.sh@20 -- # IFS=: 00:05:42.922 02:08:10 -- accel/accel.sh@20 -- # read -r var val 00:05:42.922 02:08:10 -- accel/accel.sh@21 -- # val= 00:05:42.923 02:08:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.923 02:08:10 -- accel/accel.sh@20 -- # IFS=: 00:05:42.923 02:08:10 -- accel/accel.sh@20 -- # read -r var val 00:05:42.923 02:08:10 -- accel/accel.sh@21 -- # val=software 00:05:42.923 02:08:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.923 02:08:10 -- accel/accel.sh@23 -- # accel_module=software 00:05:42.923 02:08:10 -- accel/accel.sh@20 -- # IFS=: 00:05:42.923 02:08:10 -- accel/accel.sh@20 -- # read -r var val 00:05:42.923 02:08:10 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:42.923 02:08:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.923 02:08:10 -- accel/accel.sh@20 -- # IFS=: 00:05:42.923 02:08:10 -- accel/accel.sh@20 -- # read -r var val 00:05:42.923 02:08:10 -- accel/accel.sh@21 -- # val=32 00:05:42.923 02:08:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.923 02:08:10 -- accel/accel.sh@20 -- # IFS=: 00:05:42.923 02:08:10 -- accel/accel.sh@20 -- # read -r var val 00:05:42.923 02:08:10 -- accel/accel.sh@21 -- # val=32 00:05:42.923 02:08:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.923 02:08:10 -- accel/accel.sh@20 -- # IFS=: 00:05:42.923 02:08:10 -- accel/accel.sh@20 -- # read -r var val 00:05:42.923 02:08:10 -- accel/accel.sh@21 -- # val=1 00:05:42.923 02:08:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.923 02:08:10 -- accel/accel.sh@20 -- # IFS=: 00:05:42.923 02:08:10 -- accel/accel.sh@20 -- # read -r var val 00:05:42.923 02:08:10 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:42.923 02:08:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.923 02:08:10 -- accel/accel.sh@20 -- # IFS=: 00:05:42.923 02:08:10 -- accel/accel.sh@20 -- # read -r var val 00:05:42.923 02:08:10 -- accel/accel.sh@21 -- # val=Yes 00:05:42.923 02:08:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.923 02:08:10 -- accel/accel.sh@20 -- # IFS=: 00:05:42.923 02:08:10 -- accel/accel.sh@20 -- # read -r var val 00:05:42.923 02:08:10 -- accel/accel.sh@21 -- # val= 00:05:42.923 02:08:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.923 02:08:10 -- accel/accel.sh@20 -- # IFS=: 00:05:42.923 02:08:10 -- accel/accel.sh@20 -- # read -r var val 00:05:42.923 02:08:10 -- accel/accel.sh@21 -- # val= 00:05:42.923 02:08:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.923 02:08:10 -- accel/accel.sh@20 -- # IFS=: 00:05:42.923 02:08:10 -- accel/accel.sh@20 -- # read -r var val 00:05:44.294 02:08:11 -- accel/accel.sh@21 -- # val= 00:05:44.294 02:08:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.294 02:08:11 -- accel/accel.sh@20 -- # IFS=: 00:05:44.294 02:08:11 -- accel/accel.sh@20 -- # read -r var val 00:05:44.294 02:08:11 -- accel/accel.sh@21 -- # val= 00:05:44.294 02:08:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.294 02:08:11 -- accel/accel.sh@20 -- # IFS=: 00:05:44.294 02:08:11 -- accel/accel.sh@20 -- # read -r var val 00:05:44.294 02:08:11 -- accel/accel.sh@21 -- # val= 00:05:44.294 02:08:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.294 02:08:11 -- accel/accel.sh@20 -- # IFS=: 00:05:44.294 02:08:11 -- accel/accel.sh@20 -- # read -r var val 00:05:44.294 02:08:11 -- accel/accel.sh@21 -- # val= 00:05:44.294 02:08:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.294 02:08:11 -- accel/accel.sh@20 -- # IFS=: 00:05:44.294 02:08:11 -- accel/accel.sh@20 -- # read -r var val 00:05:44.294 02:08:11 -- accel/accel.sh@21 -- # val= 00:05:44.294 02:08:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.294 02:08:11 -- accel/accel.sh@20 -- # IFS=: 00:05:44.294 02:08:11 -- accel/accel.sh@20 -- # read -r var val 00:05:44.294 02:08:11 -- accel/accel.sh@21 -- # val= 00:05:44.294 02:08:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.294 02:08:11 -- accel/accel.sh@20 -- # IFS=: 00:05:44.294 02:08:11 -- accel/accel.sh@20 -- # read -r var val 00:05:44.294 02:08:11 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:44.294 02:08:11 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:05:44.294 02:08:11 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:44.294 00:05:44.294 real 0m2.985s 00:05:44.294 user 0m2.667s 00:05:44.294 sys 0m0.309s 00:05:44.294 02:08:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:44.294 02:08:11 -- common/autotest_common.sh@10 -- # set +x 00:05:44.294 ************************************ 00:05:44.294 END TEST accel_decomp 00:05:44.294 ************************************ 00:05:44.294 02:08:11 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:44.294 02:08:11 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:05:44.294 02:08:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:44.294 02:08:11 -- common/autotest_common.sh@10 -- # set +x 00:05:44.294 ************************************ 00:05:44.294 START TEST accel_decmop_full 00:05:44.294 ************************************ 00:05:44.294 02:08:11 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:44.294 02:08:11 -- accel/accel.sh@16 -- # local accel_opc 00:05:44.294 02:08:11 -- accel/accel.sh@17 -- # local accel_module 00:05:44.294 02:08:11 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:44.294 02:08:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:44.294 02:08:11 -- accel/accel.sh@12 -- # build_accel_config 00:05:44.294 02:08:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:44.294 02:08:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:44.294 02:08:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:44.294 02:08:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:44.294 02:08:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:44.294 02:08:11 -- accel/accel.sh@41 -- # local IFS=, 00:05:44.294 02:08:11 -- accel/accel.sh@42 -- # jq -r . 00:05:44.294 [2024-12-08 02:08:11.748186] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:44.294 [2024-12-08 02:08:11.748267] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1999517 ] 00:05:44.294 EAL: No free 2048 kB hugepages reported on node 1 00:05:44.294 [2024-12-08 02:08:11.809599] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:44.294 [2024-12-08 02:08:11.929431] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:45.666 02:08:13 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:45.666 00:05:45.666 SPDK Configuration: 00:05:45.666 Core mask: 0x1 00:05:45.666 00:05:45.666 Accel Perf Configuration: 00:05:45.666 Workload Type: decompress 00:05:45.666 Transfer size: 111250 bytes 00:05:45.666 Vector count 1 00:05:45.666 Module: software 00:05:45.666 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:45.666 Queue depth: 32 00:05:45.666 Allocate depth: 32 00:05:45.666 # threads/core: 1 00:05:45.666 Run time: 1 seconds 00:05:45.666 Verify: Yes 00:05:45.666 00:05:45.666 Running for 1 seconds... 00:05:45.666 00:05:45.666 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:45.666 ------------------------------------------------------------------------------------ 00:05:45.666 0,0 3776/s 155 MiB/s 0 0 00:05:45.666 ==================================================================================== 00:05:45.666 Total 3776/s 400 MiB/s 0 0' 00:05:45.666 02:08:13 -- accel/accel.sh@20 -- # IFS=: 00:05:45.666 02:08:13 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:45.666 02:08:13 -- accel/accel.sh@20 -- # read -r var val 00:05:45.666 02:08:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:45.666 02:08:13 -- accel/accel.sh@12 -- # build_accel_config 00:05:45.666 02:08:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:45.666 02:08:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:45.666 02:08:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:45.666 02:08:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:45.666 02:08:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:45.666 02:08:13 -- accel/accel.sh@41 -- # local IFS=, 00:05:45.666 02:08:13 -- accel/accel.sh@42 -- # jq -r . 00:05:45.666 [2024-12-08 02:08:13.244164] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:45.666 [2024-12-08 02:08:13.244253] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1999668 ] 00:05:45.666 EAL: No free 2048 kB hugepages reported on node 1 00:05:45.666 [2024-12-08 02:08:13.306004] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:45.666 [2024-12-08 02:08:13.423018] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:45.925 02:08:13 -- accel/accel.sh@21 -- # val= 00:05:45.925 02:08:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.925 02:08:13 -- accel/accel.sh@20 -- # IFS=: 00:05:45.925 02:08:13 -- accel/accel.sh@20 -- # read -r var val 00:05:45.925 02:08:13 -- accel/accel.sh@21 -- # val= 00:05:45.925 02:08:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.925 02:08:13 -- accel/accel.sh@20 -- # IFS=: 00:05:45.925 02:08:13 -- accel/accel.sh@20 -- # read -r var val 00:05:45.925 02:08:13 -- accel/accel.sh@21 -- # val= 00:05:45.925 02:08:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.925 02:08:13 -- accel/accel.sh@20 -- # IFS=: 00:05:45.925 02:08:13 -- accel/accel.sh@20 -- # read -r var val 00:05:45.925 02:08:13 -- accel/accel.sh@21 -- # val=0x1 00:05:45.925 02:08:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.925 02:08:13 -- accel/accel.sh@20 -- # IFS=: 00:05:45.925 02:08:13 -- accel/accel.sh@20 -- # read -r var val 00:05:45.925 02:08:13 -- accel/accel.sh@21 -- # val= 00:05:45.925 02:08:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.925 02:08:13 -- accel/accel.sh@20 -- # IFS=: 00:05:45.925 02:08:13 -- accel/accel.sh@20 -- # read -r var val 00:05:45.925 02:08:13 -- accel/accel.sh@21 -- # val= 00:05:45.925 02:08:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.925 02:08:13 -- accel/accel.sh@20 -- # IFS=: 00:05:45.925 02:08:13 -- accel/accel.sh@20 -- # read -r var val 00:05:45.925 02:08:13 -- accel/accel.sh@21 -- # val=decompress 00:05:45.925 02:08:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.925 02:08:13 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:45.925 02:08:13 -- accel/accel.sh@20 -- # IFS=: 00:05:45.925 02:08:13 -- accel/accel.sh@20 -- # read -r var val 00:05:45.925 02:08:13 -- accel/accel.sh@21 -- # val='111250 bytes' 00:05:45.925 02:08:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.925 02:08:13 -- accel/accel.sh@20 -- # IFS=: 00:05:45.925 02:08:13 -- accel/accel.sh@20 -- # read -r var val 00:05:45.925 02:08:13 -- accel/accel.sh@21 -- # val= 00:05:45.925 02:08:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.925 02:08:13 -- accel/accel.sh@20 -- # IFS=: 00:05:45.925 02:08:13 -- accel/accel.sh@20 -- # read -r var val 00:05:45.925 02:08:13 -- accel/accel.sh@21 -- # val=software 00:05:45.925 02:08:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.925 02:08:13 -- accel/accel.sh@23 -- # accel_module=software 00:05:45.925 02:08:13 -- accel/accel.sh@20 -- # IFS=: 00:05:45.925 02:08:13 -- accel/accel.sh@20 -- # read -r var val 00:05:45.925 02:08:13 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:45.925 02:08:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.925 02:08:13 -- accel/accel.sh@20 -- # IFS=: 00:05:45.925 02:08:13 -- accel/accel.sh@20 -- # read -r var val 00:05:45.925 02:08:13 -- accel/accel.sh@21 -- # val=32 00:05:45.925 02:08:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.925 02:08:13 -- accel/accel.sh@20 -- # IFS=: 00:05:45.925 02:08:13 -- accel/accel.sh@20 -- # read -r var val 00:05:45.925 02:08:13 -- accel/accel.sh@21 -- # val=32 00:05:45.925 02:08:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.925 02:08:13 -- accel/accel.sh@20 -- # IFS=: 00:05:45.925 02:08:13 -- accel/accel.sh@20 -- # read -r var val 00:05:45.925 02:08:13 -- accel/accel.sh@21 -- # val=1 00:05:45.925 02:08:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.925 02:08:13 -- accel/accel.sh@20 -- # IFS=: 00:05:45.925 02:08:13 -- accel/accel.sh@20 -- # read -r var val 00:05:45.925 02:08:13 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:45.925 02:08:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.925 02:08:13 -- accel/accel.sh@20 -- # IFS=: 00:05:45.925 02:08:13 -- accel/accel.sh@20 -- # read -r var val 00:05:45.926 02:08:13 -- accel/accel.sh@21 -- # val=Yes 00:05:45.926 02:08:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.926 02:08:13 -- accel/accel.sh@20 -- # IFS=: 00:05:45.926 02:08:13 -- accel/accel.sh@20 -- # read -r var val 00:05:45.926 02:08:13 -- accel/accel.sh@21 -- # val= 00:05:45.926 02:08:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.926 02:08:13 -- accel/accel.sh@20 -- # IFS=: 00:05:45.926 02:08:13 -- accel/accel.sh@20 -- # read -r var val 00:05:45.926 02:08:13 -- accel/accel.sh@21 -- # val= 00:05:45.926 02:08:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.926 02:08:13 -- accel/accel.sh@20 -- # IFS=: 00:05:45.926 02:08:13 -- accel/accel.sh@20 -- # read -r var val 00:05:47.302 02:08:14 -- accel/accel.sh@21 -- # val= 00:05:47.302 02:08:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.302 02:08:14 -- accel/accel.sh@20 -- # IFS=: 00:05:47.302 02:08:14 -- accel/accel.sh@20 -- # read -r var val 00:05:47.302 02:08:14 -- accel/accel.sh@21 -- # val= 00:05:47.302 02:08:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.302 02:08:14 -- accel/accel.sh@20 -- # IFS=: 00:05:47.302 02:08:14 -- accel/accel.sh@20 -- # read -r var val 00:05:47.302 02:08:14 -- accel/accel.sh@21 -- # val= 00:05:47.302 02:08:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.302 02:08:14 -- accel/accel.sh@20 -- # IFS=: 00:05:47.302 02:08:14 -- accel/accel.sh@20 -- # read -r var val 00:05:47.302 02:08:14 -- accel/accel.sh@21 -- # val= 00:05:47.302 02:08:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.302 02:08:14 -- accel/accel.sh@20 -- # IFS=: 00:05:47.302 02:08:14 -- accel/accel.sh@20 -- # read -r var val 00:05:47.302 02:08:14 -- accel/accel.sh@21 -- # val= 00:05:47.302 02:08:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.302 02:08:14 -- accel/accel.sh@20 -- # IFS=: 00:05:47.302 02:08:14 -- accel/accel.sh@20 -- # read -r var val 00:05:47.302 02:08:14 -- accel/accel.sh@21 -- # val= 00:05:47.302 02:08:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.302 02:08:14 -- accel/accel.sh@20 -- # IFS=: 00:05:47.302 02:08:14 -- accel/accel.sh@20 -- # read -r var val 00:05:47.302 02:08:14 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:47.302 02:08:14 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:05:47.302 02:08:14 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:47.302 00:05:47.302 real 0m2.983s 00:05:47.302 user 0m2.677s 00:05:47.302 sys 0m0.297s 00:05:47.302 02:08:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:47.302 02:08:14 -- common/autotest_common.sh@10 -- # set +x 00:05:47.302 ************************************ 00:05:47.302 END TEST accel_decmop_full 00:05:47.302 ************************************ 00:05:47.302 02:08:14 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:47.302 02:08:14 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:05:47.302 02:08:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:47.302 02:08:14 -- common/autotest_common.sh@10 -- # set +x 00:05:47.302 ************************************ 00:05:47.302 START TEST accel_decomp_mcore 00:05:47.302 ************************************ 00:05:47.302 02:08:14 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:47.302 02:08:14 -- accel/accel.sh@16 -- # local accel_opc 00:05:47.302 02:08:14 -- accel/accel.sh@17 -- # local accel_module 00:05:47.302 02:08:14 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:47.302 02:08:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:47.302 02:08:14 -- accel/accel.sh@12 -- # build_accel_config 00:05:47.302 02:08:14 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:47.302 02:08:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:47.302 02:08:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:47.302 02:08:14 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:47.302 02:08:14 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:47.302 02:08:14 -- accel/accel.sh@41 -- # local IFS=, 00:05:47.302 02:08:14 -- accel/accel.sh@42 -- # jq -r . 00:05:47.302 [2024-12-08 02:08:14.758331] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:47.302 [2024-12-08 02:08:14.758412] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1999836 ] 00:05:47.302 EAL: No free 2048 kB hugepages reported on node 1 00:05:47.302 [2024-12-08 02:08:14.820025] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:47.302 [2024-12-08 02:08:14.945516] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:47.302 [2024-12-08 02:08:14.945569] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:47.302 [2024-12-08 02:08:14.945599] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:47.302 [2024-12-08 02:08:14.945602] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:48.673 02:08:16 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:48.673 00:05:48.673 SPDK Configuration: 00:05:48.673 Core mask: 0xf 00:05:48.673 00:05:48.673 Accel Perf Configuration: 00:05:48.673 Workload Type: decompress 00:05:48.673 Transfer size: 4096 bytes 00:05:48.673 Vector count 1 00:05:48.673 Module: software 00:05:48.673 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:48.673 Queue depth: 32 00:05:48.673 Allocate depth: 32 00:05:48.673 # threads/core: 1 00:05:48.673 Run time: 1 seconds 00:05:48.673 Verify: Yes 00:05:48.673 00:05:48.673 Running for 1 seconds... 00:05:48.673 00:05:48.673 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:48.673 ------------------------------------------------------------------------------------ 00:05:48.673 0,0 50112/s 92 MiB/s 0 0 00:05:48.673 3,0 50560/s 93 MiB/s 0 0 00:05:48.673 2,0 50496/s 93 MiB/s 0 0 00:05:48.673 1,0 50272/s 92 MiB/s 0 0 00:05:48.673 ==================================================================================== 00:05:48.673 Total 201440/s 786 MiB/s 0 0' 00:05:48.673 02:08:16 -- accel/accel.sh@20 -- # IFS=: 00:05:48.673 02:08:16 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:48.673 02:08:16 -- accel/accel.sh@20 -- # read -r var val 00:05:48.673 02:08:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:48.673 02:08:16 -- accel/accel.sh@12 -- # build_accel_config 00:05:48.673 02:08:16 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:48.673 02:08:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:48.673 02:08:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:48.673 02:08:16 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:48.673 02:08:16 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:48.673 02:08:16 -- accel/accel.sh@41 -- # local IFS=, 00:05:48.673 02:08:16 -- accel/accel.sh@42 -- # jq -r . 00:05:48.673 [2024-12-08 02:08:16.261127] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:48.673 [2024-12-08 02:08:16.261214] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2000094 ] 00:05:48.673 EAL: No free 2048 kB hugepages reported on node 1 00:05:48.673 [2024-12-08 02:08:16.322736] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:48.673 [2024-12-08 02:08:16.445931] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:48.673 [2024-12-08 02:08:16.445984] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:48.673 [2024-12-08 02:08:16.446038] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:48.673 [2024-12-08 02:08:16.446041] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:48.931 02:08:16 -- accel/accel.sh@21 -- # val= 00:05:48.931 02:08:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.931 02:08:16 -- accel/accel.sh@20 -- # IFS=: 00:05:48.931 02:08:16 -- accel/accel.sh@20 -- # read -r var val 00:05:48.932 02:08:16 -- accel/accel.sh@21 -- # val= 00:05:48.932 02:08:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.932 02:08:16 -- accel/accel.sh@20 -- # IFS=: 00:05:48.932 02:08:16 -- accel/accel.sh@20 -- # read -r var val 00:05:48.932 02:08:16 -- accel/accel.sh@21 -- # val= 00:05:48.932 02:08:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.932 02:08:16 -- accel/accel.sh@20 -- # IFS=: 00:05:48.932 02:08:16 -- accel/accel.sh@20 -- # read -r var val 00:05:48.932 02:08:16 -- accel/accel.sh@21 -- # val=0xf 00:05:48.932 02:08:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.932 02:08:16 -- accel/accel.sh@20 -- # IFS=: 00:05:48.932 02:08:16 -- accel/accel.sh@20 -- # read -r var val 00:05:48.932 02:08:16 -- accel/accel.sh@21 -- # val= 00:05:48.932 02:08:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.932 02:08:16 -- accel/accel.sh@20 -- # IFS=: 00:05:48.932 02:08:16 -- accel/accel.sh@20 -- # read -r var val 00:05:48.932 02:08:16 -- accel/accel.sh@21 -- # val= 00:05:48.932 02:08:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.932 02:08:16 -- accel/accel.sh@20 -- # IFS=: 00:05:48.932 02:08:16 -- accel/accel.sh@20 -- # read -r var val 00:05:48.932 02:08:16 -- accel/accel.sh@21 -- # val=decompress 00:05:48.932 02:08:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.932 02:08:16 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:48.932 02:08:16 -- accel/accel.sh@20 -- # IFS=: 00:05:48.932 02:08:16 -- accel/accel.sh@20 -- # read -r var val 00:05:48.932 02:08:16 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:48.932 02:08:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.932 02:08:16 -- accel/accel.sh@20 -- # IFS=: 00:05:48.932 02:08:16 -- accel/accel.sh@20 -- # read -r var val 00:05:48.932 02:08:16 -- accel/accel.sh@21 -- # val= 00:05:48.932 02:08:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.932 02:08:16 -- accel/accel.sh@20 -- # IFS=: 00:05:48.932 02:08:16 -- accel/accel.sh@20 -- # read -r var val 00:05:48.932 02:08:16 -- accel/accel.sh@21 -- # val=software 00:05:48.932 02:08:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.932 02:08:16 -- accel/accel.sh@23 -- # accel_module=software 00:05:48.932 02:08:16 -- accel/accel.sh@20 -- # IFS=: 00:05:48.932 02:08:16 -- accel/accel.sh@20 -- # read -r var val 00:05:48.932 02:08:16 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:48.932 02:08:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.932 02:08:16 -- accel/accel.sh@20 -- # IFS=: 00:05:48.932 02:08:16 -- accel/accel.sh@20 -- # read -r var val 00:05:48.932 02:08:16 -- accel/accel.sh@21 -- # val=32 00:05:48.932 02:08:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.932 02:08:16 -- accel/accel.sh@20 -- # IFS=: 00:05:48.932 02:08:16 -- accel/accel.sh@20 -- # read -r var val 00:05:48.932 02:08:16 -- accel/accel.sh@21 -- # val=32 00:05:48.932 02:08:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.932 02:08:16 -- accel/accel.sh@20 -- # IFS=: 00:05:48.932 02:08:16 -- accel/accel.sh@20 -- # read -r var val 00:05:48.932 02:08:16 -- accel/accel.sh@21 -- # val=1 00:05:48.932 02:08:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.932 02:08:16 -- accel/accel.sh@20 -- # IFS=: 00:05:48.932 02:08:16 -- accel/accel.sh@20 -- # read -r var val 00:05:48.932 02:08:16 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:48.932 02:08:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.932 02:08:16 -- accel/accel.sh@20 -- # IFS=: 00:05:48.932 02:08:16 -- accel/accel.sh@20 -- # read -r var val 00:05:48.932 02:08:16 -- accel/accel.sh@21 -- # val=Yes 00:05:48.932 02:08:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.932 02:08:16 -- accel/accel.sh@20 -- # IFS=: 00:05:48.932 02:08:16 -- accel/accel.sh@20 -- # read -r var val 00:05:48.932 02:08:16 -- accel/accel.sh@21 -- # val= 00:05:48.932 02:08:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.932 02:08:16 -- accel/accel.sh@20 -- # IFS=: 00:05:48.932 02:08:16 -- accel/accel.sh@20 -- # read -r var val 00:05:48.932 02:08:16 -- accel/accel.sh@21 -- # val= 00:05:48.932 02:08:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.932 02:08:16 -- accel/accel.sh@20 -- # IFS=: 00:05:48.932 02:08:16 -- accel/accel.sh@20 -- # read -r var val 00:05:50.308 02:08:17 -- accel/accel.sh@21 -- # val= 00:05:50.308 02:08:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.308 02:08:17 -- accel/accel.sh@20 -- # IFS=: 00:05:50.308 02:08:17 -- accel/accel.sh@20 -- # read -r var val 00:05:50.308 02:08:17 -- accel/accel.sh@21 -- # val= 00:05:50.308 02:08:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.308 02:08:17 -- accel/accel.sh@20 -- # IFS=: 00:05:50.308 02:08:17 -- accel/accel.sh@20 -- # read -r var val 00:05:50.308 02:08:17 -- accel/accel.sh@21 -- # val= 00:05:50.308 02:08:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.308 02:08:17 -- accel/accel.sh@20 -- # IFS=: 00:05:50.308 02:08:17 -- accel/accel.sh@20 -- # read -r var val 00:05:50.308 02:08:17 -- accel/accel.sh@21 -- # val= 00:05:50.308 02:08:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.308 02:08:17 -- accel/accel.sh@20 -- # IFS=: 00:05:50.308 02:08:17 -- accel/accel.sh@20 -- # read -r var val 00:05:50.308 02:08:17 -- accel/accel.sh@21 -- # val= 00:05:50.308 02:08:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.308 02:08:17 -- accel/accel.sh@20 -- # IFS=: 00:05:50.308 02:08:17 -- accel/accel.sh@20 -- # read -r var val 00:05:50.308 02:08:17 -- accel/accel.sh@21 -- # val= 00:05:50.308 02:08:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.308 02:08:17 -- accel/accel.sh@20 -- # IFS=: 00:05:50.308 02:08:17 -- accel/accel.sh@20 -- # read -r var val 00:05:50.308 02:08:17 -- accel/accel.sh@21 -- # val= 00:05:50.308 02:08:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.308 02:08:17 -- accel/accel.sh@20 -- # IFS=: 00:05:50.308 02:08:17 -- accel/accel.sh@20 -- # read -r var val 00:05:50.308 02:08:17 -- accel/accel.sh@21 -- # val= 00:05:50.308 02:08:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.308 02:08:17 -- accel/accel.sh@20 -- # IFS=: 00:05:50.308 02:08:17 -- accel/accel.sh@20 -- # read -r var val 00:05:50.308 02:08:17 -- accel/accel.sh@21 -- # val= 00:05:50.308 02:08:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.308 02:08:17 -- accel/accel.sh@20 -- # IFS=: 00:05:50.308 02:08:17 -- accel/accel.sh@20 -- # read -r var val 00:05:50.308 02:08:17 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:50.308 02:08:17 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:05:50.308 02:08:17 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:50.308 00:05:50.308 real 0m2.998s 00:05:50.308 user 0m9.622s 00:05:50.308 sys 0m0.304s 00:05:50.308 02:08:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:50.308 02:08:17 -- common/autotest_common.sh@10 -- # set +x 00:05:50.308 ************************************ 00:05:50.308 END TEST accel_decomp_mcore 00:05:50.308 ************************************ 00:05:50.308 02:08:17 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:05:50.308 02:08:17 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:05:50.308 02:08:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:50.308 02:08:17 -- common/autotest_common.sh@10 -- # set +x 00:05:50.308 ************************************ 00:05:50.308 START TEST accel_decomp_full_mcore 00:05:50.308 ************************************ 00:05:50.308 02:08:17 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:05:50.308 02:08:17 -- accel/accel.sh@16 -- # local accel_opc 00:05:50.308 02:08:17 -- accel/accel.sh@17 -- # local accel_module 00:05:50.308 02:08:17 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:05:50.308 02:08:17 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:05:50.308 02:08:17 -- accel/accel.sh@12 -- # build_accel_config 00:05:50.308 02:08:17 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:50.308 02:08:17 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:50.308 02:08:17 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:50.308 02:08:17 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:50.308 02:08:17 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:50.308 02:08:17 -- accel/accel.sh@41 -- # local IFS=, 00:05:50.308 02:08:17 -- accel/accel.sh@42 -- # jq -r . 00:05:50.308 [2024-12-08 02:08:17.783026] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:50.308 [2024-12-08 02:08:17.783110] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2000255 ] 00:05:50.308 EAL: No free 2048 kB hugepages reported on node 1 00:05:50.308 [2024-12-08 02:08:17.844564] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:50.308 [2024-12-08 02:08:17.968699] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:50.308 [2024-12-08 02:08:17.968756] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:50.308 [2024-12-08 02:08:17.968820] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:50.308 [2024-12-08 02:08:17.968824] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:51.686 02:08:19 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:51.686 00:05:51.686 SPDK Configuration: 00:05:51.686 Core mask: 0xf 00:05:51.686 00:05:51.686 Accel Perf Configuration: 00:05:51.686 Workload Type: decompress 00:05:51.686 Transfer size: 111250 bytes 00:05:51.686 Vector count 1 00:05:51.686 Module: software 00:05:51.686 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:51.686 Queue depth: 32 00:05:51.686 Allocate depth: 32 00:05:51.686 # threads/core: 1 00:05:51.686 Run time: 1 seconds 00:05:51.686 Verify: Yes 00:05:51.686 00:05:51.686 Running for 1 seconds... 00:05:51.686 00:05:51.686 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:51.686 ------------------------------------------------------------------------------------ 00:05:51.686 0,0 3776/s 155 MiB/s 0 0 00:05:51.686 3,0 3776/s 155 MiB/s 0 0 00:05:51.686 2,0 3776/s 155 MiB/s 0 0 00:05:51.686 1,0 3776/s 155 MiB/s 0 0 00:05:51.686 ==================================================================================== 00:05:51.686 Total 15104/s 1602 MiB/s 0 0' 00:05:51.686 02:08:19 -- accel/accel.sh@20 -- # IFS=: 00:05:51.686 02:08:19 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:05:51.686 02:08:19 -- accel/accel.sh@20 -- # read -r var val 00:05:51.686 02:08:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:05:51.686 02:08:19 -- accel/accel.sh@12 -- # build_accel_config 00:05:51.686 02:08:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:51.686 02:08:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:51.686 02:08:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:51.686 02:08:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:51.686 02:08:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:51.686 02:08:19 -- accel/accel.sh@41 -- # local IFS=, 00:05:51.686 02:08:19 -- accel/accel.sh@42 -- # jq -r . 00:05:51.686 [2024-12-08 02:08:19.280768] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:51.686 [2024-12-08 02:08:19.280852] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2000408 ] 00:05:51.686 EAL: No free 2048 kB hugepages reported on node 1 00:05:51.686 [2024-12-08 02:08:19.344958] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:51.944 [2024-12-08 02:08:19.466900] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:51.945 [2024-12-08 02:08:19.466957] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:51.945 [2024-12-08 02:08:19.467008] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:51.945 [2024-12-08 02:08:19.467011] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:51.945 02:08:19 -- accel/accel.sh@21 -- # val= 00:05:51.945 02:08:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.945 02:08:19 -- accel/accel.sh@20 -- # IFS=: 00:05:51.945 02:08:19 -- accel/accel.sh@20 -- # read -r var val 00:05:51.945 02:08:19 -- accel/accel.sh@21 -- # val= 00:05:51.945 02:08:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.945 02:08:19 -- accel/accel.sh@20 -- # IFS=: 00:05:51.945 02:08:19 -- accel/accel.sh@20 -- # read -r var val 00:05:51.945 02:08:19 -- accel/accel.sh@21 -- # val= 00:05:51.945 02:08:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.945 02:08:19 -- accel/accel.sh@20 -- # IFS=: 00:05:51.945 02:08:19 -- accel/accel.sh@20 -- # read -r var val 00:05:51.945 02:08:19 -- accel/accel.sh@21 -- # val=0xf 00:05:51.945 02:08:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.945 02:08:19 -- accel/accel.sh@20 -- # IFS=: 00:05:51.945 02:08:19 -- accel/accel.sh@20 -- # read -r var val 00:05:51.945 02:08:19 -- accel/accel.sh@21 -- # val= 00:05:51.945 02:08:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.945 02:08:19 -- accel/accel.sh@20 -- # IFS=: 00:05:51.945 02:08:19 -- accel/accel.sh@20 -- # read -r var val 00:05:51.945 02:08:19 -- accel/accel.sh@21 -- # val= 00:05:51.945 02:08:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.945 02:08:19 -- accel/accel.sh@20 -- # IFS=: 00:05:51.945 02:08:19 -- accel/accel.sh@20 -- # read -r var val 00:05:51.945 02:08:19 -- accel/accel.sh@21 -- # val=decompress 00:05:51.945 02:08:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.945 02:08:19 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:51.945 02:08:19 -- accel/accel.sh@20 -- # IFS=: 00:05:51.945 02:08:19 -- accel/accel.sh@20 -- # read -r var val 00:05:51.945 02:08:19 -- accel/accel.sh@21 -- # val='111250 bytes' 00:05:51.945 02:08:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.945 02:08:19 -- accel/accel.sh@20 -- # IFS=: 00:05:51.945 02:08:19 -- accel/accel.sh@20 -- # read -r var val 00:05:51.945 02:08:19 -- accel/accel.sh@21 -- # val= 00:05:51.945 02:08:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.945 02:08:19 -- accel/accel.sh@20 -- # IFS=: 00:05:51.945 02:08:19 -- accel/accel.sh@20 -- # read -r var val 00:05:51.945 02:08:19 -- accel/accel.sh@21 -- # val=software 00:05:51.945 02:08:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.945 02:08:19 -- accel/accel.sh@23 -- # accel_module=software 00:05:51.945 02:08:19 -- accel/accel.sh@20 -- # IFS=: 00:05:51.945 02:08:19 -- accel/accel.sh@20 -- # read -r var val 00:05:51.945 02:08:19 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:51.945 02:08:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.945 02:08:19 -- accel/accel.sh@20 -- # IFS=: 00:05:51.945 02:08:19 -- accel/accel.sh@20 -- # read -r var val 00:05:51.945 02:08:19 -- accel/accel.sh@21 -- # val=32 00:05:51.945 02:08:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.945 02:08:19 -- accel/accel.sh@20 -- # IFS=: 00:05:51.945 02:08:19 -- accel/accel.sh@20 -- # read -r var val 00:05:51.945 02:08:19 -- accel/accel.sh@21 -- # val=32 00:05:51.945 02:08:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.945 02:08:19 -- accel/accel.sh@20 -- # IFS=: 00:05:51.945 02:08:19 -- accel/accel.sh@20 -- # read -r var val 00:05:51.945 02:08:19 -- accel/accel.sh@21 -- # val=1 00:05:51.945 02:08:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.945 02:08:19 -- accel/accel.sh@20 -- # IFS=: 00:05:51.945 02:08:19 -- accel/accel.sh@20 -- # read -r var val 00:05:51.945 02:08:19 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:51.945 02:08:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.945 02:08:19 -- accel/accel.sh@20 -- # IFS=: 00:05:51.945 02:08:19 -- accel/accel.sh@20 -- # read -r var val 00:05:51.945 02:08:19 -- accel/accel.sh@21 -- # val=Yes 00:05:51.945 02:08:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.945 02:08:19 -- accel/accel.sh@20 -- # IFS=: 00:05:51.945 02:08:19 -- accel/accel.sh@20 -- # read -r var val 00:05:51.945 02:08:19 -- accel/accel.sh@21 -- # val= 00:05:51.945 02:08:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.945 02:08:19 -- accel/accel.sh@20 -- # IFS=: 00:05:51.945 02:08:19 -- accel/accel.sh@20 -- # read -r var val 00:05:51.945 02:08:19 -- accel/accel.sh@21 -- # val= 00:05:51.945 02:08:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.945 02:08:19 -- accel/accel.sh@20 -- # IFS=: 00:05:51.945 02:08:19 -- accel/accel.sh@20 -- # read -r var val 00:05:53.323 02:08:20 -- accel/accel.sh@21 -- # val= 00:05:53.323 02:08:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.323 02:08:20 -- accel/accel.sh@20 -- # IFS=: 00:05:53.323 02:08:20 -- accel/accel.sh@20 -- # read -r var val 00:05:53.323 02:08:20 -- accel/accel.sh@21 -- # val= 00:05:53.323 02:08:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.323 02:08:20 -- accel/accel.sh@20 -- # IFS=: 00:05:53.323 02:08:20 -- accel/accel.sh@20 -- # read -r var val 00:05:53.323 02:08:20 -- accel/accel.sh@21 -- # val= 00:05:53.323 02:08:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.323 02:08:20 -- accel/accel.sh@20 -- # IFS=: 00:05:53.323 02:08:20 -- accel/accel.sh@20 -- # read -r var val 00:05:53.323 02:08:20 -- accel/accel.sh@21 -- # val= 00:05:53.323 02:08:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.323 02:08:20 -- accel/accel.sh@20 -- # IFS=: 00:05:53.323 02:08:20 -- accel/accel.sh@20 -- # read -r var val 00:05:53.323 02:08:20 -- accel/accel.sh@21 -- # val= 00:05:53.323 02:08:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.323 02:08:20 -- accel/accel.sh@20 -- # IFS=: 00:05:53.323 02:08:20 -- accel/accel.sh@20 -- # read -r var val 00:05:53.323 02:08:20 -- accel/accel.sh@21 -- # val= 00:05:53.323 02:08:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.323 02:08:20 -- accel/accel.sh@20 -- # IFS=: 00:05:53.323 02:08:20 -- accel/accel.sh@20 -- # read -r var val 00:05:53.323 02:08:20 -- accel/accel.sh@21 -- # val= 00:05:53.323 02:08:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.323 02:08:20 -- accel/accel.sh@20 -- # IFS=: 00:05:53.323 02:08:20 -- accel/accel.sh@20 -- # read -r var val 00:05:53.323 02:08:20 -- accel/accel.sh@21 -- # val= 00:05:53.323 02:08:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.323 02:08:20 -- accel/accel.sh@20 -- # IFS=: 00:05:53.323 02:08:20 -- accel/accel.sh@20 -- # read -r var val 00:05:53.323 02:08:20 -- accel/accel.sh@21 -- # val= 00:05:53.323 02:08:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.323 02:08:20 -- accel/accel.sh@20 -- # IFS=: 00:05:53.323 02:08:20 -- accel/accel.sh@20 -- # read -r var val 00:05:53.323 02:08:20 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:53.323 02:08:20 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:05:53.323 02:08:20 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:53.323 00:05:53.323 real 0m3.015s 00:05:53.323 user 0m9.696s 00:05:53.323 sys 0m0.308s 00:05:53.323 02:08:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:53.323 02:08:20 -- common/autotest_common.sh@10 -- # set +x 00:05:53.323 ************************************ 00:05:53.323 END TEST accel_decomp_full_mcore 00:05:53.323 ************************************ 00:05:53.323 02:08:20 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:05:53.323 02:08:20 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:05:53.323 02:08:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:53.323 02:08:20 -- common/autotest_common.sh@10 -- # set +x 00:05:53.323 ************************************ 00:05:53.323 START TEST accel_decomp_mthread 00:05:53.323 ************************************ 00:05:53.323 02:08:20 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:05:53.323 02:08:20 -- accel/accel.sh@16 -- # local accel_opc 00:05:53.323 02:08:20 -- accel/accel.sh@17 -- # local accel_module 00:05:53.323 02:08:20 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:05:53.323 02:08:20 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:05:53.323 02:08:20 -- accel/accel.sh@12 -- # build_accel_config 00:05:53.323 02:08:20 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:53.323 02:08:20 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:53.323 02:08:20 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:53.323 02:08:20 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:53.323 02:08:20 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:53.323 02:08:20 -- accel/accel.sh@41 -- # local IFS=, 00:05:53.323 02:08:20 -- accel/accel.sh@42 -- # jq -r . 00:05:53.323 [2024-12-08 02:08:20.826291] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:53.323 [2024-12-08 02:08:20.826373] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2000684 ] 00:05:53.323 EAL: No free 2048 kB hugepages reported on node 1 00:05:53.323 [2024-12-08 02:08:20.888912] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:53.323 [2024-12-08 02:08:21.010151] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:54.795 02:08:22 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:54.795 00:05:54.795 SPDK Configuration: 00:05:54.795 Core mask: 0x1 00:05:54.795 00:05:54.795 Accel Perf Configuration: 00:05:54.795 Workload Type: decompress 00:05:54.795 Transfer size: 4096 bytes 00:05:54.795 Vector count 1 00:05:54.795 Module: software 00:05:54.795 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:54.795 Queue depth: 32 00:05:54.795 Allocate depth: 32 00:05:54.795 # threads/core: 2 00:05:54.795 Run time: 1 seconds 00:05:54.795 Verify: Yes 00:05:54.795 00:05:54.795 Running for 1 seconds... 00:05:54.795 00:05:54.795 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:54.795 ------------------------------------------------------------------------------------ 00:05:54.795 0,1 27968/s 51 MiB/s 0 0 00:05:54.795 0,0 27872/s 51 MiB/s 0 0 00:05:54.795 ==================================================================================== 00:05:54.795 Total 55840/s 218 MiB/s 0 0' 00:05:54.795 02:08:22 -- accel/accel.sh@20 -- # IFS=: 00:05:54.795 02:08:22 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:05:54.795 02:08:22 -- accel/accel.sh@20 -- # read -r var val 00:05:54.795 02:08:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:05:54.796 02:08:22 -- accel/accel.sh@12 -- # build_accel_config 00:05:54.796 02:08:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:54.796 02:08:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:54.796 02:08:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:54.796 02:08:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:54.796 02:08:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:54.796 02:08:22 -- accel/accel.sh@41 -- # local IFS=, 00:05:54.796 02:08:22 -- accel/accel.sh@42 -- # jq -r . 00:05:54.796 [2024-12-08 02:08:22.310379] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:54.796 [2024-12-08 02:08:22.310467] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2000838 ] 00:05:54.796 EAL: No free 2048 kB hugepages reported on node 1 00:05:54.796 [2024-12-08 02:08:22.371855] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:54.796 [2024-12-08 02:08:22.491718] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:54.796 02:08:22 -- accel/accel.sh@21 -- # val= 00:05:54.796 02:08:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.796 02:08:22 -- accel/accel.sh@20 -- # IFS=: 00:05:54.796 02:08:22 -- accel/accel.sh@20 -- # read -r var val 00:05:54.796 02:08:22 -- accel/accel.sh@21 -- # val= 00:05:54.796 02:08:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.796 02:08:22 -- accel/accel.sh@20 -- # IFS=: 00:05:54.796 02:08:22 -- accel/accel.sh@20 -- # read -r var val 00:05:54.796 02:08:22 -- accel/accel.sh@21 -- # val= 00:05:54.796 02:08:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.796 02:08:22 -- accel/accel.sh@20 -- # IFS=: 00:05:54.796 02:08:22 -- accel/accel.sh@20 -- # read -r var val 00:05:54.796 02:08:22 -- accel/accel.sh@21 -- # val=0x1 00:05:54.796 02:08:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.796 02:08:22 -- accel/accel.sh@20 -- # IFS=: 00:05:54.796 02:08:22 -- accel/accel.sh@20 -- # read -r var val 00:05:54.796 02:08:22 -- accel/accel.sh@21 -- # val= 00:05:54.796 02:08:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.796 02:08:22 -- accel/accel.sh@20 -- # IFS=: 00:05:54.796 02:08:22 -- accel/accel.sh@20 -- # read -r var val 00:05:54.796 02:08:22 -- accel/accel.sh@21 -- # val= 00:05:54.796 02:08:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.796 02:08:22 -- accel/accel.sh@20 -- # IFS=: 00:05:54.796 02:08:22 -- accel/accel.sh@20 -- # read -r var val 00:05:54.796 02:08:22 -- accel/accel.sh@21 -- # val=decompress 00:05:54.796 02:08:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.796 02:08:22 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:54.796 02:08:22 -- accel/accel.sh@20 -- # IFS=: 00:05:54.796 02:08:22 -- accel/accel.sh@20 -- # read -r var val 00:05:54.796 02:08:22 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:54.796 02:08:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.796 02:08:22 -- accel/accel.sh@20 -- # IFS=: 00:05:54.796 02:08:22 -- accel/accel.sh@20 -- # read -r var val 00:05:54.796 02:08:22 -- accel/accel.sh@21 -- # val= 00:05:54.796 02:08:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.796 02:08:22 -- accel/accel.sh@20 -- # IFS=: 00:05:54.796 02:08:22 -- accel/accel.sh@20 -- # read -r var val 00:05:54.796 02:08:22 -- accel/accel.sh@21 -- # val=software 00:05:54.796 02:08:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.796 02:08:22 -- accel/accel.sh@23 -- # accel_module=software 00:05:54.796 02:08:22 -- accel/accel.sh@20 -- # IFS=: 00:05:54.796 02:08:22 -- accel/accel.sh@20 -- # read -r var val 00:05:54.796 02:08:22 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:54.796 02:08:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.796 02:08:22 -- accel/accel.sh@20 -- # IFS=: 00:05:54.796 02:08:22 -- accel/accel.sh@20 -- # read -r var val 00:05:54.796 02:08:22 -- accel/accel.sh@21 -- # val=32 00:05:54.796 02:08:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.796 02:08:22 -- accel/accel.sh@20 -- # IFS=: 00:05:54.796 02:08:22 -- accel/accel.sh@20 -- # read -r var val 00:05:54.796 02:08:22 -- accel/accel.sh@21 -- # val=32 00:05:54.796 02:08:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.796 02:08:22 -- accel/accel.sh@20 -- # IFS=: 00:05:54.796 02:08:22 -- accel/accel.sh@20 -- # read -r var val 00:05:54.796 02:08:22 -- accel/accel.sh@21 -- # val=2 00:05:54.796 02:08:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.796 02:08:22 -- accel/accel.sh@20 -- # IFS=: 00:05:54.796 02:08:22 -- accel/accel.sh@20 -- # read -r var val 00:05:54.796 02:08:22 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:54.796 02:08:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.796 02:08:22 -- accel/accel.sh@20 -- # IFS=: 00:05:54.796 02:08:22 -- accel/accel.sh@20 -- # read -r var val 00:05:54.796 02:08:22 -- accel/accel.sh@21 -- # val=Yes 00:05:54.796 02:08:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.796 02:08:22 -- accel/accel.sh@20 -- # IFS=: 00:05:54.796 02:08:22 -- accel/accel.sh@20 -- # read -r var val 00:05:54.796 02:08:22 -- accel/accel.sh@21 -- # val= 00:05:54.796 02:08:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.796 02:08:22 -- accel/accel.sh@20 -- # IFS=: 00:05:54.796 02:08:22 -- accel/accel.sh@20 -- # read -r var val 00:05:54.796 02:08:22 -- accel/accel.sh@21 -- # val= 00:05:54.796 02:08:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.796 02:08:22 -- accel/accel.sh@20 -- # IFS=: 00:05:54.796 02:08:22 -- accel/accel.sh@20 -- # read -r var val 00:05:56.170 02:08:23 -- accel/accel.sh@21 -- # val= 00:05:56.170 02:08:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.170 02:08:23 -- accel/accel.sh@20 -- # IFS=: 00:05:56.170 02:08:23 -- accel/accel.sh@20 -- # read -r var val 00:05:56.170 02:08:23 -- accel/accel.sh@21 -- # val= 00:05:56.170 02:08:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.170 02:08:23 -- accel/accel.sh@20 -- # IFS=: 00:05:56.170 02:08:23 -- accel/accel.sh@20 -- # read -r var val 00:05:56.170 02:08:23 -- accel/accel.sh@21 -- # val= 00:05:56.170 02:08:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.170 02:08:23 -- accel/accel.sh@20 -- # IFS=: 00:05:56.170 02:08:23 -- accel/accel.sh@20 -- # read -r var val 00:05:56.170 02:08:23 -- accel/accel.sh@21 -- # val= 00:05:56.170 02:08:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.170 02:08:23 -- accel/accel.sh@20 -- # IFS=: 00:05:56.170 02:08:23 -- accel/accel.sh@20 -- # read -r var val 00:05:56.170 02:08:23 -- accel/accel.sh@21 -- # val= 00:05:56.170 02:08:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.170 02:08:23 -- accel/accel.sh@20 -- # IFS=: 00:05:56.170 02:08:23 -- accel/accel.sh@20 -- # read -r var val 00:05:56.170 02:08:23 -- accel/accel.sh@21 -- # val= 00:05:56.170 02:08:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.170 02:08:23 -- accel/accel.sh@20 -- # IFS=: 00:05:56.170 02:08:23 -- accel/accel.sh@20 -- # read -r var val 00:05:56.170 02:08:23 -- accel/accel.sh@21 -- # val= 00:05:56.170 02:08:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.170 02:08:23 -- accel/accel.sh@20 -- # IFS=: 00:05:56.170 02:08:23 -- accel/accel.sh@20 -- # read -r var val 00:05:56.170 02:08:23 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:56.170 02:08:23 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:05:56.170 02:08:23 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:56.170 00:05:56.170 real 0m2.979s 00:05:56.170 user 0m2.676s 00:05:56.170 sys 0m0.295s 00:05:56.170 02:08:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:56.170 02:08:23 -- common/autotest_common.sh@10 -- # set +x 00:05:56.170 ************************************ 00:05:56.170 END TEST accel_decomp_mthread 00:05:56.170 ************************************ 00:05:56.170 02:08:23 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:05:56.170 02:08:23 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:05:56.170 02:08:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:56.170 02:08:23 -- common/autotest_common.sh@10 -- # set +x 00:05:56.170 ************************************ 00:05:56.170 START TEST accel_deomp_full_mthread 00:05:56.170 ************************************ 00:05:56.170 02:08:23 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:05:56.170 02:08:23 -- accel/accel.sh@16 -- # local accel_opc 00:05:56.170 02:08:23 -- accel/accel.sh@17 -- # local accel_module 00:05:56.170 02:08:23 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:05:56.170 02:08:23 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:05:56.170 02:08:23 -- accel/accel.sh@12 -- # build_accel_config 00:05:56.170 02:08:23 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:56.170 02:08:23 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:56.170 02:08:23 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:56.170 02:08:23 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:56.170 02:08:23 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:56.170 02:08:23 -- accel/accel.sh@41 -- # local IFS=, 00:05:56.170 02:08:23 -- accel/accel.sh@42 -- # jq -r . 00:05:56.170 [2024-12-08 02:08:23.831439] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:56.170 [2024-12-08 02:08:23.831528] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2001003 ] 00:05:56.170 EAL: No free 2048 kB hugepages reported on node 1 00:05:56.170 [2024-12-08 02:08:23.893335] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:56.429 [2024-12-08 02:08:24.007705] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:57.801 02:08:25 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:57.801 00:05:57.801 SPDK Configuration: 00:05:57.801 Core mask: 0x1 00:05:57.801 00:05:57.801 Accel Perf Configuration: 00:05:57.801 Workload Type: decompress 00:05:57.801 Transfer size: 111250 bytes 00:05:57.801 Vector count 1 00:05:57.801 Module: software 00:05:57.801 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:57.801 Queue depth: 32 00:05:57.801 Allocate depth: 32 00:05:57.801 # threads/core: 2 00:05:57.801 Run time: 1 seconds 00:05:57.801 Verify: Yes 00:05:57.801 00:05:57.801 Running for 1 seconds... 00:05:57.801 00:05:57.801 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:57.801 ------------------------------------------------------------------------------------ 00:05:57.801 0,1 1952/s 80 MiB/s 0 0 00:05:57.801 0,0 1920/s 79 MiB/s 0 0 00:05:57.801 ==================================================================================== 00:05:57.801 Total 3872/s 410 MiB/s 0 0' 00:05:57.801 02:08:25 -- accel/accel.sh@20 -- # IFS=: 00:05:57.801 02:08:25 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:05:57.801 02:08:25 -- accel/accel.sh@20 -- # read -r var val 00:05:57.801 02:08:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:05:57.801 02:08:25 -- accel/accel.sh@12 -- # build_accel_config 00:05:57.801 02:08:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:57.801 02:08:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:57.801 02:08:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:57.801 02:08:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:57.801 02:08:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:57.801 02:08:25 -- accel/accel.sh@41 -- # local IFS=, 00:05:57.801 02:08:25 -- accel/accel.sh@42 -- # jq -r . 00:05:57.801 [2024-12-08 02:08:25.339507] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:57.801 [2024-12-08 02:08:25.339705] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2001262 ] 00:05:57.801 EAL: No free 2048 kB hugepages reported on node 1 00:05:57.801 [2024-12-08 02:08:25.401402] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:57.801 [2024-12-08 02:08:25.521882] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:58.057 02:08:25 -- accel/accel.sh@21 -- # val= 00:05:58.057 02:08:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.057 02:08:25 -- accel/accel.sh@20 -- # IFS=: 00:05:58.058 02:08:25 -- accel/accel.sh@20 -- # read -r var val 00:05:58.058 02:08:25 -- accel/accel.sh@21 -- # val= 00:05:58.058 02:08:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.058 02:08:25 -- accel/accel.sh@20 -- # IFS=: 00:05:58.058 02:08:25 -- accel/accel.sh@20 -- # read -r var val 00:05:58.058 02:08:25 -- accel/accel.sh@21 -- # val= 00:05:58.058 02:08:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.058 02:08:25 -- accel/accel.sh@20 -- # IFS=: 00:05:58.058 02:08:25 -- accel/accel.sh@20 -- # read -r var val 00:05:58.058 02:08:25 -- accel/accel.sh@21 -- # val=0x1 00:05:58.058 02:08:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.058 02:08:25 -- accel/accel.sh@20 -- # IFS=: 00:05:58.058 02:08:25 -- accel/accel.sh@20 -- # read -r var val 00:05:58.058 02:08:25 -- accel/accel.sh@21 -- # val= 00:05:58.058 02:08:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.058 02:08:25 -- accel/accel.sh@20 -- # IFS=: 00:05:58.058 02:08:25 -- accel/accel.sh@20 -- # read -r var val 00:05:58.058 02:08:25 -- accel/accel.sh@21 -- # val= 00:05:58.058 02:08:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.058 02:08:25 -- accel/accel.sh@20 -- # IFS=: 00:05:58.058 02:08:25 -- accel/accel.sh@20 -- # read -r var val 00:05:58.058 02:08:25 -- accel/accel.sh@21 -- # val=decompress 00:05:58.058 02:08:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.058 02:08:25 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:58.058 02:08:25 -- accel/accel.sh@20 -- # IFS=: 00:05:58.058 02:08:25 -- accel/accel.sh@20 -- # read -r var val 00:05:58.058 02:08:25 -- accel/accel.sh@21 -- # val='111250 bytes' 00:05:58.058 02:08:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.058 02:08:25 -- accel/accel.sh@20 -- # IFS=: 00:05:58.058 02:08:25 -- accel/accel.sh@20 -- # read -r var val 00:05:58.058 02:08:25 -- accel/accel.sh@21 -- # val= 00:05:58.058 02:08:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.058 02:08:25 -- accel/accel.sh@20 -- # IFS=: 00:05:58.058 02:08:25 -- accel/accel.sh@20 -- # read -r var val 00:05:58.058 02:08:25 -- accel/accel.sh@21 -- # val=software 00:05:58.058 02:08:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.058 02:08:25 -- accel/accel.sh@23 -- # accel_module=software 00:05:58.058 02:08:25 -- accel/accel.sh@20 -- # IFS=: 00:05:58.058 02:08:25 -- accel/accel.sh@20 -- # read -r var val 00:05:58.058 02:08:25 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:58.058 02:08:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.058 02:08:25 -- accel/accel.sh@20 -- # IFS=: 00:05:58.058 02:08:25 -- accel/accel.sh@20 -- # read -r var val 00:05:58.058 02:08:25 -- accel/accel.sh@21 -- # val=32 00:05:58.058 02:08:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.058 02:08:25 -- accel/accel.sh@20 -- # IFS=: 00:05:58.058 02:08:25 -- accel/accel.sh@20 -- # read -r var val 00:05:58.058 02:08:25 -- accel/accel.sh@21 -- # val=32 00:05:58.058 02:08:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.058 02:08:25 -- accel/accel.sh@20 -- # IFS=: 00:05:58.058 02:08:25 -- accel/accel.sh@20 -- # read -r var val 00:05:58.058 02:08:25 -- accel/accel.sh@21 -- # val=2 00:05:58.058 02:08:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.058 02:08:25 -- accel/accel.sh@20 -- # IFS=: 00:05:58.058 02:08:25 -- accel/accel.sh@20 -- # read -r var val 00:05:58.058 02:08:25 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:58.058 02:08:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.058 02:08:25 -- accel/accel.sh@20 -- # IFS=: 00:05:58.058 02:08:25 -- accel/accel.sh@20 -- # read -r var val 00:05:58.058 02:08:25 -- accel/accel.sh@21 -- # val=Yes 00:05:58.058 02:08:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.058 02:08:25 -- accel/accel.sh@20 -- # IFS=: 00:05:58.058 02:08:25 -- accel/accel.sh@20 -- # read -r var val 00:05:58.058 02:08:25 -- accel/accel.sh@21 -- # val= 00:05:58.058 02:08:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.058 02:08:25 -- accel/accel.sh@20 -- # IFS=: 00:05:58.058 02:08:25 -- accel/accel.sh@20 -- # read -r var val 00:05:58.058 02:08:25 -- accel/accel.sh@21 -- # val= 00:05:58.058 02:08:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.058 02:08:25 -- accel/accel.sh@20 -- # IFS=: 00:05:58.058 02:08:25 -- accel/accel.sh@20 -- # read -r var val 00:05:59.429 02:08:26 -- accel/accel.sh@21 -- # val= 00:05:59.429 02:08:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.429 02:08:26 -- accel/accel.sh@20 -- # IFS=: 00:05:59.429 02:08:26 -- accel/accel.sh@20 -- # read -r var val 00:05:59.429 02:08:26 -- accel/accel.sh@21 -- # val= 00:05:59.429 02:08:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.429 02:08:26 -- accel/accel.sh@20 -- # IFS=: 00:05:59.429 02:08:26 -- accel/accel.sh@20 -- # read -r var val 00:05:59.429 02:08:26 -- accel/accel.sh@21 -- # val= 00:05:59.429 02:08:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.429 02:08:26 -- accel/accel.sh@20 -- # IFS=: 00:05:59.429 02:08:26 -- accel/accel.sh@20 -- # read -r var val 00:05:59.429 02:08:26 -- accel/accel.sh@21 -- # val= 00:05:59.429 02:08:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.429 02:08:26 -- accel/accel.sh@20 -- # IFS=: 00:05:59.429 02:08:26 -- accel/accel.sh@20 -- # read -r var val 00:05:59.429 02:08:26 -- accel/accel.sh@21 -- # val= 00:05:59.429 02:08:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.429 02:08:26 -- accel/accel.sh@20 -- # IFS=: 00:05:59.429 02:08:26 -- accel/accel.sh@20 -- # read -r var val 00:05:59.429 02:08:26 -- accel/accel.sh@21 -- # val= 00:05:59.429 02:08:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.429 02:08:26 -- accel/accel.sh@20 -- # IFS=: 00:05:59.429 02:08:26 -- accel/accel.sh@20 -- # read -r var val 00:05:59.429 02:08:26 -- accel/accel.sh@21 -- # val= 00:05:59.429 02:08:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.429 02:08:26 -- accel/accel.sh@20 -- # IFS=: 00:05:59.429 02:08:26 -- accel/accel.sh@20 -- # read -r var val 00:05:59.429 02:08:26 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:59.429 02:08:26 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:05:59.429 02:08:26 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:59.429 00:05:59.429 real 0m3.030s 00:05:59.429 user 0m2.722s 00:05:59.429 sys 0m0.299s 00:05:59.429 02:08:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:59.429 02:08:26 -- common/autotest_common.sh@10 -- # set +x 00:05:59.429 ************************************ 00:05:59.429 END TEST accel_deomp_full_mthread 00:05:59.429 ************************************ 00:05:59.429 02:08:26 -- accel/accel.sh@116 -- # [[ n == y ]] 00:05:59.429 02:08:26 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:05:59.429 02:08:26 -- accel/accel.sh@129 -- # build_accel_config 00:05:59.429 02:08:26 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:05:59.429 02:08:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:59.429 02:08:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:59.429 02:08:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:59.429 02:08:26 -- common/autotest_common.sh@10 -- # set +x 00:05:59.429 02:08:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:59.429 02:08:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:59.429 02:08:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:59.429 02:08:26 -- accel/accel.sh@41 -- # local IFS=, 00:05:59.429 02:08:26 -- accel/accel.sh@42 -- # jq -r . 00:05:59.429 ************************************ 00:05:59.429 START TEST accel_dif_functional_tests 00:05:59.429 ************************************ 00:05:59.429 02:08:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:05:59.429 [2024-12-08 02:08:26.906520] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:59.429 [2024-12-08 02:08:26.906622] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2001421 ] 00:05:59.429 EAL: No free 2048 kB hugepages reported on node 1 00:05:59.429 [2024-12-08 02:08:26.966937] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:59.429 [2024-12-08 02:08:27.090204] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:59.429 [2024-12-08 02:08:27.090260] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:59.429 [2024-12-08 02:08:27.090263] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:59.429 00:05:59.429 00:05:59.429 CUnit - A unit testing framework for C - Version 2.1-3 00:05:59.429 http://cunit.sourceforge.net/ 00:05:59.429 00:05:59.429 00:05:59.429 Suite: accel_dif 00:05:59.429 Test: verify: DIF generated, GUARD check ...passed 00:05:59.429 Test: verify: DIF generated, APPTAG check ...passed 00:05:59.429 Test: verify: DIF generated, REFTAG check ...passed 00:05:59.430 Test: verify: DIF not generated, GUARD check ...[2024-12-08 02:08:27.193298] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:05:59.430 [2024-12-08 02:08:27.193372] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:05:59.430 passed 00:05:59.430 Test: verify: DIF not generated, APPTAG check ...[2024-12-08 02:08:27.193418] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:05:59.430 [2024-12-08 02:08:27.193448] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:05:59.430 passed 00:05:59.430 Test: verify: DIF not generated, REFTAG check ...[2024-12-08 02:08:27.193483] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:05:59.430 [2024-12-08 02:08:27.193510] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:05:59.430 passed 00:05:59.430 Test: verify: APPTAG correct, APPTAG check ...passed 00:05:59.430 Test: verify: APPTAG incorrect, APPTAG check ...[2024-12-08 02:08:27.193608] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:05:59.430 passed 00:05:59.430 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:05:59.430 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:05:59.430 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:05:59.430 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-12-08 02:08:27.193766] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:05:59.430 passed 00:05:59.430 Test: generate copy: DIF generated, GUARD check ...passed 00:05:59.430 Test: generate copy: DIF generated, APTTAG check ...passed 00:05:59.430 Test: generate copy: DIF generated, REFTAG check ...passed 00:05:59.430 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:05:59.430 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:05:59.430 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:05:59.430 Test: generate copy: iovecs-len validate ...[2024-12-08 02:08:27.194025] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:05:59.430 passed 00:05:59.430 Test: generate copy: buffer alignment validate ...passed 00:05:59.430 00:05:59.430 Run Summary: Type Total Ran Passed Failed Inactive 00:05:59.430 suites 1 1 n/a 0 0 00:05:59.430 tests 20 20 20 0 0 00:05:59.430 asserts 204 204 204 0 n/a 00:05:59.430 00:05:59.430 Elapsed time = 0.003 seconds 00:05:59.688 00:05:59.688 real 0m0.583s 00:05:59.688 user 0m0.881s 00:05:59.688 sys 0m0.182s 00:05:59.688 02:08:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:59.688 02:08:27 -- common/autotest_common.sh@10 -- # set +x 00:05:59.688 ************************************ 00:05:59.688 END TEST accel_dif_functional_tests 00:05:59.688 ************************************ 00:05:59.947 00:05:59.947 real 1m3.330s 00:05:59.947 user 1m11.108s 00:05:59.947 sys 0m7.299s 00:05:59.947 02:08:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:59.947 02:08:27 -- common/autotest_common.sh@10 -- # set +x 00:05:59.947 ************************************ 00:05:59.947 END TEST accel 00:05:59.947 ************************************ 00:05:59.947 02:08:27 -- spdk/autotest.sh@177 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:05:59.947 02:08:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:59.947 02:08:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:59.947 02:08:27 -- common/autotest_common.sh@10 -- # set +x 00:05:59.947 ************************************ 00:05:59.947 START TEST accel_rpc 00:05:59.947 ************************************ 00:05:59.948 02:08:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:05:59.948 * Looking for test storage... 00:05:59.948 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:05:59.948 02:08:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:59.948 02:08:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:59.948 02:08:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:59.948 02:08:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:59.948 02:08:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:59.948 02:08:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:59.948 02:08:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:59.948 02:08:27 -- scripts/common.sh@335 -- # IFS=.-: 00:05:59.948 02:08:27 -- scripts/common.sh@335 -- # read -ra ver1 00:05:59.948 02:08:27 -- scripts/common.sh@336 -- # IFS=.-: 00:05:59.948 02:08:27 -- scripts/common.sh@336 -- # read -ra ver2 00:05:59.948 02:08:27 -- scripts/common.sh@337 -- # local 'op=<' 00:05:59.948 02:08:27 -- scripts/common.sh@339 -- # ver1_l=2 00:05:59.948 02:08:27 -- scripts/common.sh@340 -- # ver2_l=1 00:05:59.948 02:08:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:59.948 02:08:27 -- scripts/common.sh@343 -- # case "$op" in 00:05:59.948 02:08:27 -- scripts/common.sh@344 -- # : 1 00:05:59.948 02:08:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:59.948 02:08:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:59.948 02:08:27 -- scripts/common.sh@364 -- # decimal 1 00:05:59.948 02:08:27 -- scripts/common.sh@352 -- # local d=1 00:05:59.948 02:08:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:59.948 02:08:27 -- scripts/common.sh@354 -- # echo 1 00:05:59.948 02:08:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:59.948 02:08:27 -- scripts/common.sh@365 -- # decimal 2 00:05:59.948 02:08:27 -- scripts/common.sh@352 -- # local d=2 00:05:59.948 02:08:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:59.948 02:08:27 -- scripts/common.sh@354 -- # echo 2 00:05:59.948 02:08:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:59.948 02:08:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:59.948 02:08:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:59.948 02:08:27 -- scripts/common.sh@367 -- # return 0 00:05:59.948 02:08:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:59.948 02:08:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:59.948 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:59.948 --rc genhtml_branch_coverage=1 00:05:59.948 --rc genhtml_function_coverage=1 00:05:59.948 --rc genhtml_legend=1 00:05:59.948 --rc geninfo_all_blocks=1 00:05:59.948 --rc geninfo_unexecuted_blocks=1 00:05:59.948 00:05:59.948 ' 00:05:59.948 02:08:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:59.948 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:59.948 --rc genhtml_branch_coverage=1 00:05:59.948 --rc genhtml_function_coverage=1 00:05:59.948 --rc genhtml_legend=1 00:05:59.948 --rc geninfo_all_blocks=1 00:05:59.948 --rc geninfo_unexecuted_blocks=1 00:05:59.948 00:05:59.948 ' 00:05:59.948 02:08:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:59.948 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:59.948 --rc genhtml_branch_coverage=1 00:05:59.948 --rc genhtml_function_coverage=1 00:05:59.948 --rc genhtml_legend=1 00:05:59.948 --rc geninfo_all_blocks=1 00:05:59.948 --rc geninfo_unexecuted_blocks=1 00:05:59.948 00:05:59.948 ' 00:05:59.948 02:08:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:59.948 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:59.948 --rc genhtml_branch_coverage=1 00:05:59.948 --rc genhtml_function_coverage=1 00:05:59.948 --rc genhtml_legend=1 00:05:59.948 --rc geninfo_all_blocks=1 00:05:59.948 --rc geninfo_unexecuted_blocks=1 00:05:59.948 00:05:59.948 ' 00:05:59.948 02:08:27 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:59.948 02:08:27 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=2001617 00:05:59.948 02:08:27 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:05:59.948 02:08:27 -- accel/accel_rpc.sh@15 -- # waitforlisten 2001617 00:05:59.948 02:08:27 -- common/autotest_common.sh@829 -- # '[' -z 2001617 ']' 00:05:59.948 02:08:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:59.948 02:08:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:59.948 02:08:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:59.948 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:59.948 02:08:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:59.948 02:08:27 -- common/autotest_common.sh@10 -- # set +x 00:05:59.948 [2024-12-08 02:08:27.674738] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:59.948 [2024-12-08 02:08:27.674827] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2001617 ] 00:05:59.948 EAL: No free 2048 kB hugepages reported on node 1 00:06:00.207 [2024-12-08 02:08:27.736182] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:00.207 [2024-12-08 02:08:27.853907] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:00.207 [2024-12-08 02:08:27.854100] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:01.163 02:08:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:01.163 02:08:28 -- common/autotest_common.sh@862 -- # return 0 00:06:01.163 02:08:28 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:06:01.163 02:08:28 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:06:01.163 02:08:28 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:06:01.163 02:08:28 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:06:01.163 02:08:28 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:06:01.163 02:08:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:01.163 02:08:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:01.163 02:08:28 -- common/autotest_common.sh@10 -- # set +x 00:06:01.163 ************************************ 00:06:01.163 START TEST accel_assign_opcode 00:06:01.163 ************************************ 00:06:01.163 02:08:28 -- common/autotest_common.sh@1114 -- # accel_assign_opcode_test_suite 00:06:01.163 02:08:28 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:06:01.163 02:08:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:01.163 02:08:28 -- common/autotest_common.sh@10 -- # set +x 00:06:01.163 [2024-12-08 02:08:28.668608] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:06:01.163 02:08:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:01.163 02:08:28 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:06:01.163 02:08:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:01.163 02:08:28 -- common/autotest_common.sh@10 -- # set +x 00:06:01.163 [2024-12-08 02:08:28.676614] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:06:01.163 02:08:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:01.164 02:08:28 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:06:01.164 02:08:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:01.164 02:08:28 -- common/autotest_common.sh@10 -- # set +x 00:06:01.164 02:08:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:01.164 02:08:28 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:06:01.164 02:08:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:01.164 02:08:28 -- common/autotest_common.sh@10 -- # set +x 00:06:01.164 02:08:28 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:06:01.164 02:08:28 -- accel/accel_rpc.sh@42 -- # grep software 00:06:01.164 02:08:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:01.421 software 00:06:01.421 00:06:01.421 real 0m0.304s 00:06:01.421 user 0m0.040s 00:06:01.421 sys 0m0.008s 00:06:01.421 02:08:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:01.421 02:08:28 -- common/autotest_common.sh@10 -- # set +x 00:06:01.421 ************************************ 00:06:01.421 END TEST accel_assign_opcode 00:06:01.421 ************************************ 00:06:01.421 02:08:28 -- accel/accel_rpc.sh@55 -- # killprocess 2001617 00:06:01.421 02:08:28 -- common/autotest_common.sh@936 -- # '[' -z 2001617 ']' 00:06:01.421 02:08:28 -- common/autotest_common.sh@940 -- # kill -0 2001617 00:06:01.421 02:08:28 -- common/autotest_common.sh@941 -- # uname 00:06:01.421 02:08:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:01.421 02:08:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2001617 00:06:01.421 02:08:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:01.421 02:08:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:01.421 02:08:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2001617' 00:06:01.421 killing process with pid 2001617 00:06:01.421 02:08:29 -- common/autotest_common.sh@955 -- # kill 2001617 00:06:01.421 02:08:29 -- common/autotest_common.sh@960 -- # wait 2001617 00:06:01.987 00:06:01.987 real 0m2.003s 00:06:01.987 user 0m2.155s 00:06:01.987 sys 0m0.470s 00:06:01.987 02:08:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:01.987 02:08:29 -- common/autotest_common.sh@10 -- # set +x 00:06:01.987 ************************************ 00:06:01.987 END TEST accel_rpc 00:06:01.987 ************************************ 00:06:01.987 02:08:29 -- spdk/autotest.sh@178 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:01.987 02:08:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:01.987 02:08:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:01.987 02:08:29 -- common/autotest_common.sh@10 -- # set +x 00:06:01.987 ************************************ 00:06:01.987 START TEST app_cmdline 00:06:01.987 ************************************ 00:06:01.987 02:08:29 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:01.987 * Looking for test storage... 00:06:01.987 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:01.987 02:08:29 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:01.987 02:08:29 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:01.987 02:08:29 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:01.987 02:08:29 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:01.987 02:08:29 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:01.987 02:08:29 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:01.987 02:08:29 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:01.987 02:08:29 -- scripts/common.sh@335 -- # IFS=.-: 00:06:01.987 02:08:29 -- scripts/common.sh@335 -- # read -ra ver1 00:06:01.987 02:08:29 -- scripts/common.sh@336 -- # IFS=.-: 00:06:01.987 02:08:29 -- scripts/common.sh@336 -- # read -ra ver2 00:06:01.987 02:08:29 -- scripts/common.sh@337 -- # local 'op=<' 00:06:01.987 02:08:29 -- scripts/common.sh@339 -- # ver1_l=2 00:06:01.987 02:08:29 -- scripts/common.sh@340 -- # ver2_l=1 00:06:01.987 02:08:29 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:01.987 02:08:29 -- scripts/common.sh@343 -- # case "$op" in 00:06:01.987 02:08:29 -- scripts/common.sh@344 -- # : 1 00:06:01.987 02:08:29 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:01.987 02:08:29 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:01.987 02:08:29 -- scripts/common.sh@364 -- # decimal 1 00:06:01.987 02:08:29 -- scripts/common.sh@352 -- # local d=1 00:06:01.987 02:08:29 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:01.987 02:08:29 -- scripts/common.sh@354 -- # echo 1 00:06:01.987 02:08:29 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:01.987 02:08:29 -- scripts/common.sh@365 -- # decimal 2 00:06:01.987 02:08:29 -- scripts/common.sh@352 -- # local d=2 00:06:01.987 02:08:29 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:01.987 02:08:29 -- scripts/common.sh@354 -- # echo 2 00:06:01.987 02:08:29 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:01.987 02:08:29 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:01.987 02:08:29 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:01.987 02:08:29 -- scripts/common.sh@367 -- # return 0 00:06:01.987 02:08:29 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:01.987 02:08:29 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:01.987 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:01.987 --rc genhtml_branch_coverage=1 00:06:01.987 --rc genhtml_function_coverage=1 00:06:01.988 --rc genhtml_legend=1 00:06:01.988 --rc geninfo_all_blocks=1 00:06:01.988 --rc geninfo_unexecuted_blocks=1 00:06:01.988 00:06:01.988 ' 00:06:01.988 02:08:29 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:01.988 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:01.988 --rc genhtml_branch_coverage=1 00:06:01.988 --rc genhtml_function_coverage=1 00:06:01.988 --rc genhtml_legend=1 00:06:01.988 --rc geninfo_all_blocks=1 00:06:01.988 --rc geninfo_unexecuted_blocks=1 00:06:01.988 00:06:01.988 ' 00:06:01.988 02:08:29 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:01.988 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:01.988 --rc genhtml_branch_coverage=1 00:06:01.988 --rc genhtml_function_coverage=1 00:06:01.988 --rc genhtml_legend=1 00:06:01.988 --rc geninfo_all_blocks=1 00:06:01.988 --rc geninfo_unexecuted_blocks=1 00:06:01.988 00:06:01.988 ' 00:06:01.988 02:08:29 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:01.988 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:01.988 --rc genhtml_branch_coverage=1 00:06:01.988 --rc genhtml_function_coverage=1 00:06:01.988 --rc genhtml_legend=1 00:06:01.988 --rc geninfo_all_blocks=1 00:06:01.988 --rc geninfo_unexecuted_blocks=1 00:06:01.988 00:06:01.988 ' 00:06:01.988 02:08:29 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:06:01.988 02:08:29 -- app/cmdline.sh@17 -- # spdk_tgt_pid=2001962 00:06:01.988 02:08:29 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:06:01.988 02:08:29 -- app/cmdline.sh@18 -- # waitforlisten 2001962 00:06:01.988 02:08:29 -- common/autotest_common.sh@829 -- # '[' -z 2001962 ']' 00:06:01.988 02:08:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:01.988 02:08:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:01.988 02:08:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:01.988 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:01.988 02:08:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:01.988 02:08:29 -- common/autotest_common.sh@10 -- # set +x 00:06:01.988 [2024-12-08 02:08:29.711979] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:01.988 [2024-12-08 02:08:29.712070] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2001962 ] 00:06:01.988 EAL: No free 2048 kB hugepages reported on node 1 00:06:02.246 [2024-12-08 02:08:29.767436] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:02.246 [2024-12-08 02:08:29.878615] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:02.246 [2024-12-08 02:08:29.878780] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:03.220 02:08:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:03.220 02:08:30 -- common/autotest_common.sh@862 -- # return 0 00:06:03.220 02:08:30 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:06:03.220 { 00:06:03.220 "version": "SPDK v24.01.1-pre git sha1 c13c99a5e", 00:06:03.220 "fields": { 00:06:03.220 "major": 24, 00:06:03.220 "minor": 1, 00:06:03.220 "patch": 1, 00:06:03.220 "suffix": "-pre", 00:06:03.220 "commit": "c13c99a5e" 00:06:03.220 } 00:06:03.220 } 00:06:03.478 02:08:31 -- app/cmdline.sh@22 -- # expected_methods=() 00:06:03.478 02:08:31 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:06:03.478 02:08:31 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:06:03.478 02:08:31 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:06:03.478 02:08:31 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:06:03.478 02:08:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:03.478 02:08:31 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:06:03.478 02:08:31 -- common/autotest_common.sh@10 -- # set +x 00:06:03.478 02:08:31 -- app/cmdline.sh@26 -- # sort 00:06:03.478 02:08:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:03.478 02:08:31 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:06:03.478 02:08:31 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:06:03.478 02:08:31 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:03.478 02:08:31 -- common/autotest_common.sh@650 -- # local es=0 00:06:03.478 02:08:31 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:03.478 02:08:31 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:03.478 02:08:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:03.478 02:08:31 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:03.478 02:08:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:03.478 02:08:31 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:03.478 02:08:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:03.478 02:08:31 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:03.478 02:08:31 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:06:03.478 02:08:31 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:03.736 request: 00:06:03.736 { 00:06:03.736 "method": "env_dpdk_get_mem_stats", 00:06:03.736 "req_id": 1 00:06:03.736 } 00:06:03.736 Got JSON-RPC error response 00:06:03.736 response: 00:06:03.736 { 00:06:03.736 "code": -32601, 00:06:03.736 "message": "Method not found" 00:06:03.736 } 00:06:03.736 02:08:31 -- common/autotest_common.sh@653 -- # es=1 00:06:03.736 02:08:31 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:03.736 02:08:31 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:03.736 02:08:31 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:03.736 02:08:31 -- app/cmdline.sh@1 -- # killprocess 2001962 00:06:03.736 02:08:31 -- common/autotest_common.sh@936 -- # '[' -z 2001962 ']' 00:06:03.736 02:08:31 -- common/autotest_common.sh@940 -- # kill -0 2001962 00:06:03.736 02:08:31 -- common/autotest_common.sh@941 -- # uname 00:06:03.736 02:08:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:03.736 02:08:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2001962 00:06:03.736 02:08:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:03.736 02:08:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:03.736 02:08:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2001962' 00:06:03.736 killing process with pid 2001962 00:06:03.736 02:08:31 -- common/autotest_common.sh@955 -- # kill 2001962 00:06:03.736 02:08:31 -- common/autotest_common.sh@960 -- # wait 2001962 00:06:04.302 00:06:04.302 real 0m2.278s 00:06:04.302 user 0m2.887s 00:06:04.302 sys 0m0.514s 00:06:04.302 02:08:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:04.302 02:08:31 -- common/autotest_common.sh@10 -- # set +x 00:06:04.302 ************************************ 00:06:04.302 END TEST app_cmdline 00:06:04.302 ************************************ 00:06:04.302 02:08:31 -- spdk/autotest.sh@179 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:04.302 02:08:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:04.302 02:08:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:04.303 02:08:31 -- common/autotest_common.sh@10 -- # set +x 00:06:04.303 ************************************ 00:06:04.303 START TEST version 00:06:04.303 ************************************ 00:06:04.303 02:08:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:04.303 * Looking for test storage... 00:06:04.303 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:04.303 02:08:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:04.303 02:08:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:04.303 02:08:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:04.303 02:08:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:04.303 02:08:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:04.303 02:08:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:04.303 02:08:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:04.303 02:08:31 -- scripts/common.sh@335 -- # IFS=.-: 00:06:04.303 02:08:31 -- scripts/common.sh@335 -- # read -ra ver1 00:06:04.303 02:08:31 -- scripts/common.sh@336 -- # IFS=.-: 00:06:04.303 02:08:31 -- scripts/common.sh@336 -- # read -ra ver2 00:06:04.303 02:08:31 -- scripts/common.sh@337 -- # local 'op=<' 00:06:04.303 02:08:31 -- scripts/common.sh@339 -- # ver1_l=2 00:06:04.303 02:08:31 -- scripts/common.sh@340 -- # ver2_l=1 00:06:04.303 02:08:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:04.303 02:08:31 -- scripts/common.sh@343 -- # case "$op" in 00:06:04.303 02:08:31 -- scripts/common.sh@344 -- # : 1 00:06:04.303 02:08:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:04.303 02:08:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:04.303 02:08:31 -- scripts/common.sh@364 -- # decimal 1 00:06:04.303 02:08:31 -- scripts/common.sh@352 -- # local d=1 00:06:04.303 02:08:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:04.303 02:08:31 -- scripts/common.sh@354 -- # echo 1 00:06:04.303 02:08:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:04.303 02:08:31 -- scripts/common.sh@365 -- # decimal 2 00:06:04.303 02:08:31 -- scripts/common.sh@352 -- # local d=2 00:06:04.303 02:08:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:04.303 02:08:31 -- scripts/common.sh@354 -- # echo 2 00:06:04.303 02:08:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:04.303 02:08:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:04.303 02:08:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:04.303 02:08:31 -- scripts/common.sh@367 -- # return 0 00:06:04.303 02:08:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:04.303 02:08:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:04.303 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:04.303 --rc genhtml_branch_coverage=1 00:06:04.303 --rc genhtml_function_coverage=1 00:06:04.303 --rc genhtml_legend=1 00:06:04.303 --rc geninfo_all_blocks=1 00:06:04.303 --rc geninfo_unexecuted_blocks=1 00:06:04.303 00:06:04.303 ' 00:06:04.303 02:08:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:04.303 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:04.303 --rc genhtml_branch_coverage=1 00:06:04.303 --rc genhtml_function_coverage=1 00:06:04.303 --rc genhtml_legend=1 00:06:04.303 --rc geninfo_all_blocks=1 00:06:04.303 --rc geninfo_unexecuted_blocks=1 00:06:04.303 00:06:04.303 ' 00:06:04.303 02:08:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:04.303 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:04.303 --rc genhtml_branch_coverage=1 00:06:04.303 --rc genhtml_function_coverage=1 00:06:04.303 --rc genhtml_legend=1 00:06:04.303 --rc geninfo_all_blocks=1 00:06:04.303 --rc geninfo_unexecuted_blocks=1 00:06:04.303 00:06:04.303 ' 00:06:04.303 02:08:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:04.303 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:04.303 --rc genhtml_branch_coverage=1 00:06:04.303 --rc genhtml_function_coverage=1 00:06:04.303 --rc genhtml_legend=1 00:06:04.303 --rc geninfo_all_blocks=1 00:06:04.303 --rc geninfo_unexecuted_blocks=1 00:06:04.303 00:06:04.303 ' 00:06:04.303 02:08:31 -- app/version.sh@17 -- # get_header_version major 00:06:04.303 02:08:31 -- app/version.sh@14 -- # cut -f2 00:06:04.303 02:08:31 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:04.303 02:08:31 -- app/version.sh@14 -- # tr -d '"' 00:06:04.303 02:08:31 -- app/version.sh@17 -- # major=24 00:06:04.303 02:08:31 -- app/version.sh@18 -- # get_header_version minor 00:06:04.303 02:08:31 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:04.303 02:08:31 -- app/version.sh@14 -- # cut -f2 00:06:04.303 02:08:31 -- app/version.sh@14 -- # tr -d '"' 00:06:04.303 02:08:31 -- app/version.sh@18 -- # minor=1 00:06:04.303 02:08:31 -- app/version.sh@19 -- # get_header_version patch 00:06:04.303 02:08:31 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:04.303 02:08:31 -- app/version.sh@14 -- # cut -f2 00:06:04.303 02:08:31 -- app/version.sh@14 -- # tr -d '"' 00:06:04.304 02:08:31 -- app/version.sh@19 -- # patch=1 00:06:04.304 02:08:31 -- app/version.sh@20 -- # get_header_version suffix 00:06:04.304 02:08:31 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:04.304 02:08:32 -- app/version.sh@14 -- # cut -f2 00:06:04.304 02:08:32 -- app/version.sh@14 -- # tr -d '"' 00:06:04.304 02:08:32 -- app/version.sh@20 -- # suffix=-pre 00:06:04.304 02:08:32 -- app/version.sh@22 -- # version=24.1 00:06:04.304 02:08:32 -- app/version.sh@25 -- # (( patch != 0 )) 00:06:04.304 02:08:32 -- app/version.sh@25 -- # version=24.1.1 00:06:04.304 02:08:32 -- app/version.sh@28 -- # version=24.1.1rc0 00:06:04.304 02:08:32 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:04.304 02:08:32 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:06:04.304 02:08:32 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:06:04.304 02:08:32 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:06:04.304 00:06:04.304 real 0m0.205s 00:06:04.304 user 0m0.132s 00:06:04.304 sys 0m0.097s 00:06:04.304 02:08:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:04.304 02:08:32 -- common/autotest_common.sh@10 -- # set +x 00:06:04.304 ************************************ 00:06:04.304 END TEST version 00:06:04.304 ************************************ 00:06:04.304 02:08:32 -- spdk/autotest.sh@181 -- # '[' 0 -eq 1 ']' 00:06:04.304 02:08:32 -- spdk/autotest.sh@191 -- # uname -s 00:06:04.304 02:08:32 -- spdk/autotest.sh@191 -- # [[ Linux == Linux ]] 00:06:04.304 02:08:32 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:04.304 02:08:32 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:04.304 02:08:32 -- spdk/autotest.sh@204 -- # '[' 0 -eq 1 ']' 00:06:04.304 02:08:32 -- spdk/autotest.sh@251 -- # '[' 0 -eq 1 ']' 00:06:04.304 02:08:32 -- spdk/autotest.sh@255 -- # timing_exit lib 00:06:04.304 02:08:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:04.304 02:08:32 -- common/autotest_common.sh@10 -- # set +x 00:06:04.562 02:08:32 -- spdk/autotest.sh@257 -- # '[' 0 -eq 1 ']' 00:06:04.562 02:08:32 -- spdk/autotest.sh@265 -- # '[' 0 -eq 1 ']' 00:06:04.562 02:08:32 -- spdk/autotest.sh@274 -- # '[' 1 -eq 1 ']' 00:06:04.562 02:08:32 -- spdk/autotest.sh@275 -- # export NET_TYPE 00:06:04.562 02:08:32 -- spdk/autotest.sh@278 -- # '[' tcp = rdma ']' 00:06:04.562 02:08:32 -- spdk/autotest.sh@281 -- # '[' tcp = tcp ']' 00:06:04.562 02:08:32 -- spdk/autotest.sh@282 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:04.562 02:08:32 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:04.562 02:08:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:04.562 02:08:32 -- common/autotest_common.sh@10 -- # set +x 00:06:04.562 ************************************ 00:06:04.562 START TEST nvmf_tcp 00:06:04.562 ************************************ 00:06:04.562 02:08:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:04.562 * Looking for test storage... 00:06:04.562 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:06:04.562 02:08:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:04.562 02:08:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:04.562 02:08:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:04.562 02:08:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:04.562 02:08:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:04.562 02:08:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:04.562 02:08:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:04.562 02:08:32 -- scripts/common.sh@335 -- # IFS=.-: 00:06:04.562 02:08:32 -- scripts/common.sh@335 -- # read -ra ver1 00:06:04.562 02:08:32 -- scripts/common.sh@336 -- # IFS=.-: 00:06:04.563 02:08:32 -- scripts/common.sh@336 -- # read -ra ver2 00:06:04.563 02:08:32 -- scripts/common.sh@337 -- # local 'op=<' 00:06:04.563 02:08:32 -- scripts/common.sh@339 -- # ver1_l=2 00:06:04.563 02:08:32 -- scripts/common.sh@340 -- # ver2_l=1 00:06:04.563 02:08:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:04.563 02:08:32 -- scripts/common.sh@343 -- # case "$op" in 00:06:04.563 02:08:32 -- scripts/common.sh@344 -- # : 1 00:06:04.563 02:08:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:04.563 02:08:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:04.563 02:08:32 -- scripts/common.sh@364 -- # decimal 1 00:06:04.563 02:08:32 -- scripts/common.sh@352 -- # local d=1 00:06:04.563 02:08:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:04.563 02:08:32 -- scripts/common.sh@354 -- # echo 1 00:06:04.563 02:08:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:04.563 02:08:32 -- scripts/common.sh@365 -- # decimal 2 00:06:04.563 02:08:32 -- scripts/common.sh@352 -- # local d=2 00:06:04.563 02:08:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:04.563 02:08:32 -- scripts/common.sh@354 -- # echo 2 00:06:04.563 02:08:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:04.563 02:08:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:04.563 02:08:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:04.563 02:08:32 -- scripts/common.sh@367 -- # return 0 00:06:04.563 02:08:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:04.563 02:08:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:04.563 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:04.563 --rc genhtml_branch_coverage=1 00:06:04.563 --rc genhtml_function_coverage=1 00:06:04.563 --rc genhtml_legend=1 00:06:04.563 --rc geninfo_all_blocks=1 00:06:04.563 --rc geninfo_unexecuted_blocks=1 00:06:04.563 00:06:04.563 ' 00:06:04.563 02:08:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:04.563 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:04.563 --rc genhtml_branch_coverage=1 00:06:04.563 --rc genhtml_function_coverage=1 00:06:04.563 --rc genhtml_legend=1 00:06:04.563 --rc geninfo_all_blocks=1 00:06:04.563 --rc geninfo_unexecuted_blocks=1 00:06:04.563 00:06:04.563 ' 00:06:04.563 02:08:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:04.563 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:04.563 --rc genhtml_branch_coverage=1 00:06:04.563 --rc genhtml_function_coverage=1 00:06:04.563 --rc genhtml_legend=1 00:06:04.563 --rc geninfo_all_blocks=1 00:06:04.563 --rc geninfo_unexecuted_blocks=1 00:06:04.563 00:06:04.563 ' 00:06:04.563 02:08:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:04.563 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:04.563 --rc genhtml_branch_coverage=1 00:06:04.563 --rc genhtml_function_coverage=1 00:06:04.563 --rc genhtml_legend=1 00:06:04.563 --rc geninfo_all_blocks=1 00:06:04.563 --rc geninfo_unexecuted_blocks=1 00:06:04.563 00:06:04.563 ' 00:06:04.563 02:08:32 -- nvmf/nvmf.sh@10 -- # uname -s 00:06:04.563 02:08:32 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:06:04.563 02:08:32 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:04.563 02:08:32 -- nvmf/common.sh@7 -- # uname -s 00:06:04.563 02:08:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:04.563 02:08:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:04.563 02:08:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:04.563 02:08:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:04.563 02:08:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:04.563 02:08:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:04.563 02:08:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:04.563 02:08:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:04.563 02:08:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:04.563 02:08:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:04.563 02:08:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:04.563 02:08:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:04.563 02:08:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:04.563 02:08:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:04.563 02:08:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:04.563 02:08:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:04.563 02:08:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:04.563 02:08:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:04.563 02:08:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:04.563 02:08:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:04.563 02:08:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:04.563 02:08:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:04.563 02:08:32 -- paths/export.sh@5 -- # export PATH 00:06:04.563 02:08:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:04.563 02:08:32 -- nvmf/common.sh@46 -- # : 0 00:06:04.563 02:08:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:04.563 02:08:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:04.563 02:08:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:04.563 02:08:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:04.563 02:08:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:04.563 02:08:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:04.563 02:08:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:04.563 02:08:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:04.563 02:08:32 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:06:04.563 02:08:32 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:06:04.563 02:08:32 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:06:04.563 02:08:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:04.563 02:08:32 -- common/autotest_common.sh@10 -- # set +x 00:06:04.563 02:08:32 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:06:04.563 02:08:32 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:04.563 02:08:32 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:04.563 02:08:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:04.563 02:08:32 -- common/autotest_common.sh@10 -- # set +x 00:06:04.563 ************************************ 00:06:04.563 START TEST nvmf_example 00:06:04.563 ************************************ 00:06:04.563 02:08:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:04.563 * Looking for test storage... 00:06:04.563 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:04.563 02:08:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:04.563 02:08:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:04.563 02:08:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:04.822 02:08:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:04.822 02:08:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:04.822 02:08:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:04.822 02:08:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:04.822 02:08:32 -- scripts/common.sh@335 -- # IFS=.-: 00:06:04.822 02:08:32 -- scripts/common.sh@335 -- # read -ra ver1 00:06:04.822 02:08:32 -- scripts/common.sh@336 -- # IFS=.-: 00:06:04.822 02:08:32 -- scripts/common.sh@336 -- # read -ra ver2 00:06:04.822 02:08:32 -- scripts/common.sh@337 -- # local 'op=<' 00:06:04.822 02:08:32 -- scripts/common.sh@339 -- # ver1_l=2 00:06:04.822 02:08:32 -- scripts/common.sh@340 -- # ver2_l=1 00:06:04.822 02:08:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:04.822 02:08:32 -- scripts/common.sh@343 -- # case "$op" in 00:06:04.822 02:08:32 -- scripts/common.sh@344 -- # : 1 00:06:04.822 02:08:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:04.822 02:08:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:04.822 02:08:32 -- scripts/common.sh@364 -- # decimal 1 00:06:04.822 02:08:32 -- scripts/common.sh@352 -- # local d=1 00:06:04.822 02:08:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:04.822 02:08:32 -- scripts/common.sh@354 -- # echo 1 00:06:04.822 02:08:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:04.822 02:08:32 -- scripts/common.sh@365 -- # decimal 2 00:06:04.822 02:08:32 -- scripts/common.sh@352 -- # local d=2 00:06:04.822 02:08:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:04.822 02:08:32 -- scripts/common.sh@354 -- # echo 2 00:06:04.822 02:08:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:04.822 02:08:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:04.822 02:08:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:04.822 02:08:32 -- scripts/common.sh@367 -- # return 0 00:06:04.822 02:08:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:04.822 02:08:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:04.822 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:04.822 --rc genhtml_branch_coverage=1 00:06:04.822 --rc genhtml_function_coverage=1 00:06:04.822 --rc genhtml_legend=1 00:06:04.822 --rc geninfo_all_blocks=1 00:06:04.822 --rc geninfo_unexecuted_blocks=1 00:06:04.822 00:06:04.822 ' 00:06:04.822 02:08:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:04.822 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:04.822 --rc genhtml_branch_coverage=1 00:06:04.822 --rc genhtml_function_coverage=1 00:06:04.822 --rc genhtml_legend=1 00:06:04.822 --rc geninfo_all_blocks=1 00:06:04.822 --rc geninfo_unexecuted_blocks=1 00:06:04.822 00:06:04.822 ' 00:06:04.822 02:08:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:04.822 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:04.822 --rc genhtml_branch_coverage=1 00:06:04.822 --rc genhtml_function_coverage=1 00:06:04.822 --rc genhtml_legend=1 00:06:04.822 --rc geninfo_all_blocks=1 00:06:04.822 --rc geninfo_unexecuted_blocks=1 00:06:04.822 00:06:04.822 ' 00:06:04.822 02:08:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:04.822 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:04.822 --rc genhtml_branch_coverage=1 00:06:04.822 --rc genhtml_function_coverage=1 00:06:04.822 --rc genhtml_legend=1 00:06:04.822 --rc geninfo_all_blocks=1 00:06:04.822 --rc geninfo_unexecuted_blocks=1 00:06:04.822 00:06:04.822 ' 00:06:04.822 02:08:32 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:04.822 02:08:32 -- nvmf/common.sh@7 -- # uname -s 00:06:04.822 02:08:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:04.822 02:08:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:04.822 02:08:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:04.822 02:08:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:04.822 02:08:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:04.822 02:08:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:04.822 02:08:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:04.822 02:08:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:04.822 02:08:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:04.822 02:08:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:04.822 02:08:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:04.822 02:08:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:04.822 02:08:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:04.822 02:08:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:04.822 02:08:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:04.822 02:08:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:04.822 02:08:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:04.822 02:08:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:04.822 02:08:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:04.822 02:08:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:04.823 02:08:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:04.823 02:08:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:04.823 02:08:32 -- paths/export.sh@5 -- # export PATH 00:06:04.823 02:08:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:04.823 02:08:32 -- nvmf/common.sh@46 -- # : 0 00:06:04.823 02:08:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:04.823 02:08:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:04.823 02:08:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:04.823 02:08:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:04.823 02:08:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:04.823 02:08:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:04.823 02:08:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:04.823 02:08:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:04.823 02:08:32 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:06:04.823 02:08:32 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:06:04.823 02:08:32 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:06:04.823 02:08:32 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:06:04.823 02:08:32 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:06:04.823 02:08:32 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:06:04.823 02:08:32 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:06:04.823 02:08:32 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:06:04.823 02:08:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:04.823 02:08:32 -- common/autotest_common.sh@10 -- # set +x 00:06:04.823 02:08:32 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:06:04.823 02:08:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:04.823 02:08:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:04.823 02:08:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:04.823 02:08:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:04.823 02:08:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:04.823 02:08:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:04.823 02:08:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:04.823 02:08:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:04.823 02:08:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:04.823 02:08:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:04.823 02:08:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:04.823 02:08:32 -- common/autotest_common.sh@10 -- # set +x 00:06:06.726 02:08:34 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:06.726 02:08:34 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:06.726 02:08:34 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:06.726 02:08:34 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:06.726 02:08:34 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:06.726 02:08:34 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:06.726 02:08:34 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:06.726 02:08:34 -- nvmf/common.sh@294 -- # net_devs=() 00:06:06.726 02:08:34 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:06.726 02:08:34 -- nvmf/common.sh@295 -- # e810=() 00:06:06.726 02:08:34 -- nvmf/common.sh@295 -- # local -ga e810 00:06:06.726 02:08:34 -- nvmf/common.sh@296 -- # x722=() 00:06:06.726 02:08:34 -- nvmf/common.sh@296 -- # local -ga x722 00:06:06.726 02:08:34 -- nvmf/common.sh@297 -- # mlx=() 00:06:06.726 02:08:34 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:06.726 02:08:34 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:06.726 02:08:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:06.726 02:08:34 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:06.726 02:08:34 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:06.726 02:08:34 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:06.726 02:08:34 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:06.726 02:08:34 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:06.726 02:08:34 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:06.726 02:08:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:06.726 02:08:34 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:06.726 02:08:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:06.726 02:08:34 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:06.726 02:08:34 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:06.726 02:08:34 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:06.726 02:08:34 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:06.726 02:08:34 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:06.726 02:08:34 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:06.726 02:08:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:06.726 02:08:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:06.726 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:06.726 02:08:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:06.726 02:08:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:06.726 02:08:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:06.726 02:08:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:06.726 02:08:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:06.726 02:08:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:06.726 02:08:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:06.726 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:06.726 02:08:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:06.726 02:08:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:06.726 02:08:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:06.726 02:08:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:06.726 02:08:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:06.726 02:08:34 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:06.726 02:08:34 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:06.726 02:08:34 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:06.726 02:08:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:06.726 02:08:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:06.726 02:08:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:06.726 02:08:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:06.726 02:08:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:06.726 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:06.726 02:08:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:06.726 02:08:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:06.726 02:08:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:06.726 02:08:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:06.726 02:08:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:06.726 02:08:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:06.726 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:06.727 02:08:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:06.727 02:08:34 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:06.727 02:08:34 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:06.727 02:08:34 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:06.727 02:08:34 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:06.727 02:08:34 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:06.727 02:08:34 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:06.727 02:08:34 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:06.727 02:08:34 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:06.727 02:08:34 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:06.727 02:08:34 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:06.727 02:08:34 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:06.727 02:08:34 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:06.727 02:08:34 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:06.727 02:08:34 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:06.727 02:08:34 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:06.727 02:08:34 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:06.727 02:08:34 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:06.727 02:08:34 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:06.727 02:08:34 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:06.727 02:08:34 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:06.985 02:08:34 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:06.985 02:08:34 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:06.985 02:08:34 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:06.985 02:08:34 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:06.985 02:08:34 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:06.985 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:06.985 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.245 ms 00:06:06.985 00:06:06.985 --- 10.0.0.2 ping statistics --- 00:06:06.985 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:06.985 rtt min/avg/max/mdev = 0.245/0.245/0.245/0.000 ms 00:06:06.985 02:08:34 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:06.985 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:06.985 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.115 ms 00:06:06.985 00:06:06.985 --- 10.0.0.1 ping statistics --- 00:06:06.985 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:06.985 rtt min/avg/max/mdev = 0.115/0.115/0.115/0.000 ms 00:06:06.985 02:08:34 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:06.985 02:08:34 -- nvmf/common.sh@410 -- # return 0 00:06:06.985 02:08:34 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:06.985 02:08:34 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:06.985 02:08:34 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:06.985 02:08:34 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:06.985 02:08:34 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:06.985 02:08:34 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:06.985 02:08:34 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:06.985 02:08:34 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:06:06.985 02:08:34 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:06:06.985 02:08:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:06.985 02:08:34 -- common/autotest_common.sh@10 -- # set +x 00:06:06.985 02:08:34 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:06:06.985 02:08:34 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:06:06.985 02:08:34 -- target/nvmf_example.sh@34 -- # nvmfpid=2004029 00:06:06.985 02:08:34 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:06:06.985 02:08:34 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:06:06.985 02:08:34 -- target/nvmf_example.sh@36 -- # waitforlisten 2004029 00:06:06.985 02:08:34 -- common/autotest_common.sh@829 -- # '[' -z 2004029 ']' 00:06:06.985 02:08:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:06.985 02:08:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:06.985 02:08:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:06.985 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:06.985 02:08:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:06.985 02:08:34 -- common/autotest_common.sh@10 -- # set +x 00:06:06.985 EAL: No free 2048 kB hugepages reported on node 1 00:06:07.918 02:08:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:07.918 02:08:35 -- common/autotest_common.sh@862 -- # return 0 00:06:07.918 02:08:35 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:06:07.918 02:08:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:07.918 02:08:35 -- common/autotest_common.sh@10 -- # set +x 00:06:07.918 02:08:35 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:06:07.918 02:08:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:07.918 02:08:35 -- common/autotest_common.sh@10 -- # set +x 00:06:07.918 02:08:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:07.918 02:08:35 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:06:07.918 02:08:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:07.918 02:08:35 -- common/autotest_common.sh@10 -- # set +x 00:06:07.918 02:08:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:07.918 02:08:35 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:06:07.918 02:08:35 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:07.918 02:08:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:07.918 02:08:35 -- common/autotest_common.sh@10 -- # set +x 00:06:08.175 02:08:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:08.175 02:08:35 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:06:08.175 02:08:35 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:06:08.175 02:08:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:08.175 02:08:35 -- common/autotest_common.sh@10 -- # set +x 00:06:08.175 02:08:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:08.175 02:08:35 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:08.175 02:08:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:08.175 02:08:35 -- common/autotest_common.sh@10 -- # set +x 00:06:08.175 02:08:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:08.175 02:08:35 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:06:08.175 02:08:35 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:06:08.176 EAL: No free 2048 kB hugepages reported on node 1 00:06:18.140 Initializing NVMe Controllers 00:06:18.140 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:06:18.140 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:06:18.140 Initialization complete. Launching workers. 00:06:18.140 ======================================================== 00:06:18.140 Latency(us) 00:06:18.140 Device Information : IOPS MiB/s Average min max 00:06:18.140 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15401.06 60.16 4155.33 846.90 15670.78 00:06:18.140 ======================================================== 00:06:18.140 Total : 15401.06 60.16 4155.33 846.90 15670.78 00:06:18.140 00:06:18.397 02:08:45 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:06:18.397 02:08:45 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:06:18.397 02:08:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:06:18.397 02:08:45 -- nvmf/common.sh@116 -- # sync 00:06:18.397 02:08:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:06:18.397 02:08:45 -- nvmf/common.sh@119 -- # set +e 00:06:18.397 02:08:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:06:18.397 02:08:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:06:18.397 rmmod nvme_tcp 00:06:18.397 rmmod nvme_fabrics 00:06:18.397 rmmod nvme_keyring 00:06:18.397 02:08:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:06:18.397 02:08:45 -- nvmf/common.sh@123 -- # set -e 00:06:18.397 02:08:45 -- nvmf/common.sh@124 -- # return 0 00:06:18.397 02:08:45 -- nvmf/common.sh@477 -- # '[' -n 2004029 ']' 00:06:18.397 02:08:45 -- nvmf/common.sh@478 -- # killprocess 2004029 00:06:18.397 02:08:45 -- common/autotest_common.sh@936 -- # '[' -z 2004029 ']' 00:06:18.397 02:08:45 -- common/autotest_common.sh@940 -- # kill -0 2004029 00:06:18.397 02:08:45 -- common/autotest_common.sh@941 -- # uname 00:06:18.397 02:08:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:18.397 02:08:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2004029 00:06:18.397 02:08:46 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:06:18.397 02:08:46 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:06:18.397 02:08:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2004029' 00:06:18.397 killing process with pid 2004029 00:06:18.397 02:08:46 -- common/autotest_common.sh@955 -- # kill 2004029 00:06:18.397 02:08:46 -- common/autotest_common.sh@960 -- # wait 2004029 00:06:18.655 nvmf threads initialize successfully 00:06:18.655 bdev subsystem init successfully 00:06:18.655 created a nvmf target service 00:06:18.655 create targets's poll groups done 00:06:18.655 all subsystems of target started 00:06:18.655 nvmf target is running 00:06:18.655 all subsystems of target stopped 00:06:18.655 destroy targets's poll groups done 00:06:18.655 destroyed the nvmf target service 00:06:18.655 bdev subsystem finish successfully 00:06:18.655 nvmf threads destroy successfully 00:06:18.655 02:08:46 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:06:18.655 02:08:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:06:18.655 02:08:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:06:18.655 02:08:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:06:18.655 02:08:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:06:18.655 02:08:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:18.655 02:08:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:18.655 02:08:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:20.556 02:08:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:06:20.556 02:08:48 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:06:20.556 02:08:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:20.556 02:08:48 -- common/autotest_common.sh@10 -- # set +x 00:06:20.556 00:06:20.556 real 0m16.074s 00:06:20.556 user 0m45.531s 00:06:20.556 sys 0m3.222s 00:06:20.556 02:08:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:20.556 02:08:48 -- common/autotest_common.sh@10 -- # set +x 00:06:20.556 ************************************ 00:06:20.556 END TEST nvmf_example 00:06:20.556 ************************************ 00:06:20.815 02:08:48 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:20.815 02:08:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:20.815 02:08:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:20.815 02:08:48 -- common/autotest_common.sh@10 -- # set +x 00:06:20.815 ************************************ 00:06:20.815 START TEST nvmf_filesystem 00:06:20.815 ************************************ 00:06:20.815 02:08:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:20.815 * Looking for test storage... 00:06:20.815 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:20.815 02:08:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:20.815 02:08:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:20.815 02:08:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:20.815 02:08:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:20.815 02:08:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:20.815 02:08:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:20.815 02:08:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:20.815 02:08:48 -- scripts/common.sh@335 -- # IFS=.-: 00:06:20.815 02:08:48 -- scripts/common.sh@335 -- # read -ra ver1 00:06:20.815 02:08:48 -- scripts/common.sh@336 -- # IFS=.-: 00:06:20.815 02:08:48 -- scripts/common.sh@336 -- # read -ra ver2 00:06:20.815 02:08:48 -- scripts/common.sh@337 -- # local 'op=<' 00:06:20.815 02:08:48 -- scripts/common.sh@339 -- # ver1_l=2 00:06:20.815 02:08:48 -- scripts/common.sh@340 -- # ver2_l=1 00:06:20.815 02:08:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:20.815 02:08:48 -- scripts/common.sh@343 -- # case "$op" in 00:06:20.815 02:08:48 -- scripts/common.sh@344 -- # : 1 00:06:20.815 02:08:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:20.815 02:08:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:20.815 02:08:48 -- scripts/common.sh@364 -- # decimal 1 00:06:20.815 02:08:48 -- scripts/common.sh@352 -- # local d=1 00:06:20.815 02:08:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:20.815 02:08:48 -- scripts/common.sh@354 -- # echo 1 00:06:20.815 02:08:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:20.815 02:08:48 -- scripts/common.sh@365 -- # decimal 2 00:06:20.815 02:08:48 -- scripts/common.sh@352 -- # local d=2 00:06:20.815 02:08:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:20.815 02:08:48 -- scripts/common.sh@354 -- # echo 2 00:06:20.815 02:08:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:20.815 02:08:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:20.815 02:08:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:20.815 02:08:48 -- scripts/common.sh@367 -- # return 0 00:06:20.815 02:08:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:20.815 02:08:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:20.815 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:20.815 --rc genhtml_branch_coverage=1 00:06:20.815 --rc genhtml_function_coverage=1 00:06:20.815 --rc genhtml_legend=1 00:06:20.815 --rc geninfo_all_blocks=1 00:06:20.815 --rc geninfo_unexecuted_blocks=1 00:06:20.815 00:06:20.815 ' 00:06:20.815 02:08:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:20.815 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:20.815 --rc genhtml_branch_coverage=1 00:06:20.815 --rc genhtml_function_coverage=1 00:06:20.815 --rc genhtml_legend=1 00:06:20.815 --rc geninfo_all_blocks=1 00:06:20.815 --rc geninfo_unexecuted_blocks=1 00:06:20.815 00:06:20.815 ' 00:06:20.815 02:08:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:20.815 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:20.815 --rc genhtml_branch_coverage=1 00:06:20.815 --rc genhtml_function_coverage=1 00:06:20.815 --rc genhtml_legend=1 00:06:20.815 --rc geninfo_all_blocks=1 00:06:20.815 --rc geninfo_unexecuted_blocks=1 00:06:20.815 00:06:20.815 ' 00:06:20.815 02:08:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:20.815 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:20.815 --rc genhtml_branch_coverage=1 00:06:20.815 --rc genhtml_function_coverage=1 00:06:20.815 --rc genhtml_legend=1 00:06:20.815 --rc geninfo_all_blocks=1 00:06:20.815 --rc geninfo_unexecuted_blocks=1 00:06:20.815 00:06:20.815 ' 00:06:20.815 02:08:48 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:06:20.815 02:08:48 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:06:20.815 02:08:48 -- common/autotest_common.sh@34 -- # set -e 00:06:20.815 02:08:48 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:06:20.815 02:08:48 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:06:20.815 02:08:48 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:06:20.815 02:08:48 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:06:20.815 02:08:48 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:06:20.815 02:08:48 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:06:20.815 02:08:48 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:06:20.815 02:08:48 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:06:20.815 02:08:48 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:06:20.815 02:08:48 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:06:20.815 02:08:48 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:06:20.815 02:08:48 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:06:20.815 02:08:48 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:06:20.815 02:08:48 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:06:20.815 02:08:48 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:06:20.815 02:08:48 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:06:20.815 02:08:48 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:06:20.815 02:08:48 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:06:20.815 02:08:48 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:06:20.815 02:08:48 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:06:20.815 02:08:48 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:06:20.815 02:08:48 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:06:20.815 02:08:48 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:20.815 02:08:48 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:06:20.815 02:08:48 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:06:20.815 02:08:48 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:06:20.815 02:08:48 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:06:20.815 02:08:48 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:06:20.815 02:08:48 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:06:20.815 02:08:48 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:06:20.815 02:08:48 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:06:20.815 02:08:48 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:06:20.815 02:08:48 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:06:20.815 02:08:48 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:06:20.815 02:08:48 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:06:20.815 02:08:48 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:06:20.815 02:08:48 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:06:20.815 02:08:48 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:06:20.815 02:08:48 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:06:20.815 02:08:48 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:20.815 02:08:48 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:06:20.815 02:08:48 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:06:20.816 02:08:48 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:06:20.816 02:08:48 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:06:20.816 02:08:48 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:06:20.816 02:08:48 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:06:20.816 02:08:48 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:06:20.816 02:08:48 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:06:20.816 02:08:48 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:06:20.816 02:08:48 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:06:20.816 02:08:48 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:06:20.816 02:08:48 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:06:20.816 02:08:48 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:06:20.816 02:08:48 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:06:20.816 02:08:48 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:06:20.816 02:08:48 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:06:20.816 02:08:48 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:06:20.816 02:08:48 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:06:20.816 02:08:48 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:06:20.816 02:08:48 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:06:20.816 02:08:48 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:06:20.816 02:08:48 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:06:20.816 02:08:48 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:06:20.816 02:08:48 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:06:20.816 02:08:48 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR= 00:06:20.816 02:08:48 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:06:20.816 02:08:48 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:06:20.816 02:08:48 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:06:20.816 02:08:48 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:06:20.816 02:08:48 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:06:20.816 02:08:48 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:06:20.816 02:08:48 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:06:20.816 02:08:48 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:06:20.816 02:08:48 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:06:20.816 02:08:48 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:06:20.816 02:08:48 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:06:20.816 02:08:48 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:06:20.816 02:08:48 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:06:20.816 02:08:48 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:06:20.816 02:08:48 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:06:20.816 02:08:48 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:06:20.816 02:08:48 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:06:20.816 02:08:48 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:06:20.816 02:08:48 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:20.816 02:08:48 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:20.816 02:08:48 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:20.816 02:08:48 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:20.816 02:08:48 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:20.816 02:08:48 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:20.816 02:08:48 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:20.816 02:08:48 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:20.816 02:08:48 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:06:20.816 02:08:48 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:06:20.816 02:08:48 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:06:20.816 02:08:48 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:06:20.816 02:08:48 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:06:20.816 02:08:48 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:06:20.816 02:08:48 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:06:20.816 02:08:48 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:06:20.816 #define SPDK_CONFIG_H 00:06:20.816 #define SPDK_CONFIG_APPS 1 00:06:20.816 #define SPDK_CONFIG_ARCH native 00:06:20.816 #undef SPDK_CONFIG_ASAN 00:06:20.816 #undef SPDK_CONFIG_AVAHI 00:06:20.816 #undef SPDK_CONFIG_CET 00:06:20.816 #define SPDK_CONFIG_COVERAGE 1 00:06:20.816 #define SPDK_CONFIG_CROSS_PREFIX 00:06:20.816 #undef SPDK_CONFIG_CRYPTO 00:06:20.816 #undef SPDK_CONFIG_CRYPTO_MLX5 00:06:20.816 #undef SPDK_CONFIG_CUSTOMOCF 00:06:20.816 #undef SPDK_CONFIG_DAOS 00:06:20.816 #define SPDK_CONFIG_DAOS_DIR 00:06:20.816 #define SPDK_CONFIG_DEBUG 1 00:06:20.816 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:06:20.816 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:20.816 #define SPDK_CONFIG_DPDK_INC_DIR 00:06:20.816 #define SPDK_CONFIG_DPDK_LIB_DIR 00:06:20.816 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:06:20.816 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:20.816 #define SPDK_CONFIG_EXAMPLES 1 00:06:20.816 #undef SPDK_CONFIG_FC 00:06:20.816 #define SPDK_CONFIG_FC_PATH 00:06:20.816 #define SPDK_CONFIG_FIO_PLUGIN 1 00:06:20.816 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:06:20.816 #undef SPDK_CONFIG_FUSE 00:06:20.816 #undef SPDK_CONFIG_FUZZER 00:06:20.816 #define SPDK_CONFIG_FUZZER_LIB 00:06:20.816 #undef SPDK_CONFIG_GOLANG 00:06:20.816 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:06:20.816 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:06:20.816 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:06:20.816 #undef SPDK_CONFIG_HAVE_LIBBSD 00:06:20.816 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:06:20.816 #define SPDK_CONFIG_IDXD 1 00:06:20.816 #define SPDK_CONFIG_IDXD_KERNEL 1 00:06:20.816 #undef SPDK_CONFIG_IPSEC_MB 00:06:20.816 #define SPDK_CONFIG_IPSEC_MB_DIR 00:06:20.816 #define SPDK_CONFIG_ISAL 1 00:06:20.816 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:06:20.816 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:06:20.816 #define SPDK_CONFIG_LIBDIR 00:06:20.816 #undef SPDK_CONFIG_LTO 00:06:20.816 #define SPDK_CONFIG_MAX_LCORES 00:06:20.816 #define SPDK_CONFIG_NVME_CUSE 1 00:06:20.816 #undef SPDK_CONFIG_OCF 00:06:20.816 #define SPDK_CONFIG_OCF_PATH 00:06:20.816 #define SPDK_CONFIG_OPENSSL_PATH 00:06:20.816 #undef SPDK_CONFIG_PGO_CAPTURE 00:06:20.816 #undef SPDK_CONFIG_PGO_USE 00:06:20.816 #define SPDK_CONFIG_PREFIX /usr/local 00:06:20.816 #undef SPDK_CONFIG_RAID5F 00:06:20.816 #undef SPDK_CONFIG_RBD 00:06:20.816 #define SPDK_CONFIG_RDMA 1 00:06:20.816 #define SPDK_CONFIG_RDMA_PROV verbs 00:06:20.816 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:06:20.816 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:06:20.816 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:06:20.816 #define SPDK_CONFIG_SHARED 1 00:06:20.816 #undef SPDK_CONFIG_SMA 00:06:20.816 #define SPDK_CONFIG_TESTS 1 00:06:20.816 #undef SPDK_CONFIG_TSAN 00:06:20.816 #define SPDK_CONFIG_UBLK 1 00:06:20.816 #define SPDK_CONFIG_UBSAN 1 00:06:20.816 #undef SPDK_CONFIG_UNIT_TESTS 00:06:20.816 #undef SPDK_CONFIG_URING 00:06:20.816 #define SPDK_CONFIG_URING_PATH 00:06:20.816 #undef SPDK_CONFIG_URING_ZNS 00:06:20.816 #undef SPDK_CONFIG_USDT 00:06:20.816 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:06:20.816 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:06:20.816 #undef SPDK_CONFIG_VFIO_USER 00:06:20.816 #define SPDK_CONFIG_VFIO_USER_DIR 00:06:20.816 #define SPDK_CONFIG_VHOST 1 00:06:20.816 #define SPDK_CONFIG_VIRTIO 1 00:06:20.816 #undef SPDK_CONFIG_VTUNE 00:06:20.816 #define SPDK_CONFIG_VTUNE_DIR 00:06:20.816 #define SPDK_CONFIG_WERROR 1 00:06:20.816 #define SPDK_CONFIG_WPDK_DIR 00:06:20.816 #undef SPDK_CONFIG_XNVME 00:06:20.816 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:06:20.816 02:08:48 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:06:20.816 02:08:48 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:20.816 02:08:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:20.816 02:08:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:20.816 02:08:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:20.816 02:08:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:20.816 02:08:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:20.816 02:08:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:20.816 02:08:48 -- paths/export.sh@5 -- # export PATH 00:06:20.816 02:08:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:20.816 02:08:48 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:20.816 02:08:48 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:20.817 02:08:48 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:20.817 02:08:48 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:20.817 02:08:48 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:06:20.817 02:08:48 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:20.817 02:08:48 -- pm/common@16 -- # TEST_TAG=N/A 00:06:20.817 02:08:48 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:06:20.817 02:08:48 -- common/autotest_common.sh@52 -- # : 1 00:06:20.817 02:08:48 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:06:20.817 02:08:48 -- common/autotest_common.sh@56 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:06:20.817 02:08:48 -- common/autotest_common.sh@58 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:06:20.817 02:08:48 -- common/autotest_common.sh@60 -- # : 1 00:06:20.817 02:08:48 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:06:20.817 02:08:48 -- common/autotest_common.sh@62 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:06:20.817 02:08:48 -- common/autotest_common.sh@64 -- # : 00:06:20.817 02:08:48 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:06:20.817 02:08:48 -- common/autotest_common.sh@66 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:06:20.817 02:08:48 -- common/autotest_common.sh@68 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:06:20.817 02:08:48 -- common/autotest_common.sh@70 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:06:20.817 02:08:48 -- common/autotest_common.sh@72 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:06:20.817 02:08:48 -- common/autotest_common.sh@74 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:06:20.817 02:08:48 -- common/autotest_common.sh@76 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:06:20.817 02:08:48 -- common/autotest_common.sh@78 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:06:20.817 02:08:48 -- common/autotest_common.sh@80 -- # : 1 00:06:20.817 02:08:48 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:06:20.817 02:08:48 -- common/autotest_common.sh@82 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:06:20.817 02:08:48 -- common/autotest_common.sh@84 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:06:20.817 02:08:48 -- common/autotest_common.sh@86 -- # : 1 00:06:20.817 02:08:48 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:06:20.817 02:08:48 -- common/autotest_common.sh@88 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:06:20.817 02:08:48 -- common/autotest_common.sh@90 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:06:20.817 02:08:48 -- common/autotest_common.sh@92 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:06:20.817 02:08:48 -- common/autotest_common.sh@94 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:06:20.817 02:08:48 -- common/autotest_common.sh@96 -- # : tcp 00:06:20.817 02:08:48 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:06:20.817 02:08:48 -- common/autotest_common.sh@98 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:06:20.817 02:08:48 -- common/autotest_common.sh@100 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:06:20.817 02:08:48 -- common/autotest_common.sh@102 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:06:20.817 02:08:48 -- common/autotest_common.sh@104 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:06:20.817 02:08:48 -- common/autotest_common.sh@106 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:06:20.817 02:08:48 -- common/autotest_common.sh@108 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:06:20.817 02:08:48 -- common/autotest_common.sh@110 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:06:20.817 02:08:48 -- common/autotest_common.sh@112 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:06:20.817 02:08:48 -- common/autotest_common.sh@114 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:06:20.817 02:08:48 -- common/autotest_common.sh@116 -- # : 1 00:06:20.817 02:08:48 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:06:20.817 02:08:48 -- common/autotest_common.sh@118 -- # : 00:06:20.817 02:08:48 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:06:20.817 02:08:48 -- common/autotest_common.sh@120 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:06:20.817 02:08:48 -- common/autotest_common.sh@122 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:06:20.817 02:08:48 -- common/autotest_common.sh@124 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:06:20.817 02:08:48 -- common/autotest_common.sh@126 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:06:20.817 02:08:48 -- common/autotest_common.sh@128 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:06:20.817 02:08:48 -- common/autotest_common.sh@130 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:06:20.817 02:08:48 -- common/autotest_common.sh@132 -- # : 00:06:20.817 02:08:48 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:06:20.817 02:08:48 -- common/autotest_common.sh@134 -- # : true 00:06:20.817 02:08:48 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:06:20.817 02:08:48 -- common/autotest_common.sh@136 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:06:20.817 02:08:48 -- common/autotest_common.sh@138 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:06:20.817 02:08:48 -- common/autotest_common.sh@140 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:06:20.817 02:08:48 -- common/autotest_common.sh@142 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:06:20.817 02:08:48 -- common/autotest_common.sh@144 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:06:20.817 02:08:48 -- common/autotest_common.sh@146 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:06:20.817 02:08:48 -- common/autotest_common.sh@148 -- # : e810 00:06:20.817 02:08:48 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:06:20.817 02:08:48 -- common/autotest_common.sh@150 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:06:20.817 02:08:48 -- common/autotest_common.sh@152 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:06:20.817 02:08:48 -- common/autotest_common.sh@154 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:06:20.817 02:08:48 -- common/autotest_common.sh@156 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:06:20.817 02:08:48 -- common/autotest_common.sh@158 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:06:20.817 02:08:48 -- common/autotest_common.sh@160 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:06:20.817 02:08:48 -- common/autotest_common.sh@163 -- # : 00:06:20.817 02:08:48 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:06:20.817 02:08:48 -- common/autotest_common.sh@165 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:06:20.817 02:08:48 -- common/autotest_common.sh@167 -- # : 0 00:06:20.817 02:08:48 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:06:20.817 02:08:48 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:20.817 02:08:48 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:20.817 02:08:48 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:20.817 02:08:48 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:20.817 02:08:48 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:20.817 02:08:48 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:20.817 02:08:48 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:20.817 02:08:48 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:20.817 02:08:48 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:06:20.817 02:08:48 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:06:20.818 02:08:48 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:20.818 02:08:48 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:20.818 02:08:48 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:06:20.818 02:08:48 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:06:20.818 02:08:48 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:20.818 02:08:48 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:20.818 02:08:48 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:20.818 02:08:48 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:20.818 02:08:48 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:06:20.818 02:08:48 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:06:20.818 02:08:48 -- common/autotest_common.sh@196 -- # cat 00:06:20.818 02:08:48 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:06:20.818 02:08:48 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:20.818 02:08:48 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:20.818 02:08:48 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:20.818 02:08:48 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:20.818 02:08:48 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:06:20.818 02:08:48 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:06:20.818 02:08:48 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:20.818 02:08:48 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:20.818 02:08:48 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:20.818 02:08:48 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:20.818 02:08:48 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:20.818 02:08:48 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:20.818 02:08:48 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:20.818 02:08:48 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:20.818 02:08:48 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:20.818 02:08:48 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:20.818 02:08:48 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:20.818 02:08:48 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:20.818 02:08:48 -- common/autotest_common.sh@247 -- # _LCOV_MAIN=0 00:06:20.818 02:08:48 -- common/autotest_common.sh@248 -- # _LCOV_LLVM=1 00:06:20.818 02:08:48 -- common/autotest_common.sh@249 -- # _LCOV= 00:06:20.818 02:08:48 -- common/autotest_common.sh@250 -- # [[ '' == *clang* ]] 00:06:20.818 02:08:48 -- common/autotest_common.sh@250 -- # [[ 0 -eq 1 ]] 00:06:20.818 02:08:48 -- common/autotest_common.sh@252 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:06:20.818 02:08:48 -- common/autotest_common.sh@253 -- # _lcov_opt[_LCOV_MAIN]= 00:06:20.818 02:08:48 -- common/autotest_common.sh@255 -- # lcov_opt= 00:06:20.818 02:08:48 -- common/autotest_common.sh@258 -- # '[' 0 -eq 0 ']' 00:06:20.818 02:08:48 -- common/autotest_common.sh@259 -- # export valgrind= 00:06:20.818 02:08:48 -- common/autotest_common.sh@259 -- # valgrind= 00:06:20.818 02:08:48 -- common/autotest_common.sh@265 -- # uname -s 00:06:20.818 02:08:48 -- common/autotest_common.sh@265 -- # '[' Linux = Linux ']' 00:06:20.818 02:08:48 -- common/autotest_common.sh@266 -- # HUGEMEM=4096 00:06:20.818 02:08:48 -- common/autotest_common.sh@267 -- # export CLEAR_HUGE=yes 00:06:20.818 02:08:48 -- common/autotest_common.sh@267 -- # CLEAR_HUGE=yes 00:06:20.818 02:08:48 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:20.818 02:08:48 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:20.818 02:08:48 -- common/autotest_common.sh@275 -- # MAKE=make 00:06:20.818 02:08:48 -- common/autotest_common.sh@276 -- # MAKEFLAGS=-j48 00:06:20.818 02:08:48 -- common/autotest_common.sh@292 -- # export HUGEMEM=4096 00:06:20.818 02:08:48 -- common/autotest_common.sh@292 -- # HUGEMEM=4096 00:06:20.818 02:08:48 -- common/autotest_common.sh@294 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:06:20.818 02:08:48 -- common/autotest_common.sh@299 -- # NO_HUGE=() 00:06:20.818 02:08:48 -- common/autotest_common.sh@300 -- # TEST_MODE= 00:06:20.818 02:08:48 -- common/autotest_common.sh@301 -- # for i in "$@" 00:06:20.818 02:08:48 -- common/autotest_common.sh@302 -- # case "$i" in 00:06:20.818 02:08:48 -- common/autotest_common.sh@307 -- # TEST_TRANSPORT=tcp 00:06:20.818 02:08:48 -- common/autotest_common.sh@319 -- # [[ -z 2005778 ]] 00:06:20.818 02:08:48 -- common/autotest_common.sh@319 -- # kill -0 2005778 00:06:20.818 02:08:48 -- common/autotest_common.sh@1675 -- # set_test_storage 2147483648 00:06:20.818 02:08:48 -- common/autotest_common.sh@329 -- # [[ -v testdir ]] 00:06:20.818 02:08:48 -- common/autotest_common.sh@331 -- # local requested_size=2147483648 00:06:20.818 02:08:48 -- common/autotest_common.sh@332 -- # local mount target_dir 00:06:20.818 02:08:48 -- common/autotest_common.sh@334 -- # local -A mounts fss sizes avails uses 00:06:20.818 02:08:48 -- common/autotest_common.sh@335 -- # local source fs size avail mount use 00:06:20.818 02:08:48 -- common/autotest_common.sh@337 -- # local storage_fallback storage_candidates 00:06:20.818 02:08:48 -- common/autotest_common.sh@339 -- # mktemp -udt spdk.XXXXXX 00:06:20.818 02:08:48 -- common/autotest_common.sh@339 -- # storage_fallback=/tmp/spdk.ss4Zqj 00:06:20.818 02:08:48 -- common/autotest_common.sh@344 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:06:20.818 02:08:48 -- common/autotest_common.sh@346 -- # [[ -n '' ]] 00:06:20.818 02:08:48 -- common/autotest_common.sh@351 -- # [[ -n '' ]] 00:06:20.818 02:08:48 -- common/autotest_common.sh@356 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.ss4Zqj/tests/target /tmp/spdk.ss4Zqj 00:06:20.818 02:08:48 -- common/autotest_common.sh@359 -- # requested_size=2214592512 00:06:20.818 02:08:48 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:20.818 02:08:48 -- common/autotest_common.sh@328 -- # df -T 00:06:20.818 02:08:48 -- common/autotest_common.sh@328 -- # grep -v Filesystem 00:06:20.818 02:08:48 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_devtmpfs 00:06:20.818 02:08:48 -- common/autotest_common.sh@362 -- # fss["$mount"]=devtmpfs 00:06:20.818 02:08:48 -- common/autotest_common.sh@363 -- # avails["$mount"]=67108864 00:06:20.818 02:08:48 -- common/autotest_common.sh@363 -- # sizes["$mount"]=67108864 00:06:20.818 02:08:48 -- common/autotest_common.sh@364 -- # uses["$mount"]=0 00:06:20.818 02:08:48 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:20.818 02:08:48 -- common/autotest_common.sh@362 -- # mounts["$mount"]=/dev/pmem0 00:06:20.818 02:08:48 -- common/autotest_common.sh@362 -- # fss["$mount"]=ext2 00:06:20.818 02:08:48 -- common/autotest_common.sh@363 -- # avails["$mount"]=4096 00:06:20.818 02:08:48 -- common/autotest_common.sh@363 -- # sizes["$mount"]=5284429824 00:06:20.818 02:08:48 -- common/autotest_common.sh@364 -- # uses["$mount"]=5284425728 00:06:20.818 02:08:48 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:20.818 02:08:48 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_root 00:06:20.818 02:08:48 -- common/autotest_common.sh@362 -- # fss["$mount"]=overlay 00:06:20.818 02:08:48 -- common/autotest_common.sh@363 -- # avails["$mount"]=55780454400 00:06:20.818 02:08:48 -- common/autotest_common.sh@363 -- # sizes["$mount"]=61988511744 00:06:20.818 02:08:48 -- common/autotest_common.sh@364 -- # uses["$mount"]=6208057344 00:06:20.818 02:08:48 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:20.818 02:08:48 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:20.818 02:08:48 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:20.818 02:08:48 -- common/autotest_common.sh@363 -- # avails["$mount"]=30991663104 00:06:20.818 02:08:48 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994255872 00:06:20.818 02:08:48 -- common/autotest_common.sh@364 -- # uses["$mount"]=2592768 00:06:20.818 02:08:48 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:20.818 02:08:48 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:20.818 02:08:48 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:20.818 02:08:48 -- common/autotest_common.sh@363 -- # avails["$mount"]=12388913152 00:06:20.818 02:08:48 -- common/autotest_common.sh@363 -- # sizes["$mount"]=12397703168 00:06:20.818 02:08:48 -- common/autotest_common.sh@364 -- # uses["$mount"]=8790016 00:06:20.818 02:08:48 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:20.818 02:08:48 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:20.818 02:08:48 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:20.818 02:08:48 -- common/autotest_common.sh@363 -- # avails["$mount"]=30993756160 00:06:20.818 02:08:48 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994255872 00:06:20.818 02:08:48 -- common/autotest_common.sh@364 -- # uses["$mount"]=499712 00:06:20.818 02:08:48 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:20.818 02:08:48 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:20.818 02:08:48 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:20.818 02:08:48 -- common/autotest_common.sh@363 -- # avails["$mount"]=6198837248 00:06:20.818 02:08:48 -- common/autotest_common.sh@363 -- # sizes["$mount"]=6198849536 00:06:20.818 02:08:48 -- common/autotest_common.sh@364 -- # uses["$mount"]=12288 00:06:20.818 02:08:48 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:20.818 02:08:48 -- common/autotest_common.sh@367 -- # printf '* Looking for test storage...\n' 00:06:20.818 * Looking for test storage... 00:06:20.818 02:08:48 -- common/autotest_common.sh@369 -- # local target_space new_size 00:06:20.818 02:08:48 -- common/autotest_common.sh@370 -- # for target_dir in "${storage_candidates[@]}" 00:06:20.818 02:08:48 -- common/autotest_common.sh@373 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:20.819 02:08:48 -- common/autotest_common.sh@373 -- # awk '$1 !~ /Filesystem/{print $6}' 00:06:20.819 02:08:48 -- common/autotest_common.sh@373 -- # mount=/ 00:06:20.819 02:08:48 -- common/autotest_common.sh@375 -- # target_space=55780454400 00:06:20.819 02:08:48 -- common/autotest_common.sh@376 -- # (( target_space == 0 || target_space < requested_size )) 00:06:20.819 02:08:48 -- common/autotest_common.sh@379 -- # (( target_space >= requested_size )) 00:06:20.819 02:08:48 -- common/autotest_common.sh@381 -- # [[ overlay == tmpfs ]] 00:06:20.819 02:08:48 -- common/autotest_common.sh@381 -- # [[ overlay == ramfs ]] 00:06:20.819 02:08:48 -- common/autotest_common.sh@381 -- # [[ / == / ]] 00:06:20.819 02:08:48 -- common/autotest_common.sh@382 -- # new_size=8422649856 00:06:20.819 02:08:48 -- common/autotest_common.sh@383 -- # (( new_size * 100 / sizes[/] > 95 )) 00:06:20.819 02:08:48 -- common/autotest_common.sh@388 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:20.819 02:08:48 -- common/autotest_common.sh@388 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:20.819 02:08:48 -- common/autotest_common.sh@389 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:20.819 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:20.819 02:08:48 -- common/autotest_common.sh@390 -- # return 0 00:06:20.819 02:08:48 -- common/autotest_common.sh@1677 -- # set -o errtrace 00:06:20.819 02:08:48 -- common/autotest_common.sh@1678 -- # shopt -s extdebug 00:06:20.819 02:08:48 -- common/autotest_common.sh@1679 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:06:20.819 02:08:48 -- common/autotest_common.sh@1681 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:06:20.819 02:08:48 -- common/autotest_common.sh@1682 -- # true 00:06:20.819 02:08:48 -- common/autotest_common.sh@1684 -- # xtrace_fd 00:06:20.819 02:08:48 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:06:20.819 02:08:48 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:06:20.819 02:08:48 -- common/autotest_common.sh@27 -- # exec 00:06:20.819 02:08:48 -- common/autotest_common.sh@29 -- # exec 00:06:20.819 02:08:48 -- common/autotest_common.sh@31 -- # xtrace_restore 00:06:20.819 02:08:48 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:06:20.819 02:08:48 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:06:20.819 02:08:48 -- common/autotest_common.sh@18 -- # set -x 00:06:20.819 02:08:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:21.077 02:08:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:21.077 02:08:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:21.077 02:08:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:21.077 02:08:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:21.077 02:08:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:21.077 02:08:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:21.077 02:08:48 -- scripts/common.sh@335 -- # IFS=.-: 00:06:21.078 02:08:48 -- scripts/common.sh@335 -- # read -ra ver1 00:06:21.078 02:08:48 -- scripts/common.sh@336 -- # IFS=.-: 00:06:21.078 02:08:48 -- scripts/common.sh@336 -- # read -ra ver2 00:06:21.078 02:08:48 -- scripts/common.sh@337 -- # local 'op=<' 00:06:21.078 02:08:48 -- scripts/common.sh@339 -- # ver1_l=2 00:06:21.078 02:08:48 -- scripts/common.sh@340 -- # ver2_l=1 00:06:21.078 02:08:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:21.078 02:08:48 -- scripts/common.sh@343 -- # case "$op" in 00:06:21.078 02:08:48 -- scripts/common.sh@344 -- # : 1 00:06:21.078 02:08:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:21.078 02:08:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:21.078 02:08:48 -- scripts/common.sh@364 -- # decimal 1 00:06:21.078 02:08:48 -- scripts/common.sh@352 -- # local d=1 00:06:21.078 02:08:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:21.078 02:08:48 -- scripts/common.sh@354 -- # echo 1 00:06:21.078 02:08:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:21.078 02:08:48 -- scripts/common.sh@365 -- # decimal 2 00:06:21.078 02:08:48 -- scripts/common.sh@352 -- # local d=2 00:06:21.078 02:08:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:21.078 02:08:48 -- scripts/common.sh@354 -- # echo 2 00:06:21.078 02:08:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:21.078 02:08:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:21.078 02:08:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:21.078 02:08:48 -- scripts/common.sh@367 -- # return 0 00:06:21.078 02:08:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:21.078 02:08:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:21.078 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:21.078 --rc genhtml_branch_coverage=1 00:06:21.078 --rc genhtml_function_coverage=1 00:06:21.078 --rc genhtml_legend=1 00:06:21.078 --rc geninfo_all_blocks=1 00:06:21.078 --rc geninfo_unexecuted_blocks=1 00:06:21.078 00:06:21.078 ' 00:06:21.078 02:08:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:21.078 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:21.078 --rc genhtml_branch_coverage=1 00:06:21.078 --rc genhtml_function_coverage=1 00:06:21.078 --rc genhtml_legend=1 00:06:21.078 --rc geninfo_all_blocks=1 00:06:21.078 --rc geninfo_unexecuted_blocks=1 00:06:21.078 00:06:21.078 ' 00:06:21.078 02:08:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:21.078 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:21.078 --rc genhtml_branch_coverage=1 00:06:21.078 --rc genhtml_function_coverage=1 00:06:21.078 --rc genhtml_legend=1 00:06:21.078 --rc geninfo_all_blocks=1 00:06:21.078 --rc geninfo_unexecuted_blocks=1 00:06:21.078 00:06:21.078 ' 00:06:21.078 02:08:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:21.078 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:21.078 --rc genhtml_branch_coverage=1 00:06:21.078 --rc genhtml_function_coverage=1 00:06:21.078 --rc genhtml_legend=1 00:06:21.078 --rc geninfo_all_blocks=1 00:06:21.078 --rc geninfo_unexecuted_blocks=1 00:06:21.078 00:06:21.078 ' 00:06:21.078 02:08:48 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:21.078 02:08:48 -- nvmf/common.sh@7 -- # uname -s 00:06:21.078 02:08:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:21.078 02:08:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:21.078 02:08:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:21.078 02:08:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:21.078 02:08:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:21.078 02:08:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:21.078 02:08:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:21.078 02:08:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:21.078 02:08:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:21.078 02:08:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:21.078 02:08:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:21.078 02:08:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:21.078 02:08:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:21.078 02:08:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:21.078 02:08:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:21.078 02:08:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:21.078 02:08:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:21.078 02:08:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:21.078 02:08:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:21.078 02:08:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:21.078 02:08:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:21.078 02:08:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:21.078 02:08:48 -- paths/export.sh@5 -- # export PATH 00:06:21.078 02:08:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:21.078 02:08:48 -- nvmf/common.sh@46 -- # : 0 00:06:21.078 02:08:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:21.078 02:08:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:21.078 02:08:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:21.078 02:08:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:21.078 02:08:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:21.078 02:08:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:21.078 02:08:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:21.078 02:08:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:21.078 02:08:48 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:06:21.078 02:08:48 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:06:21.078 02:08:48 -- target/filesystem.sh@15 -- # nvmftestinit 00:06:21.078 02:08:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:21.078 02:08:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:21.078 02:08:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:21.078 02:08:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:21.079 02:08:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:21.079 02:08:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:21.079 02:08:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:21.079 02:08:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:21.079 02:08:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:21.079 02:08:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:21.079 02:08:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:21.079 02:08:48 -- common/autotest_common.sh@10 -- # set +x 00:06:23.012 02:08:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:23.012 02:08:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:23.013 02:08:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:23.013 02:08:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:23.013 02:08:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:23.013 02:08:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:23.013 02:08:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:23.013 02:08:50 -- nvmf/common.sh@294 -- # net_devs=() 00:06:23.013 02:08:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:23.013 02:08:50 -- nvmf/common.sh@295 -- # e810=() 00:06:23.013 02:08:50 -- nvmf/common.sh@295 -- # local -ga e810 00:06:23.013 02:08:50 -- nvmf/common.sh@296 -- # x722=() 00:06:23.013 02:08:50 -- nvmf/common.sh@296 -- # local -ga x722 00:06:23.013 02:08:50 -- nvmf/common.sh@297 -- # mlx=() 00:06:23.013 02:08:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:23.013 02:08:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:23.013 02:08:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:23.013 02:08:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:23.013 02:08:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:23.013 02:08:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:23.013 02:08:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:23.013 02:08:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:23.013 02:08:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:23.013 02:08:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:23.013 02:08:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:23.013 02:08:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:23.013 02:08:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:23.013 02:08:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:23.013 02:08:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:23.013 02:08:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:23.013 02:08:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:23.013 02:08:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:23.013 02:08:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:23.013 02:08:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:23.013 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:23.013 02:08:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:23.013 02:08:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:23.013 02:08:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:23.013 02:08:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:23.013 02:08:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:23.013 02:08:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:23.013 02:08:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:23.013 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:23.013 02:08:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:23.013 02:08:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:23.013 02:08:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:23.013 02:08:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:23.013 02:08:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:23.013 02:08:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:23.013 02:08:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:23.013 02:08:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:23.013 02:08:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:23.013 02:08:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:23.013 02:08:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:23.013 02:08:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:23.013 02:08:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:23.013 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:23.013 02:08:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:23.013 02:08:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:23.013 02:08:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:23.013 02:08:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:23.013 02:08:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:23.013 02:08:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:23.013 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:23.013 02:08:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:23.013 02:08:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:23.013 02:08:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:23.013 02:08:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:23.013 02:08:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:23.013 02:08:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:23.013 02:08:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:23.013 02:08:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:23.013 02:08:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:23.013 02:08:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:23.013 02:08:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:23.013 02:08:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:23.013 02:08:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:23.013 02:08:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:23.013 02:08:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:23.013 02:08:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:23.013 02:08:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:23.013 02:08:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:23.013 02:08:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:23.270 02:08:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:23.270 02:08:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:23.270 02:08:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:23.270 02:08:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:23.270 02:08:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:23.270 02:08:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:23.270 02:08:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:23.270 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:23.270 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.198 ms 00:06:23.270 00:06:23.270 --- 10.0.0.2 ping statistics --- 00:06:23.270 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:23.270 rtt min/avg/max/mdev = 0.198/0.198/0.198/0.000 ms 00:06:23.270 02:08:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:23.270 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:23.270 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.094 ms 00:06:23.270 00:06:23.270 --- 10.0.0.1 ping statistics --- 00:06:23.270 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:23.270 rtt min/avg/max/mdev = 0.094/0.094/0.094/0.000 ms 00:06:23.270 02:08:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:23.270 02:08:50 -- nvmf/common.sh@410 -- # return 0 00:06:23.270 02:08:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:23.270 02:08:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:23.270 02:08:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:23.270 02:08:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:23.270 02:08:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:23.270 02:08:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:23.270 02:08:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:23.270 02:08:50 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:06:23.270 02:08:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:23.271 02:08:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:23.271 02:08:50 -- common/autotest_common.sh@10 -- # set +x 00:06:23.271 ************************************ 00:06:23.271 START TEST nvmf_filesystem_no_in_capsule 00:06:23.271 ************************************ 00:06:23.271 02:08:50 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 0 00:06:23.271 02:08:50 -- target/filesystem.sh@47 -- # in_capsule=0 00:06:23.271 02:08:50 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:06:23.271 02:08:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:06:23.271 02:08:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:23.271 02:08:50 -- common/autotest_common.sh@10 -- # set +x 00:06:23.271 02:08:50 -- nvmf/common.sh@469 -- # nvmfpid=2007426 00:06:23.271 02:08:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:23.271 02:08:50 -- nvmf/common.sh@470 -- # waitforlisten 2007426 00:06:23.271 02:08:50 -- common/autotest_common.sh@829 -- # '[' -z 2007426 ']' 00:06:23.271 02:08:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:23.271 02:08:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:23.271 02:08:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:23.271 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:23.271 02:08:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:23.271 02:08:50 -- common/autotest_common.sh@10 -- # set +x 00:06:23.271 [2024-12-08 02:08:50.976264] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:23.271 [2024-12-08 02:08:50.976341] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:23.271 EAL: No free 2048 kB hugepages reported on node 1 00:06:23.528 [2024-12-08 02:08:51.055290] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:23.528 [2024-12-08 02:08:51.191910] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:23.528 [2024-12-08 02:08:51.192097] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:23.528 [2024-12-08 02:08:51.192129] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:23.528 [2024-12-08 02:08:51.192155] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:23.528 [2024-12-08 02:08:51.192230] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:23.528 [2024-12-08 02:08:51.192290] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:23.528 [2024-12-08 02:08:51.192356] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:23.528 [2024-12-08 02:08:51.192366] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:24.461 02:08:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:24.461 02:08:52 -- common/autotest_common.sh@862 -- # return 0 00:06:24.461 02:08:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:06:24.461 02:08:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:24.461 02:08:52 -- common/autotest_common.sh@10 -- # set +x 00:06:24.461 02:08:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:24.461 02:08:52 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:06:24.461 02:08:52 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:06:24.461 02:08:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:24.461 02:08:52 -- common/autotest_common.sh@10 -- # set +x 00:06:24.461 [2024-12-08 02:08:52.133575] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:24.461 02:08:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:24.461 02:08:52 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:06:24.461 02:08:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:24.461 02:08:52 -- common/autotest_common.sh@10 -- # set +x 00:06:24.720 Malloc1 00:06:24.720 02:08:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:24.720 02:08:52 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:06:24.720 02:08:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:24.720 02:08:52 -- common/autotest_common.sh@10 -- # set +x 00:06:24.720 02:08:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:24.720 02:08:52 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:06:24.720 02:08:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:24.720 02:08:52 -- common/autotest_common.sh@10 -- # set +x 00:06:24.720 02:08:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:24.720 02:08:52 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:24.720 02:08:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:24.720 02:08:52 -- common/autotest_common.sh@10 -- # set +x 00:06:24.720 [2024-12-08 02:08:52.322410] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:06:24.720 02:08:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:24.720 02:08:52 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:06:24.720 02:08:52 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:06:24.720 02:08:52 -- common/autotest_common.sh@1368 -- # local bdev_info 00:06:24.720 02:08:52 -- common/autotest_common.sh@1369 -- # local bs 00:06:24.720 02:08:52 -- common/autotest_common.sh@1370 -- # local nb 00:06:24.720 02:08:52 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:06:24.720 02:08:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:24.720 02:08:52 -- common/autotest_common.sh@10 -- # set +x 00:06:24.720 02:08:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:24.720 02:08:52 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:06:24.720 { 00:06:24.720 "name": "Malloc1", 00:06:24.720 "aliases": [ 00:06:24.720 "661df0e7-8f54-4bdf-9133-7ae2da0a44f7" 00:06:24.720 ], 00:06:24.720 "product_name": "Malloc disk", 00:06:24.720 "block_size": 512, 00:06:24.720 "num_blocks": 1048576, 00:06:24.720 "uuid": "661df0e7-8f54-4bdf-9133-7ae2da0a44f7", 00:06:24.720 "assigned_rate_limits": { 00:06:24.720 "rw_ios_per_sec": 0, 00:06:24.720 "rw_mbytes_per_sec": 0, 00:06:24.720 "r_mbytes_per_sec": 0, 00:06:24.720 "w_mbytes_per_sec": 0 00:06:24.720 }, 00:06:24.720 "claimed": true, 00:06:24.720 "claim_type": "exclusive_write", 00:06:24.720 "zoned": false, 00:06:24.720 "supported_io_types": { 00:06:24.720 "read": true, 00:06:24.720 "write": true, 00:06:24.720 "unmap": true, 00:06:24.720 "write_zeroes": true, 00:06:24.720 "flush": true, 00:06:24.720 "reset": true, 00:06:24.720 "compare": false, 00:06:24.720 "compare_and_write": false, 00:06:24.720 "abort": true, 00:06:24.720 "nvme_admin": false, 00:06:24.720 "nvme_io": false 00:06:24.720 }, 00:06:24.720 "memory_domains": [ 00:06:24.720 { 00:06:24.720 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:24.720 "dma_device_type": 2 00:06:24.720 } 00:06:24.720 ], 00:06:24.720 "driver_specific": {} 00:06:24.720 } 00:06:24.720 ]' 00:06:24.720 02:08:52 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:06:24.720 02:08:52 -- common/autotest_common.sh@1372 -- # bs=512 00:06:24.720 02:08:52 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:06:24.720 02:08:52 -- common/autotest_common.sh@1373 -- # nb=1048576 00:06:24.720 02:08:52 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:06:24.720 02:08:52 -- common/autotest_common.sh@1377 -- # echo 512 00:06:24.720 02:08:52 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:06:24.720 02:08:52 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:06:25.285 02:08:53 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:06:25.285 02:08:53 -- common/autotest_common.sh@1187 -- # local i=0 00:06:25.285 02:08:53 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:06:25.285 02:08:53 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:06:25.285 02:08:53 -- common/autotest_common.sh@1194 -- # sleep 2 00:06:27.811 02:08:55 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:06:27.811 02:08:55 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:06:27.811 02:08:55 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:06:27.811 02:08:55 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:06:27.811 02:08:55 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:06:27.811 02:08:55 -- common/autotest_common.sh@1197 -- # return 0 00:06:27.811 02:08:55 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:06:27.811 02:08:55 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:06:27.811 02:08:55 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:06:27.811 02:08:55 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:06:27.811 02:08:55 -- setup/common.sh@76 -- # local dev=nvme0n1 00:06:27.811 02:08:55 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:06:27.811 02:08:55 -- setup/common.sh@80 -- # echo 536870912 00:06:27.811 02:08:55 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:06:27.811 02:08:55 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:06:27.811 02:08:55 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:06:27.811 02:08:55 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:06:27.811 02:08:55 -- target/filesystem.sh@69 -- # partprobe 00:06:28.377 02:08:55 -- target/filesystem.sh@70 -- # sleep 1 00:06:29.310 02:08:56 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:06:29.310 02:08:56 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:06:29.310 02:08:56 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:29.310 02:08:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:29.310 02:08:56 -- common/autotest_common.sh@10 -- # set +x 00:06:29.310 ************************************ 00:06:29.310 START TEST filesystem_ext4 00:06:29.310 ************************************ 00:06:29.310 02:08:56 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:06:29.310 02:08:56 -- target/filesystem.sh@18 -- # fstype=ext4 00:06:29.310 02:08:56 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:29.310 02:08:56 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:06:29.310 02:08:56 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:06:29.310 02:08:56 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:29.310 02:08:56 -- common/autotest_common.sh@914 -- # local i=0 00:06:29.310 02:08:56 -- common/autotest_common.sh@915 -- # local force 00:06:29.310 02:08:56 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:06:29.310 02:08:56 -- common/autotest_common.sh@918 -- # force=-F 00:06:29.311 02:08:56 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:06:29.311 mke2fs 1.47.0 (5-Feb-2023) 00:06:29.311 Discarding device blocks: 0/522240 done 00:06:29.311 Creating filesystem with 522240 1k blocks and 130560 inodes 00:06:29.311 Filesystem UUID: 2b91e452-be53-44d7-9ccd-a2552191cc5b 00:06:29.311 Superblock backups stored on blocks: 00:06:29.311 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:06:29.311 00:06:29.311 Allocating group tables: 0/64 done 00:06:29.311 Writing inode tables: 0/64 done 00:06:29.568 Creating journal (8192 blocks): done 00:06:31.766 Writing superblocks and filesystem accounting information: 0/64 8/64 done 00:06:31.766 00:06:31.766 02:08:59 -- common/autotest_common.sh@931 -- # return 0 00:06:31.766 02:08:59 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:37.096 02:09:04 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:37.096 02:09:04 -- target/filesystem.sh@25 -- # sync 00:06:37.096 02:09:04 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:37.096 02:09:04 -- target/filesystem.sh@27 -- # sync 00:06:37.096 02:09:04 -- target/filesystem.sh@29 -- # i=0 00:06:37.096 02:09:04 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:37.096 02:09:04 -- target/filesystem.sh@37 -- # kill -0 2007426 00:06:37.096 02:09:04 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:37.096 02:09:04 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:37.096 02:09:04 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:37.096 02:09:04 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:37.096 00:06:37.096 real 0m7.958s 00:06:37.096 user 0m0.017s 00:06:37.096 sys 0m0.066s 00:06:37.096 02:09:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:37.096 02:09:04 -- common/autotest_common.sh@10 -- # set +x 00:06:37.096 ************************************ 00:06:37.096 END TEST filesystem_ext4 00:06:37.096 ************************************ 00:06:37.096 02:09:04 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:06:37.096 02:09:04 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:37.096 02:09:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:37.096 02:09:04 -- common/autotest_common.sh@10 -- # set +x 00:06:37.096 ************************************ 00:06:37.096 START TEST filesystem_btrfs 00:06:37.096 ************************************ 00:06:37.096 02:09:04 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:06:37.096 02:09:04 -- target/filesystem.sh@18 -- # fstype=btrfs 00:06:37.096 02:09:04 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:37.096 02:09:04 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:06:37.096 02:09:04 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:06:37.096 02:09:04 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:37.096 02:09:04 -- common/autotest_common.sh@914 -- # local i=0 00:06:37.096 02:09:04 -- common/autotest_common.sh@915 -- # local force 00:06:37.096 02:09:04 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:06:37.096 02:09:04 -- common/autotest_common.sh@920 -- # force=-f 00:06:37.096 02:09:04 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:06:37.359 btrfs-progs v6.8.1 00:06:37.359 See https://btrfs.readthedocs.io for more information. 00:06:37.359 00:06:37.359 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:06:37.359 NOTE: several default settings have changed in version 5.15, please make sure 00:06:37.359 this does not affect your deployments: 00:06:37.359 - DUP for metadata (-m dup) 00:06:37.359 - enabled no-holes (-O no-holes) 00:06:37.359 - enabled free-space-tree (-R free-space-tree) 00:06:37.359 00:06:37.359 Label: (null) 00:06:37.360 UUID: e75aa162-7bed-4743-954f-dba0128b7b08 00:06:37.360 Node size: 16384 00:06:37.360 Sector size: 4096 (CPU page size: 4096) 00:06:37.360 Filesystem size: 510.00MiB 00:06:37.360 Block group profiles: 00:06:37.360 Data: single 8.00MiB 00:06:37.360 Metadata: DUP 32.00MiB 00:06:37.360 System: DUP 8.00MiB 00:06:37.360 SSD detected: yes 00:06:37.360 Zoned device: no 00:06:37.360 Features: extref, skinny-metadata, no-holes, free-space-tree 00:06:37.360 Checksum: crc32c 00:06:37.360 Number of devices: 1 00:06:37.360 Devices: 00:06:37.360 ID SIZE PATH 00:06:37.360 1 510.00MiB /dev/nvme0n1p1 00:06:37.360 00:06:37.360 02:09:04 -- common/autotest_common.sh@931 -- # return 0 00:06:37.360 02:09:04 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:37.925 02:09:05 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:37.925 02:09:05 -- target/filesystem.sh@25 -- # sync 00:06:37.925 02:09:05 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:37.925 02:09:05 -- target/filesystem.sh@27 -- # sync 00:06:37.925 02:09:05 -- target/filesystem.sh@29 -- # i=0 00:06:37.925 02:09:05 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:37.925 02:09:05 -- target/filesystem.sh@37 -- # kill -0 2007426 00:06:37.925 02:09:05 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:37.925 02:09:05 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:37.925 02:09:05 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:37.925 02:09:05 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:37.925 00:06:37.925 real 0m0.691s 00:06:37.925 user 0m0.017s 00:06:37.925 sys 0m0.096s 00:06:37.925 02:09:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:37.925 02:09:05 -- common/autotest_common.sh@10 -- # set +x 00:06:37.925 ************************************ 00:06:37.925 END TEST filesystem_btrfs 00:06:37.925 ************************************ 00:06:37.925 02:09:05 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:06:37.925 02:09:05 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:37.925 02:09:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:37.925 02:09:05 -- common/autotest_common.sh@10 -- # set +x 00:06:37.925 ************************************ 00:06:37.925 START TEST filesystem_xfs 00:06:37.925 ************************************ 00:06:37.925 02:09:05 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:06:37.925 02:09:05 -- target/filesystem.sh@18 -- # fstype=xfs 00:06:37.925 02:09:05 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:37.925 02:09:05 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:06:37.925 02:09:05 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:06:37.925 02:09:05 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:37.925 02:09:05 -- common/autotest_common.sh@914 -- # local i=0 00:06:37.925 02:09:05 -- common/autotest_common.sh@915 -- # local force 00:06:37.925 02:09:05 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:06:37.925 02:09:05 -- common/autotest_common.sh@920 -- # force=-f 00:06:37.925 02:09:05 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:06:37.925 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:06:37.925 = sectsz=512 attr=2, projid32bit=1 00:06:37.925 = crc=1 finobt=1, sparse=1, rmapbt=0 00:06:37.925 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:06:37.925 data = bsize=4096 blocks=130560, imaxpct=25 00:06:37.925 = sunit=0 swidth=0 blks 00:06:37.925 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:06:37.925 log =internal log bsize=4096 blocks=16384, version=2 00:06:37.925 = sectsz=512 sunit=0 blks, lazy-count=1 00:06:37.925 realtime =none extsz=4096 blocks=0, rtextents=0 00:06:39.295 Discarding blocks...Done. 00:06:39.295 02:09:06 -- common/autotest_common.sh@931 -- # return 0 00:06:39.295 02:09:06 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:40.666 02:09:08 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:40.955 02:09:08 -- target/filesystem.sh@25 -- # sync 00:06:40.955 02:09:08 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:40.955 02:09:08 -- target/filesystem.sh@27 -- # sync 00:06:40.955 02:09:08 -- target/filesystem.sh@29 -- # i=0 00:06:40.955 02:09:08 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:40.955 02:09:08 -- target/filesystem.sh@37 -- # kill -0 2007426 00:06:40.955 02:09:08 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:40.955 02:09:08 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:40.955 02:09:08 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:40.956 02:09:08 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:40.956 00:06:40.956 real 0m2.953s 00:06:40.956 user 0m0.020s 00:06:40.956 sys 0m0.051s 00:06:40.956 02:09:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:40.956 02:09:08 -- common/autotest_common.sh@10 -- # set +x 00:06:40.956 ************************************ 00:06:40.956 END TEST filesystem_xfs 00:06:40.956 ************************************ 00:06:40.956 02:09:08 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:06:41.213 02:09:08 -- target/filesystem.sh@93 -- # sync 00:06:41.213 02:09:08 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:06:41.213 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:06:41.213 02:09:08 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:06:41.214 02:09:08 -- common/autotest_common.sh@1208 -- # local i=0 00:06:41.214 02:09:08 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:06:41.214 02:09:08 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:06:41.214 02:09:08 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:06:41.214 02:09:08 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:06:41.214 02:09:08 -- common/autotest_common.sh@1220 -- # return 0 00:06:41.214 02:09:08 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:06:41.214 02:09:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:41.214 02:09:08 -- common/autotest_common.sh@10 -- # set +x 00:06:41.214 02:09:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:41.214 02:09:08 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:06:41.214 02:09:08 -- target/filesystem.sh@101 -- # killprocess 2007426 00:06:41.214 02:09:08 -- common/autotest_common.sh@936 -- # '[' -z 2007426 ']' 00:06:41.214 02:09:08 -- common/autotest_common.sh@940 -- # kill -0 2007426 00:06:41.214 02:09:08 -- common/autotest_common.sh@941 -- # uname 00:06:41.214 02:09:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:41.214 02:09:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2007426 00:06:41.214 02:09:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:41.214 02:09:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:41.214 02:09:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2007426' 00:06:41.214 killing process with pid 2007426 00:06:41.214 02:09:08 -- common/autotest_common.sh@955 -- # kill 2007426 00:06:41.214 02:09:08 -- common/autotest_common.sh@960 -- # wait 2007426 00:06:41.779 02:09:09 -- target/filesystem.sh@102 -- # nvmfpid= 00:06:41.779 00:06:41.779 real 0m18.473s 00:06:41.779 user 1m11.506s 00:06:41.779 sys 0m2.247s 00:06:41.779 02:09:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:41.779 02:09:09 -- common/autotest_common.sh@10 -- # set +x 00:06:41.779 ************************************ 00:06:41.779 END TEST nvmf_filesystem_no_in_capsule 00:06:41.779 ************************************ 00:06:41.779 02:09:09 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:06:41.779 02:09:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:41.779 02:09:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:41.779 02:09:09 -- common/autotest_common.sh@10 -- # set +x 00:06:41.779 ************************************ 00:06:41.779 START TEST nvmf_filesystem_in_capsule 00:06:41.779 ************************************ 00:06:41.779 02:09:09 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 4096 00:06:41.779 02:09:09 -- target/filesystem.sh@47 -- # in_capsule=4096 00:06:41.779 02:09:09 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:06:41.779 02:09:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:06:41.779 02:09:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:41.779 02:09:09 -- common/autotest_common.sh@10 -- # set +x 00:06:41.779 02:09:09 -- nvmf/common.sh@469 -- # nvmfpid=2010492 00:06:41.779 02:09:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:41.779 02:09:09 -- nvmf/common.sh@470 -- # waitforlisten 2010492 00:06:41.779 02:09:09 -- common/autotest_common.sh@829 -- # '[' -z 2010492 ']' 00:06:41.779 02:09:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:41.779 02:09:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:41.779 02:09:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:41.779 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:41.779 02:09:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:41.779 02:09:09 -- common/autotest_common.sh@10 -- # set +x 00:06:41.779 [2024-12-08 02:09:09.478192] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:41.779 [2024-12-08 02:09:09.478275] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:41.779 EAL: No free 2048 kB hugepages reported on node 1 00:06:41.779 [2024-12-08 02:09:09.547473] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:42.037 [2024-12-08 02:09:09.665379] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:42.037 [2024-12-08 02:09:09.665567] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:42.037 [2024-12-08 02:09:09.665588] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:42.037 [2024-12-08 02:09:09.665603] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:42.037 [2024-12-08 02:09:09.665662] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:42.037 [2024-12-08 02:09:09.665693] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:42.037 [2024-12-08 02:09:09.665840] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:42.037 [2024-12-08 02:09:09.665843] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:42.971 02:09:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:42.971 02:09:10 -- common/autotest_common.sh@862 -- # return 0 00:06:42.971 02:09:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:06:42.971 02:09:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:42.971 02:09:10 -- common/autotest_common.sh@10 -- # set +x 00:06:42.971 02:09:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:42.971 02:09:10 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:06:42.971 02:09:10 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:06:42.971 02:09:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:42.971 02:09:10 -- common/autotest_common.sh@10 -- # set +x 00:06:42.971 [2024-12-08 02:09:10.488180] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:42.971 02:09:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:42.971 02:09:10 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:06:42.971 02:09:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:42.971 02:09:10 -- common/autotest_common.sh@10 -- # set +x 00:06:42.971 Malloc1 00:06:42.971 02:09:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:42.971 02:09:10 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:06:42.971 02:09:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:42.971 02:09:10 -- common/autotest_common.sh@10 -- # set +x 00:06:42.971 02:09:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:42.971 02:09:10 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:06:42.971 02:09:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:42.971 02:09:10 -- common/autotest_common.sh@10 -- # set +x 00:06:42.971 02:09:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:42.971 02:09:10 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:42.971 02:09:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:42.971 02:09:10 -- common/autotest_common.sh@10 -- # set +x 00:06:42.971 [2024-12-08 02:09:10.680379] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:06:42.971 02:09:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:42.971 02:09:10 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:06:42.971 02:09:10 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:06:42.971 02:09:10 -- common/autotest_common.sh@1368 -- # local bdev_info 00:06:42.971 02:09:10 -- common/autotest_common.sh@1369 -- # local bs 00:06:42.971 02:09:10 -- common/autotest_common.sh@1370 -- # local nb 00:06:42.971 02:09:10 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:06:42.971 02:09:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:42.971 02:09:10 -- common/autotest_common.sh@10 -- # set +x 00:06:42.971 02:09:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:42.971 02:09:10 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:06:42.971 { 00:06:42.971 "name": "Malloc1", 00:06:42.971 "aliases": [ 00:06:42.971 "c4d64e55-e66a-4ea6-90e6-35255b6be660" 00:06:42.971 ], 00:06:42.971 "product_name": "Malloc disk", 00:06:42.971 "block_size": 512, 00:06:42.971 "num_blocks": 1048576, 00:06:42.971 "uuid": "c4d64e55-e66a-4ea6-90e6-35255b6be660", 00:06:42.971 "assigned_rate_limits": { 00:06:42.971 "rw_ios_per_sec": 0, 00:06:42.971 "rw_mbytes_per_sec": 0, 00:06:42.971 "r_mbytes_per_sec": 0, 00:06:42.971 "w_mbytes_per_sec": 0 00:06:42.971 }, 00:06:42.971 "claimed": true, 00:06:42.971 "claim_type": "exclusive_write", 00:06:42.971 "zoned": false, 00:06:42.971 "supported_io_types": { 00:06:42.971 "read": true, 00:06:42.971 "write": true, 00:06:42.971 "unmap": true, 00:06:42.971 "write_zeroes": true, 00:06:42.971 "flush": true, 00:06:42.971 "reset": true, 00:06:42.971 "compare": false, 00:06:42.971 "compare_and_write": false, 00:06:42.971 "abort": true, 00:06:42.971 "nvme_admin": false, 00:06:42.971 "nvme_io": false 00:06:42.971 }, 00:06:42.971 "memory_domains": [ 00:06:42.971 { 00:06:42.971 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:42.971 "dma_device_type": 2 00:06:42.971 } 00:06:42.971 ], 00:06:42.971 "driver_specific": {} 00:06:42.971 } 00:06:42.971 ]' 00:06:42.971 02:09:10 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:06:42.971 02:09:10 -- common/autotest_common.sh@1372 -- # bs=512 00:06:42.971 02:09:10 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:06:43.229 02:09:10 -- common/autotest_common.sh@1373 -- # nb=1048576 00:06:43.229 02:09:10 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:06:43.229 02:09:10 -- common/autotest_common.sh@1377 -- # echo 512 00:06:43.229 02:09:10 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:06:43.229 02:09:10 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:06:43.795 02:09:11 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:06:43.795 02:09:11 -- common/autotest_common.sh@1187 -- # local i=0 00:06:43.795 02:09:11 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:06:43.795 02:09:11 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:06:43.795 02:09:11 -- common/autotest_common.sh@1194 -- # sleep 2 00:06:45.694 02:09:13 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:06:45.694 02:09:13 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:06:45.694 02:09:13 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:06:45.694 02:09:13 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:06:45.694 02:09:13 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:06:45.694 02:09:13 -- common/autotest_common.sh@1197 -- # return 0 00:06:45.952 02:09:13 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:06:45.952 02:09:13 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:06:45.952 02:09:13 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:06:45.952 02:09:13 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:06:45.952 02:09:13 -- setup/common.sh@76 -- # local dev=nvme0n1 00:06:45.952 02:09:13 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:06:45.952 02:09:13 -- setup/common.sh@80 -- # echo 536870912 00:06:45.952 02:09:13 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:06:45.952 02:09:13 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:06:45.952 02:09:13 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:06:45.952 02:09:13 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:06:46.210 02:09:13 -- target/filesystem.sh@69 -- # partprobe 00:06:46.775 02:09:14 -- target/filesystem.sh@70 -- # sleep 1 00:06:47.709 02:09:15 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:06:47.709 02:09:15 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:06:47.709 02:09:15 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:47.709 02:09:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:47.709 02:09:15 -- common/autotest_common.sh@10 -- # set +x 00:06:47.709 ************************************ 00:06:47.709 START TEST filesystem_in_capsule_ext4 00:06:47.709 ************************************ 00:06:47.709 02:09:15 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:06:47.709 02:09:15 -- target/filesystem.sh@18 -- # fstype=ext4 00:06:47.709 02:09:15 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:47.709 02:09:15 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:06:47.709 02:09:15 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:06:47.709 02:09:15 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:47.709 02:09:15 -- common/autotest_common.sh@914 -- # local i=0 00:06:47.709 02:09:15 -- common/autotest_common.sh@915 -- # local force 00:06:47.709 02:09:15 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:06:47.709 02:09:15 -- common/autotest_common.sh@918 -- # force=-F 00:06:47.709 02:09:15 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:06:47.709 mke2fs 1.47.0 (5-Feb-2023) 00:06:47.966 Discarding device blocks: 0/522240 done 00:06:47.966 Creating filesystem with 522240 1k blocks and 130560 inodes 00:06:47.966 Filesystem UUID: 9dbf449b-0eb6-4191-8b3c-5c7a82030936 00:06:47.966 Superblock backups stored on blocks: 00:06:47.966 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:06:47.966 00:06:47.966 Allocating group tables: 0/64 done 00:06:47.967 Writing inode tables: 0/64 done 00:06:51.240 Creating journal (8192 blocks): done 00:06:52.890 Writing superblocks and filesystem accounting information: 0/64 8/64 done 00:06:52.890 00:06:52.890 02:09:20 -- common/autotest_common.sh@931 -- # return 0 00:06:52.890 02:09:20 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:59.441 02:09:26 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:59.441 02:09:26 -- target/filesystem.sh@25 -- # sync 00:06:59.441 02:09:26 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:59.441 02:09:26 -- target/filesystem.sh@27 -- # sync 00:06:59.441 02:09:26 -- target/filesystem.sh@29 -- # i=0 00:06:59.441 02:09:26 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:59.441 02:09:26 -- target/filesystem.sh@37 -- # kill -0 2010492 00:06:59.441 02:09:26 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:59.441 02:09:26 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:59.441 02:09:26 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:59.441 02:09:26 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:59.441 00:06:59.441 real 0m11.103s 00:06:59.441 user 0m0.018s 00:06:59.441 sys 0m0.074s 00:06:59.441 02:09:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:59.441 02:09:26 -- common/autotest_common.sh@10 -- # set +x 00:06:59.441 ************************************ 00:06:59.441 END TEST filesystem_in_capsule_ext4 00:06:59.441 ************************************ 00:06:59.441 02:09:26 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:06:59.441 02:09:26 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:59.441 02:09:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:59.441 02:09:26 -- common/autotest_common.sh@10 -- # set +x 00:06:59.441 ************************************ 00:06:59.441 START TEST filesystem_in_capsule_btrfs 00:06:59.441 ************************************ 00:06:59.441 02:09:26 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:06:59.441 02:09:26 -- target/filesystem.sh@18 -- # fstype=btrfs 00:06:59.442 02:09:26 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:59.442 02:09:26 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:06:59.442 02:09:26 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:06:59.442 02:09:26 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:59.442 02:09:26 -- common/autotest_common.sh@914 -- # local i=0 00:06:59.442 02:09:26 -- common/autotest_common.sh@915 -- # local force 00:06:59.442 02:09:26 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:06:59.442 02:09:26 -- common/autotest_common.sh@920 -- # force=-f 00:06:59.442 02:09:26 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:06:59.442 btrfs-progs v6.8.1 00:06:59.442 See https://btrfs.readthedocs.io for more information. 00:06:59.442 00:06:59.442 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:06:59.442 NOTE: several default settings have changed in version 5.15, please make sure 00:06:59.442 this does not affect your deployments: 00:06:59.442 - DUP for metadata (-m dup) 00:06:59.442 - enabled no-holes (-O no-holes) 00:06:59.442 - enabled free-space-tree (-R free-space-tree) 00:06:59.442 00:06:59.442 Label: (null) 00:06:59.442 UUID: b31b715c-04f7-4969-af9f-483dbe0a3ef1 00:06:59.442 Node size: 16384 00:06:59.442 Sector size: 4096 (CPU page size: 4096) 00:06:59.442 Filesystem size: 510.00MiB 00:06:59.442 Block group profiles: 00:06:59.442 Data: single 8.00MiB 00:06:59.442 Metadata: DUP 32.00MiB 00:06:59.442 System: DUP 8.00MiB 00:06:59.442 SSD detected: yes 00:06:59.442 Zoned device: no 00:06:59.442 Features: extref, skinny-metadata, no-holes, free-space-tree 00:06:59.442 Checksum: crc32c 00:06:59.442 Number of devices: 1 00:06:59.442 Devices: 00:06:59.442 ID SIZE PATH 00:06:59.442 1 510.00MiB /dev/nvme0n1p1 00:06:59.442 00:06:59.442 02:09:26 -- common/autotest_common.sh@931 -- # return 0 00:06:59.442 02:09:26 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:00.007 02:09:27 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:00.007 02:09:27 -- target/filesystem.sh@25 -- # sync 00:07:00.007 02:09:27 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:00.007 02:09:27 -- target/filesystem.sh@27 -- # sync 00:07:00.007 02:09:27 -- target/filesystem.sh@29 -- # i=0 00:07:00.007 02:09:27 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:00.007 02:09:27 -- target/filesystem.sh@37 -- # kill -0 2010492 00:07:00.007 02:09:27 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:00.007 02:09:27 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:00.007 02:09:27 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:00.007 02:09:27 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:00.007 00:07:00.007 real 0m1.075s 00:07:00.007 user 0m0.017s 00:07:00.007 sys 0m0.106s 00:07:00.007 02:09:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:00.007 02:09:27 -- common/autotest_common.sh@10 -- # set +x 00:07:00.007 ************************************ 00:07:00.007 END TEST filesystem_in_capsule_btrfs 00:07:00.007 ************************************ 00:07:00.007 02:09:27 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:07:00.007 02:09:27 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:00.007 02:09:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:00.007 02:09:27 -- common/autotest_common.sh@10 -- # set +x 00:07:00.007 ************************************ 00:07:00.007 START TEST filesystem_in_capsule_xfs 00:07:00.007 ************************************ 00:07:00.007 02:09:27 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:07:00.007 02:09:27 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:00.007 02:09:27 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:00.007 02:09:27 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:00.007 02:09:27 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:07:00.007 02:09:27 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:00.007 02:09:27 -- common/autotest_common.sh@914 -- # local i=0 00:07:00.007 02:09:27 -- common/autotest_common.sh@915 -- # local force 00:07:00.007 02:09:27 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:07:00.007 02:09:27 -- common/autotest_common.sh@920 -- # force=-f 00:07:00.007 02:09:27 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:00.265 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:00.265 = sectsz=512 attr=2, projid32bit=1 00:07:00.265 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:00.265 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:00.265 data = bsize=4096 blocks=130560, imaxpct=25 00:07:00.265 = sunit=0 swidth=0 blks 00:07:00.265 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:00.265 log =internal log bsize=4096 blocks=16384, version=2 00:07:00.265 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:00.265 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:01.198 Discarding blocks...Done. 00:07:01.198 02:09:28 -- common/autotest_common.sh@931 -- # return 0 00:07:01.198 02:09:28 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:03.726 02:09:31 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:03.726 02:09:31 -- target/filesystem.sh@25 -- # sync 00:07:03.726 02:09:31 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:03.726 02:09:31 -- target/filesystem.sh@27 -- # sync 00:07:03.726 02:09:31 -- target/filesystem.sh@29 -- # i=0 00:07:03.726 02:09:31 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:03.726 02:09:31 -- target/filesystem.sh@37 -- # kill -0 2010492 00:07:03.726 02:09:31 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:03.726 02:09:31 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:03.726 02:09:31 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:03.726 02:09:31 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:03.726 00:07:03.726 real 0m3.681s 00:07:03.726 user 0m0.016s 00:07:03.726 sys 0m0.064s 00:07:03.726 02:09:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:03.726 02:09:31 -- common/autotest_common.sh@10 -- # set +x 00:07:03.726 ************************************ 00:07:03.726 END TEST filesystem_in_capsule_xfs 00:07:03.726 ************************************ 00:07:03.726 02:09:31 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:03.984 02:09:31 -- target/filesystem.sh@93 -- # sync 00:07:03.984 02:09:31 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:03.984 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:03.984 02:09:31 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:03.984 02:09:31 -- common/autotest_common.sh@1208 -- # local i=0 00:07:03.984 02:09:31 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:07:03.984 02:09:31 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:03.984 02:09:31 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:07:03.984 02:09:31 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:03.984 02:09:31 -- common/autotest_common.sh@1220 -- # return 0 00:07:03.984 02:09:31 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:03.984 02:09:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:03.984 02:09:31 -- common/autotest_common.sh@10 -- # set +x 00:07:04.242 02:09:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.242 02:09:31 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:04.242 02:09:31 -- target/filesystem.sh@101 -- # killprocess 2010492 00:07:04.242 02:09:31 -- common/autotest_common.sh@936 -- # '[' -z 2010492 ']' 00:07:04.242 02:09:31 -- common/autotest_common.sh@940 -- # kill -0 2010492 00:07:04.242 02:09:31 -- common/autotest_common.sh@941 -- # uname 00:07:04.242 02:09:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:04.242 02:09:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2010492 00:07:04.242 02:09:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:04.242 02:09:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:04.242 02:09:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2010492' 00:07:04.242 killing process with pid 2010492 00:07:04.242 02:09:31 -- common/autotest_common.sh@955 -- # kill 2010492 00:07:04.242 02:09:31 -- common/autotest_common.sh@960 -- # wait 2010492 00:07:04.809 02:09:32 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:04.809 00:07:04.809 real 0m22.855s 00:07:04.809 user 1m28.507s 00:07:04.809 sys 0m2.674s 00:07:04.809 02:09:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:04.809 02:09:32 -- common/autotest_common.sh@10 -- # set +x 00:07:04.809 ************************************ 00:07:04.809 END TEST nvmf_filesystem_in_capsule 00:07:04.809 ************************************ 00:07:04.809 02:09:32 -- target/filesystem.sh@108 -- # nvmftestfini 00:07:04.809 02:09:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:04.809 02:09:32 -- nvmf/common.sh@116 -- # sync 00:07:04.809 02:09:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:04.809 02:09:32 -- nvmf/common.sh@119 -- # set +e 00:07:04.809 02:09:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:04.809 02:09:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:04.809 rmmod nvme_tcp 00:07:04.809 rmmod nvme_fabrics 00:07:04.809 rmmod nvme_keyring 00:07:04.809 02:09:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:04.809 02:09:32 -- nvmf/common.sh@123 -- # set -e 00:07:04.809 02:09:32 -- nvmf/common.sh@124 -- # return 0 00:07:04.810 02:09:32 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:07:04.810 02:09:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:04.810 02:09:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:04.810 02:09:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:04.810 02:09:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:04.810 02:09:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:04.810 02:09:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:04.810 02:09:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:04.810 02:09:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:06.715 02:09:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:06.715 00:07:06.715 real 0m46.059s 00:07:06.715 user 2m41.087s 00:07:06.715 sys 0m6.582s 00:07:06.715 02:09:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:06.715 02:09:34 -- common/autotest_common.sh@10 -- # set +x 00:07:06.715 ************************************ 00:07:06.715 END TEST nvmf_filesystem 00:07:06.715 ************************************ 00:07:06.715 02:09:34 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:06.715 02:09:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:06.715 02:09:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:06.715 02:09:34 -- common/autotest_common.sh@10 -- # set +x 00:07:06.715 ************************************ 00:07:06.715 START TEST nvmf_discovery 00:07:06.715 ************************************ 00:07:06.715 02:09:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:06.715 * Looking for test storage... 00:07:06.715 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:06.715 02:09:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:07.010 02:09:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:07.010 02:09:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:07.010 02:09:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:07.010 02:09:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:07.010 02:09:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:07.010 02:09:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:07.010 02:09:34 -- scripts/common.sh@335 -- # IFS=.-: 00:07:07.010 02:09:34 -- scripts/common.sh@335 -- # read -ra ver1 00:07:07.010 02:09:34 -- scripts/common.sh@336 -- # IFS=.-: 00:07:07.010 02:09:34 -- scripts/common.sh@336 -- # read -ra ver2 00:07:07.010 02:09:34 -- scripts/common.sh@337 -- # local 'op=<' 00:07:07.010 02:09:34 -- scripts/common.sh@339 -- # ver1_l=2 00:07:07.010 02:09:34 -- scripts/common.sh@340 -- # ver2_l=1 00:07:07.010 02:09:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:07.010 02:09:34 -- scripts/common.sh@343 -- # case "$op" in 00:07:07.010 02:09:34 -- scripts/common.sh@344 -- # : 1 00:07:07.010 02:09:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:07.010 02:09:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:07.010 02:09:34 -- scripts/common.sh@364 -- # decimal 1 00:07:07.010 02:09:34 -- scripts/common.sh@352 -- # local d=1 00:07:07.010 02:09:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:07.010 02:09:34 -- scripts/common.sh@354 -- # echo 1 00:07:07.010 02:09:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:07.010 02:09:34 -- scripts/common.sh@365 -- # decimal 2 00:07:07.010 02:09:34 -- scripts/common.sh@352 -- # local d=2 00:07:07.010 02:09:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:07.010 02:09:34 -- scripts/common.sh@354 -- # echo 2 00:07:07.010 02:09:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:07.010 02:09:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:07.010 02:09:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:07.010 02:09:34 -- scripts/common.sh@367 -- # return 0 00:07:07.010 02:09:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:07.010 02:09:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:07.010 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:07.010 --rc genhtml_branch_coverage=1 00:07:07.010 --rc genhtml_function_coverage=1 00:07:07.010 --rc genhtml_legend=1 00:07:07.010 --rc geninfo_all_blocks=1 00:07:07.010 --rc geninfo_unexecuted_blocks=1 00:07:07.010 00:07:07.010 ' 00:07:07.010 02:09:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:07.010 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:07.010 --rc genhtml_branch_coverage=1 00:07:07.010 --rc genhtml_function_coverage=1 00:07:07.010 --rc genhtml_legend=1 00:07:07.010 --rc geninfo_all_blocks=1 00:07:07.010 --rc geninfo_unexecuted_blocks=1 00:07:07.010 00:07:07.010 ' 00:07:07.010 02:09:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:07.010 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:07.010 --rc genhtml_branch_coverage=1 00:07:07.010 --rc genhtml_function_coverage=1 00:07:07.010 --rc genhtml_legend=1 00:07:07.010 --rc geninfo_all_blocks=1 00:07:07.010 --rc geninfo_unexecuted_blocks=1 00:07:07.010 00:07:07.010 ' 00:07:07.010 02:09:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:07.010 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:07.010 --rc genhtml_branch_coverage=1 00:07:07.010 --rc genhtml_function_coverage=1 00:07:07.010 --rc genhtml_legend=1 00:07:07.010 --rc geninfo_all_blocks=1 00:07:07.010 --rc geninfo_unexecuted_blocks=1 00:07:07.010 00:07:07.010 ' 00:07:07.010 02:09:34 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:07.010 02:09:34 -- nvmf/common.sh@7 -- # uname -s 00:07:07.010 02:09:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:07.010 02:09:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:07.010 02:09:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:07.010 02:09:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:07.010 02:09:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:07.010 02:09:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:07.010 02:09:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:07.010 02:09:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:07.010 02:09:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:07.010 02:09:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:07.010 02:09:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:07.010 02:09:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:07.010 02:09:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:07.010 02:09:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:07.010 02:09:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:07.010 02:09:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:07.010 02:09:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:07.010 02:09:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:07.010 02:09:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:07.010 02:09:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:07.010 02:09:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:07.010 02:09:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:07.010 02:09:34 -- paths/export.sh@5 -- # export PATH 00:07:07.010 02:09:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:07.010 02:09:34 -- nvmf/common.sh@46 -- # : 0 00:07:07.011 02:09:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:07.011 02:09:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:07.011 02:09:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:07.011 02:09:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:07.011 02:09:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:07.011 02:09:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:07.011 02:09:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:07.011 02:09:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:07.011 02:09:34 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:07:07.011 02:09:34 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:07:07.011 02:09:34 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:07:07.011 02:09:34 -- target/discovery.sh@15 -- # hash nvme 00:07:07.011 02:09:34 -- target/discovery.sh@20 -- # nvmftestinit 00:07:07.011 02:09:34 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:07.011 02:09:34 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:07.011 02:09:34 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:07.011 02:09:34 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:07.011 02:09:34 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:07.011 02:09:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:07.011 02:09:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:07.011 02:09:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:07.011 02:09:34 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:07.011 02:09:34 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:07.011 02:09:34 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:07.011 02:09:34 -- common/autotest_common.sh@10 -- # set +x 00:07:09.544 02:09:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:09.544 02:09:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:09.544 02:09:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:09.544 02:09:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:09.544 02:09:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:09.544 02:09:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:09.544 02:09:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:09.544 02:09:36 -- nvmf/common.sh@294 -- # net_devs=() 00:07:09.544 02:09:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:09.544 02:09:36 -- nvmf/common.sh@295 -- # e810=() 00:07:09.544 02:09:36 -- nvmf/common.sh@295 -- # local -ga e810 00:07:09.544 02:09:36 -- nvmf/common.sh@296 -- # x722=() 00:07:09.544 02:09:36 -- nvmf/common.sh@296 -- # local -ga x722 00:07:09.544 02:09:36 -- nvmf/common.sh@297 -- # mlx=() 00:07:09.544 02:09:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:09.544 02:09:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:09.544 02:09:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:09.544 02:09:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:09.544 02:09:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:09.544 02:09:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:09.544 02:09:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:09.544 02:09:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:09.544 02:09:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:09.544 02:09:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:09.544 02:09:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:09.544 02:09:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:09.544 02:09:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:09.544 02:09:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:09.544 02:09:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:09.544 02:09:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:09.544 02:09:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:09.544 02:09:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:09.544 02:09:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:09.544 02:09:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:09.544 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:09.544 02:09:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:09.544 02:09:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:09.544 02:09:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:09.544 02:09:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:09.544 02:09:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:09.544 02:09:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:09.544 02:09:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:09.544 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:09.544 02:09:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:09.544 02:09:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:09.544 02:09:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:09.544 02:09:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:09.544 02:09:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:09.544 02:09:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:09.544 02:09:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:09.544 02:09:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:09.544 02:09:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:09.544 02:09:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:09.544 02:09:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:09.544 02:09:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:09.544 02:09:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:09.544 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:09.544 02:09:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:09.544 02:09:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:09.544 02:09:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:09.544 02:09:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:09.544 02:09:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:09.544 02:09:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:09.544 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:09.544 02:09:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:09.544 02:09:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:09.544 02:09:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:09.544 02:09:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:09.544 02:09:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:09.544 02:09:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:09.544 02:09:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:09.544 02:09:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:09.544 02:09:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:09.544 02:09:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:09.544 02:09:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:09.544 02:09:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:09.544 02:09:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:09.544 02:09:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:09.544 02:09:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:09.544 02:09:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:09.544 02:09:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:09.544 02:09:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:09.544 02:09:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:09.544 02:09:36 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:09.544 02:09:36 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:09.544 02:09:36 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:09.544 02:09:36 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:09.544 02:09:36 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:09.544 02:09:36 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:09.544 02:09:36 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:09.544 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:09.544 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.302 ms 00:07:09.544 00:07:09.544 --- 10.0.0.2 ping statistics --- 00:07:09.544 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:09.544 rtt min/avg/max/mdev = 0.302/0.302/0.302/0.000 ms 00:07:09.544 02:09:36 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:09.544 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:09.544 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.123 ms 00:07:09.544 00:07:09.544 --- 10.0.0.1 ping statistics --- 00:07:09.544 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:09.544 rtt min/avg/max/mdev = 0.123/0.123/0.123/0.000 ms 00:07:09.544 02:09:36 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:09.544 02:09:36 -- nvmf/common.sh@410 -- # return 0 00:07:09.544 02:09:36 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:09.544 02:09:36 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:09.544 02:09:36 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:09.544 02:09:36 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:09.544 02:09:36 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:09.544 02:09:36 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:09.544 02:09:36 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:09.544 02:09:36 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:07:09.544 02:09:36 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:09.544 02:09:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:09.544 02:09:36 -- common/autotest_common.sh@10 -- # set +x 00:07:09.544 02:09:36 -- nvmf/common.sh@469 -- # nvmfpid=2015403 00:07:09.544 02:09:36 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:09.544 02:09:36 -- nvmf/common.sh@470 -- # waitforlisten 2015403 00:07:09.544 02:09:36 -- common/autotest_common.sh@829 -- # '[' -z 2015403 ']' 00:07:09.544 02:09:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:09.544 02:09:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:09.544 02:09:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:09.544 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:09.544 02:09:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:09.544 02:09:36 -- common/autotest_common.sh@10 -- # set +x 00:07:09.544 [2024-12-08 02:09:36.916427] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:09.544 [2024-12-08 02:09:36.916499] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:09.544 EAL: No free 2048 kB hugepages reported on node 1 00:07:09.544 [2024-12-08 02:09:36.983824] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:09.544 [2024-12-08 02:09:37.096412] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:09.544 [2024-12-08 02:09:37.096559] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:09.545 [2024-12-08 02:09:37.096579] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:09.545 [2024-12-08 02:09:37.096591] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:09.545 [2024-12-08 02:09:37.096649] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:09.545 [2024-12-08 02:09:37.096711] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:09.545 [2024-12-08 02:09:37.096735] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:09.545 [2024-12-08 02:09:37.096737] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:10.479 02:09:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:10.479 02:09:37 -- common/autotest_common.sh@862 -- # return 0 00:07:10.479 02:09:37 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:10.479 02:09:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:10.479 02:09:37 -- common/autotest_common.sh@10 -- # set +x 00:07:10.479 02:09:37 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:10.479 02:09:37 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:10.479 02:09:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.479 02:09:37 -- common/autotest_common.sh@10 -- # set +x 00:07:10.479 [2024-12-08 02:09:37.954271] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:10.480 02:09:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.480 02:09:37 -- target/discovery.sh@26 -- # seq 1 4 00:07:10.480 02:09:37 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:10.480 02:09:37 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:07:10.480 02:09:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.480 02:09:37 -- common/autotest_common.sh@10 -- # set +x 00:07:10.480 Null1 00:07:10.480 02:09:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.480 02:09:37 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:10.480 02:09:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.480 02:09:37 -- common/autotest_common.sh@10 -- # set +x 00:07:10.480 02:09:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.480 02:09:37 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:07:10.480 02:09:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.480 02:09:37 -- common/autotest_common.sh@10 -- # set +x 00:07:10.480 02:09:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.480 02:09:37 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:10.480 02:09:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.480 02:09:37 -- common/autotest_common.sh@10 -- # set +x 00:07:10.480 [2024-12-08 02:09:37.994555] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:10.480 02:09:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.480 02:09:37 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:10.480 02:09:37 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:07:10.480 02:09:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.480 02:09:37 -- common/autotest_common.sh@10 -- # set +x 00:07:10.480 Null2 00:07:10.480 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.480 02:09:38 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:07:10.480 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.480 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:07:10.480 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.480 02:09:38 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:07:10.480 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.480 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:07:10.480 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.480 02:09:38 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:07:10.480 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.480 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:07:10.480 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.480 02:09:38 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:10.480 02:09:38 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:07:10.480 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.480 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:07:10.480 Null3 00:07:10.480 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.480 02:09:38 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:07:10.480 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.480 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:07:10.480 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.480 02:09:38 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:07:10.480 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.480 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:07:10.480 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.480 02:09:38 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:07:10.480 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.480 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:07:10.480 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.480 02:09:38 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:10.480 02:09:38 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:07:10.480 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.480 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:07:10.480 Null4 00:07:10.480 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.480 02:09:38 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:07:10.480 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.480 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:07:10.480 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.480 02:09:38 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:07:10.480 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.480 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:07:10.480 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.480 02:09:38 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:07:10.480 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.480 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:07:10.480 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.480 02:09:38 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:07:10.480 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.480 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:07:10.480 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.480 02:09:38 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:07:10.480 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.480 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:07:10.480 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.480 02:09:38 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:07:10.739 00:07:10.739 Discovery Log Number of Records 6, Generation counter 6 00:07:10.739 =====Discovery Log Entry 0====== 00:07:10.739 trtype: tcp 00:07:10.739 adrfam: ipv4 00:07:10.739 subtype: current discovery subsystem 00:07:10.739 treq: not required 00:07:10.739 portid: 0 00:07:10.739 trsvcid: 4420 00:07:10.739 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:10.739 traddr: 10.0.0.2 00:07:10.739 eflags: explicit discovery connections, duplicate discovery information 00:07:10.739 sectype: none 00:07:10.739 =====Discovery Log Entry 1====== 00:07:10.739 trtype: tcp 00:07:10.739 adrfam: ipv4 00:07:10.739 subtype: nvme subsystem 00:07:10.739 treq: not required 00:07:10.739 portid: 0 00:07:10.739 trsvcid: 4420 00:07:10.739 subnqn: nqn.2016-06.io.spdk:cnode1 00:07:10.739 traddr: 10.0.0.2 00:07:10.739 eflags: none 00:07:10.739 sectype: none 00:07:10.739 =====Discovery Log Entry 2====== 00:07:10.739 trtype: tcp 00:07:10.739 adrfam: ipv4 00:07:10.739 subtype: nvme subsystem 00:07:10.739 treq: not required 00:07:10.739 portid: 0 00:07:10.739 trsvcid: 4420 00:07:10.739 subnqn: nqn.2016-06.io.spdk:cnode2 00:07:10.739 traddr: 10.0.0.2 00:07:10.739 eflags: none 00:07:10.739 sectype: none 00:07:10.739 =====Discovery Log Entry 3====== 00:07:10.739 trtype: tcp 00:07:10.739 adrfam: ipv4 00:07:10.739 subtype: nvme subsystem 00:07:10.739 treq: not required 00:07:10.739 portid: 0 00:07:10.739 trsvcid: 4420 00:07:10.739 subnqn: nqn.2016-06.io.spdk:cnode3 00:07:10.739 traddr: 10.0.0.2 00:07:10.739 eflags: none 00:07:10.739 sectype: none 00:07:10.739 =====Discovery Log Entry 4====== 00:07:10.739 trtype: tcp 00:07:10.739 adrfam: ipv4 00:07:10.739 subtype: nvme subsystem 00:07:10.739 treq: not required 00:07:10.739 portid: 0 00:07:10.739 trsvcid: 4420 00:07:10.739 subnqn: nqn.2016-06.io.spdk:cnode4 00:07:10.739 traddr: 10.0.0.2 00:07:10.739 eflags: none 00:07:10.739 sectype: none 00:07:10.739 =====Discovery Log Entry 5====== 00:07:10.739 trtype: tcp 00:07:10.739 adrfam: ipv4 00:07:10.739 subtype: discovery subsystem referral 00:07:10.739 treq: not required 00:07:10.739 portid: 0 00:07:10.739 trsvcid: 4430 00:07:10.739 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:10.739 traddr: 10.0.0.2 00:07:10.739 eflags: none 00:07:10.739 sectype: none 00:07:10.739 02:09:38 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:07:10.739 Perform nvmf subsystem discovery via RPC 00:07:10.739 02:09:38 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:07:10.739 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.739 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:07:10.739 [2024-12-08 02:09:38.327482] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:07:10.739 [ 00:07:10.739 { 00:07:10.739 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:07:10.739 "subtype": "Discovery", 00:07:10.739 "listen_addresses": [ 00:07:10.739 { 00:07:10.739 "transport": "TCP", 00:07:10.739 "trtype": "TCP", 00:07:10.739 "adrfam": "IPv4", 00:07:10.739 "traddr": "10.0.0.2", 00:07:10.739 "trsvcid": "4420" 00:07:10.739 } 00:07:10.739 ], 00:07:10.739 "allow_any_host": true, 00:07:10.739 "hosts": [] 00:07:10.739 }, 00:07:10.739 { 00:07:10.739 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:07:10.739 "subtype": "NVMe", 00:07:10.739 "listen_addresses": [ 00:07:10.739 { 00:07:10.739 "transport": "TCP", 00:07:10.739 "trtype": "TCP", 00:07:10.739 "adrfam": "IPv4", 00:07:10.739 "traddr": "10.0.0.2", 00:07:10.739 "trsvcid": "4420" 00:07:10.739 } 00:07:10.739 ], 00:07:10.739 "allow_any_host": true, 00:07:10.739 "hosts": [], 00:07:10.739 "serial_number": "SPDK00000000000001", 00:07:10.739 "model_number": "SPDK bdev Controller", 00:07:10.739 "max_namespaces": 32, 00:07:10.739 "min_cntlid": 1, 00:07:10.739 "max_cntlid": 65519, 00:07:10.739 "namespaces": [ 00:07:10.739 { 00:07:10.739 "nsid": 1, 00:07:10.739 "bdev_name": "Null1", 00:07:10.739 "name": "Null1", 00:07:10.739 "nguid": "4A06E4F8C6314ABDAEDB20E614E7B1B3", 00:07:10.739 "uuid": "4a06e4f8-c631-4abd-aedb-20e614e7b1b3" 00:07:10.739 } 00:07:10.739 ] 00:07:10.739 }, 00:07:10.739 { 00:07:10.739 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:07:10.739 "subtype": "NVMe", 00:07:10.739 "listen_addresses": [ 00:07:10.739 { 00:07:10.739 "transport": "TCP", 00:07:10.739 "trtype": "TCP", 00:07:10.739 "adrfam": "IPv4", 00:07:10.739 "traddr": "10.0.0.2", 00:07:10.739 "trsvcid": "4420" 00:07:10.739 } 00:07:10.739 ], 00:07:10.739 "allow_any_host": true, 00:07:10.739 "hosts": [], 00:07:10.739 "serial_number": "SPDK00000000000002", 00:07:10.739 "model_number": "SPDK bdev Controller", 00:07:10.739 "max_namespaces": 32, 00:07:10.739 "min_cntlid": 1, 00:07:10.739 "max_cntlid": 65519, 00:07:10.739 "namespaces": [ 00:07:10.739 { 00:07:10.739 "nsid": 1, 00:07:10.739 "bdev_name": "Null2", 00:07:10.739 "name": "Null2", 00:07:10.739 "nguid": "5EEEAB127A184771BD579E13AC86471F", 00:07:10.739 "uuid": "5eeeab12-7a18-4771-bd57-9e13ac86471f" 00:07:10.739 } 00:07:10.739 ] 00:07:10.739 }, 00:07:10.739 { 00:07:10.739 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:07:10.739 "subtype": "NVMe", 00:07:10.739 "listen_addresses": [ 00:07:10.739 { 00:07:10.739 "transport": "TCP", 00:07:10.739 "trtype": "TCP", 00:07:10.739 "adrfam": "IPv4", 00:07:10.739 "traddr": "10.0.0.2", 00:07:10.739 "trsvcid": "4420" 00:07:10.739 } 00:07:10.739 ], 00:07:10.739 "allow_any_host": true, 00:07:10.739 "hosts": [], 00:07:10.739 "serial_number": "SPDK00000000000003", 00:07:10.739 "model_number": "SPDK bdev Controller", 00:07:10.739 "max_namespaces": 32, 00:07:10.739 "min_cntlid": 1, 00:07:10.739 "max_cntlid": 65519, 00:07:10.739 "namespaces": [ 00:07:10.739 { 00:07:10.739 "nsid": 1, 00:07:10.739 "bdev_name": "Null3", 00:07:10.739 "name": "Null3", 00:07:10.739 "nguid": "C11BCC5E542C482B8AA7846467F6F076", 00:07:10.739 "uuid": "c11bcc5e-542c-482b-8aa7-846467f6f076" 00:07:10.739 } 00:07:10.739 ] 00:07:10.739 }, 00:07:10.739 { 00:07:10.739 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:07:10.739 "subtype": "NVMe", 00:07:10.739 "listen_addresses": [ 00:07:10.739 { 00:07:10.739 "transport": "TCP", 00:07:10.739 "trtype": "TCP", 00:07:10.739 "adrfam": "IPv4", 00:07:10.739 "traddr": "10.0.0.2", 00:07:10.739 "trsvcid": "4420" 00:07:10.739 } 00:07:10.739 ], 00:07:10.739 "allow_any_host": true, 00:07:10.739 "hosts": [], 00:07:10.739 "serial_number": "SPDK00000000000004", 00:07:10.739 "model_number": "SPDK bdev Controller", 00:07:10.739 "max_namespaces": 32, 00:07:10.739 "min_cntlid": 1, 00:07:10.739 "max_cntlid": 65519, 00:07:10.739 "namespaces": [ 00:07:10.739 { 00:07:10.739 "nsid": 1, 00:07:10.739 "bdev_name": "Null4", 00:07:10.739 "name": "Null4", 00:07:10.739 "nguid": "27D0E304DF4445E68454A111FA5B0957", 00:07:10.739 "uuid": "27d0e304-df44-45e6-8454-a111fa5b0957" 00:07:10.739 } 00:07:10.739 ] 00:07:10.739 } 00:07:10.739 ] 00:07:10.739 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.739 02:09:38 -- target/discovery.sh@42 -- # seq 1 4 00:07:10.739 02:09:38 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:10.739 02:09:38 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:10.739 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.739 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:07:10.739 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.739 02:09:38 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:07:10.739 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.739 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:07:10.739 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.739 02:09:38 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:10.739 02:09:38 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:07:10.739 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.739 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:07:10.739 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.739 02:09:38 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:07:10.739 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.739 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:07:10.739 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.739 02:09:38 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:10.739 02:09:38 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:07:10.739 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.739 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:07:10.739 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.739 02:09:38 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:07:10.739 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.739 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:07:10.740 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.740 02:09:38 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:10.740 02:09:38 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:07:10.740 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.740 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:07:10.740 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.740 02:09:38 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:07:10.740 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.740 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:07:10.740 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.740 02:09:38 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:07:10.740 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.740 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:07:10.740 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.740 02:09:38 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:07:10.740 02:09:38 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:07:10.740 02:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:10.740 02:09:38 -- common/autotest_common.sh@10 -- # set +x 00:07:10.740 02:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:10.740 02:09:38 -- target/discovery.sh@49 -- # check_bdevs= 00:07:10.740 02:09:38 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:07:10.740 02:09:38 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:07:10.740 02:09:38 -- target/discovery.sh@57 -- # nvmftestfini 00:07:10.740 02:09:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:10.740 02:09:38 -- nvmf/common.sh@116 -- # sync 00:07:10.740 02:09:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:10.740 02:09:38 -- nvmf/common.sh@119 -- # set +e 00:07:10.740 02:09:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:10.740 02:09:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:10.740 rmmod nvme_tcp 00:07:10.740 rmmod nvme_fabrics 00:07:10.740 rmmod nvme_keyring 00:07:10.740 02:09:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:10.740 02:09:38 -- nvmf/common.sh@123 -- # set -e 00:07:10.740 02:09:38 -- nvmf/common.sh@124 -- # return 0 00:07:10.740 02:09:38 -- nvmf/common.sh@477 -- # '[' -n 2015403 ']' 00:07:10.740 02:09:38 -- nvmf/common.sh@478 -- # killprocess 2015403 00:07:10.740 02:09:38 -- common/autotest_common.sh@936 -- # '[' -z 2015403 ']' 00:07:10.740 02:09:38 -- common/autotest_common.sh@940 -- # kill -0 2015403 00:07:10.740 02:09:38 -- common/autotest_common.sh@941 -- # uname 00:07:10.740 02:09:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:10.740 02:09:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2015403 00:07:10.998 02:09:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:10.998 02:09:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:10.998 02:09:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2015403' 00:07:10.998 killing process with pid 2015403 00:07:10.998 02:09:38 -- common/autotest_common.sh@955 -- # kill 2015403 00:07:10.998 [2024-12-08 02:09:38.552459] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:07:10.998 02:09:38 -- common/autotest_common.sh@960 -- # wait 2015403 00:07:11.258 02:09:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:11.259 02:09:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:11.259 02:09:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:11.259 02:09:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:11.259 02:09:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:11.259 02:09:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:11.259 02:09:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:11.259 02:09:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:13.165 02:09:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:13.165 00:07:13.165 real 0m6.442s 00:07:13.165 user 0m7.992s 00:07:13.165 sys 0m1.925s 00:07:13.165 02:09:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:13.165 02:09:40 -- common/autotest_common.sh@10 -- # set +x 00:07:13.165 ************************************ 00:07:13.165 END TEST nvmf_discovery 00:07:13.165 ************************************ 00:07:13.165 02:09:40 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:13.165 02:09:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:13.165 02:09:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:13.165 02:09:40 -- common/autotest_common.sh@10 -- # set +x 00:07:13.165 ************************************ 00:07:13.165 START TEST nvmf_referrals 00:07:13.165 ************************************ 00:07:13.165 02:09:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:13.425 * Looking for test storage... 00:07:13.425 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:13.425 02:09:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:13.425 02:09:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:13.425 02:09:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:13.425 02:09:41 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:13.425 02:09:41 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:13.425 02:09:41 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:13.425 02:09:41 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:13.425 02:09:41 -- scripts/common.sh@335 -- # IFS=.-: 00:07:13.425 02:09:41 -- scripts/common.sh@335 -- # read -ra ver1 00:07:13.425 02:09:41 -- scripts/common.sh@336 -- # IFS=.-: 00:07:13.425 02:09:41 -- scripts/common.sh@336 -- # read -ra ver2 00:07:13.425 02:09:41 -- scripts/common.sh@337 -- # local 'op=<' 00:07:13.425 02:09:41 -- scripts/common.sh@339 -- # ver1_l=2 00:07:13.425 02:09:41 -- scripts/common.sh@340 -- # ver2_l=1 00:07:13.425 02:09:41 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:13.425 02:09:41 -- scripts/common.sh@343 -- # case "$op" in 00:07:13.425 02:09:41 -- scripts/common.sh@344 -- # : 1 00:07:13.425 02:09:41 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:13.425 02:09:41 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:13.425 02:09:41 -- scripts/common.sh@364 -- # decimal 1 00:07:13.425 02:09:41 -- scripts/common.sh@352 -- # local d=1 00:07:13.425 02:09:41 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:13.425 02:09:41 -- scripts/common.sh@354 -- # echo 1 00:07:13.425 02:09:41 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:13.425 02:09:41 -- scripts/common.sh@365 -- # decimal 2 00:07:13.425 02:09:41 -- scripts/common.sh@352 -- # local d=2 00:07:13.425 02:09:41 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:13.425 02:09:41 -- scripts/common.sh@354 -- # echo 2 00:07:13.425 02:09:41 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:13.425 02:09:41 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:13.425 02:09:41 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:13.425 02:09:41 -- scripts/common.sh@367 -- # return 0 00:07:13.425 02:09:41 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:13.425 02:09:41 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:13.425 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:13.425 --rc genhtml_branch_coverage=1 00:07:13.425 --rc genhtml_function_coverage=1 00:07:13.425 --rc genhtml_legend=1 00:07:13.425 --rc geninfo_all_blocks=1 00:07:13.425 --rc geninfo_unexecuted_blocks=1 00:07:13.425 00:07:13.425 ' 00:07:13.425 02:09:41 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:13.425 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:13.425 --rc genhtml_branch_coverage=1 00:07:13.425 --rc genhtml_function_coverage=1 00:07:13.425 --rc genhtml_legend=1 00:07:13.425 --rc geninfo_all_blocks=1 00:07:13.425 --rc geninfo_unexecuted_blocks=1 00:07:13.425 00:07:13.425 ' 00:07:13.425 02:09:41 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:13.425 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:13.425 --rc genhtml_branch_coverage=1 00:07:13.425 --rc genhtml_function_coverage=1 00:07:13.425 --rc genhtml_legend=1 00:07:13.425 --rc geninfo_all_blocks=1 00:07:13.425 --rc geninfo_unexecuted_blocks=1 00:07:13.425 00:07:13.425 ' 00:07:13.425 02:09:41 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:13.425 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:13.425 --rc genhtml_branch_coverage=1 00:07:13.425 --rc genhtml_function_coverage=1 00:07:13.425 --rc genhtml_legend=1 00:07:13.425 --rc geninfo_all_blocks=1 00:07:13.425 --rc geninfo_unexecuted_blocks=1 00:07:13.425 00:07:13.425 ' 00:07:13.425 02:09:41 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:13.425 02:09:41 -- nvmf/common.sh@7 -- # uname -s 00:07:13.425 02:09:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:13.425 02:09:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:13.425 02:09:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:13.425 02:09:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:13.425 02:09:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:13.425 02:09:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:13.425 02:09:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:13.425 02:09:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:13.425 02:09:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:13.425 02:09:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:13.425 02:09:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:13.425 02:09:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:13.425 02:09:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:13.425 02:09:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:13.425 02:09:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:13.425 02:09:41 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:13.425 02:09:41 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:13.425 02:09:41 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:13.425 02:09:41 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:13.425 02:09:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:13.425 02:09:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:13.425 02:09:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:13.425 02:09:41 -- paths/export.sh@5 -- # export PATH 00:07:13.425 02:09:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:13.425 02:09:41 -- nvmf/common.sh@46 -- # : 0 00:07:13.425 02:09:41 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:13.425 02:09:41 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:13.425 02:09:41 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:13.425 02:09:41 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:13.425 02:09:41 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:13.425 02:09:41 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:13.425 02:09:41 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:13.425 02:09:41 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:13.425 02:09:41 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:07:13.425 02:09:41 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:07:13.425 02:09:41 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:07:13.425 02:09:41 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:07:13.425 02:09:41 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:07:13.425 02:09:41 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:07:13.425 02:09:41 -- target/referrals.sh@37 -- # nvmftestinit 00:07:13.425 02:09:41 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:13.425 02:09:41 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:13.425 02:09:41 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:13.425 02:09:41 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:13.425 02:09:41 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:13.425 02:09:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:13.425 02:09:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:13.425 02:09:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:13.425 02:09:41 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:13.425 02:09:41 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:13.425 02:09:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:13.425 02:09:41 -- common/autotest_common.sh@10 -- # set +x 00:07:15.331 02:09:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:15.331 02:09:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:15.331 02:09:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:15.331 02:09:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:15.331 02:09:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:15.331 02:09:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:15.331 02:09:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:15.331 02:09:43 -- nvmf/common.sh@294 -- # net_devs=() 00:07:15.331 02:09:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:15.331 02:09:43 -- nvmf/common.sh@295 -- # e810=() 00:07:15.331 02:09:43 -- nvmf/common.sh@295 -- # local -ga e810 00:07:15.331 02:09:43 -- nvmf/common.sh@296 -- # x722=() 00:07:15.331 02:09:43 -- nvmf/common.sh@296 -- # local -ga x722 00:07:15.331 02:09:43 -- nvmf/common.sh@297 -- # mlx=() 00:07:15.331 02:09:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:15.331 02:09:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:15.331 02:09:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:15.331 02:09:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:15.331 02:09:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:15.331 02:09:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:15.331 02:09:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:15.331 02:09:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:15.331 02:09:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:15.331 02:09:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:15.331 02:09:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:15.331 02:09:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:15.331 02:09:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:15.331 02:09:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:15.331 02:09:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:15.331 02:09:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:15.331 02:09:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:15.331 02:09:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:15.331 02:09:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:15.331 02:09:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:15.331 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:15.331 02:09:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:15.331 02:09:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:15.331 02:09:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:15.331 02:09:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:15.590 02:09:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:15.590 02:09:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:15.590 02:09:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:15.590 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:15.590 02:09:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:15.590 02:09:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:15.590 02:09:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:15.590 02:09:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:15.590 02:09:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:15.590 02:09:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:15.590 02:09:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:15.590 02:09:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:15.590 02:09:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:15.590 02:09:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:15.590 02:09:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:15.590 02:09:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:15.590 02:09:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:15.590 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:15.590 02:09:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:15.590 02:09:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:15.590 02:09:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:15.590 02:09:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:15.590 02:09:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:15.590 02:09:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:15.590 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:15.590 02:09:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:15.590 02:09:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:15.590 02:09:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:15.590 02:09:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:15.590 02:09:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:15.590 02:09:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:15.590 02:09:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:15.590 02:09:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:15.590 02:09:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:15.590 02:09:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:15.590 02:09:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:15.590 02:09:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:15.590 02:09:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:15.590 02:09:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:15.590 02:09:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:15.590 02:09:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:15.590 02:09:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:15.590 02:09:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:15.590 02:09:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:15.590 02:09:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:15.590 02:09:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:15.590 02:09:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:15.590 02:09:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:15.590 02:09:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:15.590 02:09:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:15.590 02:09:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:15.590 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:15.590 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.353 ms 00:07:15.590 00:07:15.591 --- 10.0.0.2 ping statistics --- 00:07:15.591 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:15.591 rtt min/avg/max/mdev = 0.353/0.353/0.353/0.000 ms 00:07:15.591 02:09:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:15.591 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:15.591 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.154 ms 00:07:15.591 00:07:15.591 --- 10.0.0.1 ping statistics --- 00:07:15.591 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:15.591 rtt min/avg/max/mdev = 0.154/0.154/0.154/0.000 ms 00:07:15.591 02:09:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:15.591 02:09:43 -- nvmf/common.sh@410 -- # return 0 00:07:15.591 02:09:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:15.591 02:09:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:15.591 02:09:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:15.591 02:09:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:15.591 02:09:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:15.591 02:09:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:15.591 02:09:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:15.854 02:09:43 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:07:15.854 02:09:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:15.854 02:09:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:15.854 02:09:43 -- common/autotest_common.sh@10 -- # set +x 00:07:15.854 02:09:43 -- nvmf/common.sh@469 -- # nvmfpid=2017658 00:07:15.854 02:09:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:15.854 02:09:43 -- nvmf/common.sh@470 -- # waitforlisten 2017658 00:07:15.854 02:09:43 -- common/autotest_common.sh@829 -- # '[' -z 2017658 ']' 00:07:15.854 02:09:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:15.854 02:09:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:15.854 02:09:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:15.854 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:15.854 02:09:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:15.854 02:09:43 -- common/autotest_common.sh@10 -- # set +x 00:07:15.854 [2024-12-08 02:09:43.429082] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:15.854 [2024-12-08 02:09:43.429159] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:15.854 EAL: No free 2048 kB hugepages reported on node 1 00:07:15.854 [2024-12-08 02:09:43.492959] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:15.854 [2024-12-08 02:09:43.603926] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:15.854 [2024-12-08 02:09:43.604077] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:15.854 [2024-12-08 02:09:43.604095] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:15.854 [2024-12-08 02:09:43.604107] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:15.854 [2024-12-08 02:09:43.604166] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:15.854 [2024-12-08 02:09:43.604228] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:15.854 [2024-12-08 02:09:43.604295] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:15.854 [2024-12-08 02:09:43.604298] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:16.846 02:09:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:16.846 02:09:44 -- common/autotest_common.sh@862 -- # return 0 00:07:16.846 02:09:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:16.846 02:09:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:16.846 02:09:44 -- common/autotest_common.sh@10 -- # set +x 00:07:16.846 02:09:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:16.846 02:09:44 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:16.846 02:09:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:16.846 02:09:44 -- common/autotest_common.sh@10 -- # set +x 00:07:16.846 [2024-12-08 02:09:44.423152] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:16.846 02:09:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:16.846 02:09:44 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:07:16.846 02:09:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:16.846 02:09:44 -- common/autotest_common.sh@10 -- # set +x 00:07:16.846 [2024-12-08 02:09:44.435368] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:07:16.846 02:09:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:16.846 02:09:44 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:07:16.846 02:09:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:16.846 02:09:44 -- common/autotest_common.sh@10 -- # set +x 00:07:16.846 02:09:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:16.846 02:09:44 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:07:16.846 02:09:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:16.846 02:09:44 -- common/autotest_common.sh@10 -- # set +x 00:07:16.846 02:09:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:16.846 02:09:44 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:07:16.846 02:09:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:16.846 02:09:44 -- common/autotest_common.sh@10 -- # set +x 00:07:16.846 02:09:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:16.846 02:09:44 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:16.846 02:09:44 -- target/referrals.sh@48 -- # jq length 00:07:16.846 02:09:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:16.846 02:09:44 -- common/autotest_common.sh@10 -- # set +x 00:07:16.846 02:09:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:16.846 02:09:44 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:07:16.846 02:09:44 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:07:16.846 02:09:44 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:16.846 02:09:44 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:16.846 02:09:44 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:16.846 02:09:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:16.846 02:09:44 -- common/autotest_common.sh@10 -- # set +x 00:07:16.846 02:09:44 -- target/referrals.sh@21 -- # sort 00:07:16.846 02:09:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:16.846 02:09:44 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:16.846 02:09:44 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:16.846 02:09:44 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:07:16.846 02:09:44 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:16.846 02:09:44 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:16.846 02:09:44 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:16.846 02:09:44 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:16.846 02:09:44 -- target/referrals.sh@26 -- # sort 00:07:17.105 02:09:44 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:17.105 02:09:44 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:17.105 02:09:44 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:07:17.105 02:09:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:17.105 02:09:44 -- common/autotest_common.sh@10 -- # set +x 00:07:17.105 02:09:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:17.105 02:09:44 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:07:17.105 02:09:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:17.105 02:09:44 -- common/autotest_common.sh@10 -- # set +x 00:07:17.105 02:09:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:17.105 02:09:44 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:07:17.105 02:09:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:17.105 02:09:44 -- common/autotest_common.sh@10 -- # set +x 00:07:17.105 02:09:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:17.105 02:09:44 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:17.105 02:09:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:17.105 02:09:44 -- target/referrals.sh@56 -- # jq length 00:07:17.105 02:09:44 -- common/autotest_common.sh@10 -- # set +x 00:07:17.105 02:09:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:17.105 02:09:44 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:07:17.105 02:09:44 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:07:17.105 02:09:44 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:17.105 02:09:44 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:17.105 02:09:44 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:17.105 02:09:44 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:17.105 02:09:44 -- target/referrals.sh@26 -- # sort 00:07:17.364 02:09:45 -- target/referrals.sh@26 -- # echo 00:07:17.364 02:09:45 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:07:17.364 02:09:45 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:07:17.364 02:09:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:17.364 02:09:45 -- common/autotest_common.sh@10 -- # set +x 00:07:17.364 02:09:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:17.364 02:09:45 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:17.364 02:09:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:17.364 02:09:45 -- common/autotest_common.sh@10 -- # set +x 00:07:17.364 02:09:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:17.364 02:09:45 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:07:17.364 02:09:45 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:17.364 02:09:45 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:17.364 02:09:45 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:17.364 02:09:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:17.364 02:09:45 -- target/referrals.sh@21 -- # sort 00:07:17.364 02:09:45 -- common/autotest_common.sh@10 -- # set +x 00:07:17.364 02:09:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:17.364 02:09:45 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:07:17.364 02:09:45 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:17.364 02:09:45 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:07:17.364 02:09:45 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:17.364 02:09:45 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:17.364 02:09:45 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:17.364 02:09:45 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:17.364 02:09:45 -- target/referrals.sh@26 -- # sort 00:07:17.621 02:09:45 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:07:17.621 02:09:45 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:17.621 02:09:45 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:07:17.621 02:09:45 -- target/referrals.sh@67 -- # jq -r .subnqn 00:07:17.621 02:09:45 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:17.621 02:09:45 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:17.621 02:09:45 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:17.878 02:09:45 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:07:17.878 02:09:45 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:07:17.878 02:09:45 -- target/referrals.sh@68 -- # jq -r .subnqn 00:07:17.878 02:09:45 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:17.878 02:09:45 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:17.878 02:09:45 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:18.135 02:09:45 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:18.135 02:09:45 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:18.135 02:09:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:18.135 02:09:45 -- common/autotest_common.sh@10 -- # set +x 00:07:18.135 02:09:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:18.135 02:09:45 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:07:18.135 02:09:45 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:18.135 02:09:45 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:18.135 02:09:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:18.135 02:09:45 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:18.135 02:09:45 -- common/autotest_common.sh@10 -- # set +x 00:07:18.135 02:09:45 -- target/referrals.sh@21 -- # sort 00:07:18.135 02:09:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:18.135 02:09:45 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:07:18.135 02:09:45 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:18.135 02:09:45 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:07:18.135 02:09:45 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:18.135 02:09:45 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:18.135 02:09:45 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:18.135 02:09:45 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:18.135 02:09:45 -- target/referrals.sh@26 -- # sort 00:07:18.135 02:09:45 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:07:18.135 02:09:45 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:18.135 02:09:45 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:07:18.135 02:09:45 -- target/referrals.sh@75 -- # jq -r .subnqn 00:07:18.135 02:09:45 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:18.135 02:09:45 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:18.135 02:09:45 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:18.392 02:09:46 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:07:18.392 02:09:46 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:07:18.392 02:09:46 -- target/referrals.sh@76 -- # jq -r .subnqn 00:07:18.392 02:09:46 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:18.392 02:09:46 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:18.392 02:09:46 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:18.650 02:09:46 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:18.650 02:09:46 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:07:18.650 02:09:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:18.650 02:09:46 -- common/autotest_common.sh@10 -- # set +x 00:07:18.650 02:09:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:18.650 02:09:46 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:18.650 02:09:46 -- target/referrals.sh@82 -- # jq length 00:07:18.650 02:09:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:18.650 02:09:46 -- common/autotest_common.sh@10 -- # set +x 00:07:18.650 02:09:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:18.650 02:09:46 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:07:18.650 02:09:46 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:07:18.650 02:09:46 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:18.650 02:09:46 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:18.650 02:09:46 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:18.650 02:09:46 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:18.650 02:09:46 -- target/referrals.sh@26 -- # sort 00:07:18.908 02:09:46 -- target/referrals.sh@26 -- # echo 00:07:18.908 02:09:46 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:07:18.908 02:09:46 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:07:18.908 02:09:46 -- target/referrals.sh@86 -- # nvmftestfini 00:07:18.908 02:09:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:18.908 02:09:46 -- nvmf/common.sh@116 -- # sync 00:07:18.908 02:09:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:18.908 02:09:46 -- nvmf/common.sh@119 -- # set +e 00:07:18.908 02:09:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:18.908 02:09:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:18.908 rmmod nvme_tcp 00:07:18.908 rmmod nvme_fabrics 00:07:18.908 rmmod nvme_keyring 00:07:18.908 02:09:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:18.908 02:09:46 -- nvmf/common.sh@123 -- # set -e 00:07:18.908 02:09:46 -- nvmf/common.sh@124 -- # return 0 00:07:18.908 02:09:46 -- nvmf/common.sh@477 -- # '[' -n 2017658 ']' 00:07:18.908 02:09:46 -- nvmf/common.sh@478 -- # killprocess 2017658 00:07:18.908 02:09:46 -- common/autotest_common.sh@936 -- # '[' -z 2017658 ']' 00:07:18.908 02:09:46 -- common/autotest_common.sh@940 -- # kill -0 2017658 00:07:18.908 02:09:46 -- common/autotest_common.sh@941 -- # uname 00:07:18.908 02:09:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:18.908 02:09:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2017658 00:07:18.908 02:09:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:18.908 02:09:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:18.908 02:09:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2017658' 00:07:18.908 killing process with pid 2017658 00:07:18.908 02:09:46 -- common/autotest_common.sh@955 -- # kill 2017658 00:07:18.908 02:09:46 -- common/autotest_common.sh@960 -- # wait 2017658 00:07:19.167 02:09:46 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:19.167 02:09:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:19.167 02:09:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:19.167 02:09:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:19.167 02:09:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:19.167 02:09:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:19.167 02:09:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:19.167 02:09:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:21.699 02:09:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:21.699 00:07:21.699 real 0m8.034s 00:07:21.699 user 0m14.673s 00:07:21.699 sys 0m2.305s 00:07:21.699 02:09:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:21.699 02:09:48 -- common/autotest_common.sh@10 -- # set +x 00:07:21.699 ************************************ 00:07:21.699 END TEST nvmf_referrals 00:07:21.699 ************************************ 00:07:21.699 02:09:48 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:21.699 02:09:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:21.699 02:09:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:21.699 02:09:48 -- common/autotest_common.sh@10 -- # set +x 00:07:21.699 ************************************ 00:07:21.699 START TEST nvmf_connect_disconnect 00:07:21.699 ************************************ 00:07:21.699 02:09:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:21.699 * Looking for test storage... 00:07:21.699 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:21.699 02:09:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:21.699 02:09:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:21.699 02:09:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:21.699 02:09:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:21.699 02:09:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:21.699 02:09:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:21.699 02:09:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:21.699 02:09:49 -- scripts/common.sh@335 -- # IFS=.-: 00:07:21.699 02:09:49 -- scripts/common.sh@335 -- # read -ra ver1 00:07:21.699 02:09:49 -- scripts/common.sh@336 -- # IFS=.-: 00:07:21.699 02:09:49 -- scripts/common.sh@336 -- # read -ra ver2 00:07:21.700 02:09:49 -- scripts/common.sh@337 -- # local 'op=<' 00:07:21.700 02:09:49 -- scripts/common.sh@339 -- # ver1_l=2 00:07:21.700 02:09:49 -- scripts/common.sh@340 -- # ver2_l=1 00:07:21.700 02:09:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:21.700 02:09:49 -- scripts/common.sh@343 -- # case "$op" in 00:07:21.700 02:09:49 -- scripts/common.sh@344 -- # : 1 00:07:21.700 02:09:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:21.700 02:09:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:21.700 02:09:49 -- scripts/common.sh@364 -- # decimal 1 00:07:21.700 02:09:49 -- scripts/common.sh@352 -- # local d=1 00:07:21.700 02:09:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:21.700 02:09:49 -- scripts/common.sh@354 -- # echo 1 00:07:21.700 02:09:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:21.700 02:09:49 -- scripts/common.sh@365 -- # decimal 2 00:07:21.700 02:09:49 -- scripts/common.sh@352 -- # local d=2 00:07:21.700 02:09:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:21.700 02:09:49 -- scripts/common.sh@354 -- # echo 2 00:07:21.700 02:09:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:21.700 02:09:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:21.700 02:09:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:21.700 02:09:49 -- scripts/common.sh@367 -- # return 0 00:07:21.700 02:09:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:21.700 02:09:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:21.700 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:21.700 --rc genhtml_branch_coverage=1 00:07:21.700 --rc genhtml_function_coverage=1 00:07:21.700 --rc genhtml_legend=1 00:07:21.700 --rc geninfo_all_blocks=1 00:07:21.700 --rc geninfo_unexecuted_blocks=1 00:07:21.700 00:07:21.700 ' 00:07:21.700 02:09:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:21.700 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:21.700 --rc genhtml_branch_coverage=1 00:07:21.700 --rc genhtml_function_coverage=1 00:07:21.700 --rc genhtml_legend=1 00:07:21.700 --rc geninfo_all_blocks=1 00:07:21.700 --rc geninfo_unexecuted_blocks=1 00:07:21.700 00:07:21.700 ' 00:07:21.700 02:09:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:21.700 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:21.700 --rc genhtml_branch_coverage=1 00:07:21.700 --rc genhtml_function_coverage=1 00:07:21.700 --rc genhtml_legend=1 00:07:21.700 --rc geninfo_all_blocks=1 00:07:21.700 --rc geninfo_unexecuted_blocks=1 00:07:21.700 00:07:21.700 ' 00:07:21.700 02:09:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:21.700 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:21.700 --rc genhtml_branch_coverage=1 00:07:21.700 --rc genhtml_function_coverage=1 00:07:21.700 --rc genhtml_legend=1 00:07:21.700 --rc geninfo_all_blocks=1 00:07:21.700 --rc geninfo_unexecuted_blocks=1 00:07:21.700 00:07:21.700 ' 00:07:21.700 02:09:49 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:21.700 02:09:49 -- nvmf/common.sh@7 -- # uname -s 00:07:21.700 02:09:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:21.700 02:09:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:21.700 02:09:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:21.700 02:09:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:21.700 02:09:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:21.700 02:09:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:21.700 02:09:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:21.700 02:09:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:21.700 02:09:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:21.700 02:09:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:21.700 02:09:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:21.700 02:09:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:21.700 02:09:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:21.700 02:09:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:21.700 02:09:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:21.700 02:09:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:21.700 02:09:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:21.700 02:09:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:21.700 02:09:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:21.700 02:09:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:21.700 02:09:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:21.700 02:09:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:21.700 02:09:49 -- paths/export.sh@5 -- # export PATH 00:07:21.700 02:09:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:21.700 02:09:49 -- nvmf/common.sh@46 -- # : 0 00:07:21.700 02:09:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:21.700 02:09:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:21.700 02:09:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:21.700 02:09:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:21.700 02:09:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:21.700 02:09:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:21.700 02:09:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:21.700 02:09:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:21.700 02:09:49 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:07:21.700 02:09:49 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:07:21.700 02:09:49 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:07:21.700 02:09:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:21.700 02:09:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:21.700 02:09:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:21.700 02:09:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:21.700 02:09:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:21.700 02:09:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:21.700 02:09:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:21.700 02:09:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:21.700 02:09:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:21.700 02:09:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:21.700 02:09:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:21.700 02:09:49 -- common/autotest_common.sh@10 -- # set +x 00:07:23.607 02:09:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:23.607 02:09:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:23.607 02:09:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:23.607 02:09:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:23.607 02:09:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:23.607 02:09:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:23.607 02:09:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:23.607 02:09:51 -- nvmf/common.sh@294 -- # net_devs=() 00:07:23.607 02:09:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:23.607 02:09:51 -- nvmf/common.sh@295 -- # e810=() 00:07:23.607 02:09:51 -- nvmf/common.sh@295 -- # local -ga e810 00:07:23.607 02:09:51 -- nvmf/common.sh@296 -- # x722=() 00:07:23.607 02:09:51 -- nvmf/common.sh@296 -- # local -ga x722 00:07:23.607 02:09:51 -- nvmf/common.sh@297 -- # mlx=() 00:07:23.607 02:09:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:23.607 02:09:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:23.607 02:09:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:23.607 02:09:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:23.607 02:09:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:23.607 02:09:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:23.607 02:09:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:23.607 02:09:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:23.607 02:09:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:23.607 02:09:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:23.607 02:09:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:23.607 02:09:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:23.607 02:09:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:23.607 02:09:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:23.607 02:09:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:23.607 02:09:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:23.607 02:09:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:23.607 02:09:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:23.607 02:09:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:23.607 02:09:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:23.607 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:23.607 02:09:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:23.607 02:09:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:23.607 02:09:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:23.607 02:09:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:23.607 02:09:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:23.607 02:09:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:23.607 02:09:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:23.607 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:23.607 02:09:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:23.607 02:09:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:23.607 02:09:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:23.607 02:09:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:23.607 02:09:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:23.607 02:09:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:23.607 02:09:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:23.607 02:09:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:23.607 02:09:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:23.607 02:09:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:23.607 02:09:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:23.607 02:09:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:23.607 02:09:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:23.607 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:23.607 02:09:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:23.607 02:09:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:23.607 02:09:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:23.607 02:09:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:23.608 02:09:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:23.608 02:09:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:23.608 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:23.608 02:09:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:23.608 02:09:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:23.608 02:09:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:23.608 02:09:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:23.608 02:09:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:23.608 02:09:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:23.608 02:09:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:23.608 02:09:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:23.608 02:09:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:23.608 02:09:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:23.608 02:09:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:23.608 02:09:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:23.608 02:09:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:23.608 02:09:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:23.608 02:09:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:23.608 02:09:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:23.608 02:09:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:23.608 02:09:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:23.608 02:09:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:23.608 02:09:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:23.608 02:09:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:23.608 02:09:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:23.608 02:09:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:23.866 02:09:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:23.866 02:09:51 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:23.866 02:09:51 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:23.866 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:23.866 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.158 ms 00:07:23.866 00:07:23.866 --- 10.0.0.2 ping statistics --- 00:07:23.866 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:23.866 rtt min/avg/max/mdev = 0.158/0.158/0.158/0.000 ms 00:07:23.866 02:09:51 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:23.866 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:23.866 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.122 ms 00:07:23.866 00:07:23.866 --- 10.0.0.1 ping statistics --- 00:07:23.866 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:23.866 rtt min/avg/max/mdev = 0.122/0.122/0.122/0.000 ms 00:07:23.866 02:09:51 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:23.866 02:09:51 -- nvmf/common.sh@410 -- # return 0 00:07:23.866 02:09:51 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:23.866 02:09:51 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:23.866 02:09:51 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:23.866 02:09:51 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:23.866 02:09:51 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:23.866 02:09:51 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:23.866 02:09:51 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:23.866 02:09:51 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:07:23.866 02:09:51 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:23.866 02:09:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:23.866 02:09:51 -- common/autotest_common.sh@10 -- # set +x 00:07:23.866 02:09:51 -- nvmf/common.sh@469 -- # nvmfpid=2020121 00:07:23.866 02:09:51 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:23.866 02:09:51 -- nvmf/common.sh@470 -- # waitforlisten 2020121 00:07:23.866 02:09:51 -- common/autotest_common.sh@829 -- # '[' -z 2020121 ']' 00:07:23.866 02:09:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:23.866 02:09:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:23.866 02:09:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:23.866 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:23.866 02:09:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:23.866 02:09:51 -- common/autotest_common.sh@10 -- # set +x 00:07:23.866 [2024-12-08 02:09:51.496731] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:23.866 [2024-12-08 02:09:51.496814] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:23.866 EAL: No free 2048 kB hugepages reported on node 1 00:07:23.866 [2024-12-08 02:09:51.565861] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:24.125 [2024-12-08 02:09:51.684748] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:24.125 [2024-12-08 02:09:51.684908] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:24.125 [2024-12-08 02:09:51.684936] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:24.125 [2024-12-08 02:09:51.684951] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:24.125 [2024-12-08 02:09:51.685034] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:24.125 [2024-12-08 02:09:51.685099] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:24.125 [2024-12-08 02:09:51.685154] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:24.125 [2024-12-08 02:09:51.685157] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:24.715 02:09:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:24.715 02:09:52 -- common/autotest_common.sh@862 -- # return 0 00:07:24.715 02:09:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:24.715 02:09:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:24.715 02:09:52 -- common/autotest_common.sh@10 -- # set +x 00:07:24.973 02:09:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:24.973 02:09:52 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:24.973 02:09:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:24.973 02:09:52 -- common/autotest_common.sh@10 -- # set +x 00:07:24.973 [2024-12-08 02:09:52.508205] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:24.973 02:09:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:24.973 02:09:52 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:07:24.973 02:09:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:24.973 02:09:52 -- common/autotest_common.sh@10 -- # set +x 00:07:24.973 02:09:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:24.973 02:09:52 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:07:24.973 02:09:52 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:24.973 02:09:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:24.973 02:09:52 -- common/autotest_common.sh@10 -- # set +x 00:07:24.973 02:09:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:24.973 02:09:52 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:24.973 02:09:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:24.973 02:09:52 -- common/autotest_common.sh@10 -- # set +x 00:07:24.973 02:09:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:24.973 02:09:52 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:24.973 02:09:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:24.973 02:09:52 -- common/autotest_common.sh@10 -- # set +x 00:07:24.973 [2024-12-08 02:09:52.559353] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:24.973 02:09:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:24.973 02:09:52 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:07:24.973 02:09:52 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:07:24.973 02:09:52 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:07:24.973 02:09:52 -- target/connect_disconnect.sh@34 -- # set +x 00:07:27.501 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:30.025 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:31.922 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:34.452 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:36.988 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:38.889 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:41.427 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:43.967 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:46.504 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:48.413 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:50.949 [2024-12-08 02:10:18.417284] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1862000 is same with the state(5) to be set 00:07:50.949 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:53.486 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:56.022 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:57.997 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:00.550 [2024-12-08 02:10:27.775468] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1862000 is same with the state(5) to be set 00:08:00.550 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:02.459 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:04.996 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:07.527 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:09.436 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:11.973 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:14.526 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:16.434 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:18.965 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:21.501 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:23.404 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:25.941 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:27.847 [2024-12-08 02:10:55.600430] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1861e60 is same with the state(5) to be set 00:08:27.847 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:30.380 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:32.919 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:34.824 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:37.360 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:39.900 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:41.888 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:44.425 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:46.330 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:48.862 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:51.397 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:53.300 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:55.835 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:57.743 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:00.306 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:02.842 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:04.742 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:07.268 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:09.804 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:11.714 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:14.254 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:16.786 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:18.693 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:21.232 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:23.143 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:25.712 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:28.251 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:30.157 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:32.694 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:35.230 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:37.138 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:39.670 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:42.207 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:44.115 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:46.652 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:48.555 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:51.087 [2024-12-08 02:12:18.545396] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1861e60 is same with the state(5) to be set 00:09:51.087 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:53.626 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:55.528 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:58.061 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:00.658 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:02.555 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:05.081 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:06.979 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:09.549 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:12.071 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:13.966 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:16.494 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:18.398 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:20.931 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:23.467 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:25.370 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:27.906 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:29.813 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:32.365 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:34.906 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:36.852 [2024-12-08 02:13:04.563284] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1861e60 is same with the state(5) to be set 00:10:36.852 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:39.417 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:41.947 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:43.855 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:46.391 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:48.294 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:50.838 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:53.372 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:55.279 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:57.814 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:00.339 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:02.243 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:04.779 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:07.315 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:09.216 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:11.752 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:13.720 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:16.253 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:16.253 02:13:43 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:11:16.253 02:13:43 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:11:16.253 02:13:43 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:16.253 02:13:43 -- nvmf/common.sh@116 -- # sync 00:11:16.253 02:13:43 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:16.253 02:13:43 -- nvmf/common.sh@119 -- # set +e 00:11:16.253 02:13:43 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:16.253 02:13:43 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:16.253 rmmod nvme_tcp 00:11:16.253 rmmod nvme_fabrics 00:11:16.253 rmmod nvme_keyring 00:11:16.253 02:13:43 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:16.253 02:13:43 -- nvmf/common.sh@123 -- # set -e 00:11:16.253 02:13:43 -- nvmf/common.sh@124 -- # return 0 00:11:16.253 02:13:43 -- nvmf/common.sh@477 -- # '[' -n 2020121 ']' 00:11:16.253 02:13:43 -- nvmf/common.sh@478 -- # killprocess 2020121 00:11:16.253 02:13:43 -- common/autotest_common.sh@936 -- # '[' -z 2020121 ']' 00:11:16.253 02:13:43 -- common/autotest_common.sh@940 -- # kill -0 2020121 00:11:16.253 02:13:43 -- common/autotest_common.sh@941 -- # uname 00:11:16.253 02:13:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:16.253 02:13:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2020121 00:11:16.253 02:13:43 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:16.253 02:13:43 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:16.253 02:13:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2020121' 00:11:16.253 killing process with pid 2020121 00:11:16.253 02:13:43 -- common/autotest_common.sh@955 -- # kill 2020121 00:11:16.253 02:13:43 -- common/autotest_common.sh@960 -- # wait 2020121 00:11:16.253 02:13:44 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:16.253 02:13:44 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:16.253 02:13:44 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:16.253 02:13:44 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:16.253 02:13:44 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:16.253 02:13:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:16.253 02:13:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:16.253 02:13:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:18.791 02:13:46 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:18.791 00:11:18.791 real 3m57.068s 00:11:18.791 user 15m4.367s 00:11:18.791 sys 0m33.994s 00:11:18.791 02:13:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:18.791 02:13:46 -- common/autotest_common.sh@10 -- # set +x 00:11:18.791 ************************************ 00:11:18.791 END TEST nvmf_connect_disconnect 00:11:18.791 ************************************ 00:11:18.791 02:13:46 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:18.791 02:13:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:18.791 02:13:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:18.791 02:13:46 -- common/autotest_common.sh@10 -- # set +x 00:11:18.791 ************************************ 00:11:18.791 START TEST nvmf_multitarget 00:11:18.791 ************************************ 00:11:18.791 02:13:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:18.791 * Looking for test storage... 00:11:18.791 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:18.791 02:13:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:18.791 02:13:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:18.791 02:13:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:18.791 02:13:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:18.791 02:13:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:18.791 02:13:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:18.791 02:13:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:18.791 02:13:46 -- scripts/common.sh@335 -- # IFS=.-: 00:11:18.791 02:13:46 -- scripts/common.sh@335 -- # read -ra ver1 00:11:18.791 02:13:46 -- scripts/common.sh@336 -- # IFS=.-: 00:11:18.791 02:13:46 -- scripts/common.sh@336 -- # read -ra ver2 00:11:18.791 02:13:46 -- scripts/common.sh@337 -- # local 'op=<' 00:11:18.791 02:13:46 -- scripts/common.sh@339 -- # ver1_l=2 00:11:18.791 02:13:46 -- scripts/common.sh@340 -- # ver2_l=1 00:11:18.791 02:13:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:18.791 02:13:46 -- scripts/common.sh@343 -- # case "$op" in 00:11:18.791 02:13:46 -- scripts/common.sh@344 -- # : 1 00:11:18.791 02:13:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:18.791 02:13:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:18.791 02:13:46 -- scripts/common.sh@364 -- # decimal 1 00:11:18.791 02:13:46 -- scripts/common.sh@352 -- # local d=1 00:11:18.791 02:13:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:18.791 02:13:46 -- scripts/common.sh@354 -- # echo 1 00:11:18.791 02:13:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:18.791 02:13:46 -- scripts/common.sh@365 -- # decimal 2 00:11:18.791 02:13:46 -- scripts/common.sh@352 -- # local d=2 00:11:18.791 02:13:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:18.791 02:13:46 -- scripts/common.sh@354 -- # echo 2 00:11:18.791 02:13:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:18.791 02:13:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:18.791 02:13:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:18.791 02:13:46 -- scripts/common.sh@367 -- # return 0 00:11:18.791 02:13:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:18.791 02:13:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:18.791 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:18.791 --rc genhtml_branch_coverage=1 00:11:18.791 --rc genhtml_function_coverage=1 00:11:18.791 --rc genhtml_legend=1 00:11:18.791 --rc geninfo_all_blocks=1 00:11:18.791 --rc geninfo_unexecuted_blocks=1 00:11:18.791 00:11:18.791 ' 00:11:18.791 02:13:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:18.791 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:18.791 --rc genhtml_branch_coverage=1 00:11:18.791 --rc genhtml_function_coverage=1 00:11:18.791 --rc genhtml_legend=1 00:11:18.791 --rc geninfo_all_blocks=1 00:11:18.791 --rc geninfo_unexecuted_blocks=1 00:11:18.791 00:11:18.791 ' 00:11:18.791 02:13:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:18.791 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:18.791 --rc genhtml_branch_coverage=1 00:11:18.791 --rc genhtml_function_coverage=1 00:11:18.791 --rc genhtml_legend=1 00:11:18.791 --rc geninfo_all_blocks=1 00:11:18.791 --rc geninfo_unexecuted_blocks=1 00:11:18.791 00:11:18.791 ' 00:11:18.791 02:13:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:18.791 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:18.791 --rc genhtml_branch_coverage=1 00:11:18.791 --rc genhtml_function_coverage=1 00:11:18.791 --rc genhtml_legend=1 00:11:18.791 --rc geninfo_all_blocks=1 00:11:18.791 --rc geninfo_unexecuted_blocks=1 00:11:18.791 00:11:18.791 ' 00:11:18.791 02:13:46 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:18.791 02:13:46 -- nvmf/common.sh@7 -- # uname -s 00:11:18.791 02:13:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:18.791 02:13:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:18.791 02:13:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:18.791 02:13:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:18.791 02:13:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:18.791 02:13:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:18.791 02:13:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:18.791 02:13:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:18.791 02:13:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:18.791 02:13:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:18.791 02:13:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:18.791 02:13:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:18.791 02:13:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:18.791 02:13:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:18.791 02:13:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:18.791 02:13:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:18.791 02:13:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:18.791 02:13:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:18.791 02:13:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:18.791 02:13:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:18.791 02:13:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:18.791 02:13:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:18.791 02:13:46 -- paths/export.sh@5 -- # export PATH 00:11:18.791 02:13:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:18.791 02:13:46 -- nvmf/common.sh@46 -- # : 0 00:11:18.791 02:13:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:18.791 02:13:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:18.791 02:13:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:18.791 02:13:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:18.791 02:13:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:18.791 02:13:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:18.791 02:13:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:18.791 02:13:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:18.791 02:13:46 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:11:18.791 02:13:46 -- target/multitarget.sh@15 -- # nvmftestinit 00:11:18.791 02:13:46 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:18.791 02:13:46 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:18.791 02:13:46 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:18.791 02:13:46 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:18.791 02:13:46 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:18.791 02:13:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:18.791 02:13:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:18.791 02:13:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:18.791 02:13:46 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:18.791 02:13:46 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:18.791 02:13:46 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:18.791 02:13:46 -- common/autotest_common.sh@10 -- # set +x 00:11:20.688 02:13:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:20.688 02:13:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:20.688 02:13:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:20.688 02:13:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:20.688 02:13:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:20.688 02:13:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:20.688 02:13:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:20.688 02:13:48 -- nvmf/common.sh@294 -- # net_devs=() 00:11:20.688 02:13:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:20.688 02:13:48 -- nvmf/common.sh@295 -- # e810=() 00:11:20.688 02:13:48 -- nvmf/common.sh@295 -- # local -ga e810 00:11:20.688 02:13:48 -- nvmf/common.sh@296 -- # x722=() 00:11:20.688 02:13:48 -- nvmf/common.sh@296 -- # local -ga x722 00:11:20.688 02:13:48 -- nvmf/common.sh@297 -- # mlx=() 00:11:20.688 02:13:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:20.688 02:13:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:20.688 02:13:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:20.688 02:13:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:20.688 02:13:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:20.688 02:13:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:20.688 02:13:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:20.688 02:13:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:20.688 02:13:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:20.688 02:13:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:20.688 02:13:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:20.688 02:13:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:20.688 02:13:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:20.688 02:13:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:20.688 02:13:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:20.688 02:13:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:20.688 02:13:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:20.688 02:13:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:20.688 02:13:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:20.688 02:13:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:20.688 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:20.688 02:13:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:20.688 02:13:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:20.688 02:13:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:20.688 02:13:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:20.688 02:13:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:20.688 02:13:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:20.688 02:13:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:20.688 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:20.688 02:13:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:20.688 02:13:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:20.688 02:13:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:20.688 02:13:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:20.688 02:13:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:20.688 02:13:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:20.688 02:13:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:20.688 02:13:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:20.688 02:13:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:20.688 02:13:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:20.688 02:13:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:20.688 02:13:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:20.688 02:13:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:20.688 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:20.688 02:13:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:20.688 02:13:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:20.688 02:13:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:20.688 02:13:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:20.688 02:13:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:20.688 02:13:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:20.688 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:20.688 02:13:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:20.689 02:13:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:20.689 02:13:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:20.689 02:13:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:20.689 02:13:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:20.689 02:13:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:20.689 02:13:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:20.689 02:13:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:20.689 02:13:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:20.689 02:13:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:20.689 02:13:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:20.689 02:13:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:20.689 02:13:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:20.689 02:13:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:20.689 02:13:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:20.689 02:13:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:20.689 02:13:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:20.689 02:13:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:20.689 02:13:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:20.689 02:13:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:20.689 02:13:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:20.689 02:13:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:20.689 02:13:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:20.689 02:13:48 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:20.689 02:13:48 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:20.689 02:13:48 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:20.689 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:20.689 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.206 ms 00:11:20.689 00:11:20.689 --- 10.0.0.2 ping statistics --- 00:11:20.689 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:20.689 rtt min/avg/max/mdev = 0.206/0.206/0.206/0.000 ms 00:11:20.689 02:13:48 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:20.689 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:20.689 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.099 ms 00:11:20.689 00:11:20.689 --- 10.0.0.1 ping statistics --- 00:11:20.689 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:20.689 rtt min/avg/max/mdev = 0.099/0.099/0.099/0.000 ms 00:11:20.689 02:13:48 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:20.689 02:13:48 -- nvmf/common.sh@410 -- # return 0 00:11:20.689 02:13:48 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:20.689 02:13:48 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:20.689 02:13:48 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:20.689 02:13:48 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:20.689 02:13:48 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:20.689 02:13:48 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:20.689 02:13:48 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:20.689 02:13:48 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:11:20.689 02:13:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:20.689 02:13:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:20.689 02:13:48 -- common/autotest_common.sh@10 -- # set +x 00:11:20.689 02:13:48 -- nvmf/common.sh@469 -- # nvmfpid=2052148 00:11:20.689 02:13:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:20.689 02:13:48 -- nvmf/common.sh@470 -- # waitforlisten 2052148 00:11:20.689 02:13:48 -- common/autotest_common.sh@829 -- # '[' -z 2052148 ']' 00:11:20.689 02:13:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:20.689 02:13:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:20.689 02:13:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:20.689 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:20.689 02:13:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:20.689 02:13:48 -- common/autotest_common.sh@10 -- # set +x 00:11:20.689 [2024-12-08 02:13:48.450358] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:20.689 [2024-12-08 02:13:48.450450] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:20.947 EAL: No free 2048 kB hugepages reported on node 1 00:11:20.947 [2024-12-08 02:13:48.520339] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:20.947 [2024-12-08 02:13:48.641211] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:20.947 [2024-12-08 02:13:48.641385] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:20.947 [2024-12-08 02:13:48.641413] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:20.947 [2024-12-08 02:13:48.641429] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:20.947 [2024-12-08 02:13:48.641546] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:20.947 [2024-12-08 02:13:48.641593] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:20.947 [2024-12-08 02:13:48.641644] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:20.947 [2024-12-08 02:13:48.641647] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:21.879 02:13:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:21.879 02:13:49 -- common/autotest_common.sh@862 -- # return 0 00:11:21.879 02:13:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:21.879 02:13:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:21.879 02:13:49 -- common/autotest_common.sh@10 -- # set +x 00:11:21.879 02:13:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:21.879 02:13:49 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:11:21.879 02:13:49 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:21.879 02:13:49 -- target/multitarget.sh@21 -- # jq length 00:11:21.879 02:13:49 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:11:21.879 02:13:49 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:11:22.138 "nvmf_tgt_1" 00:11:22.138 02:13:49 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:11:22.138 "nvmf_tgt_2" 00:11:22.138 02:13:49 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:22.138 02:13:49 -- target/multitarget.sh@28 -- # jq length 00:11:22.138 02:13:49 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:11:22.138 02:13:49 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:11:22.396 true 00:11:22.396 02:13:50 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:11:22.396 true 00:11:22.396 02:13:50 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:22.396 02:13:50 -- target/multitarget.sh@35 -- # jq length 00:11:22.653 02:13:50 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:11:22.653 02:13:50 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:11:22.653 02:13:50 -- target/multitarget.sh@41 -- # nvmftestfini 00:11:22.653 02:13:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:22.653 02:13:50 -- nvmf/common.sh@116 -- # sync 00:11:22.653 02:13:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:22.653 02:13:50 -- nvmf/common.sh@119 -- # set +e 00:11:22.653 02:13:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:22.653 02:13:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:22.653 rmmod nvme_tcp 00:11:22.653 rmmod nvme_fabrics 00:11:22.653 rmmod nvme_keyring 00:11:22.653 02:13:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:22.653 02:13:50 -- nvmf/common.sh@123 -- # set -e 00:11:22.653 02:13:50 -- nvmf/common.sh@124 -- # return 0 00:11:22.653 02:13:50 -- nvmf/common.sh@477 -- # '[' -n 2052148 ']' 00:11:22.653 02:13:50 -- nvmf/common.sh@478 -- # killprocess 2052148 00:11:22.653 02:13:50 -- common/autotest_common.sh@936 -- # '[' -z 2052148 ']' 00:11:22.653 02:13:50 -- common/autotest_common.sh@940 -- # kill -0 2052148 00:11:22.653 02:13:50 -- common/autotest_common.sh@941 -- # uname 00:11:22.653 02:13:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:22.653 02:13:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2052148 00:11:22.653 02:13:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:22.653 02:13:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:22.653 02:13:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2052148' 00:11:22.653 killing process with pid 2052148 00:11:22.653 02:13:50 -- common/autotest_common.sh@955 -- # kill 2052148 00:11:22.653 02:13:50 -- common/autotest_common.sh@960 -- # wait 2052148 00:11:22.911 02:13:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:22.911 02:13:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:22.911 02:13:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:22.911 02:13:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:22.911 02:13:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:22.911 02:13:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:22.911 02:13:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:22.911 02:13:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:25.445 02:13:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:25.445 00:11:25.445 real 0m6.579s 00:11:25.445 user 0m9.531s 00:11:25.445 sys 0m1.940s 00:11:25.445 02:13:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:25.445 02:13:52 -- common/autotest_common.sh@10 -- # set +x 00:11:25.445 ************************************ 00:11:25.445 END TEST nvmf_multitarget 00:11:25.445 ************************************ 00:11:25.445 02:13:52 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:25.445 02:13:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:25.445 02:13:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:25.445 02:13:52 -- common/autotest_common.sh@10 -- # set +x 00:11:25.445 ************************************ 00:11:25.445 START TEST nvmf_rpc 00:11:25.445 ************************************ 00:11:25.445 02:13:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:25.445 * Looking for test storage... 00:11:25.445 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:25.445 02:13:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:25.445 02:13:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:25.445 02:13:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:25.445 02:13:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:25.445 02:13:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:25.445 02:13:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:25.445 02:13:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:25.445 02:13:52 -- scripts/common.sh@335 -- # IFS=.-: 00:11:25.445 02:13:52 -- scripts/common.sh@335 -- # read -ra ver1 00:11:25.445 02:13:52 -- scripts/common.sh@336 -- # IFS=.-: 00:11:25.445 02:13:52 -- scripts/common.sh@336 -- # read -ra ver2 00:11:25.445 02:13:52 -- scripts/common.sh@337 -- # local 'op=<' 00:11:25.445 02:13:52 -- scripts/common.sh@339 -- # ver1_l=2 00:11:25.445 02:13:52 -- scripts/common.sh@340 -- # ver2_l=1 00:11:25.445 02:13:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:25.445 02:13:52 -- scripts/common.sh@343 -- # case "$op" in 00:11:25.445 02:13:52 -- scripts/common.sh@344 -- # : 1 00:11:25.445 02:13:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:25.445 02:13:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:25.445 02:13:52 -- scripts/common.sh@364 -- # decimal 1 00:11:25.445 02:13:52 -- scripts/common.sh@352 -- # local d=1 00:11:25.445 02:13:52 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:25.445 02:13:52 -- scripts/common.sh@354 -- # echo 1 00:11:25.445 02:13:52 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:25.445 02:13:52 -- scripts/common.sh@365 -- # decimal 2 00:11:25.445 02:13:52 -- scripts/common.sh@352 -- # local d=2 00:11:25.445 02:13:52 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:25.445 02:13:52 -- scripts/common.sh@354 -- # echo 2 00:11:25.445 02:13:52 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:25.445 02:13:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:25.445 02:13:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:25.445 02:13:52 -- scripts/common.sh@367 -- # return 0 00:11:25.445 02:13:52 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:25.445 02:13:52 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:25.445 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:25.445 --rc genhtml_branch_coverage=1 00:11:25.445 --rc genhtml_function_coverage=1 00:11:25.445 --rc genhtml_legend=1 00:11:25.445 --rc geninfo_all_blocks=1 00:11:25.445 --rc geninfo_unexecuted_blocks=1 00:11:25.445 00:11:25.445 ' 00:11:25.445 02:13:52 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:25.445 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:25.445 --rc genhtml_branch_coverage=1 00:11:25.446 --rc genhtml_function_coverage=1 00:11:25.446 --rc genhtml_legend=1 00:11:25.446 --rc geninfo_all_blocks=1 00:11:25.446 --rc geninfo_unexecuted_blocks=1 00:11:25.446 00:11:25.446 ' 00:11:25.446 02:13:52 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:25.446 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:25.446 --rc genhtml_branch_coverage=1 00:11:25.446 --rc genhtml_function_coverage=1 00:11:25.446 --rc genhtml_legend=1 00:11:25.446 --rc geninfo_all_blocks=1 00:11:25.446 --rc geninfo_unexecuted_blocks=1 00:11:25.446 00:11:25.446 ' 00:11:25.446 02:13:52 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:25.446 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:25.446 --rc genhtml_branch_coverage=1 00:11:25.446 --rc genhtml_function_coverage=1 00:11:25.446 --rc genhtml_legend=1 00:11:25.446 --rc geninfo_all_blocks=1 00:11:25.446 --rc geninfo_unexecuted_blocks=1 00:11:25.446 00:11:25.446 ' 00:11:25.446 02:13:52 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:25.446 02:13:52 -- nvmf/common.sh@7 -- # uname -s 00:11:25.446 02:13:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:25.446 02:13:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:25.446 02:13:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:25.446 02:13:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:25.446 02:13:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:25.446 02:13:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:25.446 02:13:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:25.446 02:13:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:25.446 02:13:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:25.446 02:13:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:25.446 02:13:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:25.446 02:13:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:25.446 02:13:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:25.446 02:13:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:25.446 02:13:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:25.446 02:13:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:25.446 02:13:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:25.446 02:13:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:25.446 02:13:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:25.446 02:13:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:25.446 02:13:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:25.446 02:13:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:25.446 02:13:52 -- paths/export.sh@5 -- # export PATH 00:11:25.446 02:13:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:25.446 02:13:52 -- nvmf/common.sh@46 -- # : 0 00:11:25.446 02:13:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:25.446 02:13:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:25.446 02:13:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:25.446 02:13:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:25.446 02:13:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:25.446 02:13:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:25.446 02:13:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:25.446 02:13:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:25.446 02:13:52 -- target/rpc.sh@11 -- # loops=5 00:11:25.446 02:13:52 -- target/rpc.sh@23 -- # nvmftestinit 00:11:25.446 02:13:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:25.446 02:13:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:25.446 02:13:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:25.446 02:13:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:25.446 02:13:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:25.446 02:13:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:25.446 02:13:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:25.446 02:13:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:25.446 02:13:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:25.446 02:13:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:25.446 02:13:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:25.446 02:13:52 -- common/autotest_common.sh@10 -- # set +x 00:11:27.347 02:13:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:27.347 02:13:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:27.347 02:13:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:27.347 02:13:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:27.347 02:13:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:27.347 02:13:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:27.347 02:13:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:27.347 02:13:54 -- nvmf/common.sh@294 -- # net_devs=() 00:11:27.347 02:13:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:27.347 02:13:54 -- nvmf/common.sh@295 -- # e810=() 00:11:27.347 02:13:54 -- nvmf/common.sh@295 -- # local -ga e810 00:11:27.347 02:13:54 -- nvmf/common.sh@296 -- # x722=() 00:11:27.347 02:13:54 -- nvmf/common.sh@296 -- # local -ga x722 00:11:27.347 02:13:54 -- nvmf/common.sh@297 -- # mlx=() 00:11:27.347 02:13:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:27.347 02:13:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:27.347 02:13:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:27.347 02:13:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:27.347 02:13:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:27.347 02:13:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:27.348 02:13:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:27.348 02:13:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:27.348 02:13:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:27.348 02:13:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:27.348 02:13:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:27.348 02:13:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:27.348 02:13:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:27.348 02:13:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:27.348 02:13:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:27.348 02:13:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:27.348 02:13:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:27.348 02:13:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:27.348 02:13:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:27.348 02:13:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:27.348 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:27.348 02:13:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:27.348 02:13:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:27.348 02:13:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:27.348 02:13:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:27.348 02:13:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:27.348 02:13:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:27.348 02:13:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:27.348 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:27.348 02:13:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:27.348 02:13:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:27.348 02:13:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:27.348 02:13:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:27.348 02:13:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:27.348 02:13:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:27.348 02:13:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:27.348 02:13:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:27.348 02:13:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:27.348 02:13:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:27.348 02:13:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:27.348 02:13:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:27.348 02:13:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:27.348 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:27.348 02:13:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:27.348 02:13:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:27.348 02:13:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:27.348 02:13:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:27.348 02:13:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:27.348 02:13:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:27.348 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:27.348 02:13:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:27.348 02:13:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:27.348 02:13:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:27.348 02:13:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:27.348 02:13:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:27.348 02:13:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:27.348 02:13:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:27.348 02:13:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:27.348 02:13:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:27.348 02:13:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:27.348 02:13:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:27.348 02:13:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:27.348 02:13:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:27.348 02:13:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:27.348 02:13:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:27.348 02:13:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:27.348 02:13:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:27.348 02:13:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:27.348 02:13:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:27.348 02:13:55 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:27.348 02:13:55 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:27.348 02:13:55 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:27.348 02:13:55 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:27.348 02:13:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:27.348 02:13:55 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:27.348 02:13:55 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:27.348 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:27.348 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.352 ms 00:11:27.348 00:11:27.348 --- 10.0.0.2 ping statistics --- 00:11:27.348 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:27.348 rtt min/avg/max/mdev = 0.352/0.352/0.352/0.000 ms 00:11:27.348 02:13:55 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:27.348 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:27.348 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.171 ms 00:11:27.348 00:11:27.348 --- 10.0.0.1 ping statistics --- 00:11:27.348 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:27.348 rtt min/avg/max/mdev = 0.171/0.171/0.171/0.000 ms 00:11:27.348 02:13:55 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:27.348 02:13:55 -- nvmf/common.sh@410 -- # return 0 00:11:27.348 02:13:55 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:27.348 02:13:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:27.348 02:13:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:27.348 02:13:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:27.348 02:13:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:27.348 02:13:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:27.348 02:13:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:27.348 02:13:55 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:11:27.348 02:13:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:27.348 02:13:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:27.348 02:13:55 -- common/autotest_common.sh@10 -- # set +x 00:11:27.348 02:13:55 -- nvmf/common.sh@469 -- # nvmfpid=2054400 00:11:27.348 02:13:55 -- nvmf/common.sh@470 -- # waitforlisten 2054400 00:11:27.348 02:13:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:27.348 02:13:55 -- common/autotest_common.sh@829 -- # '[' -z 2054400 ']' 00:11:27.348 02:13:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:27.348 02:13:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:27.348 02:13:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:27.348 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:27.348 02:13:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:27.348 02:13:55 -- common/autotest_common.sh@10 -- # set +x 00:11:27.606 [2024-12-08 02:13:55.147828] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:27.606 [2024-12-08 02:13:55.147914] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:27.606 EAL: No free 2048 kB hugepages reported on node 1 00:11:27.606 [2024-12-08 02:13:55.222979] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:27.606 [2024-12-08 02:13:55.346669] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:27.606 [2024-12-08 02:13:55.346827] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:27.606 [2024-12-08 02:13:55.346846] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:27.606 [2024-12-08 02:13:55.346861] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:27.606 [2024-12-08 02:13:55.346926] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:27.606 [2024-12-08 02:13:55.346985] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:27.606 [2024-12-08 02:13:55.347041] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:27.606 [2024-12-08 02:13:55.347044] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:28.536 02:13:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:28.536 02:13:56 -- common/autotest_common.sh@862 -- # return 0 00:11:28.536 02:13:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:28.536 02:13:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:28.536 02:13:56 -- common/autotest_common.sh@10 -- # set +x 00:11:28.536 02:13:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:28.536 02:13:56 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:11:28.536 02:13:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:28.536 02:13:56 -- common/autotest_common.sh@10 -- # set +x 00:11:28.536 02:13:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:28.536 02:13:56 -- target/rpc.sh@26 -- # stats='{ 00:11:28.536 "tick_rate": 2700000000, 00:11:28.536 "poll_groups": [ 00:11:28.536 { 00:11:28.536 "name": "nvmf_tgt_poll_group_0", 00:11:28.536 "admin_qpairs": 0, 00:11:28.536 "io_qpairs": 0, 00:11:28.536 "current_admin_qpairs": 0, 00:11:28.536 "current_io_qpairs": 0, 00:11:28.536 "pending_bdev_io": 0, 00:11:28.536 "completed_nvme_io": 0, 00:11:28.536 "transports": [] 00:11:28.536 }, 00:11:28.536 { 00:11:28.536 "name": "nvmf_tgt_poll_group_1", 00:11:28.536 "admin_qpairs": 0, 00:11:28.536 "io_qpairs": 0, 00:11:28.536 "current_admin_qpairs": 0, 00:11:28.536 "current_io_qpairs": 0, 00:11:28.536 "pending_bdev_io": 0, 00:11:28.536 "completed_nvme_io": 0, 00:11:28.536 "transports": [] 00:11:28.536 }, 00:11:28.536 { 00:11:28.536 "name": "nvmf_tgt_poll_group_2", 00:11:28.536 "admin_qpairs": 0, 00:11:28.536 "io_qpairs": 0, 00:11:28.536 "current_admin_qpairs": 0, 00:11:28.536 "current_io_qpairs": 0, 00:11:28.536 "pending_bdev_io": 0, 00:11:28.536 "completed_nvme_io": 0, 00:11:28.536 "transports": [] 00:11:28.536 }, 00:11:28.536 { 00:11:28.536 "name": "nvmf_tgt_poll_group_3", 00:11:28.536 "admin_qpairs": 0, 00:11:28.536 "io_qpairs": 0, 00:11:28.536 "current_admin_qpairs": 0, 00:11:28.536 "current_io_qpairs": 0, 00:11:28.536 "pending_bdev_io": 0, 00:11:28.536 "completed_nvme_io": 0, 00:11:28.536 "transports": [] 00:11:28.536 } 00:11:28.536 ] 00:11:28.536 }' 00:11:28.536 02:13:56 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:11:28.536 02:13:56 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:11:28.536 02:13:56 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:11:28.536 02:13:56 -- target/rpc.sh@15 -- # wc -l 00:11:28.536 02:13:56 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:11:28.536 02:13:56 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:11:28.536 02:13:56 -- target/rpc.sh@29 -- # [[ null == null ]] 00:11:28.536 02:13:56 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:11:28.536 02:13:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:28.536 02:13:56 -- common/autotest_common.sh@10 -- # set +x 00:11:28.536 [2024-12-08 02:13:56.275421] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:28.536 02:13:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:28.536 02:13:56 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:11:28.536 02:13:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:28.536 02:13:56 -- common/autotest_common.sh@10 -- # set +x 00:11:28.536 02:13:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:28.536 02:13:56 -- target/rpc.sh@33 -- # stats='{ 00:11:28.536 "tick_rate": 2700000000, 00:11:28.536 "poll_groups": [ 00:11:28.536 { 00:11:28.536 "name": "nvmf_tgt_poll_group_0", 00:11:28.536 "admin_qpairs": 0, 00:11:28.536 "io_qpairs": 0, 00:11:28.536 "current_admin_qpairs": 0, 00:11:28.536 "current_io_qpairs": 0, 00:11:28.536 "pending_bdev_io": 0, 00:11:28.536 "completed_nvme_io": 0, 00:11:28.536 "transports": [ 00:11:28.536 { 00:11:28.536 "trtype": "TCP" 00:11:28.536 } 00:11:28.536 ] 00:11:28.536 }, 00:11:28.536 { 00:11:28.536 "name": "nvmf_tgt_poll_group_1", 00:11:28.536 "admin_qpairs": 0, 00:11:28.536 "io_qpairs": 0, 00:11:28.536 "current_admin_qpairs": 0, 00:11:28.536 "current_io_qpairs": 0, 00:11:28.536 "pending_bdev_io": 0, 00:11:28.536 "completed_nvme_io": 0, 00:11:28.536 "transports": [ 00:11:28.536 { 00:11:28.536 "trtype": "TCP" 00:11:28.536 } 00:11:28.536 ] 00:11:28.536 }, 00:11:28.536 { 00:11:28.536 "name": "nvmf_tgt_poll_group_2", 00:11:28.536 "admin_qpairs": 0, 00:11:28.536 "io_qpairs": 0, 00:11:28.536 "current_admin_qpairs": 0, 00:11:28.536 "current_io_qpairs": 0, 00:11:28.536 "pending_bdev_io": 0, 00:11:28.536 "completed_nvme_io": 0, 00:11:28.536 "transports": [ 00:11:28.536 { 00:11:28.536 "trtype": "TCP" 00:11:28.536 } 00:11:28.536 ] 00:11:28.536 }, 00:11:28.536 { 00:11:28.536 "name": "nvmf_tgt_poll_group_3", 00:11:28.536 "admin_qpairs": 0, 00:11:28.536 "io_qpairs": 0, 00:11:28.536 "current_admin_qpairs": 0, 00:11:28.536 "current_io_qpairs": 0, 00:11:28.536 "pending_bdev_io": 0, 00:11:28.536 "completed_nvme_io": 0, 00:11:28.536 "transports": [ 00:11:28.536 { 00:11:28.536 "trtype": "TCP" 00:11:28.536 } 00:11:28.536 ] 00:11:28.536 } 00:11:28.536 ] 00:11:28.536 }' 00:11:28.536 02:13:56 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:11:28.536 02:13:56 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:11:28.536 02:13:56 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:11:28.536 02:13:56 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:28.795 02:13:56 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:11:28.795 02:13:56 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:11:28.795 02:13:56 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:11:28.795 02:13:56 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:11:28.795 02:13:56 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:28.795 02:13:56 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:11:28.795 02:13:56 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:11:28.795 02:13:56 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:11:28.795 02:13:56 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:11:28.795 02:13:56 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:11:28.795 02:13:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:28.795 02:13:56 -- common/autotest_common.sh@10 -- # set +x 00:11:28.795 Malloc1 00:11:28.795 02:13:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:28.795 02:13:56 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:11:28.795 02:13:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:28.795 02:13:56 -- common/autotest_common.sh@10 -- # set +x 00:11:28.795 02:13:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:28.795 02:13:56 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:28.795 02:13:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:28.795 02:13:56 -- common/autotest_common.sh@10 -- # set +x 00:11:28.795 02:13:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:28.795 02:13:56 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:11:28.795 02:13:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:28.795 02:13:56 -- common/autotest_common.sh@10 -- # set +x 00:11:28.795 02:13:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:28.795 02:13:56 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:28.795 02:13:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:28.795 02:13:56 -- common/autotest_common.sh@10 -- # set +x 00:11:28.795 [2024-12-08 02:13:56.427686] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:28.795 02:13:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:28.795 02:13:56 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:28.795 02:13:56 -- common/autotest_common.sh@650 -- # local es=0 00:11:28.795 02:13:56 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:28.795 02:13:56 -- common/autotest_common.sh@638 -- # local arg=nvme 00:11:28.795 02:13:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:28.795 02:13:56 -- common/autotest_common.sh@642 -- # type -t nvme 00:11:28.795 02:13:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:28.795 02:13:56 -- common/autotest_common.sh@644 -- # type -P nvme 00:11:28.795 02:13:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:28.795 02:13:56 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:11:28.795 02:13:56 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:11:28.795 02:13:56 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:28.795 [2024-12-08 02:13:56.450120] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:11:28.795 Failed to write to /dev/nvme-fabrics: Input/output error 00:11:28.795 could not add new controller: failed to write to nvme-fabrics device 00:11:28.795 02:13:56 -- common/autotest_common.sh@653 -- # es=1 00:11:28.795 02:13:56 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:11:28.795 02:13:56 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:11:28.795 02:13:56 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:11:28.795 02:13:56 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:28.795 02:13:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:28.795 02:13:56 -- common/autotest_common.sh@10 -- # set +x 00:11:28.795 02:13:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:28.795 02:13:56 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:29.361 02:13:57 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:11:29.361 02:13:57 -- common/autotest_common.sh@1187 -- # local i=0 00:11:29.361 02:13:57 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:29.361 02:13:57 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:29.361 02:13:57 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:31.885 02:13:59 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:31.885 02:13:59 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:31.885 02:13:59 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:31.885 02:13:59 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:31.885 02:13:59 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:31.885 02:13:59 -- common/autotest_common.sh@1197 -- # return 0 00:11:31.885 02:13:59 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:31.885 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:31.885 02:13:59 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:31.885 02:13:59 -- common/autotest_common.sh@1208 -- # local i=0 00:11:31.885 02:13:59 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:31.885 02:13:59 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:31.885 02:13:59 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:31.885 02:13:59 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:31.885 02:13:59 -- common/autotest_common.sh@1220 -- # return 0 00:11:31.885 02:13:59 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:31.885 02:13:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:31.885 02:13:59 -- common/autotest_common.sh@10 -- # set +x 00:11:31.885 02:13:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:31.885 02:13:59 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:31.885 02:13:59 -- common/autotest_common.sh@650 -- # local es=0 00:11:31.885 02:13:59 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:31.885 02:13:59 -- common/autotest_common.sh@638 -- # local arg=nvme 00:11:31.885 02:13:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:31.885 02:13:59 -- common/autotest_common.sh@642 -- # type -t nvme 00:11:31.885 02:13:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:31.885 02:13:59 -- common/autotest_common.sh@644 -- # type -P nvme 00:11:31.885 02:13:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:31.885 02:13:59 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:11:31.885 02:13:59 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:11:31.885 02:13:59 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:31.886 [2024-12-08 02:13:59.242252] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:11:31.886 Failed to write to /dev/nvme-fabrics: Input/output error 00:11:31.886 could not add new controller: failed to write to nvme-fabrics device 00:11:31.886 02:13:59 -- common/autotest_common.sh@653 -- # es=1 00:11:31.886 02:13:59 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:11:31.886 02:13:59 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:11:31.886 02:13:59 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:11:31.886 02:13:59 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:11:31.886 02:13:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:31.886 02:13:59 -- common/autotest_common.sh@10 -- # set +x 00:11:31.886 02:13:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:31.886 02:13:59 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:32.451 02:13:59 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:11:32.451 02:13:59 -- common/autotest_common.sh@1187 -- # local i=0 00:11:32.451 02:13:59 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:32.451 02:13:59 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:32.451 02:13:59 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:34.349 02:14:01 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:34.349 02:14:01 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:34.349 02:14:01 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:34.349 02:14:01 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:34.349 02:14:01 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:34.349 02:14:01 -- common/autotest_common.sh@1197 -- # return 0 00:11:34.349 02:14:01 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:34.349 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:34.349 02:14:02 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:34.349 02:14:02 -- common/autotest_common.sh@1208 -- # local i=0 00:11:34.349 02:14:02 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:34.350 02:14:02 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:34.350 02:14:02 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:34.350 02:14:02 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:34.350 02:14:02 -- common/autotest_common.sh@1220 -- # return 0 00:11:34.350 02:14:02 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:34.350 02:14:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:34.350 02:14:02 -- common/autotest_common.sh@10 -- # set +x 00:11:34.350 02:14:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:34.350 02:14:02 -- target/rpc.sh@81 -- # seq 1 5 00:11:34.350 02:14:02 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:34.350 02:14:02 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:34.350 02:14:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:34.350 02:14:02 -- common/autotest_common.sh@10 -- # set +x 00:11:34.350 02:14:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:34.350 02:14:02 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:34.350 02:14:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:34.350 02:14:02 -- common/autotest_common.sh@10 -- # set +x 00:11:34.350 [2024-12-08 02:14:02.070803] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:34.350 02:14:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:34.350 02:14:02 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:34.350 02:14:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:34.350 02:14:02 -- common/autotest_common.sh@10 -- # set +x 00:11:34.350 02:14:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:34.350 02:14:02 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:34.350 02:14:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:34.350 02:14:02 -- common/autotest_common.sh@10 -- # set +x 00:11:34.350 02:14:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:34.350 02:14:02 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:34.915 02:14:02 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:34.915 02:14:02 -- common/autotest_common.sh@1187 -- # local i=0 00:11:34.915 02:14:02 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:34.915 02:14:02 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:34.915 02:14:02 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:37.437 02:14:04 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:37.437 02:14:04 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:37.437 02:14:04 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:37.437 02:14:04 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:37.437 02:14:04 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:37.437 02:14:04 -- common/autotest_common.sh@1197 -- # return 0 00:11:37.437 02:14:04 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:37.437 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:37.437 02:14:04 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:37.437 02:14:04 -- common/autotest_common.sh@1208 -- # local i=0 00:11:37.437 02:14:04 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:37.437 02:14:04 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:37.437 02:14:04 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:37.437 02:14:04 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:37.437 02:14:04 -- common/autotest_common.sh@1220 -- # return 0 00:11:37.437 02:14:04 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:37.437 02:14:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:37.437 02:14:04 -- common/autotest_common.sh@10 -- # set +x 00:11:37.437 02:14:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:37.437 02:14:04 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:37.437 02:14:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:37.437 02:14:04 -- common/autotest_common.sh@10 -- # set +x 00:11:37.437 02:14:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:37.437 02:14:04 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:37.437 02:14:04 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:37.437 02:14:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:37.437 02:14:04 -- common/autotest_common.sh@10 -- # set +x 00:11:37.437 02:14:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:37.437 02:14:04 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:37.437 02:14:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:37.437 02:14:04 -- common/autotest_common.sh@10 -- # set +x 00:11:37.437 [2024-12-08 02:14:04.813070] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:37.437 02:14:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:37.437 02:14:04 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:37.437 02:14:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:37.437 02:14:04 -- common/autotest_common.sh@10 -- # set +x 00:11:37.437 02:14:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:37.437 02:14:04 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:37.437 02:14:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:37.437 02:14:04 -- common/autotest_common.sh@10 -- # set +x 00:11:37.437 02:14:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:37.437 02:14:04 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:37.999 02:14:05 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:37.999 02:14:05 -- common/autotest_common.sh@1187 -- # local i=0 00:11:37.999 02:14:05 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:37.999 02:14:05 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:37.999 02:14:05 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:39.895 02:14:07 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:39.895 02:14:07 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:39.895 02:14:07 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:39.895 02:14:07 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:39.895 02:14:07 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:39.895 02:14:07 -- common/autotest_common.sh@1197 -- # return 0 00:11:39.895 02:14:07 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:39.895 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:39.895 02:14:07 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:39.895 02:14:07 -- common/autotest_common.sh@1208 -- # local i=0 00:11:39.895 02:14:07 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:39.895 02:14:07 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:39.895 02:14:07 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:39.895 02:14:07 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:39.895 02:14:07 -- common/autotest_common.sh@1220 -- # return 0 00:11:39.895 02:14:07 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:39.895 02:14:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:39.895 02:14:07 -- common/autotest_common.sh@10 -- # set +x 00:11:39.895 02:14:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:39.895 02:14:07 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:39.895 02:14:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:39.895 02:14:07 -- common/autotest_common.sh@10 -- # set +x 00:11:39.895 02:14:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:39.895 02:14:07 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:39.895 02:14:07 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:39.895 02:14:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:39.895 02:14:07 -- common/autotest_common.sh@10 -- # set +x 00:11:39.895 02:14:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:39.895 02:14:07 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:39.895 02:14:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:39.895 02:14:07 -- common/autotest_common.sh@10 -- # set +x 00:11:39.895 [2024-12-08 02:14:07.636242] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:39.895 02:14:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:39.895 02:14:07 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:39.895 02:14:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:39.895 02:14:07 -- common/autotest_common.sh@10 -- # set +x 00:11:39.895 02:14:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:39.895 02:14:07 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:39.896 02:14:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:39.896 02:14:07 -- common/autotest_common.sh@10 -- # set +x 00:11:39.896 02:14:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:39.896 02:14:07 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:40.827 02:14:08 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:40.827 02:14:08 -- common/autotest_common.sh@1187 -- # local i=0 00:11:40.827 02:14:08 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:40.827 02:14:08 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:40.827 02:14:08 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:42.724 02:14:10 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:42.724 02:14:10 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:42.724 02:14:10 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:42.724 02:14:10 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:42.724 02:14:10 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:42.724 02:14:10 -- common/autotest_common.sh@1197 -- # return 0 00:11:42.724 02:14:10 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:42.724 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:42.724 02:14:10 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:42.724 02:14:10 -- common/autotest_common.sh@1208 -- # local i=0 00:11:42.724 02:14:10 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:42.724 02:14:10 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:42.724 02:14:10 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:42.724 02:14:10 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:42.724 02:14:10 -- common/autotest_common.sh@1220 -- # return 0 00:11:42.724 02:14:10 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:42.724 02:14:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:42.724 02:14:10 -- common/autotest_common.sh@10 -- # set +x 00:11:42.724 02:14:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:42.724 02:14:10 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:42.724 02:14:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:42.724 02:14:10 -- common/autotest_common.sh@10 -- # set +x 00:11:42.724 02:14:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:42.724 02:14:10 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:42.724 02:14:10 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:42.724 02:14:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:42.724 02:14:10 -- common/autotest_common.sh@10 -- # set +x 00:11:42.724 02:14:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:42.724 02:14:10 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:42.724 02:14:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:42.724 02:14:10 -- common/autotest_common.sh@10 -- # set +x 00:11:42.724 [2024-12-08 02:14:10.501915] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:42.982 02:14:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:42.982 02:14:10 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:42.982 02:14:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:42.982 02:14:10 -- common/autotest_common.sh@10 -- # set +x 00:11:42.982 02:14:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:42.982 02:14:10 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:42.982 02:14:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:42.982 02:14:10 -- common/autotest_common.sh@10 -- # set +x 00:11:42.982 02:14:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:42.982 02:14:10 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:43.548 02:14:11 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:43.548 02:14:11 -- common/autotest_common.sh@1187 -- # local i=0 00:11:43.548 02:14:11 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:43.548 02:14:11 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:43.548 02:14:11 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:45.452 02:14:13 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:45.452 02:14:13 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:45.452 02:14:13 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:45.452 02:14:13 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:45.452 02:14:13 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:45.452 02:14:13 -- common/autotest_common.sh@1197 -- # return 0 00:11:45.452 02:14:13 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:45.452 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:45.452 02:14:13 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:45.452 02:14:13 -- common/autotest_common.sh@1208 -- # local i=0 00:11:45.452 02:14:13 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:45.744 02:14:13 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:45.744 02:14:13 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:45.744 02:14:13 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:45.744 02:14:13 -- common/autotest_common.sh@1220 -- # return 0 00:11:45.744 02:14:13 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:45.744 02:14:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.744 02:14:13 -- common/autotest_common.sh@10 -- # set +x 00:11:45.744 02:14:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.744 02:14:13 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:45.744 02:14:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.744 02:14:13 -- common/autotest_common.sh@10 -- # set +x 00:11:45.744 02:14:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.744 02:14:13 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:45.744 02:14:13 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:45.744 02:14:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.744 02:14:13 -- common/autotest_common.sh@10 -- # set +x 00:11:45.744 02:14:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.744 02:14:13 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:45.744 02:14:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.744 02:14:13 -- common/autotest_common.sh@10 -- # set +x 00:11:45.744 [2024-12-08 02:14:13.278899] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:45.744 02:14:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.744 02:14:13 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:45.744 02:14:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.744 02:14:13 -- common/autotest_common.sh@10 -- # set +x 00:11:45.744 02:14:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.744 02:14:13 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:45.744 02:14:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.744 02:14:13 -- common/autotest_common.sh@10 -- # set +x 00:11:45.744 02:14:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.744 02:14:13 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:46.322 02:14:13 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:46.322 02:14:13 -- common/autotest_common.sh@1187 -- # local i=0 00:11:46.322 02:14:13 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:46.322 02:14:13 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:46.322 02:14:13 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:48.219 02:14:15 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:48.219 02:14:15 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:48.219 02:14:15 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:48.477 02:14:16 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:48.477 02:14:16 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:48.477 02:14:16 -- common/autotest_common.sh@1197 -- # return 0 00:11:48.477 02:14:16 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:48.477 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:48.477 02:14:16 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:48.477 02:14:16 -- common/autotest_common.sh@1208 -- # local i=0 00:11:48.477 02:14:16 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:48.477 02:14:16 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:48.477 02:14:16 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:48.477 02:14:16 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:48.477 02:14:16 -- common/autotest_common.sh@1220 -- # return 0 00:11:48.477 02:14:16 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:48.477 02:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.477 02:14:16 -- common/autotest_common.sh@10 -- # set +x 00:11:48.477 02:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.477 02:14:16 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:48.477 02:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.477 02:14:16 -- common/autotest_common.sh@10 -- # set +x 00:11:48.477 02:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.477 02:14:16 -- target/rpc.sh@99 -- # seq 1 5 00:11:48.477 02:14:16 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:48.477 02:14:16 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:48.477 02:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.477 02:14:16 -- common/autotest_common.sh@10 -- # set +x 00:11:48.477 02:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.477 02:14:16 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:48.477 02:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.477 02:14:16 -- common/autotest_common.sh@10 -- # set +x 00:11:48.477 [2024-12-08 02:14:16.114229] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:48.477 02:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.477 02:14:16 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:48.477 02:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.477 02:14:16 -- common/autotest_common.sh@10 -- # set +x 00:11:48.477 02:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.477 02:14:16 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:48.477 02:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.477 02:14:16 -- common/autotest_common.sh@10 -- # set +x 00:11:48.477 02:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.477 02:14:16 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:48.477 02:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.477 02:14:16 -- common/autotest_common.sh@10 -- # set +x 00:11:48.477 02:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.477 02:14:16 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:48.477 02:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.477 02:14:16 -- common/autotest_common.sh@10 -- # set +x 00:11:48.477 02:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.477 02:14:16 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:48.477 02:14:16 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:48.477 02:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.477 02:14:16 -- common/autotest_common.sh@10 -- # set +x 00:11:48.477 02:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.477 02:14:16 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:48.477 02:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.477 02:14:16 -- common/autotest_common.sh@10 -- # set +x 00:11:48.477 [2024-12-08 02:14:16.162304] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:48.477 02:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.477 02:14:16 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:48.477 02:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.477 02:14:16 -- common/autotest_common.sh@10 -- # set +x 00:11:48.477 02:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.477 02:14:16 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:48.477 02:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.477 02:14:16 -- common/autotest_common.sh@10 -- # set +x 00:11:48.477 02:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.477 02:14:16 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:48.477 02:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.477 02:14:16 -- common/autotest_common.sh@10 -- # set +x 00:11:48.477 02:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.478 02:14:16 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:48.478 02:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.478 02:14:16 -- common/autotest_common.sh@10 -- # set +x 00:11:48.478 02:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.478 02:14:16 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:48.478 02:14:16 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:48.478 02:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.478 02:14:16 -- common/autotest_common.sh@10 -- # set +x 00:11:48.478 02:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.478 02:14:16 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:48.478 02:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.478 02:14:16 -- common/autotest_common.sh@10 -- # set +x 00:11:48.478 [2024-12-08 02:14:16.210460] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:48.478 02:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.478 02:14:16 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:48.478 02:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.478 02:14:16 -- common/autotest_common.sh@10 -- # set +x 00:11:48.478 02:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.478 02:14:16 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:48.478 02:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.478 02:14:16 -- common/autotest_common.sh@10 -- # set +x 00:11:48.478 02:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.478 02:14:16 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:48.478 02:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.478 02:14:16 -- common/autotest_common.sh@10 -- # set +x 00:11:48.478 02:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.478 02:14:16 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:48.478 02:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.478 02:14:16 -- common/autotest_common.sh@10 -- # set +x 00:11:48.478 02:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.478 02:14:16 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:48.478 02:14:16 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:48.478 02:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.478 02:14:16 -- common/autotest_common.sh@10 -- # set +x 00:11:48.478 02:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.478 02:14:16 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:48.478 02:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.478 02:14:16 -- common/autotest_common.sh@10 -- # set +x 00:11:48.736 [2024-12-08 02:14:16.258653] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:48.736 02:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.736 02:14:16 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:48.736 02:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.736 02:14:16 -- common/autotest_common.sh@10 -- # set +x 00:11:48.736 02:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.736 02:14:16 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:48.736 02:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.736 02:14:16 -- common/autotest_common.sh@10 -- # set +x 00:11:48.736 02:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.736 02:14:16 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:48.736 02:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.736 02:14:16 -- common/autotest_common.sh@10 -- # set +x 00:11:48.736 02:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.736 02:14:16 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:48.736 02:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.736 02:14:16 -- common/autotest_common.sh@10 -- # set +x 00:11:48.736 02:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.736 02:14:16 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:48.736 02:14:16 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:48.736 02:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.736 02:14:16 -- common/autotest_common.sh@10 -- # set +x 00:11:48.736 02:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.736 02:14:16 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:48.736 02:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.736 02:14:16 -- common/autotest_common.sh@10 -- # set +x 00:11:48.736 [2024-12-08 02:14:16.306828] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:48.736 02:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.736 02:14:16 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:48.736 02:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.736 02:14:16 -- common/autotest_common.sh@10 -- # set +x 00:11:48.736 02:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.736 02:14:16 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:48.736 02:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.736 02:14:16 -- common/autotest_common.sh@10 -- # set +x 00:11:48.736 02:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.736 02:14:16 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:48.736 02:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.736 02:14:16 -- common/autotest_common.sh@10 -- # set +x 00:11:48.736 02:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.736 02:14:16 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:48.736 02:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.736 02:14:16 -- common/autotest_common.sh@10 -- # set +x 00:11:48.736 02:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.736 02:14:16 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:11:48.736 02:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.736 02:14:16 -- common/autotest_common.sh@10 -- # set +x 00:11:48.736 02:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.736 02:14:16 -- target/rpc.sh@110 -- # stats='{ 00:11:48.736 "tick_rate": 2700000000, 00:11:48.736 "poll_groups": [ 00:11:48.736 { 00:11:48.736 "name": "nvmf_tgt_poll_group_0", 00:11:48.736 "admin_qpairs": 2, 00:11:48.736 "io_qpairs": 84, 00:11:48.736 "current_admin_qpairs": 0, 00:11:48.736 "current_io_qpairs": 0, 00:11:48.736 "pending_bdev_io": 0, 00:11:48.736 "completed_nvme_io": 234, 00:11:48.736 "transports": [ 00:11:48.736 { 00:11:48.736 "trtype": "TCP" 00:11:48.736 } 00:11:48.736 ] 00:11:48.736 }, 00:11:48.736 { 00:11:48.736 "name": "nvmf_tgt_poll_group_1", 00:11:48.736 "admin_qpairs": 2, 00:11:48.736 "io_qpairs": 84, 00:11:48.736 "current_admin_qpairs": 0, 00:11:48.736 "current_io_qpairs": 0, 00:11:48.736 "pending_bdev_io": 0, 00:11:48.736 "completed_nvme_io": 182, 00:11:48.736 "transports": [ 00:11:48.736 { 00:11:48.736 "trtype": "TCP" 00:11:48.736 } 00:11:48.736 ] 00:11:48.736 }, 00:11:48.736 { 00:11:48.736 "name": "nvmf_tgt_poll_group_2", 00:11:48.736 "admin_qpairs": 1, 00:11:48.736 "io_qpairs": 84, 00:11:48.736 "current_admin_qpairs": 0, 00:11:48.736 "current_io_qpairs": 0, 00:11:48.736 "pending_bdev_io": 0, 00:11:48.736 "completed_nvme_io": 134, 00:11:48.736 "transports": [ 00:11:48.736 { 00:11:48.736 "trtype": "TCP" 00:11:48.736 } 00:11:48.736 ] 00:11:48.736 }, 00:11:48.736 { 00:11:48.736 "name": "nvmf_tgt_poll_group_3", 00:11:48.736 "admin_qpairs": 2, 00:11:48.736 "io_qpairs": 84, 00:11:48.736 "current_admin_qpairs": 0, 00:11:48.736 "current_io_qpairs": 0, 00:11:48.736 "pending_bdev_io": 0, 00:11:48.736 "completed_nvme_io": 136, 00:11:48.736 "transports": [ 00:11:48.736 { 00:11:48.736 "trtype": "TCP" 00:11:48.736 } 00:11:48.736 ] 00:11:48.736 } 00:11:48.736 ] 00:11:48.736 }' 00:11:48.736 02:14:16 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:11:48.736 02:14:16 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:11:48.736 02:14:16 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:11:48.736 02:14:16 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:48.736 02:14:16 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:11:48.736 02:14:16 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:11:48.737 02:14:16 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:11:48.737 02:14:16 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:11:48.737 02:14:16 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:48.737 02:14:16 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:11:48.737 02:14:16 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:11:48.737 02:14:16 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:11:48.737 02:14:16 -- target/rpc.sh@123 -- # nvmftestfini 00:11:48.737 02:14:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:48.737 02:14:16 -- nvmf/common.sh@116 -- # sync 00:11:48.737 02:14:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:48.737 02:14:16 -- nvmf/common.sh@119 -- # set +e 00:11:48.737 02:14:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:48.737 02:14:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:48.737 rmmod nvme_tcp 00:11:48.737 rmmod nvme_fabrics 00:11:48.737 rmmod nvme_keyring 00:11:48.737 02:14:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:48.737 02:14:16 -- nvmf/common.sh@123 -- # set -e 00:11:48.737 02:14:16 -- nvmf/common.sh@124 -- # return 0 00:11:48.737 02:14:16 -- nvmf/common.sh@477 -- # '[' -n 2054400 ']' 00:11:48.737 02:14:16 -- nvmf/common.sh@478 -- # killprocess 2054400 00:11:48.737 02:14:16 -- common/autotest_common.sh@936 -- # '[' -z 2054400 ']' 00:11:48.737 02:14:16 -- common/autotest_common.sh@940 -- # kill -0 2054400 00:11:48.737 02:14:16 -- common/autotest_common.sh@941 -- # uname 00:11:48.737 02:14:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:48.737 02:14:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2054400 00:11:48.995 02:14:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:48.995 02:14:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:48.995 02:14:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2054400' 00:11:48.995 killing process with pid 2054400 00:11:48.995 02:14:16 -- common/autotest_common.sh@955 -- # kill 2054400 00:11:48.995 02:14:16 -- common/autotest_common.sh@960 -- # wait 2054400 00:11:49.254 02:14:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:49.254 02:14:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:49.254 02:14:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:49.254 02:14:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:49.254 02:14:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:49.254 02:14:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:49.254 02:14:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:49.254 02:14:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:51.160 02:14:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:51.160 00:11:51.160 real 0m26.169s 00:11:51.160 user 1m25.419s 00:11:51.160 sys 0m4.135s 00:11:51.160 02:14:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:51.160 02:14:18 -- common/autotest_common.sh@10 -- # set +x 00:11:51.160 ************************************ 00:11:51.160 END TEST nvmf_rpc 00:11:51.160 ************************************ 00:11:51.160 02:14:18 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:11:51.160 02:14:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:51.160 02:14:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:51.160 02:14:18 -- common/autotest_common.sh@10 -- # set +x 00:11:51.160 ************************************ 00:11:51.160 START TEST nvmf_invalid 00:11:51.160 ************************************ 00:11:51.160 02:14:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:11:51.160 * Looking for test storage... 00:11:51.160 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:51.160 02:14:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:51.160 02:14:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:51.160 02:14:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:51.418 02:14:19 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:51.418 02:14:19 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:51.418 02:14:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:51.418 02:14:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:51.418 02:14:19 -- scripts/common.sh@335 -- # IFS=.-: 00:11:51.418 02:14:19 -- scripts/common.sh@335 -- # read -ra ver1 00:11:51.418 02:14:19 -- scripts/common.sh@336 -- # IFS=.-: 00:11:51.418 02:14:19 -- scripts/common.sh@336 -- # read -ra ver2 00:11:51.418 02:14:19 -- scripts/common.sh@337 -- # local 'op=<' 00:11:51.418 02:14:19 -- scripts/common.sh@339 -- # ver1_l=2 00:11:51.418 02:14:19 -- scripts/common.sh@340 -- # ver2_l=1 00:11:51.418 02:14:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:51.418 02:14:19 -- scripts/common.sh@343 -- # case "$op" in 00:11:51.418 02:14:19 -- scripts/common.sh@344 -- # : 1 00:11:51.418 02:14:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:51.418 02:14:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:51.418 02:14:19 -- scripts/common.sh@364 -- # decimal 1 00:11:51.418 02:14:19 -- scripts/common.sh@352 -- # local d=1 00:11:51.418 02:14:19 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:51.418 02:14:19 -- scripts/common.sh@354 -- # echo 1 00:11:51.418 02:14:19 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:51.418 02:14:19 -- scripts/common.sh@365 -- # decimal 2 00:11:51.418 02:14:19 -- scripts/common.sh@352 -- # local d=2 00:11:51.418 02:14:19 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:51.418 02:14:19 -- scripts/common.sh@354 -- # echo 2 00:11:51.418 02:14:19 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:51.418 02:14:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:51.418 02:14:19 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:51.418 02:14:19 -- scripts/common.sh@367 -- # return 0 00:11:51.418 02:14:19 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:51.419 02:14:19 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:51.419 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:51.419 --rc genhtml_branch_coverage=1 00:11:51.419 --rc genhtml_function_coverage=1 00:11:51.419 --rc genhtml_legend=1 00:11:51.419 --rc geninfo_all_blocks=1 00:11:51.419 --rc geninfo_unexecuted_blocks=1 00:11:51.419 00:11:51.419 ' 00:11:51.419 02:14:19 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:51.419 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:51.419 --rc genhtml_branch_coverage=1 00:11:51.419 --rc genhtml_function_coverage=1 00:11:51.419 --rc genhtml_legend=1 00:11:51.419 --rc geninfo_all_blocks=1 00:11:51.419 --rc geninfo_unexecuted_blocks=1 00:11:51.419 00:11:51.419 ' 00:11:51.419 02:14:19 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:51.419 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:51.419 --rc genhtml_branch_coverage=1 00:11:51.419 --rc genhtml_function_coverage=1 00:11:51.419 --rc genhtml_legend=1 00:11:51.419 --rc geninfo_all_blocks=1 00:11:51.419 --rc geninfo_unexecuted_blocks=1 00:11:51.419 00:11:51.419 ' 00:11:51.419 02:14:19 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:51.419 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:51.419 --rc genhtml_branch_coverage=1 00:11:51.419 --rc genhtml_function_coverage=1 00:11:51.419 --rc genhtml_legend=1 00:11:51.419 --rc geninfo_all_blocks=1 00:11:51.419 --rc geninfo_unexecuted_blocks=1 00:11:51.419 00:11:51.419 ' 00:11:51.419 02:14:19 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:51.419 02:14:19 -- nvmf/common.sh@7 -- # uname -s 00:11:51.419 02:14:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:51.419 02:14:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:51.419 02:14:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:51.419 02:14:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:51.419 02:14:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:51.419 02:14:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:51.419 02:14:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:51.419 02:14:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:51.419 02:14:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:51.419 02:14:19 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:51.419 02:14:19 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:51.419 02:14:19 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:51.419 02:14:19 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:51.419 02:14:19 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:51.419 02:14:19 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:51.419 02:14:19 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:51.419 02:14:19 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:51.419 02:14:19 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:51.419 02:14:19 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:51.419 02:14:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:51.419 02:14:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:51.419 02:14:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:51.419 02:14:19 -- paths/export.sh@5 -- # export PATH 00:11:51.419 02:14:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:51.419 02:14:19 -- nvmf/common.sh@46 -- # : 0 00:11:51.419 02:14:19 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:51.419 02:14:19 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:51.419 02:14:19 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:51.419 02:14:19 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:51.419 02:14:19 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:51.419 02:14:19 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:51.419 02:14:19 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:51.419 02:14:19 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:51.419 02:14:19 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:11:51.419 02:14:19 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:11:51.419 02:14:19 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:11:51.419 02:14:19 -- target/invalid.sh@14 -- # target=foobar 00:11:51.419 02:14:19 -- target/invalid.sh@16 -- # RANDOM=0 00:11:51.419 02:14:19 -- target/invalid.sh@34 -- # nvmftestinit 00:11:51.419 02:14:19 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:51.419 02:14:19 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:51.419 02:14:19 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:51.419 02:14:19 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:51.419 02:14:19 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:51.419 02:14:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:51.419 02:14:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:51.419 02:14:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:51.419 02:14:19 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:51.419 02:14:19 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:51.419 02:14:19 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:51.419 02:14:19 -- common/autotest_common.sh@10 -- # set +x 00:11:53.324 02:14:21 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:53.324 02:14:21 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:53.324 02:14:21 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:53.324 02:14:21 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:53.324 02:14:21 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:53.324 02:14:21 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:53.324 02:14:21 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:53.324 02:14:21 -- nvmf/common.sh@294 -- # net_devs=() 00:11:53.324 02:14:21 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:53.324 02:14:21 -- nvmf/common.sh@295 -- # e810=() 00:11:53.324 02:14:21 -- nvmf/common.sh@295 -- # local -ga e810 00:11:53.324 02:14:21 -- nvmf/common.sh@296 -- # x722=() 00:11:53.324 02:14:21 -- nvmf/common.sh@296 -- # local -ga x722 00:11:53.324 02:14:21 -- nvmf/common.sh@297 -- # mlx=() 00:11:53.324 02:14:21 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:53.324 02:14:21 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:53.324 02:14:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:53.324 02:14:21 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:53.324 02:14:21 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:53.324 02:14:21 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:53.324 02:14:21 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:53.324 02:14:21 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:53.324 02:14:21 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:53.324 02:14:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:53.324 02:14:21 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:53.324 02:14:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:53.324 02:14:21 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:53.324 02:14:21 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:53.324 02:14:21 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:53.324 02:14:21 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:53.324 02:14:21 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:53.324 02:14:21 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:53.324 02:14:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:53.324 02:14:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:53.324 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:53.324 02:14:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:53.324 02:14:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:53.324 02:14:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:53.324 02:14:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:53.324 02:14:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:53.324 02:14:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:53.324 02:14:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:53.324 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:53.324 02:14:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:53.324 02:14:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:53.324 02:14:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:53.324 02:14:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:53.324 02:14:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:53.324 02:14:21 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:53.325 02:14:21 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:53.325 02:14:21 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:53.325 02:14:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:53.325 02:14:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:53.325 02:14:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:53.325 02:14:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:53.325 02:14:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:53.325 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:53.325 02:14:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:53.325 02:14:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:53.325 02:14:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:53.325 02:14:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:53.325 02:14:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:53.325 02:14:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:53.325 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:53.325 02:14:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:53.325 02:14:21 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:53.325 02:14:21 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:53.325 02:14:21 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:53.325 02:14:21 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:53.325 02:14:21 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:53.325 02:14:21 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:53.325 02:14:21 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:53.325 02:14:21 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:53.325 02:14:21 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:53.325 02:14:21 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:53.325 02:14:21 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:53.325 02:14:21 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:53.325 02:14:21 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:53.325 02:14:21 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:53.325 02:14:21 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:53.325 02:14:21 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:53.325 02:14:21 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:53.325 02:14:21 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:53.583 02:14:21 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:53.583 02:14:21 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:53.583 02:14:21 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:53.583 02:14:21 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:53.583 02:14:21 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:53.583 02:14:21 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:53.583 02:14:21 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:53.583 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:53.583 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.359 ms 00:11:53.583 00:11:53.583 --- 10.0.0.2 ping statistics --- 00:11:53.583 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:53.583 rtt min/avg/max/mdev = 0.359/0.359/0.359/0.000 ms 00:11:53.583 02:14:21 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:53.583 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:53.583 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.144 ms 00:11:53.583 00:11:53.583 --- 10.0.0.1 ping statistics --- 00:11:53.583 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:53.583 rtt min/avg/max/mdev = 0.144/0.144/0.144/0.000 ms 00:11:53.583 02:14:21 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:53.583 02:14:21 -- nvmf/common.sh@410 -- # return 0 00:11:53.583 02:14:21 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:53.583 02:14:21 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:53.583 02:14:21 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:53.583 02:14:21 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:53.583 02:14:21 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:53.583 02:14:21 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:53.583 02:14:21 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:53.583 02:14:21 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:11:53.583 02:14:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:53.583 02:14:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:53.583 02:14:21 -- common/autotest_common.sh@10 -- # set +x 00:11:53.583 02:14:21 -- nvmf/common.sh@469 -- # nvmfpid=2059120 00:11:53.583 02:14:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:53.583 02:14:21 -- nvmf/common.sh@470 -- # waitforlisten 2059120 00:11:53.583 02:14:21 -- common/autotest_common.sh@829 -- # '[' -z 2059120 ']' 00:11:53.583 02:14:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:53.583 02:14:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:53.583 02:14:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:53.583 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:53.583 02:14:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:53.583 02:14:21 -- common/autotest_common.sh@10 -- # set +x 00:11:53.583 [2024-12-08 02:14:21.254764] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:53.583 [2024-12-08 02:14:21.254845] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:53.583 EAL: No free 2048 kB hugepages reported on node 1 00:11:53.583 [2024-12-08 02:14:21.319364] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:53.840 [2024-12-08 02:14:21.432344] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:53.840 [2024-12-08 02:14:21.432508] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:53.840 [2024-12-08 02:14:21.432548] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:53.840 [2024-12-08 02:14:21.432563] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:53.840 [2024-12-08 02:14:21.432615] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:53.840 [2024-12-08 02:14:21.432678] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:53.840 [2024-12-08 02:14:21.432726] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:53.840 [2024-12-08 02:14:21.432728] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:54.768 02:14:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:54.768 02:14:22 -- common/autotest_common.sh@862 -- # return 0 00:11:54.768 02:14:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:54.768 02:14:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:54.768 02:14:22 -- common/autotest_common.sh@10 -- # set +x 00:11:54.768 02:14:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:54.768 02:14:22 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:11:54.768 02:14:22 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode13843 00:11:54.768 [2024-12-08 02:14:22.469813] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:11:54.768 02:14:22 -- target/invalid.sh@40 -- # out='request: 00:11:54.768 { 00:11:54.768 "nqn": "nqn.2016-06.io.spdk:cnode13843", 00:11:54.768 "tgt_name": "foobar", 00:11:54.768 "method": "nvmf_create_subsystem", 00:11:54.768 "req_id": 1 00:11:54.768 } 00:11:54.768 Got JSON-RPC error response 00:11:54.768 response: 00:11:54.768 { 00:11:54.768 "code": -32603, 00:11:54.768 "message": "Unable to find target foobar" 00:11:54.768 }' 00:11:54.768 02:14:22 -- target/invalid.sh@41 -- # [[ request: 00:11:54.768 { 00:11:54.768 "nqn": "nqn.2016-06.io.spdk:cnode13843", 00:11:54.768 "tgt_name": "foobar", 00:11:54.768 "method": "nvmf_create_subsystem", 00:11:54.768 "req_id": 1 00:11:54.768 } 00:11:54.768 Got JSON-RPC error response 00:11:54.768 response: 00:11:54.768 { 00:11:54.768 "code": -32603, 00:11:54.768 "message": "Unable to find target foobar" 00:11:54.768 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:11:54.768 02:14:22 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:11:54.768 02:14:22 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode20525 00:11:55.026 [2024-12-08 02:14:22.726672] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode20525: invalid serial number 'SPDKISFASTANDAWESOME' 00:11:55.026 02:14:22 -- target/invalid.sh@45 -- # out='request: 00:11:55.026 { 00:11:55.026 "nqn": "nqn.2016-06.io.spdk:cnode20525", 00:11:55.026 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:11:55.026 "method": "nvmf_create_subsystem", 00:11:55.026 "req_id": 1 00:11:55.026 } 00:11:55.026 Got JSON-RPC error response 00:11:55.026 response: 00:11:55.026 { 00:11:55.026 "code": -32602, 00:11:55.026 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:11:55.026 }' 00:11:55.026 02:14:22 -- target/invalid.sh@46 -- # [[ request: 00:11:55.026 { 00:11:55.026 "nqn": "nqn.2016-06.io.spdk:cnode20525", 00:11:55.026 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:11:55.026 "method": "nvmf_create_subsystem", 00:11:55.026 "req_id": 1 00:11:55.026 } 00:11:55.026 Got JSON-RPC error response 00:11:55.026 response: 00:11:55.026 { 00:11:55.026 "code": -32602, 00:11:55.026 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:11:55.026 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:11:55.026 02:14:22 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:11:55.026 02:14:22 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode15605 00:11:55.283 [2024-12-08 02:14:22.975474] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode15605: invalid model number 'SPDK_Controller' 00:11:55.283 02:14:22 -- target/invalid.sh@50 -- # out='request: 00:11:55.283 { 00:11:55.283 "nqn": "nqn.2016-06.io.spdk:cnode15605", 00:11:55.283 "model_number": "SPDK_Controller\u001f", 00:11:55.283 "method": "nvmf_create_subsystem", 00:11:55.283 "req_id": 1 00:11:55.283 } 00:11:55.283 Got JSON-RPC error response 00:11:55.283 response: 00:11:55.283 { 00:11:55.283 "code": -32602, 00:11:55.283 "message": "Invalid MN SPDK_Controller\u001f" 00:11:55.283 }' 00:11:55.283 02:14:22 -- target/invalid.sh@51 -- # [[ request: 00:11:55.283 { 00:11:55.283 "nqn": "nqn.2016-06.io.spdk:cnode15605", 00:11:55.283 "model_number": "SPDK_Controller\u001f", 00:11:55.283 "method": "nvmf_create_subsystem", 00:11:55.283 "req_id": 1 00:11:55.283 } 00:11:55.283 Got JSON-RPC error response 00:11:55.283 response: 00:11:55.283 { 00:11:55.283 "code": -32602, 00:11:55.283 "message": "Invalid MN SPDK_Controller\u001f" 00:11:55.283 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:11:55.283 02:14:22 -- target/invalid.sh@54 -- # gen_random_s 21 00:11:55.283 02:14:22 -- target/invalid.sh@19 -- # local length=21 ll 00:11:55.283 02:14:22 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:11:55.283 02:14:22 -- target/invalid.sh@21 -- # local chars 00:11:55.283 02:14:22 -- target/invalid.sh@22 -- # local string 00:11:55.283 02:14:22 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:11:55.283 02:14:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.283 02:14:22 -- target/invalid.sh@25 -- # printf %x 68 00:11:55.283 02:14:22 -- target/invalid.sh@25 -- # echo -e '\x44' 00:11:55.283 02:14:22 -- target/invalid.sh@25 -- # string+=D 00:11:55.283 02:14:22 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.283 02:14:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.283 02:14:23 -- target/invalid.sh@25 -- # printf %x 84 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x54' 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # string+=T 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # printf %x 38 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x26' 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # string+='&' 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # printf %x 74 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x4a' 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # string+=J 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # printf %x 86 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x56' 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # string+=V 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # printf %x 93 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x5d' 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # string+=']' 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # printf %x 113 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x71' 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # string+=q 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # printf %x 74 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x4a' 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # string+=J 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # printf %x 110 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # string+=n 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # printf %x 106 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # string+=j 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # printf %x 42 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x2a' 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # string+='*' 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # printf %x 100 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x64' 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # string+=d 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # printf %x 114 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x72' 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # string+=r 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # printf %x 123 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x7b' 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # string+='{' 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # printf %x 110 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # string+=n 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # printf %x 65 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x41' 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # string+=A 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # printf %x 42 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x2a' 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # string+='*' 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # printf %x 122 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # string+=z 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # printf %x 92 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # string+='\' 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # printf %x 36 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x24' 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # string+='$' 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # printf %x 75 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:11:55.284 02:14:23 -- target/invalid.sh@25 -- # string+=K 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.284 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.284 02:14:23 -- target/invalid.sh@28 -- # [[ D == \- ]] 00:11:55.284 02:14:23 -- target/invalid.sh@31 -- # echo 'DT&JV]qJnj*dr{nA*z\$K' 00:11:55.541 02:14:23 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s 'DT&JV]qJnj*dr{nA*z\$K' nqn.2016-06.io.spdk:cnode14900 00:11:55.541 [2024-12-08 02:14:23.292565] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode14900: invalid serial number 'DT&JV]qJnj*dr{nA*z\$K' 00:11:55.541 02:14:23 -- target/invalid.sh@54 -- # out='request: 00:11:55.541 { 00:11:55.541 "nqn": "nqn.2016-06.io.spdk:cnode14900", 00:11:55.541 "serial_number": "DT&JV]qJnj*dr{nA*z\\$K", 00:11:55.541 "method": "nvmf_create_subsystem", 00:11:55.541 "req_id": 1 00:11:55.541 } 00:11:55.541 Got JSON-RPC error response 00:11:55.541 response: 00:11:55.541 { 00:11:55.541 "code": -32602, 00:11:55.541 "message": "Invalid SN DT&JV]qJnj*dr{nA*z\\$K" 00:11:55.541 }' 00:11:55.541 02:14:23 -- target/invalid.sh@55 -- # [[ request: 00:11:55.541 { 00:11:55.541 "nqn": "nqn.2016-06.io.spdk:cnode14900", 00:11:55.541 "serial_number": "DT&JV]qJnj*dr{nA*z\\$K", 00:11:55.541 "method": "nvmf_create_subsystem", 00:11:55.541 "req_id": 1 00:11:55.541 } 00:11:55.541 Got JSON-RPC error response 00:11:55.541 response: 00:11:55.541 { 00:11:55.541 "code": -32602, 00:11:55.541 "message": "Invalid SN DT&JV]qJnj*dr{nA*z\\$K" 00:11:55.541 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:11:55.541 02:14:23 -- target/invalid.sh@58 -- # gen_random_s 41 00:11:55.541 02:14:23 -- target/invalid.sh@19 -- # local length=41 ll 00:11:55.541 02:14:23 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:11:55.541 02:14:23 -- target/invalid.sh@21 -- # local chars 00:11:55.541 02:14:23 -- target/invalid.sh@22 -- # local string 00:11:55.541 02:14:23 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:11:55.541 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.541 02:14:23 -- target/invalid.sh@25 -- # printf %x 78 00:11:55.541 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x4e' 00:11:55.541 02:14:23 -- target/invalid.sh@25 -- # string+=N 00:11:55.541 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.541 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.541 02:14:23 -- target/invalid.sh@25 -- # printf %x 47 00:11:55.542 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x2f' 00:11:55.542 02:14:23 -- target/invalid.sh@25 -- # string+=/ 00:11:55.542 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.542 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.799 02:14:23 -- target/invalid.sh@25 -- # printf %x 38 00:11:55.799 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x26' 00:11:55.799 02:14:23 -- target/invalid.sh@25 -- # string+='&' 00:11:55.799 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.799 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.799 02:14:23 -- target/invalid.sh@25 -- # printf %x 50 00:11:55.799 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x32' 00:11:55.799 02:14:23 -- target/invalid.sh@25 -- # string+=2 00:11:55.799 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.799 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.799 02:14:23 -- target/invalid.sh@25 -- # printf %x 92 00:11:55.799 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:11:55.799 02:14:23 -- target/invalid.sh@25 -- # string+='\' 00:11:55.799 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.799 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.799 02:14:23 -- target/invalid.sh@25 -- # printf %x 104 00:11:55.799 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x68' 00:11:55.799 02:14:23 -- target/invalid.sh@25 -- # string+=h 00:11:55.799 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.799 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.799 02:14:23 -- target/invalid.sh@25 -- # printf %x 108 00:11:55.799 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:11:55.799 02:14:23 -- target/invalid.sh@25 -- # string+=l 00:11:55.799 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.799 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # printf %x 69 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x45' 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # string+=E 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # printf %x 107 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x6b' 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # string+=k 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # printf %x 92 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # string+='\' 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # printf %x 65 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x41' 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # string+=A 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # printf %x 32 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x20' 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # string+=' ' 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # printf %x 59 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x3b' 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # string+=';' 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # printf %x 39 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x27' 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # string+=\' 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # printf %x 102 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x66' 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # string+=f 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # printf %x 86 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x56' 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # string+=V 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # printf %x 76 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # string+=L 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # printf %x 103 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x67' 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # string+=g 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # printf %x 115 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x73' 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # string+=s 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # printf %x 123 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x7b' 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # string+='{' 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # printf %x 58 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x3a' 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # string+=: 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # printf %x 48 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x30' 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # string+=0 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # printf %x 72 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x48' 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # string+=H 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # printf %x 110 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # string+=n 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # printf %x 37 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x25' 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # string+=% 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # printf %x 104 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x68' 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # string+=h 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # printf %x 106 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # string+=j 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # printf %x 119 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x77' 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # string+=w 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # printf %x 55 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x37' 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # string+=7 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # printf %x 115 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x73' 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # string+=s 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # printf %x 84 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x54' 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # string+=T 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # printf %x 56 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x38' 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # string+=8 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # printf %x 83 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x53' 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # string+=S 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # printf %x 77 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # string+=M 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # printf %x 48 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x30' 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # string+=0 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # printf %x 109 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x6d' 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # string+=m 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # printf %x 60 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # string+='<' 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # printf %x 89 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x59' 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # string+=Y 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # printf %x 102 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x66' 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # string+=f 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # printf %x 82 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x52' 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # string+=R 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # printf %x 106 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:11:55.800 02:14:23 -- target/invalid.sh@25 -- # string+=j 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.800 02:14:23 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.800 02:14:23 -- target/invalid.sh@28 -- # [[ N == \- ]] 00:11:55.801 02:14:23 -- target/invalid.sh@31 -- # echo 'N/&2\hlEk\A ;'\''fVLgs{:0Hn%hjw7sT8SM0m /dev/null' 00:11:58.633 02:14:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:00.538 02:14:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:00.538 00:12:00.538 real 0m9.337s 00:12:00.538 user 0m22.742s 00:12:00.538 sys 0m2.418s 00:12:00.538 02:14:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:00.538 02:14:28 -- common/autotest_common.sh@10 -- # set +x 00:12:00.538 ************************************ 00:12:00.538 END TEST nvmf_invalid 00:12:00.538 ************************************ 00:12:00.538 02:14:28 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:00.538 02:14:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:00.538 02:14:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:00.538 02:14:28 -- common/autotest_common.sh@10 -- # set +x 00:12:00.538 ************************************ 00:12:00.538 START TEST nvmf_abort 00:12:00.538 ************************************ 00:12:00.538 02:14:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:00.538 * Looking for test storage... 00:12:00.538 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:00.538 02:14:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:00.538 02:14:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:00.538 02:14:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:00.797 02:14:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:00.797 02:14:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:00.797 02:14:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:00.797 02:14:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:00.797 02:14:28 -- scripts/common.sh@335 -- # IFS=.-: 00:12:00.797 02:14:28 -- scripts/common.sh@335 -- # read -ra ver1 00:12:00.797 02:14:28 -- scripts/common.sh@336 -- # IFS=.-: 00:12:00.797 02:14:28 -- scripts/common.sh@336 -- # read -ra ver2 00:12:00.797 02:14:28 -- scripts/common.sh@337 -- # local 'op=<' 00:12:00.797 02:14:28 -- scripts/common.sh@339 -- # ver1_l=2 00:12:00.797 02:14:28 -- scripts/common.sh@340 -- # ver2_l=1 00:12:00.797 02:14:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:00.797 02:14:28 -- scripts/common.sh@343 -- # case "$op" in 00:12:00.797 02:14:28 -- scripts/common.sh@344 -- # : 1 00:12:00.797 02:14:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:00.797 02:14:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:00.797 02:14:28 -- scripts/common.sh@364 -- # decimal 1 00:12:00.797 02:14:28 -- scripts/common.sh@352 -- # local d=1 00:12:00.797 02:14:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:00.797 02:14:28 -- scripts/common.sh@354 -- # echo 1 00:12:00.797 02:14:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:00.797 02:14:28 -- scripts/common.sh@365 -- # decimal 2 00:12:00.797 02:14:28 -- scripts/common.sh@352 -- # local d=2 00:12:00.797 02:14:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:00.797 02:14:28 -- scripts/common.sh@354 -- # echo 2 00:12:00.797 02:14:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:00.797 02:14:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:00.797 02:14:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:00.797 02:14:28 -- scripts/common.sh@367 -- # return 0 00:12:00.797 02:14:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:00.797 02:14:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:00.797 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:00.797 --rc genhtml_branch_coverage=1 00:12:00.797 --rc genhtml_function_coverage=1 00:12:00.797 --rc genhtml_legend=1 00:12:00.797 --rc geninfo_all_blocks=1 00:12:00.797 --rc geninfo_unexecuted_blocks=1 00:12:00.797 00:12:00.797 ' 00:12:00.797 02:14:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:00.797 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:00.797 --rc genhtml_branch_coverage=1 00:12:00.797 --rc genhtml_function_coverage=1 00:12:00.797 --rc genhtml_legend=1 00:12:00.797 --rc geninfo_all_blocks=1 00:12:00.797 --rc geninfo_unexecuted_blocks=1 00:12:00.797 00:12:00.797 ' 00:12:00.797 02:14:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:00.797 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:00.797 --rc genhtml_branch_coverage=1 00:12:00.797 --rc genhtml_function_coverage=1 00:12:00.797 --rc genhtml_legend=1 00:12:00.797 --rc geninfo_all_blocks=1 00:12:00.797 --rc geninfo_unexecuted_blocks=1 00:12:00.797 00:12:00.797 ' 00:12:00.797 02:14:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:00.797 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:00.797 --rc genhtml_branch_coverage=1 00:12:00.797 --rc genhtml_function_coverage=1 00:12:00.797 --rc genhtml_legend=1 00:12:00.797 --rc geninfo_all_blocks=1 00:12:00.797 --rc geninfo_unexecuted_blocks=1 00:12:00.797 00:12:00.797 ' 00:12:00.797 02:14:28 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:00.797 02:14:28 -- nvmf/common.sh@7 -- # uname -s 00:12:00.797 02:14:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:00.797 02:14:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:00.797 02:14:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:00.797 02:14:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:00.797 02:14:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:00.797 02:14:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:00.797 02:14:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:00.797 02:14:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:00.797 02:14:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:00.797 02:14:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:00.797 02:14:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:00.797 02:14:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:00.797 02:14:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:00.797 02:14:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:00.797 02:14:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:00.797 02:14:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:00.797 02:14:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:00.797 02:14:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:00.797 02:14:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:00.797 02:14:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:00.797 02:14:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:00.797 02:14:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:00.797 02:14:28 -- paths/export.sh@5 -- # export PATH 00:12:00.797 02:14:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:00.797 02:14:28 -- nvmf/common.sh@46 -- # : 0 00:12:00.797 02:14:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:00.797 02:14:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:00.797 02:14:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:00.797 02:14:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:00.797 02:14:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:00.797 02:14:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:00.797 02:14:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:00.797 02:14:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:00.797 02:14:28 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:12:00.797 02:14:28 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:12:00.797 02:14:28 -- target/abort.sh@14 -- # nvmftestinit 00:12:00.797 02:14:28 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:00.797 02:14:28 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:00.797 02:14:28 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:00.797 02:14:28 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:00.797 02:14:28 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:00.797 02:14:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:00.797 02:14:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:00.797 02:14:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:00.797 02:14:28 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:00.797 02:14:28 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:00.797 02:14:28 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:00.797 02:14:28 -- common/autotest_common.sh@10 -- # set +x 00:12:02.697 02:14:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:02.697 02:14:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:02.697 02:14:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:02.697 02:14:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:02.697 02:14:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:02.697 02:14:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:02.697 02:14:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:02.697 02:14:30 -- nvmf/common.sh@294 -- # net_devs=() 00:12:02.697 02:14:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:02.697 02:14:30 -- nvmf/common.sh@295 -- # e810=() 00:12:02.697 02:14:30 -- nvmf/common.sh@295 -- # local -ga e810 00:12:02.697 02:14:30 -- nvmf/common.sh@296 -- # x722=() 00:12:02.697 02:14:30 -- nvmf/common.sh@296 -- # local -ga x722 00:12:02.697 02:14:30 -- nvmf/common.sh@297 -- # mlx=() 00:12:02.697 02:14:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:02.697 02:14:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:02.697 02:14:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:02.697 02:14:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:02.697 02:14:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:02.697 02:14:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:02.697 02:14:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:02.697 02:14:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:02.697 02:14:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:02.697 02:14:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:02.697 02:14:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:02.697 02:14:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:02.697 02:14:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:02.697 02:14:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:02.697 02:14:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:02.697 02:14:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:02.697 02:14:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:02.697 02:14:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:02.697 02:14:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:02.697 02:14:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:02.697 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:02.697 02:14:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:02.697 02:14:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:02.697 02:14:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:02.697 02:14:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:02.697 02:14:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:02.697 02:14:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:02.697 02:14:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:02.697 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:02.697 02:14:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:02.697 02:14:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:02.697 02:14:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:02.697 02:14:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:02.697 02:14:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:02.697 02:14:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:02.698 02:14:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:02.698 02:14:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:02.698 02:14:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:02.698 02:14:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:02.698 02:14:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:02.698 02:14:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:02.698 02:14:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:02.698 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:02.698 02:14:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:02.698 02:14:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:02.698 02:14:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:02.698 02:14:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:02.698 02:14:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:02.698 02:14:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:02.698 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:02.698 02:14:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:02.698 02:14:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:02.698 02:14:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:02.698 02:14:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:02.698 02:14:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:02.698 02:14:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:02.698 02:14:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:02.698 02:14:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:02.698 02:14:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:02.698 02:14:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:02.698 02:14:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:02.698 02:14:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:02.698 02:14:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:02.698 02:14:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:02.698 02:14:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:02.698 02:14:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:02.698 02:14:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:02.698 02:14:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:02.698 02:14:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:02.956 02:14:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:02.956 02:14:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:02.956 02:14:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:02.956 02:14:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:02.956 02:14:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:02.956 02:14:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:02.956 02:14:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:02.956 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:02.956 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.225 ms 00:12:02.956 00:12:02.956 --- 10.0.0.2 ping statistics --- 00:12:02.956 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:02.956 rtt min/avg/max/mdev = 0.225/0.225/0.225/0.000 ms 00:12:02.956 02:14:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:02.956 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:02.956 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.053 ms 00:12:02.956 00:12:02.956 --- 10.0.0.1 ping statistics --- 00:12:02.956 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:02.956 rtt min/avg/max/mdev = 0.053/0.053/0.053/0.000 ms 00:12:02.956 02:14:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:02.956 02:14:30 -- nvmf/common.sh@410 -- # return 0 00:12:02.957 02:14:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:02.957 02:14:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:02.957 02:14:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:02.957 02:14:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:02.957 02:14:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:02.957 02:14:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:02.957 02:14:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:02.957 02:14:30 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:12:02.957 02:14:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:02.957 02:14:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:02.957 02:14:30 -- common/autotest_common.sh@10 -- # set +x 00:12:02.957 02:14:30 -- nvmf/common.sh@469 -- # nvmfpid=2061869 00:12:02.957 02:14:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:02.957 02:14:30 -- nvmf/common.sh@470 -- # waitforlisten 2061869 00:12:02.957 02:14:30 -- common/autotest_common.sh@829 -- # '[' -z 2061869 ']' 00:12:02.957 02:14:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:02.957 02:14:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:02.957 02:14:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:02.957 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:02.957 02:14:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:02.957 02:14:30 -- common/autotest_common.sh@10 -- # set +x 00:12:02.957 [2024-12-08 02:14:30.658107] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:02.957 [2024-12-08 02:14:30.658201] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:02.957 EAL: No free 2048 kB hugepages reported on node 1 00:12:02.957 [2024-12-08 02:14:30.733978] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:03.216 [2024-12-08 02:14:30.860366] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:03.216 [2024-12-08 02:14:30.860530] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:03.216 [2024-12-08 02:14:30.860559] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:03.216 [2024-12-08 02:14:30.860574] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:03.216 [2024-12-08 02:14:30.860685] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:03.216 [2024-12-08 02:14:30.864566] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:03.216 [2024-12-08 02:14:30.864580] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:04.154 02:14:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:04.154 02:14:31 -- common/autotest_common.sh@862 -- # return 0 00:12:04.154 02:14:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:04.154 02:14:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:04.154 02:14:31 -- common/autotest_common.sh@10 -- # set +x 00:12:04.154 02:14:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:04.154 02:14:31 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:12:04.154 02:14:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:04.154 02:14:31 -- common/autotest_common.sh@10 -- # set +x 00:12:04.154 [2024-12-08 02:14:31.711445] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:04.154 02:14:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:04.154 02:14:31 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:12:04.154 02:14:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:04.154 02:14:31 -- common/autotest_common.sh@10 -- # set +x 00:12:04.154 Malloc0 00:12:04.154 02:14:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:04.154 02:14:31 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:04.154 02:14:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:04.154 02:14:31 -- common/autotest_common.sh@10 -- # set +x 00:12:04.154 Delay0 00:12:04.154 02:14:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:04.154 02:14:31 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:12:04.154 02:14:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:04.154 02:14:31 -- common/autotest_common.sh@10 -- # set +x 00:12:04.154 02:14:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:04.154 02:14:31 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:12:04.154 02:14:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:04.154 02:14:31 -- common/autotest_common.sh@10 -- # set +x 00:12:04.154 02:14:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:04.154 02:14:31 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:12:04.154 02:14:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:04.154 02:14:31 -- common/autotest_common.sh@10 -- # set +x 00:12:04.154 [2024-12-08 02:14:31.782195] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:04.154 02:14:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:04.154 02:14:31 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:04.154 02:14:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:04.154 02:14:31 -- common/autotest_common.sh@10 -- # set +x 00:12:04.154 02:14:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:04.154 02:14:31 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:12:04.154 EAL: No free 2048 kB hugepages reported on node 1 00:12:04.154 [2024-12-08 02:14:31.878394] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:12:06.696 Initializing NVMe Controllers 00:12:06.696 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:12:06.696 controller IO queue size 128 less than required 00:12:06.696 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:12:06.696 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:12:06.696 Initialization complete. Launching workers. 00:12:06.696 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 33675 00:12:06.696 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 33736, failed to submit 62 00:12:06.696 success 33675, unsuccess 61, failed 0 00:12:06.696 02:14:33 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:12:06.696 02:14:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.696 02:14:33 -- common/autotest_common.sh@10 -- # set +x 00:12:06.696 02:14:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.696 02:14:33 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:12:06.696 02:14:33 -- target/abort.sh@38 -- # nvmftestfini 00:12:06.696 02:14:33 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:06.696 02:14:33 -- nvmf/common.sh@116 -- # sync 00:12:06.696 02:14:33 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:06.696 02:14:33 -- nvmf/common.sh@119 -- # set +e 00:12:06.696 02:14:33 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:06.696 02:14:33 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:06.696 rmmod nvme_tcp 00:12:06.696 rmmod nvme_fabrics 00:12:06.696 rmmod nvme_keyring 00:12:06.696 02:14:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:06.696 02:14:34 -- nvmf/common.sh@123 -- # set -e 00:12:06.696 02:14:34 -- nvmf/common.sh@124 -- # return 0 00:12:06.696 02:14:34 -- nvmf/common.sh@477 -- # '[' -n 2061869 ']' 00:12:06.696 02:14:34 -- nvmf/common.sh@478 -- # killprocess 2061869 00:12:06.696 02:14:34 -- common/autotest_common.sh@936 -- # '[' -z 2061869 ']' 00:12:06.696 02:14:34 -- common/autotest_common.sh@940 -- # kill -0 2061869 00:12:06.696 02:14:34 -- common/autotest_common.sh@941 -- # uname 00:12:06.696 02:14:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:06.696 02:14:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2061869 00:12:06.696 02:14:34 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:12:06.696 02:14:34 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:12:06.696 02:14:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2061869' 00:12:06.696 killing process with pid 2061869 00:12:06.696 02:14:34 -- common/autotest_common.sh@955 -- # kill 2061869 00:12:06.696 02:14:34 -- common/autotest_common.sh@960 -- # wait 2061869 00:12:06.696 02:14:34 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:06.696 02:14:34 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:06.696 02:14:34 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:06.696 02:14:34 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:06.696 02:14:34 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:06.696 02:14:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:06.696 02:14:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:06.696 02:14:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:09.234 02:14:36 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:09.234 00:12:09.234 real 0m8.160s 00:12:09.234 user 0m13.113s 00:12:09.234 sys 0m2.526s 00:12:09.234 02:14:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:09.234 02:14:36 -- common/autotest_common.sh@10 -- # set +x 00:12:09.234 ************************************ 00:12:09.234 END TEST nvmf_abort 00:12:09.234 ************************************ 00:12:09.234 02:14:36 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:09.234 02:14:36 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:09.234 02:14:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:09.234 02:14:36 -- common/autotest_common.sh@10 -- # set +x 00:12:09.234 ************************************ 00:12:09.234 START TEST nvmf_ns_hotplug_stress 00:12:09.234 ************************************ 00:12:09.234 02:14:36 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:09.234 * Looking for test storage... 00:12:09.234 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:09.234 02:14:36 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:09.234 02:14:36 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:09.234 02:14:36 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:09.234 02:14:36 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:09.234 02:14:36 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:09.234 02:14:36 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:09.234 02:14:36 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:09.234 02:14:36 -- scripts/common.sh@335 -- # IFS=.-: 00:12:09.234 02:14:36 -- scripts/common.sh@335 -- # read -ra ver1 00:12:09.234 02:14:36 -- scripts/common.sh@336 -- # IFS=.-: 00:12:09.234 02:14:36 -- scripts/common.sh@336 -- # read -ra ver2 00:12:09.234 02:14:36 -- scripts/common.sh@337 -- # local 'op=<' 00:12:09.234 02:14:36 -- scripts/common.sh@339 -- # ver1_l=2 00:12:09.234 02:14:36 -- scripts/common.sh@340 -- # ver2_l=1 00:12:09.234 02:14:36 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:09.234 02:14:36 -- scripts/common.sh@343 -- # case "$op" in 00:12:09.234 02:14:36 -- scripts/common.sh@344 -- # : 1 00:12:09.234 02:14:36 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:09.234 02:14:36 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:09.234 02:14:36 -- scripts/common.sh@364 -- # decimal 1 00:12:09.234 02:14:36 -- scripts/common.sh@352 -- # local d=1 00:12:09.234 02:14:36 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:09.234 02:14:36 -- scripts/common.sh@354 -- # echo 1 00:12:09.234 02:14:36 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:09.234 02:14:36 -- scripts/common.sh@365 -- # decimal 2 00:12:09.234 02:14:36 -- scripts/common.sh@352 -- # local d=2 00:12:09.234 02:14:36 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:09.234 02:14:36 -- scripts/common.sh@354 -- # echo 2 00:12:09.234 02:14:36 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:09.234 02:14:36 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:09.234 02:14:36 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:09.234 02:14:36 -- scripts/common.sh@367 -- # return 0 00:12:09.234 02:14:36 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:09.234 02:14:36 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:09.234 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:09.234 --rc genhtml_branch_coverage=1 00:12:09.234 --rc genhtml_function_coverage=1 00:12:09.234 --rc genhtml_legend=1 00:12:09.234 --rc geninfo_all_blocks=1 00:12:09.234 --rc geninfo_unexecuted_blocks=1 00:12:09.234 00:12:09.234 ' 00:12:09.234 02:14:36 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:09.234 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:09.234 --rc genhtml_branch_coverage=1 00:12:09.234 --rc genhtml_function_coverage=1 00:12:09.234 --rc genhtml_legend=1 00:12:09.234 --rc geninfo_all_blocks=1 00:12:09.234 --rc geninfo_unexecuted_blocks=1 00:12:09.234 00:12:09.234 ' 00:12:09.234 02:14:36 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:09.234 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:09.234 --rc genhtml_branch_coverage=1 00:12:09.234 --rc genhtml_function_coverage=1 00:12:09.234 --rc genhtml_legend=1 00:12:09.234 --rc geninfo_all_blocks=1 00:12:09.234 --rc geninfo_unexecuted_blocks=1 00:12:09.234 00:12:09.234 ' 00:12:09.234 02:14:36 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:09.234 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:09.234 --rc genhtml_branch_coverage=1 00:12:09.234 --rc genhtml_function_coverage=1 00:12:09.234 --rc genhtml_legend=1 00:12:09.234 --rc geninfo_all_blocks=1 00:12:09.234 --rc geninfo_unexecuted_blocks=1 00:12:09.234 00:12:09.234 ' 00:12:09.234 02:14:36 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:09.234 02:14:36 -- nvmf/common.sh@7 -- # uname -s 00:12:09.234 02:14:36 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:09.234 02:14:36 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:09.234 02:14:36 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:09.234 02:14:36 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:09.234 02:14:36 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:09.234 02:14:36 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:09.234 02:14:36 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:09.234 02:14:36 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:09.234 02:14:36 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:09.234 02:14:36 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:09.234 02:14:36 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:09.234 02:14:36 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:09.234 02:14:36 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:09.234 02:14:36 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:09.234 02:14:36 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:09.234 02:14:36 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:09.234 02:14:36 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:09.234 02:14:36 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:09.234 02:14:36 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:09.234 02:14:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:09.234 02:14:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:09.234 02:14:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:09.234 02:14:36 -- paths/export.sh@5 -- # export PATH 00:12:09.234 02:14:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:09.234 02:14:36 -- nvmf/common.sh@46 -- # : 0 00:12:09.234 02:14:36 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:09.234 02:14:36 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:09.234 02:14:36 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:09.234 02:14:36 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:09.234 02:14:36 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:09.234 02:14:36 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:09.234 02:14:36 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:09.234 02:14:36 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:09.234 02:14:36 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:09.235 02:14:36 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:12:09.235 02:14:36 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:09.235 02:14:36 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:09.235 02:14:36 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:09.235 02:14:36 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:09.235 02:14:36 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:09.235 02:14:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:09.235 02:14:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:09.235 02:14:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:09.235 02:14:36 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:09.235 02:14:36 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:09.235 02:14:36 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:09.235 02:14:36 -- common/autotest_common.sh@10 -- # set +x 00:12:11.144 02:14:38 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:11.144 02:14:38 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:11.144 02:14:38 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:11.144 02:14:38 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:11.144 02:14:38 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:11.144 02:14:38 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:11.144 02:14:38 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:11.144 02:14:38 -- nvmf/common.sh@294 -- # net_devs=() 00:12:11.144 02:14:38 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:11.144 02:14:38 -- nvmf/common.sh@295 -- # e810=() 00:12:11.144 02:14:38 -- nvmf/common.sh@295 -- # local -ga e810 00:12:11.144 02:14:38 -- nvmf/common.sh@296 -- # x722=() 00:12:11.144 02:14:38 -- nvmf/common.sh@296 -- # local -ga x722 00:12:11.144 02:14:38 -- nvmf/common.sh@297 -- # mlx=() 00:12:11.144 02:14:38 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:11.144 02:14:38 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:11.144 02:14:38 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:11.144 02:14:38 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:11.144 02:14:38 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:11.144 02:14:38 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:11.144 02:14:38 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:11.144 02:14:38 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:11.144 02:14:38 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:11.144 02:14:38 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:11.144 02:14:38 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:11.144 02:14:38 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:11.144 02:14:38 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:11.144 02:14:38 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:11.144 02:14:38 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:11.144 02:14:38 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:11.144 02:14:38 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:11.144 02:14:38 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:11.144 02:14:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:11.144 02:14:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:11.144 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:11.144 02:14:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:11.144 02:14:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:11.144 02:14:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:11.145 02:14:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:11.145 02:14:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:11.145 02:14:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:11.145 02:14:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:11.145 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:11.145 02:14:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:11.145 02:14:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:11.145 02:14:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:11.145 02:14:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:11.145 02:14:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:11.145 02:14:38 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:11.145 02:14:38 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:11.145 02:14:38 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:11.145 02:14:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:11.145 02:14:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:11.145 02:14:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:11.145 02:14:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:11.145 02:14:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:11.145 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:11.145 02:14:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:11.145 02:14:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:11.145 02:14:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:11.145 02:14:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:11.145 02:14:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:11.145 02:14:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:11.145 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:11.145 02:14:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:11.145 02:14:38 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:11.145 02:14:38 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:11.145 02:14:38 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:11.145 02:14:38 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:11.145 02:14:38 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:11.145 02:14:38 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:11.145 02:14:38 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:11.145 02:14:38 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:11.145 02:14:38 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:11.145 02:14:38 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:11.145 02:14:38 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:11.145 02:14:38 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:11.145 02:14:38 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:11.145 02:14:38 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:11.145 02:14:38 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:11.145 02:14:38 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:11.145 02:14:38 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:11.145 02:14:38 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:11.145 02:14:38 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:11.145 02:14:38 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:11.145 02:14:38 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:11.145 02:14:38 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:11.145 02:14:38 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:11.145 02:14:38 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:11.145 02:14:38 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:11.145 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:11.145 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.198 ms 00:12:11.145 00:12:11.145 --- 10.0.0.2 ping statistics --- 00:12:11.145 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:11.145 rtt min/avg/max/mdev = 0.198/0.198/0.198/0.000 ms 00:12:11.145 02:14:38 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:11.145 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:11.145 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.105 ms 00:12:11.145 00:12:11.145 --- 10.0.0.1 ping statistics --- 00:12:11.145 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:11.145 rtt min/avg/max/mdev = 0.105/0.105/0.105/0.000 ms 00:12:11.145 02:14:38 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:11.145 02:14:38 -- nvmf/common.sh@410 -- # return 0 00:12:11.145 02:14:38 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:11.145 02:14:38 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:11.145 02:14:38 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:11.145 02:14:38 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:11.145 02:14:38 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:11.145 02:14:38 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:11.145 02:14:38 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:11.145 02:14:38 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:12:11.145 02:14:38 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:11.145 02:14:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:11.145 02:14:38 -- common/autotest_common.sh@10 -- # set +x 00:12:11.145 02:14:38 -- nvmf/common.sh@469 -- # nvmfpid=2064299 00:12:11.145 02:14:38 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:11.145 02:14:38 -- nvmf/common.sh@470 -- # waitforlisten 2064299 00:12:11.145 02:14:38 -- common/autotest_common.sh@829 -- # '[' -z 2064299 ']' 00:12:11.145 02:14:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:11.145 02:14:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:11.145 02:14:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:11.145 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:11.145 02:14:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:11.145 02:14:38 -- common/autotest_common.sh@10 -- # set +x 00:12:11.145 [2024-12-08 02:14:38.916440] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:11.145 [2024-12-08 02:14:38.916518] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:11.405 EAL: No free 2048 kB hugepages reported on node 1 00:12:11.405 [2024-12-08 02:14:38.981478] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:11.405 [2024-12-08 02:14:39.090953] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:11.405 [2024-12-08 02:14:39.091095] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:11.405 [2024-12-08 02:14:39.091112] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:11.405 [2024-12-08 02:14:39.091124] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:11.405 [2024-12-08 02:14:39.091212] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:11.405 [2024-12-08 02:14:39.091277] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:11.405 [2024-12-08 02:14:39.091279] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:12.342 02:14:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:12.342 02:14:39 -- common/autotest_common.sh@862 -- # return 0 00:12:12.342 02:14:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:12.342 02:14:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:12.342 02:14:39 -- common/autotest_common.sh@10 -- # set +x 00:12:12.342 02:14:39 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:12.342 02:14:39 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:12:12.342 02:14:39 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:12:12.599 [2024-12-08 02:14:40.211179] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:12.599 02:14:40 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:12.857 02:14:40 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:13.114 [2024-12-08 02:14:40.710092] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:13.114 02:14:40 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:13.377 02:14:40 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:12:13.635 Malloc0 00:12:13.635 02:14:41 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:13.892 Delay0 00:12:13.892 02:14:41 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:14.157 02:14:41 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:12:14.469 NULL1 00:12:14.469 02:14:42 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:12:14.752 02:14:42 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=2064744 00:12:14.752 02:14:42 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:12:14.752 02:14:42 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2064744 00:12:14.752 02:14:42 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:14.752 EAL: No free 2048 kB hugepages reported on node 1 00:12:14.752 02:14:42 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:15.010 02:14:42 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:12:15.010 02:14:42 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:12:15.267 true 00:12:15.267 02:14:43 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2064744 00:12:15.267 02:14:43 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:15.525 02:14:43 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:15.783 02:14:43 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:12:15.783 02:14:43 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:12:16.042 true 00:12:16.042 02:14:43 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2064744 00:12:16.042 02:14:43 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:16.300 02:14:44 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:16.557 02:14:44 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:12:16.557 02:14:44 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:12:16.814 true 00:12:16.814 02:14:44 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2064744 00:12:16.814 02:14:44 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:18.191 Read completed with error (sct=0, sc=11) 00:12:18.191 02:14:45 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:18.191 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:18.191 02:14:45 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:12:18.191 02:14:45 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:12:18.448 true 00:12:18.448 02:14:46 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2064744 00:12:18.448 02:14:46 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:18.706 02:14:46 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:18.963 02:14:46 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:12:18.963 02:14:46 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:12:19.221 true 00:12:19.221 02:14:46 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2064744 00:12:19.221 02:14:46 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:20.157 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:20.157 02:14:47 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:20.414 02:14:48 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:12:20.414 02:14:48 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:12:20.672 true 00:12:20.672 02:14:48 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2064744 00:12:20.672 02:14:48 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:20.930 02:14:48 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:21.188 02:14:48 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:12:21.188 02:14:48 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:12:21.447 true 00:12:21.447 02:14:49 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2064744 00:12:21.447 02:14:49 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:22.382 02:14:49 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:22.382 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:22.640 02:14:50 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:12:22.640 02:14:50 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:12:22.640 true 00:12:22.901 02:14:50 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2064744 00:12:22.901 02:14:50 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:23.160 02:14:50 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:23.420 02:14:50 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:12:23.420 02:14:50 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:12:23.420 true 00:12:23.679 02:14:51 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2064744 00:12:23.679 02:14:51 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:23.679 02:14:51 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:23.937 02:14:51 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:12:23.937 02:14:51 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:12:24.195 true 00:12:24.195 02:14:51 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2064744 00:12:24.195 02:14:51 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:25.574 02:14:52 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:25.574 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:25.574 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:25.574 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:25.574 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:25.574 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:25.574 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:25.574 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:25.574 02:14:53 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:12:25.574 02:14:53 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:12:25.833 true 00:12:25.833 02:14:53 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2064744 00:12:25.833 02:14:53 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:26.770 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:26.770 02:14:54 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:26.770 02:14:54 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:12:26.770 02:14:54 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:12:27.029 true 00:12:27.029 02:14:54 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2064744 00:12:27.029 02:14:54 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:27.287 02:14:55 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:27.544 02:14:55 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:12:27.544 02:14:55 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:12:27.801 true 00:12:27.801 02:14:55 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2064744 00:12:27.801 02:14:55 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:28.737 02:14:56 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:28.995 02:14:56 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:12:28.995 02:14:56 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:12:29.253 true 00:12:29.253 02:14:56 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2064744 00:12:29.253 02:14:56 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:29.511 02:14:57 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:29.768 02:14:57 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:12:29.768 02:14:57 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:12:30.025 true 00:12:30.025 02:14:57 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2064744 00:12:30.025 02:14:57 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:30.283 02:14:57 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:30.540 02:14:58 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:12:30.540 02:14:58 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:12:30.797 true 00:12:30.797 02:14:58 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2064744 00:12:30.797 02:14:58 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:31.733 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:31.733 02:14:59 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:31.733 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:31.991 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:31.991 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:31.991 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:31.991 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:31.991 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:31.991 02:14:59 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:12:31.991 02:14:59 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:12:32.249 true 00:12:32.249 02:15:00 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2064744 00:12:32.249 02:15:00 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:33.232 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:33.232 02:15:00 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:33.492 02:15:01 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:12:33.492 02:15:01 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:12:33.749 true 00:12:33.749 02:15:01 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2064744 00:12:33.749 02:15:01 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:34.006 02:15:01 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:34.264 02:15:01 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:12:34.264 02:15:01 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:12:34.522 true 00:12:34.522 02:15:02 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2064744 00:12:34.522 02:15:02 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:35.457 02:15:02 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:35.457 02:15:03 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:12:35.457 02:15:03 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:12:35.715 true 00:12:35.715 02:15:03 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2064744 00:12:35.715 02:15:03 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:35.974 02:15:03 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:36.232 02:15:03 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:12:36.232 02:15:03 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:12:36.490 true 00:12:36.490 02:15:04 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2064744 00:12:36.490 02:15:04 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:36.750 02:15:04 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:37.009 02:15:04 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:12:37.009 02:15:04 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:12:37.267 true 00:12:37.267 02:15:04 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2064744 00:12:37.267 02:15:04 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:38.201 02:15:05 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:38.458 02:15:06 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:12:38.458 02:15:06 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:12:38.714 true 00:12:38.714 02:15:06 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2064744 00:12:38.714 02:15:06 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:38.972 02:15:06 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:39.238 02:15:06 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:12:39.238 02:15:06 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:12:39.553 true 00:12:39.553 02:15:07 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2064744 00:12:39.553 02:15:07 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:39.837 02:15:07 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:40.095 02:15:07 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:12:40.095 02:15:07 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:12:40.353 true 00:12:40.353 02:15:08 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2064744 00:12:40.353 02:15:08 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:41.290 02:15:09 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:41.549 02:15:09 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:12:41.549 02:15:09 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:12:41.808 true 00:12:41.808 02:15:09 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2064744 00:12:41.808 02:15:09 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:42.066 02:15:09 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:42.325 02:15:10 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:12:42.325 02:15:10 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:12:42.583 true 00:12:42.583 02:15:10 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2064744 00:12:42.583 02:15:10 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:42.841 02:15:10 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:43.100 02:15:10 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:12:43.100 02:15:10 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:12:43.358 true 00:12:43.358 02:15:11 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2064744 00:12:43.358 02:15:11 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:44.734 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:44.734 02:15:12 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:44.734 02:15:12 -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:12:44.734 02:15:12 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:12:44.992 Initializing NVMe Controllers 00:12:44.992 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:12:44.992 Controller IO queue size 128, less than required. 00:12:44.992 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:12:44.992 Controller IO queue size 128, less than required. 00:12:44.992 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:12:44.992 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:12:44.992 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:12:44.992 Initialization complete. Launching workers. 00:12:44.992 ======================================================== 00:12:44.992 Latency(us) 00:12:44.992 Device Information : IOPS MiB/s Average min max 00:12:44.992 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 748.14 0.37 76877.85 2788.78 1084035.65 00:12:44.992 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 10295.09 5.03 12396.38 1593.94 371909.46 00:12:44.992 ======================================================== 00:12:44.992 Total : 11043.23 5.39 16764.77 1593.94 1084035.65 00:12:44.992 00:12:44.992 true 00:12:44.992 02:15:12 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2064744 00:12:44.992 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (2064744) - No such process 00:12:44.992 02:15:12 -- target/ns_hotplug_stress.sh@53 -- # wait 2064744 00:12:44.992 02:15:12 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:45.251 02:15:12 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:45.509 02:15:13 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:12:45.509 02:15:13 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:12:45.509 02:15:13 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:12:45.509 02:15:13 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:45.509 02:15:13 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:12:45.767 null0 00:12:45.767 02:15:13 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:45.767 02:15:13 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:45.767 02:15:13 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:12:46.025 null1 00:12:46.025 02:15:13 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:46.025 02:15:13 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:46.025 02:15:13 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:12:46.283 null2 00:12:46.283 02:15:13 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:46.283 02:15:13 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:46.283 02:15:13 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:12:46.541 null3 00:12:46.541 02:15:14 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:46.541 02:15:14 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:46.541 02:15:14 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:12:46.799 null4 00:12:46.799 02:15:14 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:46.799 02:15:14 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:46.799 02:15:14 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:12:47.057 null5 00:12:47.057 02:15:14 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:47.057 02:15:14 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:47.057 02:15:14 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:12:47.315 null6 00:12:47.315 02:15:14 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:47.315 02:15:14 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:47.315 02:15:14 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:12:47.571 null7 00:12:47.571 02:15:15 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:47.571 02:15:15 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:47.571 02:15:15 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:12:47.571 02:15:15 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:47.571 02:15:15 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:47.571 02:15:15 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:47.571 02:15:15 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:47.571 02:15:15 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:12:47.571 02:15:15 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:12:47.571 02:15:15 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:47.571 02:15:15 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:47.571 02:15:15 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:47.571 02:15:15 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:12:47.571 02:15:15 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:47.571 02:15:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.571 02:15:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:47.571 02:15:15 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:12:47.571 02:15:15 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:47.571 02:15:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.571 02:15:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:47.571 02:15:15 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:47.571 02:15:15 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:47.571 02:15:15 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:47.571 02:15:15 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:12:47.571 02:15:15 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:12:47.571 02:15:15 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:47.571 02:15:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.571 02:15:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:47.571 02:15:15 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:47.571 02:15:15 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:12:47.571 02:15:15 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@66 -- # wait 2069396 2069397 2069398 2069401 2069403 2069405 2069407 2069409 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.572 02:15:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:47.828 02:15:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:47.828 02:15:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:47.828 02:15:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:47.828 02:15:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:47.828 02:15:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:47.828 02:15:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:47.828 02:15:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:47.828 02:15:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:48.086 02:15:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.086 02:15:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.086 02:15:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:48.086 02:15:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.086 02:15:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.086 02:15:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:48.086 02:15:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.086 02:15:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.086 02:15:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:48.086 02:15:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.086 02:15:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.086 02:15:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:48.086 02:15:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.086 02:15:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.086 02:15:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:48.086 02:15:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.086 02:15:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.086 02:15:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.086 02:15:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.086 02:15:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:48.086 02:15:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:48.086 02:15:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.086 02:15:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.086 02:15:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:48.343 02:15:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:48.343 02:15:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:48.343 02:15:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:48.343 02:15:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:48.343 02:15:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:48.343 02:15:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:48.343 02:15:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:48.343 02:15:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:48.600 02:15:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.600 02:15:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.600 02:15:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:48.600 02:15:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.600 02:15:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.600 02:15:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:48.601 02:15:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.601 02:15:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.601 02:15:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:48.601 02:15:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.601 02:15:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.601 02:15:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:48.601 02:15:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.601 02:15:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.601 02:15:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:48.601 02:15:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.601 02:15:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.601 02:15:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:48.601 02:15:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.601 02:15:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.601 02:15:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:48.601 02:15:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.601 02:15:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.601 02:15:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:48.859 02:15:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:48.859 02:15:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:48.859 02:15:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:48.859 02:15:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:48.859 02:15:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:48.859 02:15:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:48.859 02:15:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:48.859 02:15:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:49.116 02:15:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.116 02:15:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.116 02:15:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:49.116 02:15:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.116 02:15:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.116 02:15:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:49.116 02:15:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.116 02:15:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.116 02:15:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:49.116 02:15:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.116 02:15:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.116 02:15:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:49.116 02:15:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.116 02:15:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.116 02:15:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:49.387 02:15:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.387 02:15:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.387 02:15:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.387 02:15:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.387 02:15:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:49.387 02:15:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:49.387 02:15:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.387 02:15:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.387 02:15:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:49.387 02:15:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:49.646 02:15:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:49.646 02:15:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:49.646 02:15:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:49.646 02:15:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:49.646 02:15:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:49.646 02:15:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:49.646 02:15:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:49.904 02:15:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.904 02:15:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.904 02:15:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:49.904 02:15:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.904 02:15:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.904 02:15:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:49.904 02:15:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.905 02:15:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.905 02:15:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:49.905 02:15:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.905 02:15:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.905 02:15:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.905 02:15:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.905 02:15:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:49.905 02:15:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:49.905 02:15:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.905 02:15:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.905 02:15:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:49.905 02:15:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.905 02:15:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.905 02:15:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:49.905 02:15:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.905 02:15:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.905 02:15:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:50.163 02:15:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:50.163 02:15:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:50.163 02:15:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:50.163 02:15:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:50.163 02:15:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:50.163 02:15:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:50.163 02:15:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:50.163 02:15:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:50.422 02:15:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.422 02:15:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.422 02:15:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:50.422 02:15:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.422 02:15:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.422 02:15:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:50.422 02:15:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.422 02:15:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.422 02:15:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:50.422 02:15:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.422 02:15:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.422 02:15:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.422 02:15:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.422 02:15:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:50.422 02:15:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:50.422 02:15:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.422 02:15:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.422 02:15:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:50.422 02:15:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.422 02:15:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.422 02:15:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:50.422 02:15:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.422 02:15:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.422 02:15:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:50.680 02:15:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:50.680 02:15:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:50.680 02:15:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:50.680 02:15:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:50.680 02:15:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:50.680 02:15:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:50.680 02:15:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:50.680 02:15:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:50.938 02:15:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.938 02:15:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.938 02:15:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:50.938 02:15:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.938 02:15:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.938 02:15:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:50.938 02:15:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.938 02:15:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.938 02:15:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:50.938 02:15:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.938 02:15:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.938 02:15:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:50.938 02:15:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.938 02:15:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.938 02:15:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:50.938 02:15:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.938 02:15:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.938 02:15:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:50.938 02:15:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.938 02:15:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.938 02:15:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:50.938 02:15:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.938 02:15:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.938 02:15:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:51.197 02:15:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:51.197 02:15:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:51.197 02:15:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:51.197 02:15:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:51.197 02:15:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:51.197 02:15:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:51.198 02:15:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:51.198 02:15:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:51.469 02:15:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:51.469 02:15:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:51.469 02:15:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:51.469 02:15:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:51.469 02:15:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:51.469 02:15:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:51.469 02:15:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:51.469 02:15:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:51.469 02:15:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:51.469 02:15:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:51.469 02:15:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:51.469 02:15:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:51.469 02:15:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:51.469 02:15:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:51.469 02:15:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:51.469 02:15:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:51.469 02:15:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:51.469 02:15:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:51.469 02:15:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:51.469 02:15:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:51.469 02:15:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:51.469 02:15:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:51.469 02:15:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:51.469 02:15:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:51.728 02:15:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:51.728 02:15:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:51.728 02:15:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:51.728 02:15:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:51.728 02:15:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:51.728 02:15:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:51.728 02:15:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:51.728 02:15:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:51.986 02:15:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:51.986 02:15:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:51.986 02:15:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:51.986 02:15:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:51.986 02:15:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:51.986 02:15:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:51.986 02:15:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:51.986 02:15:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:51.986 02:15:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:51.986 02:15:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:51.986 02:15:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:51.987 02:15:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:51.987 02:15:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:51.987 02:15:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:51.987 02:15:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:51.987 02:15:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:51.987 02:15:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:51.987 02:15:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:51.987 02:15:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:51.987 02:15:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:51.987 02:15:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:51.987 02:15:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:51.987 02:15:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:51.987 02:15:19 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:52.245 02:15:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:52.245 02:15:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:52.245 02:15:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:52.245 02:15:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:52.245 02:15:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:52.245 02:15:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:52.245 02:15:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:52.245 02:15:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:52.503 02:15:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:52.503 02:15:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:52.503 02:15:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:52.503 02:15:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:52.503 02:15:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:52.503 02:15:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:52.503 02:15:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:52.503 02:15:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:52.503 02:15:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:52.503 02:15:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:52.504 02:15:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:52.504 02:15:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:52.504 02:15:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:52.504 02:15:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:52.504 02:15:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:52.504 02:15:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:52.504 02:15:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:52.504 02:15:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:52.504 02:15:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:52.504 02:15:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:52.504 02:15:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:52.504 02:15:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:52.504 02:15:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:52.504 02:15:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:52.762 02:15:20 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:52.762 02:15:20 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:52.762 02:15:20 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:52.762 02:15:20 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:52.762 02:15:20 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:52.762 02:15:20 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:52.762 02:15:20 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:53.020 02:15:20 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:53.278 02:15:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:53.278 02:15:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:53.278 02:15:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:53.278 02:15:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:53.278 02:15:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:53.278 02:15:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:53.278 02:15:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:53.278 02:15:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:53.278 02:15:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:53.278 02:15:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:53.278 02:15:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:53.278 02:15:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:53.278 02:15:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:53.278 02:15:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:53.278 02:15:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:53.278 02:15:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:53.278 02:15:20 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:12:53.278 02:15:20 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:12:53.278 02:15:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:53.278 02:15:20 -- nvmf/common.sh@116 -- # sync 00:12:53.278 02:15:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:53.278 02:15:20 -- nvmf/common.sh@119 -- # set +e 00:12:53.278 02:15:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:53.278 02:15:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:53.278 rmmod nvme_tcp 00:12:53.278 rmmod nvme_fabrics 00:12:53.278 rmmod nvme_keyring 00:12:53.278 02:15:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:53.278 02:15:20 -- nvmf/common.sh@123 -- # set -e 00:12:53.278 02:15:20 -- nvmf/common.sh@124 -- # return 0 00:12:53.278 02:15:20 -- nvmf/common.sh@477 -- # '[' -n 2064299 ']' 00:12:53.278 02:15:20 -- nvmf/common.sh@478 -- # killprocess 2064299 00:12:53.278 02:15:20 -- common/autotest_common.sh@936 -- # '[' -z 2064299 ']' 00:12:53.278 02:15:20 -- common/autotest_common.sh@940 -- # kill -0 2064299 00:12:53.278 02:15:20 -- common/autotest_common.sh@941 -- # uname 00:12:53.278 02:15:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:53.278 02:15:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2064299 00:12:53.278 02:15:20 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:12:53.278 02:15:20 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:12:53.278 02:15:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2064299' 00:12:53.278 killing process with pid 2064299 00:12:53.278 02:15:20 -- common/autotest_common.sh@955 -- # kill 2064299 00:12:53.278 02:15:20 -- common/autotest_common.sh@960 -- # wait 2064299 00:12:53.537 02:15:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:53.537 02:15:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:53.537 02:15:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:53.537 02:15:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:53.537 02:15:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:53.537 02:15:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:53.537 02:15:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:53.537 02:15:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:56.067 02:15:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:56.067 00:12:56.067 real 0m46.812s 00:12:56.067 user 3m34.041s 00:12:56.067 sys 0m15.400s 00:12:56.067 02:15:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:56.067 02:15:23 -- common/autotest_common.sh@10 -- # set +x 00:12:56.067 ************************************ 00:12:56.067 END TEST nvmf_ns_hotplug_stress 00:12:56.067 ************************************ 00:12:56.067 02:15:23 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:12:56.067 02:15:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:56.067 02:15:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:56.067 02:15:23 -- common/autotest_common.sh@10 -- # set +x 00:12:56.067 ************************************ 00:12:56.067 START TEST nvmf_connect_stress 00:12:56.067 ************************************ 00:12:56.067 02:15:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:12:56.067 * Looking for test storage... 00:12:56.067 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:56.067 02:15:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:56.067 02:15:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:56.067 02:15:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:56.067 02:15:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:56.067 02:15:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:56.067 02:15:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:56.067 02:15:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:56.067 02:15:23 -- scripts/common.sh@335 -- # IFS=.-: 00:12:56.067 02:15:23 -- scripts/common.sh@335 -- # read -ra ver1 00:12:56.067 02:15:23 -- scripts/common.sh@336 -- # IFS=.-: 00:12:56.067 02:15:23 -- scripts/common.sh@336 -- # read -ra ver2 00:12:56.067 02:15:23 -- scripts/common.sh@337 -- # local 'op=<' 00:12:56.067 02:15:23 -- scripts/common.sh@339 -- # ver1_l=2 00:12:56.067 02:15:23 -- scripts/common.sh@340 -- # ver2_l=1 00:12:56.067 02:15:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:56.067 02:15:23 -- scripts/common.sh@343 -- # case "$op" in 00:12:56.067 02:15:23 -- scripts/common.sh@344 -- # : 1 00:12:56.067 02:15:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:56.067 02:15:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:56.067 02:15:23 -- scripts/common.sh@364 -- # decimal 1 00:12:56.067 02:15:23 -- scripts/common.sh@352 -- # local d=1 00:12:56.067 02:15:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:56.067 02:15:23 -- scripts/common.sh@354 -- # echo 1 00:12:56.067 02:15:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:56.067 02:15:23 -- scripts/common.sh@365 -- # decimal 2 00:12:56.067 02:15:23 -- scripts/common.sh@352 -- # local d=2 00:12:56.067 02:15:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:56.067 02:15:23 -- scripts/common.sh@354 -- # echo 2 00:12:56.067 02:15:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:56.067 02:15:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:56.067 02:15:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:56.067 02:15:23 -- scripts/common.sh@367 -- # return 0 00:12:56.067 02:15:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:56.067 02:15:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:56.067 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:56.068 --rc genhtml_branch_coverage=1 00:12:56.068 --rc genhtml_function_coverage=1 00:12:56.068 --rc genhtml_legend=1 00:12:56.068 --rc geninfo_all_blocks=1 00:12:56.068 --rc geninfo_unexecuted_blocks=1 00:12:56.068 00:12:56.068 ' 00:12:56.068 02:15:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:56.068 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:56.068 --rc genhtml_branch_coverage=1 00:12:56.068 --rc genhtml_function_coverage=1 00:12:56.068 --rc genhtml_legend=1 00:12:56.068 --rc geninfo_all_blocks=1 00:12:56.068 --rc geninfo_unexecuted_blocks=1 00:12:56.068 00:12:56.068 ' 00:12:56.068 02:15:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:56.068 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:56.068 --rc genhtml_branch_coverage=1 00:12:56.068 --rc genhtml_function_coverage=1 00:12:56.068 --rc genhtml_legend=1 00:12:56.068 --rc geninfo_all_blocks=1 00:12:56.068 --rc geninfo_unexecuted_blocks=1 00:12:56.068 00:12:56.068 ' 00:12:56.068 02:15:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:56.068 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:56.068 --rc genhtml_branch_coverage=1 00:12:56.068 --rc genhtml_function_coverage=1 00:12:56.068 --rc genhtml_legend=1 00:12:56.068 --rc geninfo_all_blocks=1 00:12:56.068 --rc geninfo_unexecuted_blocks=1 00:12:56.068 00:12:56.068 ' 00:12:56.068 02:15:23 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:56.068 02:15:23 -- nvmf/common.sh@7 -- # uname -s 00:12:56.068 02:15:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:56.068 02:15:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:56.068 02:15:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:56.068 02:15:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:56.068 02:15:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:56.068 02:15:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:56.068 02:15:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:56.068 02:15:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:56.068 02:15:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:56.068 02:15:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:56.068 02:15:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:56.068 02:15:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:56.068 02:15:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:56.068 02:15:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:56.068 02:15:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:56.068 02:15:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:56.068 02:15:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:56.068 02:15:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:56.068 02:15:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:56.068 02:15:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:56.068 02:15:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:56.068 02:15:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:56.068 02:15:23 -- paths/export.sh@5 -- # export PATH 00:12:56.068 02:15:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:56.068 02:15:23 -- nvmf/common.sh@46 -- # : 0 00:12:56.068 02:15:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:56.068 02:15:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:56.068 02:15:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:56.068 02:15:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:56.068 02:15:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:56.068 02:15:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:56.068 02:15:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:56.068 02:15:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:56.068 02:15:23 -- target/connect_stress.sh@12 -- # nvmftestinit 00:12:56.068 02:15:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:56.068 02:15:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:56.068 02:15:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:56.068 02:15:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:56.068 02:15:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:56.068 02:15:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:56.068 02:15:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:56.068 02:15:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:56.068 02:15:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:56.068 02:15:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:56.068 02:15:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:56.068 02:15:23 -- common/autotest_common.sh@10 -- # set +x 00:12:57.969 02:15:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:57.969 02:15:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:57.969 02:15:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:57.969 02:15:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:57.969 02:15:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:57.969 02:15:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:57.969 02:15:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:57.969 02:15:25 -- nvmf/common.sh@294 -- # net_devs=() 00:12:57.969 02:15:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:57.969 02:15:25 -- nvmf/common.sh@295 -- # e810=() 00:12:57.969 02:15:25 -- nvmf/common.sh@295 -- # local -ga e810 00:12:57.969 02:15:25 -- nvmf/common.sh@296 -- # x722=() 00:12:57.969 02:15:25 -- nvmf/common.sh@296 -- # local -ga x722 00:12:57.969 02:15:25 -- nvmf/common.sh@297 -- # mlx=() 00:12:57.969 02:15:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:57.969 02:15:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:57.969 02:15:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:57.969 02:15:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:57.969 02:15:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:57.969 02:15:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:57.969 02:15:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:57.969 02:15:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:57.969 02:15:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:57.969 02:15:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:57.969 02:15:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:57.969 02:15:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:57.969 02:15:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:57.969 02:15:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:57.969 02:15:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:57.969 02:15:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:57.969 02:15:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:57.969 02:15:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:57.969 02:15:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:57.969 02:15:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:57.969 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:57.969 02:15:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:57.969 02:15:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:57.969 02:15:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:57.969 02:15:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:57.969 02:15:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:57.969 02:15:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:57.969 02:15:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:57.969 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:57.969 02:15:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:57.969 02:15:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:57.969 02:15:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:57.969 02:15:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:57.969 02:15:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:57.969 02:15:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:57.969 02:15:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:57.969 02:15:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:57.969 02:15:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:57.969 02:15:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:57.969 02:15:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:57.969 02:15:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:57.969 02:15:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:57.969 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:57.969 02:15:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:57.969 02:15:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:57.969 02:15:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:57.969 02:15:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:57.969 02:15:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:57.969 02:15:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:57.969 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:57.969 02:15:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:57.969 02:15:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:57.969 02:15:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:57.969 02:15:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:57.969 02:15:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:57.969 02:15:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:57.969 02:15:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:57.969 02:15:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:57.969 02:15:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:57.969 02:15:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:57.969 02:15:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:57.969 02:15:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:57.969 02:15:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:57.969 02:15:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:57.969 02:15:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:57.969 02:15:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:57.969 02:15:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:57.969 02:15:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:57.969 02:15:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:57.969 02:15:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:57.969 02:15:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:57.969 02:15:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:57.969 02:15:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:57.969 02:15:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:57.969 02:15:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:57.969 02:15:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:57.969 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:57.969 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.135 ms 00:12:57.969 00:12:57.969 --- 10.0.0.2 ping statistics --- 00:12:57.969 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:57.969 rtt min/avg/max/mdev = 0.135/0.135/0.135/0.000 ms 00:12:57.969 02:15:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:57.969 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:57.969 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.125 ms 00:12:57.969 00:12:57.969 --- 10.0.0.1 ping statistics --- 00:12:57.969 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:57.969 rtt min/avg/max/mdev = 0.125/0.125/0.125/0.000 ms 00:12:57.969 02:15:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:57.969 02:15:25 -- nvmf/common.sh@410 -- # return 0 00:12:57.969 02:15:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:57.969 02:15:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:57.969 02:15:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:57.969 02:15:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:57.969 02:15:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:57.969 02:15:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:57.969 02:15:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:57.969 02:15:25 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:12:57.969 02:15:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:57.969 02:15:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:57.969 02:15:25 -- common/autotest_common.sh@10 -- # set +x 00:12:57.969 02:15:25 -- nvmf/common.sh@469 -- # nvmfpid=2072319 00:12:57.969 02:15:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:57.969 02:15:25 -- nvmf/common.sh@470 -- # waitforlisten 2072319 00:12:57.969 02:15:25 -- common/autotest_common.sh@829 -- # '[' -z 2072319 ']' 00:12:57.969 02:15:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:57.969 02:15:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:57.969 02:15:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:57.969 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:57.969 02:15:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:57.969 02:15:25 -- common/autotest_common.sh@10 -- # set +x 00:12:57.969 [2024-12-08 02:15:25.618037] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:57.969 [2024-12-08 02:15:25.618131] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:57.969 EAL: No free 2048 kB hugepages reported on node 1 00:12:57.969 [2024-12-08 02:15:25.687148] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:58.227 [2024-12-08 02:15:25.801363] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:58.227 [2024-12-08 02:15:25.801549] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:58.227 [2024-12-08 02:15:25.801572] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:58.227 [2024-12-08 02:15:25.801588] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:58.227 [2024-12-08 02:15:25.801705] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:58.227 [2024-12-08 02:15:25.801746] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:58.227 [2024-12-08 02:15:25.801749] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:58.791 02:15:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:58.791 02:15:26 -- common/autotest_common.sh@862 -- # return 0 00:12:58.791 02:15:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:58.791 02:15:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:58.791 02:15:26 -- common/autotest_common.sh@10 -- # set +x 00:12:59.049 02:15:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:59.049 02:15:26 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:12:59.049 02:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:59.049 02:15:26 -- common/autotest_common.sh@10 -- # set +x 00:12:59.049 [2024-12-08 02:15:26.596356] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:59.049 02:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:59.049 02:15:26 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:59.049 02:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:59.049 02:15:26 -- common/autotest_common.sh@10 -- # set +x 00:12:59.049 02:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:59.049 02:15:26 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:59.049 02:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:59.049 02:15:26 -- common/autotest_common.sh@10 -- # set +x 00:12:59.049 [2024-12-08 02:15:26.631693] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:59.049 02:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:59.049 02:15:26 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:12:59.049 02:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:59.049 02:15:26 -- common/autotest_common.sh@10 -- # set +x 00:12:59.049 NULL1 00:12:59.049 02:15:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:59.049 02:15:26 -- target/connect_stress.sh@21 -- # PERF_PID=2072412 00:12:59.049 02:15:26 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:12:59.049 02:15:26 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:12:59.049 02:15:26 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:12:59.049 02:15:26 -- target/connect_stress.sh@27 -- # seq 1 20 00:12:59.049 02:15:26 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:59.049 02:15:26 -- target/connect_stress.sh@28 -- # cat 00:12:59.049 02:15:26 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:59.049 02:15:26 -- target/connect_stress.sh@28 -- # cat 00:12:59.049 02:15:26 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:59.049 02:15:26 -- target/connect_stress.sh@28 -- # cat 00:12:59.049 02:15:26 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:59.049 02:15:26 -- target/connect_stress.sh@28 -- # cat 00:12:59.049 02:15:26 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:59.049 02:15:26 -- target/connect_stress.sh@28 -- # cat 00:12:59.049 02:15:26 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:59.049 02:15:26 -- target/connect_stress.sh@28 -- # cat 00:12:59.049 02:15:26 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:59.049 02:15:26 -- target/connect_stress.sh@28 -- # cat 00:12:59.049 02:15:26 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:59.049 02:15:26 -- target/connect_stress.sh@28 -- # cat 00:12:59.049 02:15:26 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:59.049 02:15:26 -- target/connect_stress.sh@28 -- # cat 00:12:59.049 02:15:26 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:59.049 02:15:26 -- target/connect_stress.sh@28 -- # cat 00:12:59.049 EAL: No free 2048 kB hugepages reported on node 1 00:12:59.049 02:15:26 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:59.049 02:15:26 -- target/connect_stress.sh@28 -- # cat 00:12:59.049 02:15:26 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:59.049 02:15:26 -- target/connect_stress.sh@28 -- # cat 00:12:59.049 02:15:26 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:59.049 02:15:26 -- target/connect_stress.sh@28 -- # cat 00:12:59.049 02:15:26 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:59.049 02:15:26 -- target/connect_stress.sh@28 -- # cat 00:12:59.049 02:15:26 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:59.049 02:15:26 -- target/connect_stress.sh@28 -- # cat 00:12:59.049 02:15:26 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:59.049 02:15:26 -- target/connect_stress.sh@28 -- # cat 00:12:59.049 02:15:26 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:59.049 02:15:26 -- target/connect_stress.sh@28 -- # cat 00:12:59.049 02:15:26 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:59.049 02:15:26 -- target/connect_stress.sh@28 -- # cat 00:12:59.049 02:15:26 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:59.049 02:15:26 -- target/connect_stress.sh@28 -- # cat 00:12:59.049 02:15:26 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:59.049 02:15:26 -- target/connect_stress.sh@28 -- # cat 00:12:59.049 02:15:26 -- target/connect_stress.sh@34 -- # kill -0 2072412 00:12:59.049 02:15:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:59.049 02:15:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:59.049 02:15:26 -- common/autotest_common.sh@10 -- # set +x 00:12:59.307 02:15:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:59.307 02:15:27 -- target/connect_stress.sh@34 -- # kill -0 2072412 00:12:59.307 02:15:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:59.307 02:15:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:59.307 02:15:27 -- common/autotest_common.sh@10 -- # set +x 00:12:59.564 02:15:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:59.564 02:15:27 -- target/connect_stress.sh@34 -- # kill -0 2072412 00:12:59.564 02:15:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:59.564 02:15:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:59.564 02:15:27 -- common/autotest_common.sh@10 -- # set +x 00:13:00.130 02:15:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:00.130 02:15:27 -- target/connect_stress.sh@34 -- # kill -0 2072412 00:13:00.130 02:15:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:00.130 02:15:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:00.130 02:15:27 -- common/autotest_common.sh@10 -- # set +x 00:13:00.388 02:15:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:00.388 02:15:27 -- target/connect_stress.sh@34 -- # kill -0 2072412 00:13:00.388 02:15:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:00.388 02:15:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:00.388 02:15:27 -- common/autotest_common.sh@10 -- # set +x 00:13:00.646 02:15:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:00.646 02:15:28 -- target/connect_stress.sh@34 -- # kill -0 2072412 00:13:00.646 02:15:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:00.646 02:15:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:00.646 02:15:28 -- common/autotest_common.sh@10 -- # set +x 00:13:00.903 02:15:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:00.903 02:15:28 -- target/connect_stress.sh@34 -- # kill -0 2072412 00:13:00.903 02:15:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:00.903 02:15:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:00.903 02:15:28 -- common/autotest_common.sh@10 -- # set +x 00:13:01.162 02:15:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:01.162 02:15:28 -- target/connect_stress.sh@34 -- # kill -0 2072412 00:13:01.162 02:15:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:01.162 02:15:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:01.162 02:15:28 -- common/autotest_common.sh@10 -- # set +x 00:13:01.728 02:15:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:01.728 02:15:29 -- target/connect_stress.sh@34 -- # kill -0 2072412 00:13:01.728 02:15:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:01.728 02:15:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:01.728 02:15:29 -- common/autotest_common.sh@10 -- # set +x 00:13:01.986 02:15:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:01.986 02:15:29 -- target/connect_stress.sh@34 -- # kill -0 2072412 00:13:01.986 02:15:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:01.986 02:15:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:01.986 02:15:29 -- common/autotest_common.sh@10 -- # set +x 00:13:02.244 02:15:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.244 02:15:29 -- target/connect_stress.sh@34 -- # kill -0 2072412 00:13:02.244 02:15:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:02.244 02:15:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.244 02:15:29 -- common/autotest_common.sh@10 -- # set +x 00:13:02.502 02:15:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.502 02:15:30 -- target/connect_stress.sh@34 -- # kill -0 2072412 00:13:02.502 02:15:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:02.502 02:15:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.502 02:15:30 -- common/autotest_common.sh@10 -- # set +x 00:13:03.069 02:15:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.069 02:15:30 -- target/connect_stress.sh@34 -- # kill -0 2072412 00:13:03.069 02:15:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:03.069 02:15:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.069 02:15:30 -- common/autotest_common.sh@10 -- # set +x 00:13:03.326 02:15:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.326 02:15:30 -- target/connect_stress.sh@34 -- # kill -0 2072412 00:13:03.327 02:15:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:03.327 02:15:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.327 02:15:30 -- common/autotest_common.sh@10 -- # set +x 00:13:03.584 02:15:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.584 02:15:31 -- target/connect_stress.sh@34 -- # kill -0 2072412 00:13:03.584 02:15:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:03.584 02:15:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.584 02:15:31 -- common/autotest_common.sh@10 -- # set +x 00:13:03.842 02:15:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.842 02:15:31 -- target/connect_stress.sh@34 -- # kill -0 2072412 00:13:03.842 02:15:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:03.842 02:15:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.842 02:15:31 -- common/autotest_common.sh@10 -- # set +x 00:13:04.129 02:15:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:04.129 02:15:31 -- target/connect_stress.sh@34 -- # kill -0 2072412 00:13:04.129 02:15:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:04.129 02:15:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:04.129 02:15:31 -- common/autotest_common.sh@10 -- # set +x 00:13:04.411 02:15:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:04.411 02:15:32 -- target/connect_stress.sh@34 -- # kill -0 2072412 00:13:04.411 02:15:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:04.411 02:15:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:04.411 02:15:32 -- common/autotest_common.sh@10 -- # set +x 00:13:04.977 02:15:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:04.977 02:15:32 -- target/connect_stress.sh@34 -- # kill -0 2072412 00:13:04.977 02:15:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:04.977 02:15:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:04.977 02:15:32 -- common/autotest_common.sh@10 -- # set +x 00:13:05.235 02:15:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.235 02:15:32 -- target/connect_stress.sh@34 -- # kill -0 2072412 00:13:05.235 02:15:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:05.235 02:15:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.235 02:15:32 -- common/autotest_common.sh@10 -- # set +x 00:13:05.493 02:15:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.493 02:15:33 -- target/connect_stress.sh@34 -- # kill -0 2072412 00:13:05.493 02:15:33 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:05.493 02:15:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.493 02:15:33 -- common/autotest_common.sh@10 -- # set +x 00:13:05.751 02:15:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.751 02:15:33 -- target/connect_stress.sh@34 -- # kill -0 2072412 00:13:05.751 02:15:33 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:05.751 02:15:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.751 02:15:33 -- common/autotest_common.sh@10 -- # set +x 00:13:06.009 02:15:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:06.009 02:15:33 -- target/connect_stress.sh@34 -- # kill -0 2072412 00:13:06.009 02:15:33 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:06.009 02:15:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:06.009 02:15:33 -- common/autotest_common.sh@10 -- # set +x 00:13:06.574 02:15:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:06.574 02:15:34 -- target/connect_stress.sh@34 -- # kill -0 2072412 00:13:06.574 02:15:34 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:06.574 02:15:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:06.574 02:15:34 -- common/autotest_common.sh@10 -- # set +x 00:13:06.832 02:15:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:06.832 02:15:34 -- target/connect_stress.sh@34 -- # kill -0 2072412 00:13:06.832 02:15:34 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:06.832 02:15:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:06.832 02:15:34 -- common/autotest_common.sh@10 -- # set +x 00:13:07.090 02:15:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.090 02:15:34 -- target/connect_stress.sh@34 -- # kill -0 2072412 00:13:07.090 02:15:34 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:07.090 02:15:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.090 02:15:34 -- common/autotest_common.sh@10 -- # set +x 00:13:07.348 02:15:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.348 02:15:35 -- target/connect_stress.sh@34 -- # kill -0 2072412 00:13:07.348 02:15:35 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:07.348 02:15:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.348 02:15:35 -- common/autotest_common.sh@10 -- # set +x 00:13:07.605 02:15:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.605 02:15:35 -- target/connect_stress.sh@34 -- # kill -0 2072412 00:13:07.605 02:15:35 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:07.605 02:15:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.605 02:15:35 -- common/autotest_common.sh@10 -- # set +x 00:13:08.169 02:15:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:08.169 02:15:35 -- target/connect_stress.sh@34 -- # kill -0 2072412 00:13:08.169 02:15:35 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:08.169 02:15:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:08.169 02:15:35 -- common/autotest_common.sh@10 -- # set +x 00:13:08.426 02:15:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:08.426 02:15:36 -- target/connect_stress.sh@34 -- # kill -0 2072412 00:13:08.426 02:15:36 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:08.426 02:15:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:08.426 02:15:36 -- common/autotest_common.sh@10 -- # set +x 00:13:08.682 02:15:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:08.682 02:15:36 -- target/connect_stress.sh@34 -- # kill -0 2072412 00:13:08.682 02:15:36 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:08.682 02:15:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:08.682 02:15:36 -- common/autotest_common.sh@10 -- # set +x 00:13:08.939 02:15:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:08.939 02:15:36 -- target/connect_stress.sh@34 -- # kill -0 2072412 00:13:08.939 02:15:36 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:08.939 02:15:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:08.939 02:15:36 -- common/autotest_common.sh@10 -- # set +x 00:13:09.196 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:09.196 02:15:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:09.196 02:15:36 -- target/connect_stress.sh@34 -- # kill -0 2072412 00:13:09.196 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (2072412) - No such process 00:13:09.196 02:15:36 -- target/connect_stress.sh@38 -- # wait 2072412 00:13:09.196 02:15:36 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:09.196 02:15:36 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:13:09.196 02:15:36 -- target/connect_stress.sh@43 -- # nvmftestfini 00:13:09.196 02:15:36 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:09.196 02:15:36 -- nvmf/common.sh@116 -- # sync 00:13:09.455 02:15:36 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:09.455 02:15:36 -- nvmf/common.sh@119 -- # set +e 00:13:09.455 02:15:36 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:09.455 02:15:36 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:09.455 rmmod nvme_tcp 00:13:09.455 rmmod nvme_fabrics 00:13:09.455 rmmod nvme_keyring 00:13:09.455 02:15:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:09.455 02:15:37 -- nvmf/common.sh@123 -- # set -e 00:13:09.455 02:15:37 -- nvmf/common.sh@124 -- # return 0 00:13:09.455 02:15:37 -- nvmf/common.sh@477 -- # '[' -n 2072319 ']' 00:13:09.455 02:15:37 -- nvmf/common.sh@478 -- # killprocess 2072319 00:13:09.455 02:15:37 -- common/autotest_common.sh@936 -- # '[' -z 2072319 ']' 00:13:09.455 02:15:37 -- common/autotest_common.sh@940 -- # kill -0 2072319 00:13:09.455 02:15:37 -- common/autotest_common.sh@941 -- # uname 00:13:09.455 02:15:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:09.455 02:15:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2072319 00:13:09.455 02:15:37 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:09.455 02:15:37 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:09.455 02:15:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2072319' 00:13:09.455 killing process with pid 2072319 00:13:09.455 02:15:37 -- common/autotest_common.sh@955 -- # kill 2072319 00:13:09.455 02:15:37 -- common/autotest_common.sh@960 -- # wait 2072319 00:13:09.713 02:15:37 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:09.713 02:15:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:09.713 02:15:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:09.713 02:15:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:09.713 02:15:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:09.713 02:15:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:09.713 02:15:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:09.713 02:15:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:11.613 02:15:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:11.613 00:13:11.613 real 0m16.118s 00:13:11.613 user 0m41.019s 00:13:11.613 sys 0m5.650s 00:13:11.613 02:15:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:11.613 02:15:39 -- common/autotest_common.sh@10 -- # set +x 00:13:11.613 ************************************ 00:13:11.613 END TEST nvmf_connect_stress 00:13:11.613 ************************************ 00:13:11.871 02:15:39 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:11.871 02:15:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:11.871 02:15:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:11.871 02:15:39 -- common/autotest_common.sh@10 -- # set +x 00:13:11.871 ************************************ 00:13:11.871 START TEST nvmf_fused_ordering 00:13:11.871 ************************************ 00:13:11.871 02:15:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:11.871 * Looking for test storage... 00:13:11.871 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:11.871 02:15:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:11.871 02:15:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:11.871 02:15:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:11.871 02:15:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:11.871 02:15:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:11.871 02:15:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:11.871 02:15:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:11.871 02:15:39 -- scripts/common.sh@335 -- # IFS=.-: 00:13:11.871 02:15:39 -- scripts/common.sh@335 -- # read -ra ver1 00:13:11.871 02:15:39 -- scripts/common.sh@336 -- # IFS=.-: 00:13:11.871 02:15:39 -- scripts/common.sh@336 -- # read -ra ver2 00:13:11.871 02:15:39 -- scripts/common.sh@337 -- # local 'op=<' 00:13:11.871 02:15:39 -- scripts/common.sh@339 -- # ver1_l=2 00:13:11.871 02:15:39 -- scripts/common.sh@340 -- # ver2_l=1 00:13:11.871 02:15:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:11.871 02:15:39 -- scripts/common.sh@343 -- # case "$op" in 00:13:11.871 02:15:39 -- scripts/common.sh@344 -- # : 1 00:13:11.871 02:15:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:11.871 02:15:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:11.871 02:15:39 -- scripts/common.sh@364 -- # decimal 1 00:13:11.871 02:15:39 -- scripts/common.sh@352 -- # local d=1 00:13:11.871 02:15:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:11.871 02:15:39 -- scripts/common.sh@354 -- # echo 1 00:13:11.871 02:15:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:11.871 02:15:39 -- scripts/common.sh@365 -- # decimal 2 00:13:11.871 02:15:39 -- scripts/common.sh@352 -- # local d=2 00:13:11.871 02:15:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:11.871 02:15:39 -- scripts/common.sh@354 -- # echo 2 00:13:11.871 02:15:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:11.871 02:15:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:11.871 02:15:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:11.871 02:15:39 -- scripts/common.sh@367 -- # return 0 00:13:11.871 02:15:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:11.871 02:15:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:11.871 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:11.871 --rc genhtml_branch_coverage=1 00:13:11.871 --rc genhtml_function_coverage=1 00:13:11.871 --rc genhtml_legend=1 00:13:11.871 --rc geninfo_all_blocks=1 00:13:11.871 --rc geninfo_unexecuted_blocks=1 00:13:11.871 00:13:11.871 ' 00:13:11.871 02:15:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:11.871 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:11.871 --rc genhtml_branch_coverage=1 00:13:11.871 --rc genhtml_function_coverage=1 00:13:11.871 --rc genhtml_legend=1 00:13:11.871 --rc geninfo_all_blocks=1 00:13:11.871 --rc geninfo_unexecuted_blocks=1 00:13:11.871 00:13:11.871 ' 00:13:11.871 02:15:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:11.871 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:11.871 --rc genhtml_branch_coverage=1 00:13:11.871 --rc genhtml_function_coverage=1 00:13:11.871 --rc genhtml_legend=1 00:13:11.871 --rc geninfo_all_blocks=1 00:13:11.871 --rc geninfo_unexecuted_blocks=1 00:13:11.871 00:13:11.871 ' 00:13:11.871 02:15:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:11.871 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:11.871 --rc genhtml_branch_coverage=1 00:13:11.871 --rc genhtml_function_coverage=1 00:13:11.871 --rc genhtml_legend=1 00:13:11.871 --rc geninfo_all_blocks=1 00:13:11.871 --rc geninfo_unexecuted_blocks=1 00:13:11.871 00:13:11.871 ' 00:13:11.871 02:15:39 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:11.871 02:15:39 -- nvmf/common.sh@7 -- # uname -s 00:13:11.871 02:15:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:11.871 02:15:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:11.871 02:15:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:11.871 02:15:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:11.871 02:15:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:11.871 02:15:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:11.871 02:15:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:11.871 02:15:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:11.871 02:15:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:11.871 02:15:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:11.871 02:15:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:11.871 02:15:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:11.871 02:15:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:11.871 02:15:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:11.871 02:15:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:11.871 02:15:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:11.871 02:15:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:11.871 02:15:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:11.871 02:15:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:11.871 02:15:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:11.871 02:15:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:11.872 02:15:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:11.872 02:15:39 -- paths/export.sh@5 -- # export PATH 00:13:11.872 02:15:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:11.872 02:15:39 -- nvmf/common.sh@46 -- # : 0 00:13:11.872 02:15:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:11.872 02:15:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:11.872 02:15:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:11.872 02:15:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:11.872 02:15:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:11.872 02:15:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:11.872 02:15:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:11.872 02:15:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:11.872 02:15:39 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:13:11.872 02:15:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:11.872 02:15:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:11.872 02:15:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:11.872 02:15:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:11.872 02:15:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:11.872 02:15:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:11.872 02:15:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:11.872 02:15:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:11.872 02:15:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:11.872 02:15:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:11.872 02:15:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:11.872 02:15:39 -- common/autotest_common.sh@10 -- # set +x 00:13:13.772 02:15:41 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:13.772 02:15:41 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:13.772 02:15:41 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:13.772 02:15:41 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:13.772 02:15:41 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:13.772 02:15:41 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:13.772 02:15:41 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:13.772 02:15:41 -- nvmf/common.sh@294 -- # net_devs=() 00:13:13.772 02:15:41 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:13.772 02:15:41 -- nvmf/common.sh@295 -- # e810=() 00:13:13.772 02:15:41 -- nvmf/common.sh@295 -- # local -ga e810 00:13:13.772 02:15:41 -- nvmf/common.sh@296 -- # x722=() 00:13:13.772 02:15:41 -- nvmf/common.sh@296 -- # local -ga x722 00:13:13.772 02:15:41 -- nvmf/common.sh@297 -- # mlx=() 00:13:13.772 02:15:41 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:13.772 02:15:41 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:13.772 02:15:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:13.772 02:15:41 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:13.772 02:15:41 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:13.773 02:15:41 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:13.773 02:15:41 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:13.773 02:15:41 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:13.773 02:15:41 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:13.773 02:15:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:13.773 02:15:41 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:13.773 02:15:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:13.773 02:15:41 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:13.773 02:15:41 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:13.773 02:15:41 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:13.773 02:15:41 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:13.773 02:15:41 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:13.773 02:15:41 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:13.773 02:15:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:13.773 02:15:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:13.773 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:13.773 02:15:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:13.773 02:15:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:13.773 02:15:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:13.773 02:15:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:13.773 02:15:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:13.773 02:15:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:13.773 02:15:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:13.773 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:13.773 02:15:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:13.773 02:15:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:13.773 02:15:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:13.773 02:15:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:13.773 02:15:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:13.773 02:15:41 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:13.773 02:15:41 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:13.773 02:15:41 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:13.773 02:15:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:13.773 02:15:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:13.773 02:15:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:13.773 02:15:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:13.773 02:15:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:13.773 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:13.773 02:15:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:13.773 02:15:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:13.773 02:15:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:13.773 02:15:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:13.773 02:15:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:13.773 02:15:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:13.773 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:13.773 02:15:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:13.773 02:15:41 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:13.773 02:15:41 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:13.773 02:15:41 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:13.773 02:15:41 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:13.773 02:15:41 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:13.773 02:15:41 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:13.773 02:15:41 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:13.773 02:15:41 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:14.031 02:15:41 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:14.031 02:15:41 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:14.031 02:15:41 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:14.031 02:15:41 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:14.031 02:15:41 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:14.031 02:15:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:14.031 02:15:41 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:14.031 02:15:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:14.031 02:15:41 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:14.031 02:15:41 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:14.031 02:15:41 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:14.031 02:15:41 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:14.031 02:15:41 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:14.031 02:15:41 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:14.031 02:15:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:14.031 02:15:41 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:14.031 02:15:41 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:14.031 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:14.031 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.214 ms 00:13:14.031 00:13:14.031 --- 10.0.0.2 ping statistics --- 00:13:14.031 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:14.031 rtt min/avg/max/mdev = 0.214/0.214/0.214/0.000 ms 00:13:14.031 02:15:41 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:14.031 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:14.031 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.115 ms 00:13:14.031 00:13:14.031 --- 10.0.0.1 ping statistics --- 00:13:14.031 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:14.031 rtt min/avg/max/mdev = 0.115/0.115/0.115/0.000 ms 00:13:14.031 02:15:41 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:14.031 02:15:41 -- nvmf/common.sh@410 -- # return 0 00:13:14.031 02:15:41 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:14.031 02:15:41 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:14.031 02:15:41 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:14.031 02:15:41 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:14.031 02:15:41 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:14.031 02:15:41 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:14.031 02:15:41 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:14.031 02:15:41 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:13:14.031 02:15:41 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:14.031 02:15:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:14.031 02:15:41 -- common/autotest_common.sh@10 -- # set +x 00:13:14.031 02:15:41 -- nvmf/common.sh@469 -- # nvmfpid=2075675 00:13:14.031 02:15:41 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:13:14.032 02:15:41 -- nvmf/common.sh@470 -- # waitforlisten 2075675 00:13:14.032 02:15:41 -- common/autotest_common.sh@829 -- # '[' -z 2075675 ']' 00:13:14.032 02:15:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:14.032 02:15:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:14.032 02:15:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:14.032 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:14.032 02:15:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:14.032 02:15:41 -- common/autotest_common.sh@10 -- # set +x 00:13:14.032 [2024-12-08 02:15:41.739189] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:14.032 [2024-12-08 02:15:41.739268] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:14.032 EAL: No free 2048 kB hugepages reported on node 1 00:13:14.032 [2024-12-08 02:15:41.807951] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:14.303 [2024-12-08 02:15:41.923380] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:14.303 [2024-12-08 02:15:41.923552] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:14.303 [2024-12-08 02:15:41.923574] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:14.303 [2024-12-08 02:15:41.923589] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:14.303 [2024-12-08 02:15:41.923639] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:15.234 02:15:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:15.234 02:15:42 -- common/autotest_common.sh@862 -- # return 0 00:13:15.234 02:15:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:15.234 02:15:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:15.234 02:15:42 -- common/autotest_common.sh@10 -- # set +x 00:13:15.234 02:15:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:15.234 02:15:42 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:15.234 02:15:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:15.234 02:15:42 -- common/autotest_common.sh@10 -- # set +x 00:13:15.234 [2024-12-08 02:15:42.716582] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:15.234 02:15:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:15.234 02:15:42 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:15.234 02:15:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:15.234 02:15:42 -- common/autotest_common.sh@10 -- # set +x 00:13:15.234 02:15:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:15.234 02:15:42 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:15.234 02:15:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:15.234 02:15:42 -- common/autotest_common.sh@10 -- # set +x 00:13:15.234 [2024-12-08 02:15:42.732740] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:15.234 02:15:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:15.234 02:15:42 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:15.234 02:15:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:15.234 02:15:42 -- common/autotest_common.sh@10 -- # set +x 00:13:15.234 NULL1 00:13:15.234 02:15:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:15.234 02:15:42 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:13:15.234 02:15:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:15.234 02:15:42 -- common/autotest_common.sh@10 -- # set +x 00:13:15.234 02:15:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:15.234 02:15:42 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:15.234 02:15:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:15.234 02:15:42 -- common/autotest_common.sh@10 -- # set +x 00:13:15.234 02:15:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:15.234 02:15:42 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:13:15.234 [2024-12-08 02:15:42.777654] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:15.234 [2024-12-08 02:15:42.777691] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2075838 ] 00:13:15.234 EAL: No free 2048 kB hugepages reported on node 1 00:13:15.492 Attached to nqn.2016-06.io.spdk:cnode1 00:13:15.492 Namespace ID: 1 size: 1GB 00:13:15.492 fused_ordering(0) 00:13:15.492 fused_ordering(1) 00:13:15.492 fused_ordering(2) 00:13:15.492 fused_ordering(3) 00:13:15.492 fused_ordering(4) 00:13:15.492 fused_ordering(5) 00:13:15.492 fused_ordering(6) 00:13:15.492 fused_ordering(7) 00:13:15.492 fused_ordering(8) 00:13:15.492 fused_ordering(9) 00:13:15.492 fused_ordering(10) 00:13:15.492 fused_ordering(11) 00:13:15.492 fused_ordering(12) 00:13:15.492 fused_ordering(13) 00:13:15.492 fused_ordering(14) 00:13:15.492 fused_ordering(15) 00:13:15.492 fused_ordering(16) 00:13:15.492 fused_ordering(17) 00:13:15.492 fused_ordering(18) 00:13:15.492 fused_ordering(19) 00:13:15.492 fused_ordering(20) 00:13:15.492 fused_ordering(21) 00:13:15.492 fused_ordering(22) 00:13:15.492 fused_ordering(23) 00:13:15.492 fused_ordering(24) 00:13:15.492 fused_ordering(25) 00:13:15.492 fused_ordering(26) 00:13:15.492 fused_ordering(27) 00:13:15.492 fused_ordering(28) 00:13:15.492 fused_ordering(29) 00:13:15.492 fused_ordering(30) 00:13:15.492 fused_ordering(31) 00:13:15.492 fused_ordering(32) 00:13:15.492 fused_ordering(33) 00:13:15.492 fused_ordering(34) 00:13:15.492 fused_ordering(35) 00:13:15.492 fused_ordering(36) 00:13:15.492 fused_ordering(37) 00:13:15.492 fused_ordering(38) 00:13:15.492 fused_ordering(39) 00:13:15.492 fused_ordering(40) 00:13:15.492 fused_ordering(41) 00:13:15.492 fused_ordering(42) 00:13:15.492 fused_ordering(43) 00:13:15.492 fused_ordering(44) 00:13:15.492 fused_ordering(45) 00:13:15.492 fused_ordering(46) 00:13:15.492 fused_ordering(47) 00:13:15.492 fused_ordering(48) 00:13:15.492 fused_ordering(49) 00:13:15.492 fused_ordering(50) 00:13:15.492 fused_ordering(51) 00:13:15.492 fused_ordering(52) 00:13:15.492 fused_ordering(53) 00:13:15.492 fused_ordering(54) 00:13:15.492 fused_ordering(55) 00:13:15.492 fused_ordering(56) 00:13:15.492 fused_ordering(57) 00:13:15.492 fused_ordering(58) 00:13:15.492 fused_ordering(59) 00:13:15.492 fused_ordering(60) 00:13:15.492 fused_ordering(61) 00:13:15.492 fused_ordering(62) 00:13:15.492 fused_ordering(63) 00:13:15.492 fused_ordering(64) 00:13:15.492 fused_ordering(65) 00:13:15.492 fused_ordering(66) 00:13:15.492 fused_ordering(67) 00:13:15.492 fused_ordering(68) 00:13:15.492 fused_ordering(69) 00:13:15.492 fused_ordering(70) 00:13:15.492 fused_ordering(71) 00:13:15.492 fused_ordering(72) 00:13:15.492 fused_ordering(73) 00:13:15.492 fused_ordering(74) 00:13:15.492 fused_ordering(75) 00:13:15.492 fused_ordering(76) 00:13:15.492 fused_ordering(77) 00:13:15.492 fused_ordering(78) 00:13:15.492 fused_ordering(79) 00:13:15.492 fused_ordering(80) 00:13:15.492 fused_ordering(81) 00:13:15.492 fused_ordering(82) 00:13:15.492 fused_ordering(83) 00:13:15.492 fused_ordering(84) 00:13:15.492 fused_ordering(85) 00:13:15.492 fused_ordering(86) 00:13:15.492 fused_ordering(87) 00:13:15.492 fused_ordering(88) 00:13:15.492 fused_ordering(89) 00:13:15.492 fused_ordering(90) 00:13:15.492 fused_ordering(91) 00:13:15.492 fused_ordering(92) 00:13:15.492 fused_ordering(93) 00:13:15.492 fused_ordering(94) 00:13:15.492 fused_ordering(95) 00:13:15.492 fused_ordering(96) 00:13:15.492 fused_ordering(97) 00:13:15.492 fused_ordering(98) 00:13:15.492 fused_ordering(99) 00:13:15.492 fused_ordering(100) 00:13:15.492 fused_ordering(101) 00:13:15.492 fused_ordering(102) 00:13:15.492 fused_ordering(103) 00:13:15.492 fused_ordering(104) 00:13:15.492 fused_ordering(105) 00:13:15.492 fused_ordering(106) 00:13:15.492 fused_ordering(107) 00:13:15.492 fused_ordering(108) 00:13:15.492 fused_ordering(109) 00:13:15.492 fused_ordering(110) 00:13:15.492 fused_ordering(111) 00:13:15.492 fused_ordering(112) 00:13:15.492 fused_ordering(113) 00:13:15.492 fused_ordering(114) 00:13:15.492 fused_ordering(115) 00:13:15.492 fused_ordering(116) 00:13:15.492 fused_ordering(117) 00:13:15.492 fused_ordering(118) 00:13:15.492 fused_ordering(119) 00:13:15.492 fused_ordering(120) 00:13:15.492 fused_ordering(121) 00:13:15.492 fused_ordering(122) 00:13:15.492 fused_ordering(123) 00:13:15.492 fused_ordering(124) 00:13:15.492 fused_ordering(125) 00:13:15.492 fused_ordering(126) 00:13:15.492 fused_ordering(127) 00:13:15.492 fused_ordering(128) 00:13:15.492 fused_ordering(129) 00:13:15.492 fused_ordering(130) 00:13:15.492 fused_ordering(131) 00:13:15.492 fused_ordering(132) 00:13:15.492 fused_ordering(133) 00:13:15.492 fused_ordering(134) 00:13:15.492 fused_ordering(135) 00:13:15.492 fused_ordering(136) 00:13:15.492 fused_ordering(137) 00:13:15.492 fused_ordering(138) 00:13:15.492 fused_ordering(139) 00:13:15.492 fused_ordering(140) 00:13:15.493 fused_ordering(141) 00:13:15.493 fused_ordering(142) 00:13:15.493 fused_ordering(143) 00:13:15.493 fused_ordering(144) 00:13:15.493 fused_ordering(145) 00:13:15.493 fused_ordering(146) 00:13:15.493 fused_ordering(147) 00:13:15.493 fused_ordering(148) 00:13:15.493 fused_ordering(149) 00:13:15.493 fused_ordering(150) 00:13:15.493 fused_ordering(151) 00:13:15.493 fused_ordering(152) 00:13:15.493 fused_ordering(153) 00:13:15.493 fused_ordering(154) 00:13:15.493 fused_ordering(155) 00:13:15.493 fused_ordering(156) 00:13:15.493 fused_ordering(157) 00:13:15.493 fused_ordering(158) 00:13:15.493 fused_ordering(159) 00:13:15.493 fused_ordering(160) 00:13:15.493 fused_ordering(161) 00:13:15.493 fused_ordering(162) 00:13:15.493 fused_ordering(163) 00:13:15.493 fused_ordering(164) 00:13:15.493 fused_ordering(165) 00:13:15.493 fused_ordering(166) 00:13:15.493 fused_ordering(167) 00:13:15.493 fused_ordering(168) 00:13:15.493 fused_ordering(169) 00:13:15.493 fused_ordering(170) 00:13:15.493 fused_ordering(171) 00:13:15.493 fused_ordering(172) 00:13:15.493 fused_ordering(173) 00:13:15.493 fused_ordering(174) 00:13:15.493 fused_ordering(175) 00:13:15.493 fused_ordering(176) 00:13:15.493 fused_ordering(177) 00:13:15.493 fused_ordering(178) 00:13:15.493 fused_ordering(179) 00:13:15.493 fused_ordering(180) 00:13:15.493 fused_ordering(181) 00:13:15.493 fused_ordering(182) 00:13:15.493 fused_ordering(183) 00:13:15.493 fused_ordering(184) 00:13:15.493 fused_ordering(185) 00:13:15.493 fused_ordering(186) 00:13:15.493 fused_ordering(187) 00:13:15.493 fused_ordering(188) 00:13:15.493 fused_ordering(189) 00:13:15.493 fused_ordering(190) 00:13:15.493 fused_ordering(191) 00:13:15.493 fused_ordering(192) 00:13:15.493 fused_ordering(193) 00:13:15.493 fused_ordering(194) 00:13:15.493 fused_ordering(195) 00:13:15.493 fused_ordering(196) 00:13:15.493 fused_ordering(197) 00:13:15.493 fused_ordering(198) 00:13:15.493 fused_ordering(199) 00:13:15.493 fused_ordering(200) 00:13:15.493 fused_ordering(201) 00:13:15.493 fused_ordering(202) 00:13:15.493 fused_ordering(203) 00:13:15.493 fused_ordering(204) 00:13:15.493 fused_ordering(205) 00:13:15.750 fused_ordering(206) 00:13:15.750 fused_ordering(207) 00:13:15.750 fused_ordering(208) 00:13:15.750 fused_ordering(209) 00:13:15.750 fused_ordering(210) 00:13:15.750 fused_ordering(211) 00:13:15.750 fused_ordering(212) 00:13:15.750 fused_ordering(213) 00:13:15.750 fused_ordering(214) 00:13:15.750 fused_ordering(215) 00:13:15.750 fused_ordering(216) 00:13:15.750 fused_ordering(217) 00:13:15.750 fused_ordering(218) 00:13:15.750 fused_ordering(219) 00:13:15.750 fused_ordering(220) 00:13:15.750 fused_ordering(221) 00:13:15.750 fused_ordering(222) 00:13:15.750 fused_ordering(223) 00:13:15.751 fused_ordering(224) 00:13:15.751 fused_ordering(225) 00:13:15.751 fused_ordering(226) 00:13:15.751 fused_ordering(227) 00:13:15.751 fused_ordering(228) 00:13:15.751 fused_ordering(229) 00:13:15.751 fused_ordering(230) 00:13:15.751 fused_ordering(231) 00:13:15.751 fused_ordering(232) 00:13:15.751 fused_ordering(233) 00:13:15.751 fused_ordering(234) 00:13:15.751 fused_ordering(235) 00:13:15.751 fused_ordering(236) 00:13:15.751 fused_ordering(237) 00:13:15.751 fused_ordering(238) 00:13:15.751 fused_ordering(239) 00:13:15.751 fused_ordering(240) 00:13:15.751 fused_ordering(241) 00:13:15.751 fused_ordering(242) 00:13:15.751 fused_ordering(243) 00:13:15.751 fused_ordering(244) 00:13:15.751 fused_ordering(245) 00:13:15.751 fused_ordering(246) 00:13:15.751 fused_ordering(247) 00:13:15.751 fused_ordering(248) 00:13:15.751 fused_ordering(249) 00:13:15.751 fused_ordering(250) 00:13:15.751 fused_ordering(251) 00:13:15.751 fused_ordering(252) 00:13:15.751 fused_ordering(253) 00:13:15.751 fused_ordering(254) 00:13:15.751 fused_ordering(255) 00:13:15.751 fused_ordering(256) 00:13:15.751 fused_ordering(257) 00:13:15.751 fused_ordering(258) 00:13:15.751 fused_ordering(259) 00:13:15.751 fused_ordering(260) 00:13:15.751 fused_ordering(261) 00:13:15.751 fused_ordering(262) 00:13:15.751 fused_ordering(263) 00:13:15.751 fused_ordering(264) 00:13:15.751 fused_ordering(265) 00:13:15.751 fused_ordering(266) 00:13:15.751 fused_ordering(267) 00:13:15.751 fused_ordering(268) 00:13:15.751 fused_ordering(269) 00:13:15.751 fused_ordering(270) 00:13:15.751 fused_ordering(271) 00:13:15.751 fused_ordering(272) 00:13:15.751 fused_ordering(273) 00:13:15.751 fused_ordering(274) 00:13:15.751 fused_ordering(275) 00:13:15.751 fused_ordering(276) 00:13:15.751 fused_ordering(277) 00:13:15.751 fused_ordering(278) 00:13:15.751 fused_ordering(279) 00:13:15.751 fused_ordering(280) 00:13:15.751 fused_ordering(281) 00:13:15.751 fused_ordering(282) 00:13:15.751 fused_ordering(283) 00:13:15.751 fused_ordering(284) 00:13:15.751 fused_ordering(285) 00:13:15.751 fused_ordering(286) 00:13:15.751 fused_ordering(287) 00:13:15.751 fused_ordering(288) 00:13:15.751 fused_ordering(289) 00:13:15.751 fused_ordering(290) 00:13:15.751 fused_ordering(291) 00:13:15.751 fused_ordering(292) 00:13:15.751 fused_ordering(293) 00:13:15.751 fused_ordering(294) 00:13:15.751 fused_ordering(295) 00:13:15.751 fused_ordering(296) 00:13:15.751 fused_ordering(297) 00:13:15.751 fused_ordering(298) 00:13:15.751 fused_ordering(299) 00:13:15.751 fused_ordering(300) 00:13:15.751 fused_ordering(301) 00:13:15.751 fused_ordering(302) 00:13:15.751 fused_ordering(303) 00:13:15.751 fused_ordering(304) 00:13:15.751 fused_ordering(305) 00:13:15.751 fused_ordering(306) 00:13:15.751 fused_ordering(307) 00:13:15.751 fused_ordering(308) 00:13:15.751 fused_ordering(309) 00:13:15.751 fused_ordering(310) 00:13:15.751 fused_ordering(311) 00:13:15.751 fused_ordering(312) 00:13:15.751 fused_ordering(313) 00:13:15.751 fused_ordering(314) 00:13:15.751 fused_ordering(315) 00:13:15.751 fused_ordering(316) 00:13:15.751 fused_ordering(317) 00:13:15.751 fused_ordering(318) 00:13:15.751 fused_ordering(319) 00:13:15.751 fused_ordering(320) 00:13:15.751 fused_ordering(321) 00:13:15.751 fused_ordering(322) 00:13:15.751 fused_ordering(323) 00:13:15.751 fused_ordering(324) 00:13:15.751 fused_ordering(325) 00:13:15.751 fused_ordering(326) 00:13:15.751 fused_ordering(327) 00:13:15.751 fused_ordering(328) 00:13:15.751 fused_ordering(329) 00:13:15.751 fused_ordering(330) 00:13:15.751 fused_ordering(331) 00:13:15.751 fused_ordering(332) 00:13:15.751 fused_ordering(333) 00:13:15.751 fused_ordering(334) 00:13:15.751 fused_ordering(335) 00:13:15.751 fused_ordering(336) 00:13:15.751 fused_ordering(337) 00:13:15.751 fused_ordering(338) 00:13:15.751 fused_ordering(339) 00:13:15.751 fused_ordering(340) 00:13:15.751 fused_ordering(341) 00:13:15.751 fused_ordering(342) 00:13:15.751 fused_ordering(343) 00:13:15.751 fused_ordering(344) 00:13:15.751 fused_ordering(345) 00:13:15.751 fused_ordering(346) 00:13:15.751 fused_ordering(347) 00:13:15.751 fused_ordering(348) 00:13:15.751 fused_ordering(349) 00:13:15.751 fused_ordering(350) 00:13:15.751 fused_ordering(351) 00:13:15.751 fused_ordering(352) 00:13:15.751 fused_ordering(353) 00:13:15.751 fused_ordering(354) 00:13:15.751 fused_ordering(355) 00:13:15.751 fused_ordering(356) 00:13:15.751 fused_ordering(357) 00:13:15.751 fused_ordering(358) 00:13:15.751 fused_ordering(359) 00:13:15.751 fused_ordering(360) 00:13:15.751 fused_ordering(361) 00:13:15.751 fused_ordering(362) 00:13:15.751 fused_ordering(363) 00:13:15.751 fused_ordering(364) 00:13:15.751 fused_ordering(365) 00:13:15.751 fused_ordering(366) 00:13:15.751 fused_ordering(367) 00:13:15.751 fused_ordering(368) 00:13:15.751 fused_ordering(369) 00:13:15.751 fused_ordering(370) 00:13:15.751 fused_ordering(371) 00:13:15.751 fused_ordering(372) 00:13:15.751 fused_ordering(373) 00:13:15.751 fused_ordering(374) 00:13:15.751 fused_ordering(375) 00:13:15.751 fused_ordering(376) 00:13:15.751 fused_ordering(377) 00:13:15.751 fused_ordering(378) 00:13:15.751 fused_ordering(379) 00:13:15.751 fused_ordering(380) 00:13:15.751 fused_ordering(381) 00:13:15.751 fused_ordering(382) 00:13:15.751 fused_ordering(383) 00:13:15.751 fused_ordering(384) 00:13:15.751 fused_ordering(385) 00:13:15.751 fused_ordering(386) 00:13:15.751 fused_ordering(387) 00:13:15.751 fused_ordering(388) 00:13:15.751 fused_ordering(389) 00:13:15.751 fused_ordering(390) 00:13:15.751 fused_ordering(391) 00:13:15.751 fused_ordering(392) 00:13:15.751 fused_ordering(393) 00:13:15.751 fused_ordering(394) 00:13:15.751 fused_ordering(395) 00:13:15.751 fused_ordering(396) 00:13:15.751 fused_ordering(397) 00:13:15.751 fused_ordering(398) 00:13:15.751 fused_ordering(399) 00:13:15.751 fused_ordering(400) 00:13:15.751 fused_ordering(401) 00:13:15.751 fused_ordering(402) 00:13:15.751 fused_ordering(403) 00:13:15.751 fused_ordering(404) 00:13:15.751 fused_ordering(405) 00:13:15.751 fused_ordering(406) 00:13:15.751 fused_ordering(407) 00:13:15.751 fused_ordering(408) 00:13:15.751 fused_ordering(409) 00:13:15.751 fused_ordering(410) 00:13:16.316 fused_ordering(411) 00:13:16.316 fused_ordering(412) 00:13:16.316 fused_ordering(413) 00:13:16.316 fused_ordering(414) 00:13:16.316 fused_ordering(415) 00:13:16.316 fused_ordering(416) 00:13:16.316 fused_ordering(417) 00:13:16.316 fused_ordering(418) 00:13:16.316 fused_ordering(419) 00:13:16.316 fused_ordering(420) 00:13:16.316 fused_ordering(421) 00:13:16.316 fused_ordering(422) 00:13:16.316 fused_ordering(423) 00:13:16.316 fused_ordering(424) 00:13:16.316 fused_ordering(425) 00:13:16.316 fused_ordering(426) 00:13:16.316 fused_ordering(427) 00:13:16.316 fused_ordering(428) 00:13:16.316 fused_ordering(429) 00:13:16.316 fused_ordering(430) 00:13:16.316 fused_ordering(431) 00:13:16.316 fused_ordering(432) 00:13:16.316 fused_ordering(433) 00:13:16.316 fused_ordering(434) 00:13:16.316 fused_ordering(435) 00:13:16.316 fused_ordering(436) 00:13:16.316 fused_ordering(437) 00:13:16.316 fused_ordering(438) 00:13:16.316 fused_ordering(439) 00:13:16.316 fused_ordering(440) 00:13:16.316 fused_ordering(441) 00:13:16.316 fused_ordering(442) 00:13:16.316 fused_ordering(443) 00:13:16.316 fused_ordering(444) 00:13:16.316 fused_ordering(445) 00:13:16.316 fused_ordering(446) 00:13:16.316 fused_ordering(447) 00:13:16.316 fused_ordering(448) 00:13:16.316 fused_ordering(449) 00:13:16.316 fused_ordering(450) 00:13:16.316 fused_ordering(451) 00:13:16.316 fused_ordering(452) 00:13:16.316 fused_ordering(453) 00:13:16.316 fused_ordering(454) 00:13:16.316 fused_ordering(455) 00:13:16.316 fused_ordering(456) 00:13:16.316 fused_ordering(457) 00:13:16.316 fused_ordering(458) 00:13:16.316 fused_ordering(459) 00:13:16.316 fused_ordering(460) 00:13:16.316 fused_ordering(461) 00:13:16.316 fused_ordering(462) 00:13:16.316 fused_ordering(463) 00:13:16.316 fused_ordering(464) 00:13:16.316 fused_ordering(465) 00:13:16.316 fused_ordering(466) 00:13:16.316 fused_ordering(467) 00:13:16.316 fused_ordering(468) 00:13:16.316 fused_ordering(469) 00:13:16.316 fused_ordering(470) 00:13:16.316 fused_ordering(471) 00:13:16.316 fused_ordering(472) 00:13:16.316 fused_ordering(473) 00:13:16.316 fused_ordering(474) 00:13:16.316 fused_ordering(475) 00:13:16.316 fused_ordering(476) 00:13:16.316 fused_ordering(477) 00:13:16.316 fused_ordering(478) 00:13:16.316 fused_ordering(479) 00:13:16.316 fused_ordering(480) 00:13:16.316 fused_ordering(481) 00:13:16.316 fused_ordering(482) 00:13:16.316 fused_ordering(483) 00:13:16.316 fused_ordering(484) 00:13:16.316 fused_ordering(485) 00:13:16.316 fused_ordering(486) 00:13:16.316 fused_ordering(487) 00:13:16.316 fused_ordering(488) 00:13:16.316 fused_ordering(489) 00:13:16.316 fused_ordering(490) 00:13:16.316 fused_ordering(491) 00:13:16.316 fused_ordering(492) 00:13:16.316 fused_ordering(493) 00:13:16.316 fused_ordering(494) 00:13:16.316 fused_ordering(495) 00:13:16.316 fused_ordering(496) 00:13:16.316 fused_ordering(497) 00:13:16.316 fused_ordering(498) 00:13:16.316 fused_ordering(499) 00:13:16.316 fused_ordering(500) 00:13:16.316 fused_ordering(501) 00:13:16.316 fused_ordering(502) 00:13:16.316 fused_ordering(503) 00:13:16.316 fused_ordering(504) 00:13:16.316 fused_ordering(505) 00:13:16.316 fused_ordering(506) 00:13:16.316 fused_ordering(507) 00:13:16.316 fused_ordering(508) 00:13:16.316 fused_ordering(509) 00:13:16.316 fused_ordering(510) 00:13:16.316 fused_ordering(511) 00:13:16.316 fused_ordering(512) 00:13:16.316 fused_ordering(513) 00:13:16.316 fused_ordering(514) 00:13:16.316 fused_ordering(515) 00:13:16.316 fused_ordering(516) 00:13:16.316 fused_ordering(517) 00:13:16.316 fused_ordering(518) 00:13:16.316 fused_ordering(519) 00:13:16.316 fused_ordering(520) 00:13:16.316 fused_ordering(521) 00:13:16.316 fused_ordering(522) 00:13:16.316 fused_ordering(523) 00:13:16.316 fused_ordering(524) 00:13:16.316 fused_ordering(525) 00:13:16.316 fused_ordering(526) 00:13:16.316 fused_ordering(527) 00:13:16.316 fused_ordering(528) 00:13:16.316 fused_ordering(529) 00:13:16.316 fused_ordering(530) 00:13:16.316 fused_ordering(531) 00:13:16.316 fused_ordering(532) 00:13:16.316 fused_ordering(533) 00:13:16.316 fused_ordering(534) 00:13:16.316 fused_ordering(535) 00:13:16.316 fused_ordering(536) 00:13:16.316 fused_ordering(537) 00:13:16.316 fused_ordering(538) 00:13:16.316 fused_ordering(539) 00:13:16.316 fused_ordering(540) 00:13:16.316 fused_ordering(541) 00:13:16.316 fused_ordering(542) 00:13:16.316 fused_ordering(543) 00:13:16.316 fused_ordering(544) 00:13:16.316 fused_ordering(545) 00:13:16.316 fused_ordering(546) 00:13:16.316 fused_ordering(547) 00:13:16.316 fused_ordering(548) 00:13:16.316 fused_ordering(549) 00:13:16.316 fused_ordering(550) 00:13:16.316 fused_ordering(551) 00:13:16.316 fused_ordering(552) 00:13:16.316 fused_ordering(553) 00:13:16.316 fused_ordering(554) 00:13:16.316 fused_ordering(555) 00:13:16.316 fused_ordering(556) 00:13:16.316 fused_ordering(557) 00:13:16.316 fused_ordering(558) 00:13:16.316 fused_ordering(559) 00:13:16.316 fused_ordering(560) 00:13:16.316 fused_ordering(561) 00:13:16.316 fused_ordering(562) 00:13:16.316 fused_ordering(563) 00:13:16.316 fused_ordering(564) 00:13:16.316 fused_ordering(565) 00:13:16.316 fused_ordering(566) 00:13:16.316 fused_ordering(567) 00:13:16.316 fused_ordering(568) 00:13:16.316 fused_ordering(569) 00:13:16.316 fused_ordering(570) 00:13:16.316 fused_ordering(571) 00:13:16.316 fused_ordering(572) 00:13:16.316 fused_ordering(573) 00:13:16.316 fused_ordering(574) 00:13:16.316 fused_ordering(575) 00:13:16.316 fused_ordering(576) 00:13:16.316 fused_ordering(577) 00:13:16.316 fused_ordering(578) 00:13:16.316 fused_ordering(579) 00:13:16.316 fused_ordering(580) 00:13:16.316 fused_ordering(581) 00:13:16.316 fused_ordering(582) 00:13:16.316 fused_ordering(583) 00:13:16.316 fused_ordering(584) 00:13:16.316 fused_ordering(585) 00:13:16.316 fused_ordering(586) 00:13:16.317 fused_ordering(587) 00:13:16.317 fused_ordering(588) 00:13:16.317 fused_ordering(589) 00:13:16.317 fused_ordering(590) 00:13:16.317 fused_ordering(591) 00:13:16.317 fused_ordering(592) 00:13:16.317 fused_ordering(593) 00:13:16.317 fused_ordering(594) 00:13:16.317 fused_ordering(595) 00:13:16.317 fused_ordering(596) 00:13:16.317 fused_ordering(597) 00:13:16.317 fused_ordering(598) 00:13:16.317 fused_ordering(599) 00:13:16.317 fused_ordering(600) 00:13:16.317 fused_ordering(601) 00:13:16.317 fused_ordering(602) 00:13:16.317 fused_ordering(603) 00:13:16.317 fused_ordering(604) 00:13:16.317 fused_ordering(605) 00:13:16.317 fused_ordering(606) 00:13:16.317 fused_ordering(607) 00:13:16.317 fused_ordering(608) 00:13:16.317 fused_ordering(609) 00:13:16.317 fused_ordering(610) 00:13:16.317 fused_ordering(611) 00:13:16.317 fused_ordering(612) 00:13:16.317 fused_ordering(613) 00:13:16.317 fused_ordering(614) 00:13:16.317 fused_ordering(615) 00:13:16.883 fused_ordering(616) 00:13:16.883 fused_ordering(617) 00:13:16.883 fused_ordering(618) 00:13:16.883 fused_ordering(619) 00:13:16.883 fused_ordering(620) 00:13:16.883 fused_ordering(621) 00:13:16.883 fused_ordering(622) 00:13:16.883 fused_ordering(623) 00:13:16.883 fused_ordering(624) 00:13:16.883 fused_ordering(625) 00:13:16.883 fused_ordering(626) 00:13:16.883 fused_ordering(627) 00:13:16.883 fused_ordering(628) 00:13:16.883 fused_ordering(629) 00:13:16.883 fused_ordering(630) 00:13:16.883 fused_ordering(631) 00:13:16.883 fused_ordering(632) 00:13:16.883 fused_ordering(633) 00:13:16.883 fused_ordering(634) 00:13:16.883 fused_ordering(635) 00:13:16.883 fused_ordering(636) 00:13:16.883 fused_ordering(637) 00:13:16.883 fused_ordering(638) 00:13:16.883 fused_ordering(639) 00:13:16.883 fused_ordering(640) 00:13:16.883 fused_ordering(641) 00:13:16.883 fused_ordering(642) 00:13:16.883 fused_ordering(643) 00:13:16.883 fused_ordering(644) 00:13:16.883 fused_ordering(645) 00:13:16.883 fused_ordering(646) 00:13:16.883 fused_ordering(647) 00:13:16.883 fused_ordering(648) 00:13:16.883 fused_ordering(649) 00:13:16.883 fused_ordering(650) 00:13:16.883 fused_ordering(651) 00:13:16.883 fused_ordering(652) 00:13:16.883 fused_ordering(653) 00:13:16.883 fused_ordering(654) 00:13:16.883 fused_ordering(655) 00:13:16.883 fused_ordering(656) 00:13:16.883 fused_ordering(657) 00:13:16.883 fused_ordering(658) 00:13:16.883 fused_ordering(659) 00:13:16.883 fused_ordering(660) 00:13:16.883 fused_ordering(661) 00:13:16.883 fused_ordering(662) 00:13:16.883 fused_ordering(663) 00:13:16.883 fused_ordering(664) 00:13:16.883 fused_ordering(665) 00:13:16.883 fused_ordering(666) 00:13:16.883 fused_ordering(667) 00:13:16.883 fused_ordering(668) 00:13:16.883 fused_ordering(669) 00:13:16.883 fused_ordering(670) 00:13:16.883 fused_ordering(671) 00:13:16.883 fused_ordering(672) 00:13:16.883 fused_ordering(673) 00:13:16.883 fused_ordering(674) 00:13:16.883 fused_ordering(675) 00:13:16.883 fused_ordering(676) 00:13:16.883 fused_ordering(677) 00:13:16.883 fused_ordering(678) 00:13:16.883 fused_ordering(679) 00:13:16.883 fused_ordering(680) 00:13:16.883 fused_ordering(681) 00:13:16.883 fused_ordering(682) 00:13:16.883 fused_ordering(683) 00:13:16.883 fused_ordering(684) 00:13:16.883 fused_ordering(685) 00:13:16.883 fused_ordering(686) 00:13:16.883 fused_ordering(687) 00:13:16.883 fused_ordering(688) 00:13:16.883 fused_ordering(689) 00:13:16.883 fused_ordering(690) 00:13:16.883 fused_ordering(691) 00:13:16.883 fused_ordering(692) 00:13:16.883 fused_ordering(693) 00:13:16.883 fused_ordering(694) 00:13:16.883 fused_ordering(695) 00:13:16.883 fused_ordering(696) 00:13:16.883 fused_ordering(697) 00:13:16.883 fused_ordering(698) 00:13:16.883 fused_ordering(699) 00:13:16.883 fused_ordering(700) 00:13:16.883 fused_ordering(701) 00:13:16.883 fused_ordering(702) 00:13:16.883 fused_ordering(703) 00:13:16.883 fused_ordering(704) 00:13:16.883 fused_ordering(705) 00:13:16.883 fused_ordering(706) 00:13:16.883 fused_ordering(707) 00:13:16.883 fused_ordering(708) 00:13:16.883 fused_ordering(709) 00:13:16.883 fused_ordering(710) 00:13:16.883 fused_ordering(711) 00:13:16.883 fused_ordering(712) 00:13:16.883 fused_ordering(713) 00:13:16.883 fused_ordering(714) 00:13:16.883 fused_ordering(715) 00:13:16.883 fused_ordering(716) 00:13:16.883 fused_ordering(717) 00:13:16.883 fused_ordering(718) 00:13:16.883 fused_ordering(719) 00:13:16.883 fused_ordering(720) 00:13:16.883 fused_ordering(721) 00:13:16.883 fused_ordering(722) 00:13:16.883 fused_ordering(723) 00:13:16.883 fused_ordering(724) 00:13:16.883 fused_ordering(725) 00:13:16.883 fused_ordering(726) 00:13:16.883 fused_ordering(727) 00:13:16.883 fused_ordering(728) 00:13:16.883 fused_ordering(729) 00:13:16.883 fused_ordering(730) 00:13:16.883 fused_ordering(731) 00:13:16.883 fused_ordering(732) 00:13:16.883 fused_ordering(733) 00:13:16.883 fused_ordering(734) 00:13:16.883 fused_ordering(735) 00:13:16.883 fused_ordering(736) 00:13:16.883 fused_ordering(737) 00:13:16.883 fused_ordering(738) 00:13:16.883 fused_ordering(739) 00:13:16.883 fused_ordering(740) 00:13:16.883 fused_ordering(741) 00:13:16.883 fused_ordering(742) 00:13:16.883 fused_ordering(743) 00:13:16.883 fused_ordering(744) 00:13:16.883 fused_ordering(745) 00:13:16.883 fused_ordering(746) 00:13:16.883 fused_ordering(747) 00:13:16.883 fused_ordering(748) 00:13:16.883 fused_ordering(749) 00:13:16.883 fused_ordering(750) 00:13:16.883 fused_ordering(751) 00:13:16.883 fused_ordering(752) 00:13:16.883 fused_ordering(753) 00:13:16.883 fused_ordering(754) 00:13:16.883 fused_ordering(755) 00:13:16.883 fused_ordering(756) 00:13:16.883 fused_ordering(757) 00:13:16.883 fused_ordering(758) 00:13:16.883 fused_ordering(759) 00:13:16.883 fused_ordering(760) 00:13:16.883 fused_ordering(761) 00:13:16.883 fused_ordering(762) 00:13:16.883 fused_ordering(763) 00:13:16.883 fused_ordering(764) 00:13:16.883 fused_ordering(765) 00:13:16.883 fused_ordering(766) 00:13:16.883 fused_ordering(767) 00:13:16.883 fused_ordering(768) 00:13:16.883 fused_ordering(769) 00:13:16.883 fused_ordering(770) 00:13:16.883 fused_ordering(771) 00:13:16.883 fused_ordering(772) 00:13:16.883 fused_ordering(773) 00:13:16.883 fused_ordering(774) 00:13:16.883 fused_ordering(775) 00:13:16.883 fused_ordering(776) 00:13:16.883 fused_ordering(777) 00:13:16.883 fused_ordering(778) 00:13:16.883 fused_ordering(779) 00:13:16.883 fused_ordering(780) 00:13:16.883 fused_ordering(781) 00:13:16.883 fused_ordering(782) 00:13:16.883 fused_ordering(783) 00:13:16.883 fused_ordering(784) 00:13:16.883 fused_ordering(785) 00:13:16.883 fused_ordering(786) 00:13:16.883 fused_ordering(787) 00:13:16.883 fused_ordering(788) 00:13:16.883 fused_ordering(789) 00:13:16.883 fused_ordering(790) 00:13:16.883 fused_ordering(791) 00:13:16.883 fused_ordering(792) 00:13:16.883 fused_ordering(793) 00:13:16.883 fused_ordering(794) 00:13:16.883 fused_ordering(795) 00:13:16.883 fused_ordering(796) 00:13:16.883 fused_ordering(797) 00:13:16.883 fused_ordering(798) 00:13:16.883 fused_ordering(799) 00:13:16.883 fused_ordering(800) 00:13:16.883 fused_ordering(801) 00:13:16.883 fused_ordering(802) 00:13:16.883 fused_ordering(803) 00:13:16.883 fused_ordering(804) 00:13:16.883 fused_ordering(805) 00:13:16.883 fused_ordering(806) 00:13:16.883 fused_ordering(807) 00:13:16.883 fused_ordering(808) 00:13:16.883 fused_ordering(809) 00:13:16.883 fused_ordering(810) 00:13:16.883 fused_ordering(811) 00:13:16.883 fused_ordering(812) 00:13:16.883 fused_ordering(813) 00:13:16.883 fused_ordering(814) 00:13:16.883 fused_ordering(815) 00:13:16.883 fused_ordering(816) 00:13:16.883 fused_ordering(817) 00:13:16.883 fused_ordering(818) 00:13:16.883 fused_ordering(819) 00:13:16.883 fused_ordering(820) 00:13:17.450 fused_ordering(821) 00:13:17.450 fused_ordering(822) 00:13:17.450 fused_ordering(823) 00:13:17.450 fused_ordering(824) 00:13:17.450 fused_ordering(825) 00:13:17.450 fused_ordering(826) 00:13:17.450 fused_ordering(827) 00:13:17.450 fused_ordering(828) 00:13:17.450 fused_ordering(829) 00:13:17.450 fused_ordering(830) 00:13:17.450 fused_ordering(831) 00:13:17.450 fused_ordering(832) 00:13:17.450 fused_ordering(833) 00:13:17.450 fused_ordering(834) 00:13:17.450 fused_ordering(835) 00:13:17.450 fused_ordering(836) 00:13:17.450 fused_ordering(837) 00:13:17.450 fused_ordering(838) 00:13:17.450 fused_ordering(839) 00:13:17.450 fused_ordering(840) 00:13:17.450 fused_ordering(841) 00:13:17.451 fused_ordering(842) 00:13:17.451 fused_ordering(843) 00:13:17.451 fused_ordering(844) 00:13:17.451 fused_ordering(845) 00:13:17.451 fused_ordering(846) 00:13:17.451 fused_ordering(847) 00:13:17.451 fused_ordering(848) 00:13:17.451 fused_ordering(849) 00:13:17.451 fused_ordering(850) 00:13:17.451 fused_ordering(851) 00:13:17.451 fused_ordering(852) 00:13:17.451 fused_ordering(853) 00:13:17.451 fused_ordering(854) 00:13:17.451 fused_ordering(855) 00:13:17.451 fused_ordering(856) 00:13:17.451 fused_ordering(857) 00:13:17.451 fused_ordering(858) 00:13:17.451 fused_ordering(859) 00:13:17.451 fused_ordering(860) 00:13:17.451 fused_ordering(861) 00:13:17.451 fused_ordering(862) 00:13:17.451 fused_ordering(863) 00:13:17.451 fused_ordering(864) 00:13:17.451 fused_ordering(865) 00:13:17.451 fused_ordering(866) 00:13:17.451 fused_ordering(867) 00:13:17.451 fused_ordering(868) 00:13:17.451 fused_ordering(869) 00:13:17.451 fused_ordering(870) 00:13:17.451 fused_ordering(871) 00:13:17.451 fused_ordering(872) 00:13:17.451 fused_ordering(873) 00:13:17.451 fused_ordering(874) 00:13:17.451 fused_ordering(875) 00:13:17.451 fused_ordering(876) 00:13:17.451 fused_ordering(877) 00:13:17.451 fused_ordering(878) 00:13:17.451 fused_ordering(879) 00:13:17.451 fused_ordering(880) 00:13:17.451 fused_ordering(881) 00:13:17.451 fused_ordering(882) 00:13:17.451 fused_ordering(883) 00:13:17.451 fused_ordering(884) 00:13:17.451 fused_ordering(885) 00:13:17.451 fused_ordering(886) 00:13:17.451 fused_ordering(887) 00:13:17.451 fused_ordering(888) 00:13:17.451 fused_ordering(889) 00:13:17.451 fused_ordering(890) 00:13:17.451 fused_ordering(891) 00:13:17.451 fused_ordering(892) 00:13:17.451 fused_ordering(893) 00:13:17.451 fused_ordering(894) 00:13:17.451 fused_ordering(895) 00:13:17.451 fused_ordering(896) 00:13:17.451 fused_ordering(897) 00:13:17.451 fused_ordering(898) 00:13:17.451 fused_ordering(899) 00:13:17.451 fused_ordering(900) 00:13:17.451 fused_ordering(901) 00:13:17.451 fused_ordering(902) 00:13:17.451 fused_ordering(903) 00:13:17.451 fused_ordering(904) 00:13:17.451 fused_ordering(905) 00:13:17.451 fused_ordering(906) 00:13:17.451 fused_ordering(907) 00:13:17.451 fused_ordering(908) 00:13:17.451 fused_ordering(909) 00:13:17.451 fused_ordering(910) 00:13:17.451 fused_ordering(911) 00:13:17.451 fused_ordering(912) 00:13:17.451 fused_ordering(913) 00:13:17.451 fused_ordering(914) 00:13:17.451 fused_ordering(915) 00:13:17.451 fused_ordering(916) 00:13:17.451 fused_ordering(917) 00:13:17.451 fused_ordering(918) 00:13:17.451 fused_ordering(919) 00:13:17.451 fused_ordering(920) 00:13:17.451 fused_ordering(921) 00:13:17.451 fused_ordering(922) 00:13:17.451 fused_ordering(923) 00:13:17.451 fused_ordering(924) 00:13:17.451 fused_ordering(925) 00:13:17.451 fused_ordering(926) 00:13:17.451 fused_ordering(927) 00:13:17.451 fused_ordering(928) 00:13:17.451 fused_ordering(929) 00:13:17.451 fused_ordering(930) 00:13:17.451 fused_ordering(931) 00:13:17.451 fused_ordering(932) 00:13:17.451 fused_ordering(933) 00:13:17.451 fused_ordering(934) 00:13:17.451 fused_ordering(935) 00:13:17.451 fused_ordering(936) 00:13:17.451 fused_ordering(937) 00:13:17.451 fused_ordering(938) 00:13:17.451 fused_ordering(939) 00:13:17.451 fused_ordering(940) 00:13:17.451 fused_ordering(941) 00:13:17.451 fused_ordering(942) 00:13:17.451 fused_ordering(943) 00:13:17.451 fused_ordering(944) 00:13:17.451 fused_ordering(945) 00:13:17.451 fused_ordering(946) 00:13:17.451 fused_ordering(947) 00:13:17.451 fused_ordering(948) 00:13:17.451 fused_ordering(949) 00:13:17.451 fused_ordering(950) 00:13:17.451 fused_ordering(951) 00:13:17.451 fused_ordering(952) 00:13:17.451 fused_ordering(953) 00:13:17.451 fused_ordering(954) 00:13:17.451 fused_ordering(955) 00:13:17.451 fused_ordering(956) 00:13:17.451 fused_ordering(957) 00:13:17.451 fused_ordering(958) 00:13:17.451 fused_ordering(959) 00:13:17.451 fused_ordering(960) 00:13:17.451 fused_ordering(961) 00:13:17.451 fused_ordering(962) 00:13:17.451 fused_ordering(963) 00:13:17.451 fused_ordering(964) 00:13:17.451 fused_ordering(965) 00:13:17.451 fused_ordering(966) 00:13:17.451 fused_ordering(967) 00:13:17.451 fused_ordering(968) 00:13:17.451 fused_ordering(969) 00:13:17.451 fused_ordering(970) 00:13:17.451 fused_ordering(971) 00:13:17.451 fused_ordering(972) 00:13:17.451 fused_ordering(973) 00:13:17.451 fused_ordering(974) 00:13:17.451 fused_ordering(975) 00:13:17.451 fused_ordering(976) 00:13:17.451 fused_ordering(977) 00:13:17.451 fused_ordering(978) 00:13:17.451 fused_ordering(979) 00:13:17.451 fused_ordering(980) 00:13:17.451 fused_ordering(981) 00:13:17.451 fused_ordering(982) 00:13:17.451 fused_ordering(983) 00:13:17.451 fused_ordering(984) 00:13:17.451 fused_ordering(985) 00:13:17.451 fused_ordering(986) 00:13:17.451 fused_ordering(987) 00:13:17.451 fused_ordering(988) 00:13:17.451 fused_ordering(989) 00:13:17.451 fused_ordering(990) 00:13:17.451 fused_ordering(991) 00:13:17.451 fused_ordering(992) 00:13:17.451 fused_ordering(993) 00:13:17.451 fused_ordering(994) 00:13:17.451 fused_ordering(995) 00:13:17.451 fused_ordering(996) 00:13:17.451 fused_ordering(997) 00:13:17.451 fused_ordering(998) 00:13:17.451 fused_ordering(999) 00:13:17.451 fused_ordering(1000) 00:13:17.451 fused_ordering(1001) 00:13:17.451 fused_ordering(1002) 00:13:17.451 fused_ordering(1003) 00:13:17.451 fused_ordering(1004) 00:13:17.451 fused_ordering(1005) 00:13:17.451 fused_ordering(1006) 00:13:17.451 fused_ordering(1007) 00:13:17.451 fused_ordering(1008) 00:13:17.451 fused_ordering(1009) 00:13:17.451 fused_ordering(1010) 00:13:17.451 fused_ordering(1011) 00:13:17.451 fused_ordering(1012) 00:13:17.451 fused_ordering(1013) 00:13:17.451 fused_ordering(1014) 00:13:17.451 fused_ordering(1015) 00:13:17.451 fused_ordering(1016) 00:13:17.451 fused_ordering(1017) 00:13:17.451 fused_ordering(1018) 00:13:17.451 fused_ordering(1019) 00:13:17.451 fused_ordering(1020) 00:13:17.451 fused_ordering(1021) 00:13:17.451 fused_ordering(1022) 00:13:17.451 fused_ordering(1023) 00:13:17.451 02:15:45 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:13:17.451 02:15:45 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:13:17.451 02:15:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:17.451 02:15:45 -- nvmf/common.sh@116 -- # sync 00:13:17.451 02:15:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:17.451 02:15:45 -- nvmf/common.sh@119 -- # set +e 00:13:17.451 02:15:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:17.451 02:15:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:17.451 rmmod nvme_tcp 00:13:17.451 rmmod nvme_fabrics 00:13:17.451 rmmod nvme_keyring 00:13:17.451 02:15:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:17.451 02:15:45 -- nvmf/common.sh@123 -- # set -e 00:13:17.451 02:15:45 -- nvmf/common.sh@124 -- # return 0 00:13:17.451 02:15:45 -- nvmf/common.sh@477 -- # '[' -n 2075675 ']' 00:13:17.451 02:15:45 -- nvmf/common.sh@478 -- # killprocess 2075675 00:13:17.451 02:15:45 -- common/autotest_common.sh@936 -- # '[' -z 2075675 ']' 00:13:17.451 02:15:45 -- common/autotest_common.sh@940 -- # kill -0 2075675 00:13:17.451 02:15:45 -- common/autotest_common.sh@941 -- # uname 00:13:17.451 02:15:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:17.451 02:15:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2075675 00:13:17.451 02:15:45 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:17.451 02:15:45 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:17.451 02:15:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2075675' 00:13:17.451 killing process with pid 2075675 00:13:17.451 02:15:45 -- common/autotest_common.sh@955 -- # kill 2075675 00:13:17.451 02:15:45 -- common/autotest_common.sh@960 -- # wait 2075675 00:13:18.016 02:15:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:18.016 02:15:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:18.016 02:15:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:18.016 02:15:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:18.016 02:15:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:18.016 02:15:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:18.016 02:15:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:18.016 02:15:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:19.918 02:15:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:19.918 00:13:19.918 real 0m8.136s 00:13:19.918 user 0m5.871s 00:13:19.918 sys 0m3.188s 00:13:19.918 02:15:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:19.918 02:15:47 -- common/autotest_common.sh@10 -- # set +x 00:13:19.918 ************************************ 00:13:19.918 END TEST nvmf_fused_ordering 00:13:19.918 ************************************ 00:13:19.918 02:15:47 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:19.918 02:15:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:19.918 02:15:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:19.918 02:15:47 -- common/autotest_common.sh@10 -- # set +x 00:13:19.918 ************************************ 00:13:19.918 START TEST nvmf_delete_subsystem 00:13:19.918 ************************************ 00:13:19.918 02:15:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:19.918 * Looking for test storage... 00:13:19.918 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:19.918 02:15:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:19.918 02:15:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:19.918 02:15:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:20.177 02:15:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:20.177 02:15:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:20.177 02:15:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:20.177 02:15:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:20.177 02:15:47 -- scripts/common.sh@335 -- # IFS=.-: 00:13:20.177 02:15:47 -- scripts/common.sh@335 -- # read -ra ver1 00:13:20.177 02:15:47 -- scripts/common.sh@336 -- # IFS=.-: 00:13:20.177 02:15:47 -- scripts/common.sh@336 -- # read -ra ver2 00:13:20.177 02:15:47 -- scripts/common.sh@337 -- # local 'op=<' 00:13:20.177 02:15:47 -- scripts/common.sh@339 -- # ver1_l=2 00:13:20.177 02:15:47 -- scripts/common.sh@340 -- # ver2_l=1 00:13:20.177 02:15:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:20.177 02:15:47 -- scripts/common.sh@343 -- # case "$op" in 00:13:20.177 02:15:47 -- scripts/common.sh@344 -- # : 1 00:13:20.177 02:15:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:20.177 02:15:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:20.177 02:15:47 -- scripts/common.sh@364 -- # decimal 1 00:13:20.177 02:15:47 -- scripts/common.sh@352 -- # local d=1 00:13:20.177 02:15:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:20.177 02:15:47 -- scripts/common.sh@354 -- # echo 1 00:13:20.177 02:15:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:20.177 02:15:47 -- scripts/common.sh@365 -- # decimal 2 00:13:20.177 02:15:47 -- scripts/common.sh@352 -- # local d=2 00:13:20.177 02:15:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:20.177 02:15:47 -- scripts/common.sh@354 -- # echo 2 00:13:20.177 02:15:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:20.177 02:15:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:20.177 02:15:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:20.177 02:15:47 -- scripts/common.sh@367 -- # return 0 00:13:20.177 02:15:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:20.177 02:15:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:20.177 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:20.177 --rc genhtml_branch_coverage=1 00:13:20.177 --rc genhtml_function_coverage=1 00:13:20.177 --rc genhtml_legend=1 00:13:20.177 --rc geninfo_all_blocks=1 00:13:20.177 --rc geninfo_unexecuted_blocks=1 00:13:20.177 00:13:20.177 ' 00:13:20.177 02:15:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:20.177 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:20.177 --rc genhtml_branch_coverage=1 00:13:20.177 --rc genhtml_function_coverage=1 00:13:20.177 --rc genhtml_legend=1 00:13:20.177 --rc geninfo_all_blocks=1 00:13:20.177 --rc geninfo_unexecuted_blocks=1 00:13:20.177 00:13:20.177 ' 00:13:20.177 02:15:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:20.177 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:20.177 --rc genhtml_branch_coverage=1 00:13:20.177 --rc genhtml_function_coverage=1 00:13:20.177 --rc genhtml_legend=1 00:13:20.177 --rc geninfo_all_blocks=1 00:13:20.177 --rc geninfo_unexecuted_blocks=1 00:13:20.177 00:13:20.177 ' 00:13:20.177 02:15:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:20.177 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:20.177 --rc genhtml_branch_coverage=1 00:13:20.177 --rc genhtml_function_coverage=1 00:13:20.177 --rc genhtml_legend=1 00:13:20.177 --rc geninfo_all_blocks=1 00:13:20.177 --rc geninfo_unexecuted_blocks=1 00:13:20.177 00:13:20.177 ' 00:13:20.177 02:15:47 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:20.177 02:15:47 -- nvmf/common.sh@7 -- # uname -s 00:13:20.177 02:15:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:20.177 02:15:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:20.177 02:15:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:20.177 02:15:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:20.177 02:15:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:20.177 02:15:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:20.177 02:15:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:20.177 02:15:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:20.177 02:15:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:20.177 02:15:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:20.177 02:15:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:20.177 02:15:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:20.177 02:15:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:20.177 02:15:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:20.177 02:15:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:20.177 02:15:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:20.177 02:15:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:20.177 02:15:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:20.177 02:15:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:20.177 02:15:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:20.177 02:15:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:20.177 02:15:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:20.177 02:15:47 -- paths/export.sh@5 -- # export PATH 00:13:20.177 02:15:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:20.177 02:15:47 -- nvmf/common.sh@46 -- # : 0 00:13:20.177 02:15:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:20.177 02:15:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:20.177 02:15:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:20.177 02:15:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:20.177 02:15:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:20.177 02:15:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:20.177 02:15:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:20.177 02:15:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:20.177 02:15:47 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:13:20.177 02:15:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:20.177 02:15:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:20.177 02:15:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:20.177 02:15:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:20.177 02:15:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:20.177 02:15:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:20.177 02:15:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:20.177 02:15:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:20.177 02:15:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:20.177 02:15:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:20.177 02:15:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:20.177 02:15:47 -- common/autotest_common.sh@10 -- # set +x 00:13:22.079 02:15:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:22.079 02:15:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:22.079 02:15:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:22.079 02:15:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:22.079 02:15:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:22.079 02:15:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:22.079 02:15:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:22.079 02:15:49 -- nvmf/common.sh@294 -- # net_devs=() 00:13:22.079 02:15:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:22.079 02:15:49 -- nvmf/common.sh@295 -- # e810=() 00:13:22.079 02:15:49 -- nvmf/common.sh@295 -- # local -ga e810 00:13:22.079 02:15:49 -- nvmf/common.sh@296 -- # x722=() 00:13:22.079 02:15:49 -- nvmf/common.sh@296 -- # local -ga x722 00:13:22.079 02:15:49 -- nvmf/common.sh@297 -- # mlx=() 00:13:22.079 02:15:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:22.079 02:15:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:22.080 02:15:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:22.080 02:15:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:22.080 02:15:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:22.080 02:15:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:22.080 02:15:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:22.080 02:15:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:22.080 02:15:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:22.080 02:15:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:22.080 02:15:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:22.080 02:15:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:22.080 02:15:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:22.080 02:15:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:22.080 02:15:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:22.080 02:15:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:22.080 02:15:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:22.080 02:15:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:22.080 02:15:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:22.080 02:15:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:22.080 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:22.080 02:15:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:22.080 02:15:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:22.080 02:15:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:22.080 02:15:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:22.080 02:15:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:22.080 02:15:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:22.080 02:15:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:22.080 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:22.080 02:15:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:22.080 02:15:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:22.080 02:15:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:22.080 02:15:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:22.080 02:15:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:22.080 02:15:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:22.080 02:15:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:22.080 02:15:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:22.080 02:15:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:22.080 02:15:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:22.080 02:15:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:22.080 02:15:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:22.080 02:15:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:22.080 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:22.080 02:15:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:22.080 02:15:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:22.080 02:15:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:22.080 02:15:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:22.080 02:15:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:22.080 02:15:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:22.080 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:22.080 02:15:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:22.080 02:15:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:22.080 02:15:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:22.080 02:15:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:22.080 02:15:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:22.080 02:15:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:22.080 02:15:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:22.080 02:15:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:22.080 02:15:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:22.080 02:15:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:22.080 02:15:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:22.080 02:15:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:22.080 02:15:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:22.080 02:15:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:22.080 02:15:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:22.080 02:15:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:22.080 02:15:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:22.080 02:15:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:22.080 02:15:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:22.080 02:15:49 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:22.080 02:15:49 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:22.080 02:15:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:22.080 02:15:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:22.080 02:15:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:22.080 02:15:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:22.080 02:15:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:22.080 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:22.080 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.204 ms 00:13:22.080 00:13:22.080 --- 10.0.0.2 ping statistics --- 00:13:22.080 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:22.080 rtt min/avg/max/mdev = 0.204/0.204/0.204/0.000 ms 00:13:22.080 02:15:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:22.080 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:22.080 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.068 ms 00:13:22.080 00:13:22.080 --- 10.0.0.1 ping statistics --- 00:13:22.080 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:22.080 rtt min/avg/max/mdev = 0.068/0.068/0.068/0.000 ms 00:13:22.080 02:15:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:22.080 02:15:49 -- nvmf/common.sh@410 -- # return 0 00:13:22.080 02:15:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:22.080 02:15:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:22.080 02:15:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:22.080 02:15:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:22.080 02:15:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:22.080 02:15:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:22.080 02:15:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:22.080 02:15:49 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:13:22.080 02:15:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:22.080 02:15:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:22.080 02:15:49 -- common/autotest_common.sh@10 -- # set +x 00:13:22.080 02:15:49 -- nvmf/common.sh@469 -- # nvmfpid=2078057 00:13:22.080 02:15:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:13:22.080 02:15:49 -- nvmf/common.sh@470 -- # waitforlisten 2078057 00:13:22.080 02:15:49 -- common/autotest_common.sh@829 -- # '[' -z 2078057 ']' 00:13:22.080 02:15:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:22.080 02:15:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:22.080 02:15:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:22.080 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:22.080 02:15:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:22.080 02:15:49 -- common/autotest_common.sh@10 -- # set +x 00:13:22.080 [2024-12-08 02:15:49.851070] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:22.080 [2024-12-08 02:15:49.851164] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:22.339 EAL: No free 2048 kB hugepages reported on node 1 00:13:22.339 [2024-12-08 02:15:49.916139] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:13:22.339 [2024-12-08 02:15:50.029284] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:22.339 [2024-12-08 02:15:50.029469] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:22.339 [2024-12-08 02:15:50.029491] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:22.339 [2024-12-08 02:15:50.029513] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:22.339 [2024-12-08 02:15:50.029595] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:22.339 [2024-12-08 02:15:50.029601] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:23.273 02:15:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:23.273 02:15:50 -- common/autotest_common.sh@862 -- # return 0 00:13:23.273 02:15:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:23.273 02:15:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:23.273 02:15:50 -- common/autotest_common.sh@10 -- # set +x 00:13:23.273 02:15:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:23.273 02:15:50 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:23.273 02:15:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.273 02:15:50 -- common/autotest_common.sh@10 -- # set +x 00:13:23.273 [2024-12-08 02:15:50.844874] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:23.273 02:15:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.273 02:15:50 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:23.273 02:15:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.273 02:15:50 -- common/autotest_common.sh@10 -- # set +x 00:13:23.273 02:15:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.273 02:15:50 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:23.273 02:15:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.273 02:15:50 -- common/autotest_common.sh@10 -- # set +x 00:13:23.273 [2024-12-08 02:15:50.861207] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:23.273 02:15:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.273 02:15:50 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:23.273 02:15:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.273 02:15:50 -- common/autotest_common.sh@10 -- # set +x 00:13:23.273 NULL1 00:13:23.273 02:15:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.273 02:15:50 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:23.273 02:15:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.273 02:15:50 -- common/autotest_common.sh@10 -- # set +x 00:13:23.273 Delay0 00:13:23.273 02:15:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.273 02:15:50 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:23.273 02:15:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.273 02:15:50 -- common/autotest_common.sh@10 -- # set +x 00:13:23.273 02:15:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.273 02:15:50 -- target/delete_subsystem.sh@28 -- # perf_pid=2078220 00:13:23.273 02:15:50 -- target/delete_subsystem.sh@30 -- # sleep 2 00:13:23.273 02:15:50 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:23.273 EAL: No free 2048 kB hugepages reported on node 1 00:13:23.274 [2024-12-08 02:15:50.935764] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:25.193 02:15:52 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:25.193 02:15:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.193 02:15:52 -- common/autotest_common.sh@10 -- # set +x 00:13:25.451 Read completed with error (sct=0, sc=8) 00:13:25.451 Read completed with error (sct=0, sc=8) 00:13:25.451 Read completed with error (sct=0, sc=8) 00:13:25.451 Read completed with error (sct=0, sc=8) 00:13:25.451 starting I/O failed: -6 00:13:25.451 Read completed with error (sct=0, sc=8) 00:13:25.451 Write completed with error (sct=0, sc=8) 00:13:25.451 Read completed with error (sct=0, sc=8) 00:13:25.451 Write completed with error (sct=0, sc=8) 00:13:25.451 starting I/O failed: -6 00:13:25.451 Read completed with error (sct=0, sc=8) 00:13:25.451 Write completed with error (sct=0, sc=8) 00:13:25.451 Read completed with error (sct=0, sc=8) 00:13:25.451 Write completed with error (sct=0, sc=8) 00:13:25.451 starting I/O failed: -6 00:13:25.451 Read completed with error (sct=0, sc=8) 00:13:25.451 Write completed with error (sct=0, sc=8) 00:13:25.451 Write completed with error (sct=0, sc=8) 00:13:25.451 Read completed with error (sct=0, sc=8) 00:13:25.451 starting I/O failed: -6 00:13:25.451 Read completed with error (sct=0, sc=8) 00:13:25.451 Read completed with error (sct=0, sc=8) 00:13:25.451 Write completed with error (sct=0, sc=8) 00:13:25.451 Read completed with error (sct=0, sc=8) 00:13:25.451 starting I/O failed: -6 00:13:25.451 Read completed with error (sct=0, sc=8) 00:13:25.451 Read completed with error (sct=0, sc=8) 00:13:25.451 Read completed with error (sct=0, sc=8) 00:13:25.451 Read completed with error (sct=0, sc=8) 00:13:25.451 starting I/O failed: -6 00:13:25.451 Read completed with error (sct=0, sc=8) 00:13:25.451 Read completed with error (sct=0, sc=8) 00:13:25.451 Read completed with error (sct=0, sc=8) 00:13:25.451 Write completed with error (sct=0, sc=8) 00:13:25.451 starting I/O failed: -6 00:13:25.451 Read completed with error (sct=0, sc=8) 00:13:25.451 Read completed with error (sct=0, sc=8) 00:13:25.451 Read completed with error (sct=0, sc=8) 00:13:25.451 Read completed with error (sct=0, sc=8) 00:13:25.451 starting I/O failed: -6 00:13:25.451 Read completed with error (sct=0, sc=8) 00:13:25.451 Read completed with error (sct=0, sc=8) 00:13:25.451 Write completed with error (sct=0, sc=8) 00:13:25.451 Read completed with error (sct=0, sc=8) 00:13:25.451 starting I/O failed: -6 00:13:25.451 Read completed with error (sct=0, sc=8) 00:13:25.451 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 [2024-12-08 02:15:53.057530] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f26d8000c00 is same with the state(5) to be set 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 [2024-12-08 02:15:53.058483] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f26d800c350 is same with the state(5) to be set 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 Write completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 Read completed with error (sct=0, sc=8) 00:13:25.452 starting I/O failed: -6 00:13:25.452 starting I/O failed: -6 00:13:25.452 starting I/O failed: -6 00:13:26.384 [2024-12-08 02:15:54.030216] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11ba960 is same with the state(5) to be set 00:13:26.384 Write completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Write completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Write completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Write completed with error (sct=0, sc=8) 00:13:26.384 Write completed with error (sct=0, sc=8) 00:13:26.384 Write completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Write completed with error (sct=0, sc=8) 00:13:26.384 Write completed with error (sct=0, sc=8) 00:13:26.384 Write completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Write completed with error (sct=0, sc=8) 00:13:26.384 Write completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Write completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Write completed with error (sct=0, sc=8) 00:13:26.384 Write completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Write completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Write completed with error (sct=0, sc=8) 00:13:26.384 Write completed with error (sct=0, sc=8) 00:13:26.384 Write completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 [2024-12-08 02:15:54.057061] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11a1770 is same with the state(5) to be set 00:13:26.384 Write completed with error (sct=0, sc=8) 00:13:26.384 Write completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Write completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Write completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Write completed with error (sct=0, sc=8) 00:13:26.384 Write completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Write completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 [2024-12-08 02:15:54.057329] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c13d0 is same with the state(5) to be set 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Write completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Write completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Write completed with error (sct=0, sc=8) 00:13:26.384 Write completed with error (sct=0, sc=8) 00:13:26.384 Write completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 [2024-12-08 02:15:54.058486] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f26d800c600 is same with the state(5) to be set 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 Read completed with error (sct=0, sc=8) 00:13:26.384 [2024-12-08 02:15:54.060844] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f26d800bf20 is same with the state(5) to be set 00:13:26.384 [2024-12-08 02:15:54.061631] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11ba960 (9): Bad file descriptor 00:13:26.384 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:13:26.384 02:15:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.384 02:15:54 -- target/delete_subsystem.sh@34 -- # delay=0 00:13:26.384 02:15:54 -- target/delete_subsystem.sh@35 -- # kill -0 2078220 00:13:26.384 02:15:54 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:13:26.384 Initializing NVMe Controllers 00:13:26.384 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:26.384 Controller IO queue size 128, less than required. 00:13:26.384 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:26.384 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:13:26.384 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:13:26.384 Initialization complete. Launching workers. 00:13:26.384 ======================================================== 00:13:26.384 Latency(us) 00:13:26.384 Device Information : IOPS MiB/s Average min max 00:13:26.384 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 173.18 0.08 995994.67 577.28 2001405.30 00:13:26.384 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 163.75 0.08 910896.31 971.94 1046489.82 00:13:26.384 ======================================================== 00:13:26.385 Total : 336.93 0.16 954636.12 577.28 2001405.30 00:13:26.385 00:13:26.951 02:15:54 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:13:26.951 02:15:54 -- target/delete_subsystem.sh@35 -- # kill -0 2078220 00:13:26.951 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (2078220) - No such process 00:13:26.951 02:15:54 -- target/delete_subsystem.sh@45 -- # NOT wait 2078220 00:13:26.951 02:15:54 -- common/autotest_common.sh@650 -- # local es=0 00:13:26.951 02:15:54 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 2078220 00:13:26.951 02:15:54 -- common/autotest_common.sh@638 -- # local arg=wait 00:13:26.951 02:15:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:26.951 02:15:54 -- common/autotest_common.sh@642 -- # type -t wait 00:13:26.951 02:15:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:26.951 02:15:54 -- common/autotest_common.sh@653 -- # wait 2078220 00:13:26.951 02:15:54 -- common/autotest_common.sh@653 -- # es=1 00:13:26.951 02:15:54 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:26.951 02:15:54 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:26.951 02:15:54 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:26.951 02:15:54 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:26.951 02:15:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.951 02:15:54 -- common/autotest_common.sh@10 -- # set +x 00:13:26.951 02:15:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.951 02:15:54 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:26.951 02:15:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.951 02:15:54 -- common/autotest_common.sh@10 -- # set +x 00:13:26.951 [2024-12-08 02:15:54.581840] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:26.951 02:15:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.951 02:15:54 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:26.951 02:15:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.951 02:15:54 -- common/autotest_common.sh@10 -- # set +x 00:13:26.951 02:15:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.951 02:15:54 -- target/delete_subsystem.sh@54 -- # perf_pid=2078633 00:13:26.951 02:15:54 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:26.951 02:15:54 -- target/delete_subsystem.sh@56 -- # delay=0 00:13:26.951 02:15:54 -- target/delete_subsystem.sh@57 -- # kill -0 2078633 00:13:26.951 02:15:54 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:26.951 EAL: No free 2048 kB hugepages reported on node 1 00:13:26.951 [2024-12-08 02:15:54.637880] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:27.519 02:15:55 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:27.519 02:15:55 -- target/delete_subsystem.sh@57 -- # kill -0 2078633 00:13:27.519 02:15:55 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:28.085 02:15:55 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:28.085 02:15:55 -- target/delete_subsystem.sh@57 -- # kill -0 2078633 00:13:28.085 02:15:55 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:28.342 02:15:56 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:28.342 02:15:56 -- target/delete_subsystem.sh@57 -- # kill -0 2078633 00:13:28.342 02:15:56 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:28.907 02:15:56 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:28.907 02:15:56 -- target/delete_subsystem.sh@57 -- # kill -0 2078633 00:13:28.907 02:15:56 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:29.472 02:15:57 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:29.472 02:15:57 -- target/delete_subsystem.sh@57 -- # kill -0 2078633 00:13:29.472 02:15:57 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:30.082 02:15:57 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:30.082 02:15:57 -- target/delete_subsystem.sh@57 -- # kill -0 2078633 00:13:30.082 02:15:57 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:30.339 Initializing NVMe Controllers 00:13:30.339 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:30.339 Controller IO queue size 128, less than required. 00:13:30.339 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:30.339 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:13:30.339 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:13:30.339 Initialization complete. Launching workers. 00:13:30.339 ======================================================== 00:13:30.339 Latency(us) 00:13:30.339 Device Information : IOPS MiB/s Average min max 00:13:30.339 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1003903.03 1000169.83 1011584.59 00:13:30.339 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1003754.32 1000166.43 1042526.05 00:13:30.339 ======================================================== 00:13:30.339 Total : 256.00 0.12 1003828.68 1000166.43 1042526.05 00:13:30.339 00:13:30.339 02:15:58 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:30.339 02:15:58 -- target/delete_subsystem.sh@57 -- # kill -0 2078633 00:13:30.339 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (2078633) - No such process 00:13:30.339 02:15:58 -- target/delete_subsystem.sh@67 -- # wait 2078633 00:13:30.339 02:15:58 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:13:30.339 02:15:58 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:13:30.339 02:15:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:30.339 02:15:58 -- nvmf/common.sh@116 -- # sync 00:13:30.339 02:15:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:30.339 02:15:58 -- nvmf/common.sh@119 -- # set +e 00:13:30.339 02:15:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:30.339 02:15:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:30.596 rmmod nvme_tcp 00:13:30.596 rmmod nvme_fabrics 00:13:30.597 rmmod nvme_keyring 00:13:30.597 02:15:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:30.597 02:15:58 -- nvmf/common.sh@123 -- # set -e 00:13:30.597 02:15:58 -- nvmf/common.sh@124 -- # return 0 00:13:30.597 02:15:58 -- nvmf/common.sh@477 -- # '[' -n 2078057 ']' 00:13:30.597 02:15:58 -- nvmf/common.sh@478 -- # killprocess 2078057 00:13:30.597 02:15:58 -- common/autotest_common.sh@936 -- # '[' -z 2078057 ']' 00:13:30.597 02:15:58 -- common/autotest_common.sh@940 -- # kill -0 2078057 00:13:30.597 02:15:58 -- common/autotest_common.sh@941 -- # uname 00:13:30.597 02:15:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:30.597 02:15:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2078057 00:13:30.597 02:15:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:30.597 02:15:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:30.597 02:15:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2078057' 00:13:30.597 killing process with pid 2078057 00:13:30.597 02:15:58 -- common/autotest_common.sh@955 -- # kill 2078057 00:13:30.597 02:15:58 -- common/autotest_common.sh@960 -- # wait 2078057 00:13:30.891 02:15:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:30.891 02:15:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:30.891 02:15:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:30.891 02:15:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:30.891 02:15:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:30.891 02:15:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:30.891 02:15:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:30.891 02:15:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:32.822 02:16:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:32.822 00:13:32.822 real 0m12.955s 00:13:32.822 user 0m29.487s 00:13:32.822 sys 0m2.874s 00:13:32.822 02:16:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:32.822 02:16:00 -- common/autotest_common.sh@10 -- # set +x 00:13:32.822 ************************************ 00:13:32.822 END TEST nvmf_delete_subsystem 00:13:32.822 ************************************ 00:13:32.822 02:16:00 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:13:32.822 02:16:00 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:13:32.822 02:16:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:32.822 02:16:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:32.822 02:16:00 -- common/autotest_common.sh@10 -- # set +x 00:13:32.822 ************************************ 00:13:32.822 START TEST nvmf_nvme_cli 00:13:32.822 ************************************ 00:13:32.822 02:16:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:13:33.081 * Looking for test storage... 00:13:33.081 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:33.081 02:16:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:33.081 02:16:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:33.081 02:16:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:33.081 02:16:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:33.081 02:16:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:33.081 02:16:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:33.081 02:16:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:33.081 02:16:00 -- scripts/common.sh@335 -- # IFS=.-: 00:13:33.081 02:16:00 -- scripts/common.sh@335 -- # read -ra ver1 00:13:33.081 02:16:00 -- scripts/common.sh@336 -- # IFS=.-: 00:13:33.081 02:16:00 -- scripts/common.sh@336 -- # read -ra ver2 00:13:33.081 02:16:00 -- scripts/common.sh@337 -- # local 'op=<' 00:13:33.081 02:16:00 -- scripts/common.sh@339 -- # ver1_l=2 00:13:33.081 02:16:00 -- scripts/common.sh@340 -- # ver2_l=1 00:13:33.081 02:16:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:33.081 02:16:00 -- scripts/common.sh@343 -- # case "$op" in 00:13:33.081 02:16:00 -- scripts/common.sh@344 -- # : 1 00:13:33.081 02:16:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:33.081 02:16:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:33.081 02:16:00 -- scripts/common.sh@364 -- # decimal 1 00:13:33.081 02:16:00 -- scripts/common.sh@352 -- # local d=1 00:13:33.081 02:16:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:33.081 02:16:00 -- scripts/common.sh@354 -- # echo 1 00:13:33.081 02:16:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:33.082 02:16:00 -- scripts/common.sh@365 -- # decimal 2 00:13:33.082 02:16:00 -- scripts/common.sh@352 -- # local d=2 00:13:33.082 02:16:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:33.082 02:16:00 -- scripts/common.sh@354 -- # echo 2 00:13:33.082 02:16:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:33.082 02:16:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:33.082 02:16:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:33.082 02:16:00 -- scripts/common.sh@367 -- # return 0 00:13:33.082 02:16:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:33.082 02:16:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:33.082 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:33.082 --rc genhtml_branch_coverage=1 00:13:33.082 --rc genhtml_function_coverage=1 00:13:33.082 --rc genhtml_legend=1 00:13:33.082 --rc geninfo_all_blocks=1 00:13:33.082 --rc geninfo_unexecuted_blocks=1 00:13:33.082 00:13:33.082 ' 00:13:33.082 02:16:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:33.082 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:33.082 --rc genhtml_branch_coverage=1 00:13:33.082 --rc genhtml_function_coverage=1 00:13:33.082 --rc genhtml_legend=1 00:13:33.082 --rc geninfo_all_blocks=1 00:13:33.082 --rc geninfo_unexecuted_blocks=1 00:13:33.082 00:13:33.082 ' 00:13:33.082 02:16:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:33.082 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:33.082 --rc genhtml_branch_coverage=1 00:13:33.082 --rc genhtml_function_coverage=1 00:13:33.082 --rc genhtml_legend=1 00:13:33.082 --rc geninfo_all_blocks=1 00:13:33.082 --rc geninfo_unexecuted_blocks=1 00:13:33.082 00:13:33.082 ' 00:13:33.082 02:16:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:33.082 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:33.082 --rc genhtml_branch_coverage=1 00:13:33.082 --rc genhtml_function_coverage=1 00:13:33.082 --rc genhtml_legend=1 00:13:33.082 --rc geninfo_all_blocks=1 00:13:33.082 --rc geninfo_unexecuted_blocks=1 00:13:33.082 00:13:33.082 ' 00:13:33.082 02:16:00 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:33.082 02:16:00 -- nvmf/common.sh@7 -- # uname -s 00:13:33.082 02:16:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:33.082 02:16:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:33.082 02:16:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:33.082 02:16:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:33.082 02:16:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:33.082 02:16:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:33.082 02:16:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:33.082 02:16:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:33.082 02:16:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:33.082 02:16:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:33.082 02:16:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:33.082 02:16:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:33.082 02:16:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:33.082 02:16:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:33.082 02:16:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:33.082 02:16:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:33.082 02:16:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:33.082 02:16:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:33.082 02:16:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:33.082 02:16:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:33.082 02:16:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:33.082 02:16:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:33.082 02:16:00 -- paths/export.sh@5 -- # export PATH 00:13:33.082 02:16:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:33.082 02:16:00 -- nvmf/common.sh@46 -- # : 0 00:13:33.082 02:16:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:33.082 02:16:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:33.082 02:16:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:33.082 02:16:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:33.082 02:16:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:33.082 02:16:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:33.082 02:16:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:33.082 02:16:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:33.082 02:16:00 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:33.082 02:16:00 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:33.082 02:16:00 -- target/nvme_cli.sh@14 -- # devs=() 00:13:33.082 02:16:00 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:13:33.082 02:16:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:33.082 02:16:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:33.082 02:16:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:33.082 02:16:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:33.082 02:16:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:33.082 02:16:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:33.082 02:16:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:33.082 02:16:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:33.082 02:16:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:33.082 02:16:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:33.082 02:16:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:33.082 02:16:00 -- common/autotest_common.sh@10 -- # set +x 00:13:34.985 02:16:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:34.985 02:16:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:34.985 02:16:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:34.985 02:16:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:34.985 02:16:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:34.985 02:16:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:34.985 02:16:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:34.985 02:16:02 -- nvmf/common.sh@294 -- # net_devs=() 00:13:34.985 02:16:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:34.985 02:16:02 -- nvmf/common.sh@295 -- # e810=() 00:13:34.985 02:16:02 -- nvmf/common.sh@295 -- # local -ga e810 00:13:34.985 02:16:02 -- nvmf/common.sh@296 -- # x722=() 00:13:34.985 02:16:02 -- nvmf/common.sh@296 -- # local -ga x722 00:13:34.985 02:16:02 -- nvmf/common.sh@297 -- # mlx=() 00:13:34.985 02:16:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:34.985 02:16:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:34.985 02:16:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:34.985 02:16:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:34.985 02:16:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:34.985 02:16:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:34.985 02:16:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:34.985 02:16:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:34.985 02:16:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:34.985 02:16:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:34.985 02:16:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:34.985 02:16:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:34.985 02:16:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:34.985 02:16:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:34.985 02:16:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:34.985 02:16:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:34.985 02:16:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:34.985 02:16:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:34.985 02:16:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:34.985 02:16:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:34.985 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:34.985 02:16:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:34.985 02:16:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:34.985 02:16:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:34.985 02:16:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:34.985 02:16:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:34.985 02:16:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:34.985 02:16:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:34.985 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:34.985 02:16:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:34.985 02:16:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:34.985 02:16:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:34.985 02:16:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:34.985 02:16:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:34.985 02:16:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:34.985 02:16:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:34.985 02:16:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:34.985 02:16:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:34.985 02:16:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:34.985 02:16:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:34.985 02:16:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:34.985 02:16:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:34.985 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:34.985 02:16:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:34.985 02:16:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:34.985 02:16:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:34.985 02:16:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:34.985 02:16:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:35.244 02:16:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:35.244 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:35.244 02:16:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:35.244 02:16:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:35.244 02:16:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:35.244 02:16:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:35.244 02:16:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:35.244 02:16:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:35.244 02:16:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:35.244 02:16:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:35.244 02:16:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:35.244 02:16:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:35.244 02:16:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:35.244 02:16:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:35.244 02:16:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:35.244 02:16:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:35.244 02:16:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:35.244 02:16:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:35.244 02:16:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:35.244 02:16:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:35.244 02:16:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:35.244 02:16:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:35.244 02:16:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:35.244 02:16:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:35.244 02:16:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:35.244 02:16:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:35.244 02:16:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:35.244 02:16:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:35.244 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:35.244 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.128 ms 00:13:35.244 00:13:35.244 --- 10.0.0.2 ping statistics --- 00:13:35.244 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:35.244 rtt min/avg/max/mdev = 0.128/0.128/0.128/0.000 ms 00:13:35.244 02:16:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:35.244 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:35.244 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.089 ms 00:13:35.244 00:13:35.244 --- 10.0.0.1 ping statistics --- 00:13:35.244 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:35.244 rtt min/avg/max/mdev = 0.089/0.089/0.089/0.000 ms 00:13:35.244 02:16:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:35.244 02:16:02 -- nvmf/common.sh@410 -- # return 0 00:13:35.244 02:16:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:35.244 02:16:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:35.244 02:16:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:35.244 02:16:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:35.244 02:16:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:35.244 02:16:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:35.244 02:16:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:35.244 02:16:02 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:13:35.244 02:16:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:35.244 02:16:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:35.244 02:16:02 -- common/autotest_common.sh@10 -- # set +x 00:13:35.244 02:16:02 -- nvmf/common.sh@469 -- # nvmfpid=2081039 00:13:35.244 02:16:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:35.244 02:16:02 -- nvmf/common.sh@470 -- # waitforlisten 2081039 00:13:35.244 02:16:02 -- common/autotest_common.sh@829 -- # '[' -z 2081039 ']' 00:13:35.244 02:16:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:35.244 02:16:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:35.244 02:16:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:35.244 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:35.244 02:16:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:35.244 02:16:02 -- common/autotest_common.sh@10 -- # set +x 00:13:35.244 [2024-12-08 02:16:02.964261] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:35.244 [2024-12-08 02:16:02.964348] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:35.244 EAL: No free 2048 kB hugepages reported on node 1 00:13:35.503 [2024-12-08 02:16:03.036118] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:35.503 [2024-12-08 02:16:03.142099] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:35.503 [2024-12-08 02:16:03.142270] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:35.503 [2024-12-08 02:16:03.142290] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:35.503 [2024-12-08 02:16:03.142302] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:35.503 [2024-12-08 02:16:03.142450] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:35.503 [2024-12-08 02:16:03.142521] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:35.503 [2024-12-08 02:16:03.142570] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:35.503 [2024-12-08 02:16:03.142574] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:36.437 02:16:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:36.437 02:16:03 -- common/autotest_common.sh@862 -- # return 0 00:13:36.437 02:16:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:36.437 02:16:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:36.437 02:16:03 -- common/autotest_common.sh@10 -- # set +x 00:13:36.437 02:16:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:36.437 02:16:03 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:36.437 02:16:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.437 02:16:03 -- common/autotest_common.sh@10 -- # set +x 00:13:36.437 [2024-12-08 02:16:04.006215] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:36.437 02:16:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.437 02:16:04 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:13:36.437 02:16:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.437 02:16:04 -- common/autotest_common.sh@10 -- # set +x 00:13:36.437 Malloc0 00:13:36.437 02:16:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.437 02:16:04 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:13:36.437 02:16:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.437 02:16:04 -- common/autotest_common.sh@10 -- # set +x 00:13:36.437 Malloc1 00:13:36.437 02:16:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.437 02:16:04 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:13:36.437 02:16:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.437 02:16:04 -- common/autotest_common.sh@10 -- # set +x 00:13:36.437 02:16:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.437 02:16:04 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:13:36.437 02:16:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.437 02:16:04 -- common/autotest_common.sh@10 -- # set +x 00:13:36.437 02:16:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.437 02:16:04 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:36.437 02:16:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.437 02:16:04 -- common/autotest_common.sh@10 -- # set +x 00:13:36.437 02:16:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.437 02:16:04 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:36.437 02:16:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.437 02:16:04 -- common/autotest_common.sh@10 -- # set +x 00:13:36.437 [2024-12-08 02:16:04.089567] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:36.437 02:16:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.437 02:16:04 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:36.437 02:16:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.437 02:16:04 -- common/autotest_common.sh@10 -- # set +x 00:13:36.437 02:16:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.437 02:16:04 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:13:36.696 00:13:36.696 Discovery Log Number of Records 2, Generation counter 2 00:13:36.696 =====Discovery Log Entry 0====== 00:13:36.696 trtype: tcp 00:13:36.696 adrfam: ipv4 00:13:36.696 subtype: current discovery subsystem 00:13:36.696 treq: not required 00:13:36.696 portid: 0 00:13:36.696 trsvcid: 4420 00:13:36.696 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:13:36.696 traddr: 10.0.0.2 00:13:36.696 eflags: explicit discovery connections, duplicate discovery information 00:13:36.696 sectype: none 00:13:36.696 =====Discovery Log Entry 1====== 00:13:36.696 trtype: tcp 00:13:36.696 adrfam: ipv4 00:13:36.696 subtype: nvme subsystem 00:13:36.696 treq: not required 00:13:36.696 portid: 0 00:13:36.696 trsvcid: 4420 00:13:36.696 subnqn: nqn.2016-06.io.spdk:cnode1 00:13:36.696 traddr: 10.0.0.2 00:13:36.696 eflags: none 00:13:36.696 sectype: none 00:13:36.696 02:16:04 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:13:36.696 02:16:04 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:13:36.696 02:16:04 -- nvmf/common.sh@510 -- # local dev _ 00:13:36.696 02:16:04 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:36.696 02:16:04 -- nvmf/common.sh@509 -- # nvme list 00:13:36.697 02:16:04 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:13:36.697 02:16:04 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:36.697 02:16:04 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:13:36.697 02:16:04 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:36.697 02:16:04 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:13:36.697 02:16:04 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:37.263 02:16:04 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:13:37.263 02:16:04 -- common/autotest_common.sh@1187 -- # local i=0 00:13:37.263 02:16:04 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:37.263 02:16:04 -- common/autotest_common.sh@1189 -- # [[ -n 2 ]] 00:13:37.263 02:16:04 -- common/autotest_common.sh@1190 -- # nvme_device_counter=2 00:13:37.263 02:16:04 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:39.158 02:16:06 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:39.158 02:16:06 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:39.158 02:16:06 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:39.158 02:16:06 -- common/autotest_common.sh@1196 -- # nvme_devices=2 00:13:39.158 02:16:06 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:39.158 02:16:06 -- common/autotest_common.sh@1197 -- # return 0 00:13:39.158 02:16:06 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:13:39.158 02:16:06 -- nvmf/common.sh@510 -- # local dev _ 00:13:39.158 02:16:06 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:39.158 02:16:06 -- nvmf/common.sh@509 -- # nvme list 00:13:39.415 02:16:07 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:13:39.415 02:16:07 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:39.415 02:16:07 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:13:39.415 02:16:07 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:39.415 02:16:07 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:13:39.415 02:16:07 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:13:39.415 02:16:07 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:39.415 02:16:07 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:13:39.415 02:16:07 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:13:39.415 02:16:07 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:39.415 02:16:07 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:13:39.415 /dev/nvme0n2 ]] 00:13:39.415 02:16:07 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:13:39.415 02:16:07 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:13:39.415 02:16:07 -- nvmf/common.sh@510 -- # local dev _ 00:13:39.415 02:16:07 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:39.415 02:16:07 -- nvmf/common.sh@509 -- # nvme list 00:13:39.673 02:16:07 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:13:39.673 02:16:07 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:39.673 02:16:07 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:13:39.673 02:16:07 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:39.673 02:16:07 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:13:39.673 02:16:07 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:13:39.673 02:16:07 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:39.673 02:16:07 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:13:39.673 02:16:07 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:13:39.673 02:16:07 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:39.673 02:16:07 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:13:39.673 02:16:07 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:39.673 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:39.931 02:16:07 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:39.931 02:16:07 -- common/autotest_common.sh@1208 -- # local i=0 00:13:39.931 02:16:07 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:39.931 02:16:07 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:39.931 02:16:07 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:39.931 02:16:07 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:39.931 02:16:07 -- common/autotest_common.sh@1220 -- # return 0 00:13:39.931 02:16:07 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:13:39.931 02:16:07 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:39.931 02:16:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:39.931 02:16:07 -- common/autotest_common.sh@10 -- # set +x 00:13:39.931 02:16:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:39.931 02:16:07 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:13:39.931 02:16:07 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:13:39.931 02:16:07 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:39.931 02:16:07 -- nvmf/common.sh@116 -- # sync 00:13:39.931 02:16:07 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:39.931 02:16:07 -- nvmf/common.sh@119 -- # set +e 00:13:39.931 02:16:07 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:39.931 02:16:07 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:39.931 rmmod nvme_tcp 00:13:39.931 rmmod nvme_fabrics 00:13:39.931 rmmod nvme_keyring 00:13:39.931 02:16:07 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:39.931 02:16:07 -- nvmf/common.sh@123 -- # set -e 00:13:39.931 02:16:07 -- nvmf/common.sh@124 -- # return 0 00:13:39.931 02:16:07 -- nvmf/common.sh@477 -- # '[' -n 2081039 ']' 00:13:39.931 02:16:07 -- nvmf/common.sh@478 -- # killprocess 2081039 00:13:39.931 02:16:07 -- common/autotest_common.sh@936 -- # '[' -z 2081039 ']' 00:13:39.931 02:16:07 -- common/autotest_common.sh@940 -- # kill -0 2081039 00:13:39.931 02:16:07 -- common/autotest_common.sh@941 -- # uname 00:13:39.931 02:16:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:39.931 02:16:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2081039 00:13:39.931 02:16:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:39.931 02:16:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:39.931 02:16:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2081039' 00:13:39.931 killing process with pid 2081039 00:13:39.931 02:16:07 -- common/autotest_common.sh@955 -- # kill 2081039 00:13:39.931 02:16:07 -- common/autotest_common.sh@960 -- # wait 2081039 00:13:40.190 02:16:07 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:40.190 02:16:07 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:40.190 02:16:07 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:40.190 02:16:07 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:40.190 02:16:07 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:40.190 02:16:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:40.190 02:16:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:40.190 02:16:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:42.725 02:16:09 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:42.725 00:13:42.725 real 0m9.386s 00:13:42.725 user 0m19.595s 00:13:42.725 sys 0m2.329s 00:13:42.725 02:16:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:42.725 02:16:09 -- common/autotest_common.sh@10 -- # set +x 00:13:42.725 ************************************ 00:13:42.725 END TEST nvmf_nvme_cli 00:13:42.725 ************************************ 00:13:42.725 02:16:09 -- nvmf/nvmf.sh@39 -- # [[ 0 -eq 1 ]] 00:13:42.725 02:16:09 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:13:42.725 02:16:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:42.725 02:16:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:42.725 02:16:09 -- common/autotest_common.sh@10 -- # set +x 00:13:42.725 ************************************ 00:13:42.725 START TEST nvmf_host_management 00:13:42.725 ************************************ 00:13:42.725 02:16:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:13:42.725 * Looking for test storage... 00:13:42.725 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:42.725 02:16:10 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:42.725 02:16:10 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:42.725 02:16:10 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:42.725 02:16:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:42.725 02:16:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:42.725 02:16:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:42.725 02:16:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:42.725 02:16:10 -- scripts/common.sh@335 -- # IFS=.-: 00:13:42.725 02:16:10 -- scripts/common.sh@335 -- # read -ra ver1 00:13:42.725 02:16:10 -- scripts/common.sh@336 -- # IFS=.-: 00:13:42.725 02:16:10 -- scripts/common.sh@336 -- # read -ra ver2 00:13:42.725 02:16:10 -- scripts/common.sh@337 -- # local 'op=<' 00:13:42.725 02:16:10 -- scripts/common.sh@339 -- # ver1_l=2 00:13:42.725 02:16:10 -- scripts/common.sh@340 -- # ver2_l=1 00:13:42.725 02:16:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:42.725 02:16:10 -- scripts/common.sh@343 -- # case "$op" in 00:13:42.725 02:16:10 -- scripts/common.sh@344 -- # : 1 00:13:42.725 02:16:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:42.725 02:16:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:42.725 02:16:10 -- scripts/common.sh@364 -- # decimal 1 00:13:42.725 02:16:10 -- scripts/common.sh@352 -- # local d=1 00:13:42.725 02:16:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:42.725 02:16:10 -- scripts/common.sh@354 -- # echo 1 00:13:42.725 02:16:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:42.725 02:16:10 -- scripts/common.sh@365 -- # decimal 2 00:13:42.725 02:16:10 -- scripts/common.sh@352 -- # local d=2 00:13:42.725 02:16:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:42.725 02:16:10 -- scripts/common.sh@354 -- # echo 2 00:13:42.725 02:16:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:42.725 02:16:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:42.725 02:16:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:42.725 02:16:10 -- scripts/common.sh@367 -- # return 0 00:13:42.725 02:16:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:42.725 02:16:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:42.725 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:42.725 --rc genhtml_branch_coverage=1 00:13:42.725 --rc genhtml_function_coverage=1 00:13:42.725 --rc genhtml_legend=1 00:13:42.725 --rc geninfo_all_blocks=1 00:13:42.725 --rc geninfo_unexecuted_blocks=1 00:13:42.725 00:13:42.725 ' 00:13:42.725 02:16:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:42.725 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:42.725 --rc genhtml_branch_coverage=1 00:13:42.725 --rc genhtml_function_coverage=1 00:13:42.725 --rc genhtml_legend=1 00:13:42.725 --rc geninfo_all_blocks=1 00:13:42.725 --rc geninfo_unexecuted_blocks=1 00:13:42.725 00:13:42.725 ' 00:13:42.725 02:16:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:42.725 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:42.725 --rc genhtml_branch_coverage=1 00:13:42.725 --rc genhtml_function_coverage=1 00:13:42.725 --rc genhtml_legend=1 00:13:42.725 --rc geninfo_all_blocks=1 00:13:42.725 --rc geninfo_unexecuted_blocks=1 00:13:42.725 00:13:42.725 ' 00:13:42.725 02:16:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:42.725 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:42.725 --rc genhtml_branch_coverage=1 00:13:42.725 --rc genhtml_function_coverage=1 00:13:42.725 --rc genhtml_legend=1 00:13:42.725 --rc geninfo_all_blocks=1 00:13:42.725 --rc geninfo_unexecuted_blocks=1 00:13:42.725 00:13:42.725 ' 00:13:42.725 02:16:10 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:42.725 02:16:10 -- nvmf/common.sh@7 -- # uname -s 00:13:42.725 02:16:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:42.725 02:16:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:42.725 02:16:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:42.725 02:16:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:42.725 02:16:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:42.725 02:16:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:42.725 02:16:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:42.725 02:16:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:42.725 02:16:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:42.725 02:16:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:42.725 02:16:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:42.725 02:16:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:42.725 02:16:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:42.725 02:16:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:42.725 02:16:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:42.725 02:16:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:42.725 02:16:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:42.725 02:16:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:42.725 02:16:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:42.725 02:16:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:42.725 02:16:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:42.725 02:16:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:42.725 02:16:10 -- paths/export.sh@5 -- # export PATH 00:13:42.725 02:16:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:42.725 02:16:10 -- nvmf/common.sh@46 -- # : 0 00:13:42.725 02:16:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:42.725 02:16:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:42.725 02:16:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:42.725 02:16:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:42.725 02:16:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:42.725 02:16:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:42.726 02:16:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:42.726 02:16:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:42.726 02:16:10 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:42.726 02:16:10 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:42.726 02:16:10 -- target/host_management.sh@104 -- # nvmftestinit 00:13:42.726 02:16:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:42.726 02:16:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:42.726 02:16:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:42.726 02:16:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:42.726 02:16:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:42.726 02:16:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:42.726 02:16:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:42.726 02:16:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:42.726 02:16:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:42.726 02:16:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:42.726 02:16:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:42.726 02:16:10 -- common/autotest_common.sh@10 -- # set +x 00:13:44.626 02:16:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:44.627 02:16:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:44.627 02:16:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:44.627 02:16:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:44.627 02:16:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:44.627 02:16:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:44.627 02:16:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:44.627 02:16:12 -- nvmf/common.sh@294 -- # net_devs=() 00:13:44.627 02:16:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:44.627 02:16:12 -- nvmf/common.sh@295 -- # e810=() 00:13:44.627 02:16:12 -- nvmf/common.sh@295 -- # local -ga e810 00:13:44.627 02:16:12 -- nvmf/common.sh@296 -- # x722=() 00:13:44.627 02:16:12 -- nvmf/common.sh@296 -- # local -ga x722 00:13:44.627 02:16:12 -- nvmf/common.sh@297 -- # mlx=() 00:13:44.627 02:16:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:44.627 02:16:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:44.627 02:16:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:44.627 02:16:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:44.627 02:16:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:44.627 02:16:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:44.627 02:16:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:44.627 02:16:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:44.627 02:16:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:44.627 02:16:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:44.627 02:16:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:44.627 02:16:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:44.627 02:16:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:44.627 02:16:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:44.627 02:16:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:44.627 02:16:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:44.627 02:16:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:44.627 02:16:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:44.627 02:16:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:44.627 02:16:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:44.627 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:44.627 02:16:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:44.627 02:16:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:44.627 02:16:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:44.627 02:16:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:44.627 02:16:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:44.627 02:16:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:44.627 02:16:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:44.627 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:44.627 02:16:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:44.627 02:16:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:44.627 02:16:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:44.627 02:16:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:44.627 02:16:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:44.627 02:16:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:44.627 02:16:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:44.627 02:16:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:44.627 02:16:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:44.627 02:16:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:44.627 02:16:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:44.627 02:16:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:44.627 02:16:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:44.627 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:44.627 02:16:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:44.627 02:16:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:44.627 02:16:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:44.627 02:16:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:44.627 02:16:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:44.627 02:16:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:44.627 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:44.627 02:16:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:44.627 02:16:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:44.627 02:16:12 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:44.627 02:16:12 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:44.627 02:16:12 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:44.627 02:16:12 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:44.627 02:16:12 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:44.627 02:16:12 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:44.627 02:16:12 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:44.627 02:16:12 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:44.627 02:16:12 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:44.627 02:16:12 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:44.627 02:16:12 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:44.627 02:16:12 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:44.627 02:16:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:44.627 02:16:12 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:44.627 02:16:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:44.627 02:16:12 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:44.627 02:16:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:44.627 02:16:12 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:44.627 02:16:12 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:44.627 02:16:12 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:44.627 02:16:12 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:44.627 02:16:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:44.627 02:16:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:44.627 02:16:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:44.627 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:44.627 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.205 ms 00:13:44.627 00:13:44.627 --- 10.0.0.2 ping statistics --- 00:13:44.627 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:44.627 rtt min/avg/max/mdev = 0.205/0.205/0.205/0.000 ms 00:13:44.627 02:16:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:44.627 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:44.627 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.072 ms 00:13:44.627 00:13:44.627 --- 10.0.0.1 ping statistics --- 00:13:44.627 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:44.627 rtt min/avg/max/mdev = 0.072/0.072/0.072/0.000 ms 00:13:44.627 02:16:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:44.627 02:16:12 -- nvmf/common.sh@410 -- # return 0 00:13:44.627 02:16:12 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:44.627 02:16:12 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:44.627 02:16:12 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:44.628 02:16:12 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:44.628 02:16:12 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:44.628 02:16:12 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:44.628 02:16:12 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:44.628 02:16:12 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:13:44.628 02:16:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:13:44.628 02:16:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:44.628 02:16:12 -- common/autotest_common.sh@10 -- # set +x 00:13:44.628 ************************************ 00:13:44.628 START TEST nvmf_host_management 00:13:44.628 ************************************ 00:13:44.628 02:16:12 -- common/autotest_common.sh@1114 -- # nvmf_host_management 00:13:44.628 02:16:12 -- target/host_management.sh@69 -- # starttarget 00:13:44.628 02:16:12 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:13:44.628 02:16:12 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:44.628 02:16:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:44.628 02:16:12 -- common/autotest_common.sh@10 -- # set +x 00:13:44.628 02:16:12 -- nvmf/common.sh@469 -- # nvmfpid=2083680 00:13:44.628 02:16:12 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:13:44.628 02:16:12 -- nvmf/common.sh@470 -- # waitforlisten 2083680 00:13:44.628 02:16:12 -- common/autotest_common.sh@829 -- # '[' -z 2083680 ']' 00:13:44.628 02:16:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:44.628 02:16:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:44.628 02:16:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:44.628 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:44.628 02:16:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:44.628 02:16:12 -- common/autotest_common.sh@10 -- # set +x 00:13:44.628 [2024-12-08 02:16:12.284850] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:44.628 [2024-12-08 02:16:12.284949] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:44.628 EAL: No free 2048 kB hugepages reported on node 1 00:13:44.628 [2024-12-08 02:16:12.354165] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:44.887 [2024-12-08 02:16:12.473716] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:44.887 [2024-12-08 02:16:12.473887] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:44.887 [2024-12-08 02:16:12.473908] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:44.887 [2024-12-08 02:16:12.473923] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:44.887 [2024-12-08 02:16:12.474019] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:44.887 [2024-12-08 02:16:12.474079] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:44.887 [2024-12-08 02:16:12.474135] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:13:44.887 [2024-12-08 02:16:12.474138] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:45.821 02:16:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:45.821 02:16:13 -- common/autotest_common.sh@862 -- # return 0 00:13:45.821 02:16:13 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:45.821 02:16:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:45.821 02:16:13 -- common/autotest_common.sh@10 -- # set +x 00:13:45.821 02:16:13 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:45.821 02:16:13 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:45.821 02:16:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.821 02:16:13 -- common/autotest_common.sh@10 -- # set +x 00:13:45.821 [2024-12-08 02:16:13.289109] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:45.821 02:16:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.821 02:16:13 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:13:45.821 02:16:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:45.821 02:16:13 -- common/autotest_common.sh@10 -- # set +x 00:13:45.821 02:16:13 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:13:45.821 02:16:13 -- target/host_management.sh@23 -- # cat 00:13:45.821 02:16:13 -- target/host_management.sh@30 -- # rpc_cmd 00:13:45.821 02:16:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.821 02:16:13 -- common/autotest_common.sh@10 -- # set +x 00:13:45.821 Malloc0 00:13:45.821 [2024-12-08 02:16:13.348121] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:45.821 02:16:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.821 02:16:13 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:13:45.821 02:16:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:45.821 02:16:13 -- common/autotest_common.sh@10 -- # set +x 00:13:45.821 02:16:13 -- target/host_management.sh@73 -- # perfpid=2083859 00:13:45.821 02:16:13 -- target/host_management.sh@74 -- # waitforlisten 2083859 /var/tmp/bdevperf.sock 00:13:45.821 02:16:13 -- common/autotest_common.sh@829 -- # '[' -z 2083859 ']' 00:13:45.821 02:16:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:13:45.821 02:16:13 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:13:45.821 02:16:13 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:13:45.821 02:16:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:45.821 02:16:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:13:45.821 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:13:45.821 02:16:13 -- nvmf/common.sh@520 -- # config=() 00:13:45.821 02:16:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:45.821 02:16:13 -- nvmf/common.sh@520 -- # local subsystem config 00:13:45.821 02:16:13 -- common/autotest_common.sh@10 -- # set +x 00:13:45.821 02:16:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:13:45.821 02:16:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:13:45.821 { 00:13:45.821 "params": { 00:13:45.821 "name": "Nvme$subsystem", 00:13:45.822 "trtype": "$TEST_TRANSPORT", 00:13:45.822 "traddr": "$NVMF_FIRST_TARGET_IP", 00:13:45.822 "adrfam": "ipv4", 00:13:45.822 "trsvcid": "$NVMF_PORT", 00:13:45.822 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:13:45.822 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:13:45.822 "hdgst": ${hdgst:-false}, 00:13:45.822 "ddgst": ${ddgst:-false} 00:13:45.822 }, 00:13:45.822 "method": "bdev_nvme_attach_controller" 00:13:45.822 } 00:13:45.822 EOF 00:13:45.822 )") 00:13:45.822 02:16:13 -- nvmf/common.sh@542 -- # cat 00:13:45.822 02:16:13 -- nvmf/common.sh@544 -- # jq . 00:13:45.822 02:16:13 -- nvmf/common.sh@545 -- # IFS=, 00:13:45.822 02:16:13 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:13:45.822 "params": { 00:13:45.822 "name": "Nvme0", 00:13:45.822 "trtype": "tcp", 00:13:45.822 "traddr": "10.0.0.2", 00:13:45.822 "adrfam": "ipv4", 00:13:45.822 "trsvcid": "4420", 00:13:45.822 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:13:45.822 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:13:45.822 "hdgst": false, 00:13:45.822 "ddgst": false 00:13:45.822 }, 00:13:45.822 "method": "bdev_nvme_attach_controller" 00:13:45.822 }' 00:13:45.822 [2024-12-08 02:16:13.415481] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:45.822 [2024-12-08 02:16:13.415584] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2083859 ] 00:13:45.822 EAL: No free 2048 kB hugepages reported on node 1 00:13:45.822 [2024-12-08 02:16:13.479152] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:45.822 [2024-12-08 02:16:13.587699] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:46.082 Running I/O for 10 seconds... 00:13:46.649 02:16:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:46.649 02:16:14 -- common/autotest_common.sh@862 -- # return 0 00:13:46.649 02:16:14 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:13:46.649 02:16:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.649 02:16:14 -- common/autotest_common.sh@10 -- # set +x 00:13:46.649 02:16:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.649 02:16:14 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:13:46.649 02:16:14 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:13:46.649 02:16:14 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:13:46.649 02:16:14 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:13:46.649 02:16:14 -- target/host_management.sh@52 -- # local ret=1 00:13:46.649 02:16:14 -- target/host_management.sh@53 -- # local i 00:13:46.649 02:16:14 -- target/host_management.sh@54 -- # (( i = 10 )) 00:13:46.649 02:16:14 -- target/host_management.sh@54 -- # (( i != 0 )) 00:13:46.649 02:16:14 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:13:46.649 02:16:14 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:13:46.649 02:16:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.649 02:16:14 -- common/autotest_common.sh@10 -- # set +x 00:13:46.910 02:16:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.910 02:16:14 -- target/host_management.sh@55 -- # read_io_count=2617 00:13:46.910 02:16:14 -- target/host_management.sh@58 -- # '[' 2617 -ge 100 ']' 00:13:46.910 02:16:14 -- target/host_management.sh@59 -- # ret=0 00:13:46.910 02:16:14 -- target/host_management.sh@60 -- # break 00:13:46.910 02:16:14 -- target/host_management.sh@64 -- # return 0 00:13:46.910 02:16:14 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:13:46.910 02:16:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.910 02:16:14 -- common/autotest_common.sh@10 -- # set +x 00:13:46.910 [2024-12-08 02:16:14.468382] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468495] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468511] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468524] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468543] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468558] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468570] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468593] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468605] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468616] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468628] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468640] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468652] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468663] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468676] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468687] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468699] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468711] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468723] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468734] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468756] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468770] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468782] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468794] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468805] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468817] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468829] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468840] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468857] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468868] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468879] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468891] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468902] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468921] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468933] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468945] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468956] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468968] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.468979] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xac5e60 is same with the state(5) to be set 00:13:46.910 [2024-12-08 02:16:14.470997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:95360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.910 [2024-12-08 02:16:14.471039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.910 [2024-12-08 02:16:14.471068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:95488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.910 [2024-12-08 02:16:14.471084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.910 [2024-12-08 02:16:14.471102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:95872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.910 [2024-12-08 02:16:14.471117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.910 [2024-12-08 02:16:14.471132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:96256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.910 [2024-12-08 02:16:14.471147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.910 [2024-12-08 02:16:14.471168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:96384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.910 [2024-12-08 02:16:14.471184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.910 [2024-12-08 02:16:14.471200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:96512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.910 [2024-12-08 02:16:14.471214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.910 [2024-12-08 02:16:14.471229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:96640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.910 [2024-12-08 02:16:14.471242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.910 [2024-12-08 02:16:14.471274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:96768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.910 [2024-12-08 02:16:14.471290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.910 [2024-12-08 02:16:14.471306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:96896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.910 [2024-12-08 02:16:14.471323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.910 [2024-12-08 02:16:14.471338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:97024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.910 [2024-12-08 02:16:14.471354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.910 [2024-12-08 02:16:14.471369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:97152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.910 [2024-12-08 02:16:14.471384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.910 [2024-12-08 02:16:14.471401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:97280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.910 [2024-12-08 02:16:14.471415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.910 [2024-12-08 02:16:14.471431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:97408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.910 [2024-12-08 02:16:14.471445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.910 [2024-12-08 02:16:14.471460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:97536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.910 [2024-12-08 02:16:14.471473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.910 [2024-12-08 02:16:14.471489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:97664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.910 [2024-12-08 02:16:14.471502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.910 [2024-12-08 02:16:14.471517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:97792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.471531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.471555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:97920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.471574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.471596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:98048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.471610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.471626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:98176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.471640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.471655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:98304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.471668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.471684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:91264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.471698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.471713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:98432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.471727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.471742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:98560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.471756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.471771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:98688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.471784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.471799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:91520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.471813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.471828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:98816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.471848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.471863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:98944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.471877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.471892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:99072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.471906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.471920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:91776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.471934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.471953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:99200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.471967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.471983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:99328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.471997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.472013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:99456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.472026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.472041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:99584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.472055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.472072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:99712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.472086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.472101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:91904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.472114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.472130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:99840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.472144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.472159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:99968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.472173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.472188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:100096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.472202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.472217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:100224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.472231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.472246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:92032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.472259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.472275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:92928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.472288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.472304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:93056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.472322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.472337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:93184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.472351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.472367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:93312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.472381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.472396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:93696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.472410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.472425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:93824 len:12 02:16:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.911 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.472444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.472460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:94336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.472473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.472488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:100352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.472503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.472518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:100480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.472531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.472555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:100608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.472570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.472591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:100736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.472605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c 02:16:14 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:13:46.911 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.472624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:100864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.472638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.472653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:100992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.472667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.911 [2024-12-08 02:16:14.472682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:101120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.911 [2024-12-08 02:16:14.472700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.912 [2024-12-08 02:16:14.472717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:101248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.912 [2024-12-08 02:16:14.472731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c 02:16:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.912 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.912 [2024-12-08 02:16:14.472749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:101376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.912 [2024-12-08 02:16:14.472763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.912 [2024-12-08 02:16:14.472778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:101504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.912 [2024-12-08 02:16:14.472792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.912 [2024-12-08 02:16:14.472807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:101632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.912 [2024-12-08 02:16:14.472821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.912 02:16:14 -- common/autotest_common.sh@10 -- # set +x 00:13:46.912 [2024-12-08 02:16:14.472841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:101760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.912 [2024-12-08 02:16:14.472854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.912 [2024-12-08 02:16:14.472870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:101888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.912 [2024-12-08 02:16:14.472884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.912 [2024-12-08 02:16:14.472898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:102016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.912 [2024-12-08 02:16:14.472912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.912 [2024-12-08 02:16:14.472928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:94592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.912 [2024-12-08 02:16:14.472941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.912 [2024-12-08 02:16:14.472957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:102144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.912 [2024-12-08 02:16:14.472971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.912 [2024-12-08 02:16:14.472987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:94848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:46.912 [2024-12-08 02:16:14.473001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:46.912 [2024-12-08 02:16:14.473101] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x9f1030 was disconnected and freed. reset controller. 00:13:46.912 [2024-12-08 02:16:14.474267] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:13:46.912 task offset: 95360 on job bdev=Nvme0n1 fails 00:13:46.912 00:13:46.912 Latency(us) 00:13:46.912 [2024-12-08T01:16:14.693Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:46.912 [2024-12-08T01:16:14.693Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:13:46.912 [2024-12-08T01:16:14.693Z] Job: Nvme0n1 ended in about 0.71 seconds with error 00:13:46.912 Verification LBA range: start 0x0 length 0x400 00:13:46.912 Nvme0n1 : 0.71 3930.58 245.66 90.39 0.00 15685.04 2500.08 22330.79 00:13:46.912 [2024-12-08T01:16:14.693Z] =================================================================================================================== 00:13:46.912 [2024-12-08T01:16:14.693Z] Total : 3930.58 245.66 90.39 0.00 15685.04 2500.08 22330.79 00:13:46.912 [2024-12-08 02:16:14.476182] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:13:46.912 [2024-12-08 02:16:14.476211] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9f3160 (9): Bad file descriptor 00:13:46.912 02:16:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.912 02:16:14 -- target/host_management.sh@87 -- # sleep 1 00:13:46.912 [2024-12-08 02:16:14.484162] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:13:47.849 02:16:15 -- target/host_management.sh@91 -- # kill -9 2083859 00:13:47.849 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (2083859) - No such process 00:13:47.849 02:16:15 -- target/host_management.sh@91 -- # true 00:13:47.849 02:16:15 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:13:47.849 02:16:15 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:13:47.849 02:16:15 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:13:47.849 02:16:15 -- nvmf/common.sh@520 -- # config=() 00:13:47.849 02:16:15 -- nvmf/common.sh@520 -- # local subsystem config 00:13:47.849 02:16:15 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:13:47.849 02:16:15 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:13:47.849 { 00:13:47.849 "params": { 00:13:47.849 "name": "Nvme$subsystem", 00:13:47.849 "trtype": "$TEST_TRANSPORT", 00:13:47.849 "traddr": "$NVMF_FIRST_TARGET_IP", 00:13:47.849 "adrfam": "ipv4", 00:13:47.849 "trsvcid": "$NVMF_PORT", 00:13:47.849 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:13:47.849 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:13:47.849 "hdgst": ${hdgst:-false}, 00:13:47.849 "ddgst": ${ddgst:-false} 00:13:47.849 }, 00:13:47.849 "method": "bdev_nvme_attach_controller" 00:13:47.849 } 00:13:47.849 EOF 00:13:47.849 )") 00:13:47.849 02:16:15 -- nvmf/common.sh@542 -- # cat 00:13:47.849 02:16:15 -- nvmf/common.sh@544 -- # jq . 00:13:47.849 02:16:15 -- nvmf/common.sh@545 -- # IFS=, 00:13:47.849 02:16:15 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:13:47.849 "params": { 00:13:47.849 "name": "Nvme0", 00:13:47.849 "trtype": "tcp", 00:13:47.849 "traddr": "10.0.0.2", 00:13:47.849 "adrfam": "ipv4", 00:13:47.849 "trsvcid": "4420", 00:13:47.849 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:13:47.849 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:13:47.849 "hdgst": false, 00:13:47.849 "ddgst": false 00:13:47.849 }, 00:13:47.849 "method": "bdev_nvme_attach_controller" 00:13:47.849 }' 00:13:47.849 [2024-12-08 02:16:15.524028] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:47.849 [2024-12-08 02:16:15.524123] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2084143 ] 00:13:47.849 EAL: No free 2048 kB hugepages reported on node 1 00:13:47.849 [2024-12-08 02:16:15.584767] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:48.107 [2024-12-08 02:16:15.695140] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:48.365 Running I/O for 1 seconds... 00:13:49.299 00:13:49.299 Latency(us) 00:13:49.299 [2024-12-08T01:16:17.080Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:49.299 [2024-12-08T01:16:17.080Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:13:49.299 Verification LBA range: start 0x0 length 0x400 00:13:49.299 Nvme0n1 : 1.01 4040.01 252.50 0.00 0.00 15599.12 970.90 20680.25 00:13:49.299 [2024-12-08T01:16:17.080Z] =================================================================================================================== 00:13:49.299 [2024-12-08T01:16:17.080Z] Total : 4040.01 252.50 0.00 0.00 15599.12 970.90 20680.25 00:13:49.557 02:16:17 -- target/host_management.sh@101 -- # stoptarget 00:13:49.557 02:16:17 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:13:49.557 02:16:17 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:13:49.557 02:16:17 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:13:49.557 02:16:17 -- target/host_management.sh@40 -- # nvmftestfini 00:13:49.557 02:16:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:49.557 02:16:17 -- nvmf/common.sh@116 -- # sync 00:13:49.557 02:16:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:49.557 02:16:17 -- nvmf/common.sh@119 -- # set +e 00:13:49.557 02:16:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:49.557 02:16:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:49.557 rmmod nvme_tcp 00:13:49.814 rmmod nvme_fabrics 00:13:49.814 rmmod nvme_keyring 00:13:49.814 02:16:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:49.814 02:16:17 -- nvmf/common.sh@123 -- # set -e 00:13:49.814 02:16:17 -- nvmf/common.sh@124 -- # return 0 00:13:49.814 02:16:17 -- nvmf/common.sh@477 -- # '[' -n 2083680 ']' 00:13:49.814 02:16:17 -- nvmf/common.sh@478 -- # killprocess 2083680 00:13:49.814 02:16:17 -- common/autotest_common.sh@936 -- # '[' -z 2083680 ']' 00:13:49.814 02:16:17 -- common/autotest_common.sh@940 -- # kill -0 2083680 00:13:49.814 02:16:17 -- common/autotest_common.sh@941 -- # uname 00:13:49.814 02:16:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:49.814 02:16:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2083680 00:13:49.814 02:16:17 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:49.814 02:16:17 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:49.814 02:16:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2083680' 00:13:49.814 killing process with pid 2083680 00:13:49.814 02:16:17 -- common/autotest_common.sh@955 -- # kill 2083680 00:13:49.814 02:16:17 -- common/autotest_common.sh@960 -- # wait 2083680 00:13:50.073 [2024-12-08 02:16:17.678169] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:13:50.073 02:16:17 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:50.073 02:16:17 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:50.073 02:16:17 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:50.073 02:16:17 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:50.073 02:16:17 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:50.073 02:16:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:50.073 02:16:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:50.073 02:16:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:51.972 02:16:19 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:51.972 00:13:51.972 real 0m7.508s 00:13:51.972 user 0m23.507s 00:13:51.972 sys 0m1.414s 00:13:51.972 02:16:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:51.972 02:16:19 -- common/autotest_common.sh@10 -- # set +x 00:13:51.972 ************************************ 00:13:51.972 END TEST nvmf_host_management 00:13:51.972 ************************************ 00:13:52.231 02:16:19 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:13:52.231 00:13:52.231 real 0m9.796s 00:13:52.231 user 0m24.363s 00:13:52.231 sys 0m2.842s 00:13:52.231 02:16:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:52.232 02:16:19 -- common/autotest_common.sh@10 -- # set +x 00:13:52.232 ************************************ 00:13:52.232 END TEST nvmf_host_management 00:13:52.232 ************************************ 00:13:52.232 02:16:19 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:13:52.232 02:16:19 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:52.232 02:16:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:52.232 02:16:19 -- common/autotest_common.sh@10 -- # set +x 00:13:52.232 ************************************ 00:13:52.232 START TEST nvmf_lvol 00:13:52.232 ************************************ 00:13:52.232 02:16:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:13:52.232 * Looking for test storage... 00:13:52.232 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:52.232 02:16:19 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:52.232 02:16:19 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:52.232 02:16:19 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:52.232 02:16:19 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:52.232 02:16:19 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:52.232 02:16:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:52.232 02:16:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:52.232 02:16:19 -- scripts/common.sh@335 -- # IFS=.-: 00:13:52.232 02:16:19 -- scripts/common.sh@335 -- # read -ra ver1 00:13:52.232 02:16:19 -- scripts/common.sh@336 -- # IFS=.-: 00:13:52.232 02:16:19 -- scripts/common.sh@336 -- # read -ra ver2 00:13:52.232 02:16:19 -- scripts/common.sh@337 -- # local 'op=<' 00:13:52.232 02:16:19 -- scripts/common.sh@339 -- # ver1_l=2 00:13:52.232 02:16:19 -- scripts/common.sh@340 -- # ver2_l=1 00:13:52.232 02:16:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:52.232 02:16:19 -- scripts/common.sh@343 -- # case "$op" in 00:13:52.232 02:16:19 -- scripts/common.sh@344 -- # : 1 00:13:52.232 02:16:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:52.232 02:16:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:52.232 02:16:19 -- scripts/common.sh@364 -- # decimal 1 00:13:52.232 02:16:19 -- scripts/common.sh@352 -- # local d=1 00:13:52.232 02:16:19 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:52.232 02:16:19 -- scripts/common.sh@354 -- # echo 1 00:13:52.232 02:16:19 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:52.232 02:16:19 -- scripts/common.sh@365 -- # decimal 2 00:13:52.232 02:16:19 -- scripts/common.sh@352 -- # local d=2 00:13:52.232 02:16:19 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:52.232 02:16:19 -- scripts/common.sh@354 -- # echo 2 00:13:52.232 02:16:19 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:52.232 02:16:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:52.232 02:16:19 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:52.232 02:16:19 -- scripts/common.sh@367 -- # return 0 00:13:52.232 02:16:19 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:52.232 02:16:19 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:52.232 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:52.232 --rc genhtml_branch_coverage=1 00:13:52.232 --rc genhtml_function_coverage=1 00:13:52.232 --rc genhtml_legend=1 00:13:52.232 --rc geninfo_all_blocks=1 00:13:52.232 --rc geninfo_unexecuted_blocks=1 00:13:52.232 00:13:52.232 ' 00:13:52.232 02:16:19 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:52.232 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:52.232 --rc genhtml_branch_coverage=1 00:13:52.232 --rc genhtml_function_coverage=1 00:13:52.232 --rc genhtml_legend=1 00:13:52.232 --rc geninfo_all_blocks=1 00:13:52.232 --rc geninfo_unexecuted_blocks=1 00:13:52.232 00:13:52.232 ' 00:13:52.232 02:16:19 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:52.232 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:52.232 --rc genhtml_branch_coverage=1 00:13:52.232 --rc genhtml_function_coverage=1 00:13:52.232 --rc genhtml_legend=1 00:13:52.232 --rc geninfo_all_blocks=1 00:13:52.232 --rc geninfo_unexecuted_blocks=1 00:13:52.232 00:13:52.232 ' 00:13:52.232 02:16:19 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:52.232 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:52.232 --rc genhtml_branch_coverage=1 00:13:52.232 --rc genhtml_function_coverage=1 00:13:52.232 --rc genhtml_legend=1 00:13:52.232 --rc geninfo_all_blocks=1 00:13:52.232 --rc geninfo_unexecuted_blocks=1 00:13:52.232 00:13:52.232 ' 00:13:52.232 02:16:19 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:52.232 02:16:19 -- nvmf/common.sh@7 -- # uname -s 00:13:52.232 02:16:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:52.232 02:16:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:52.232 02:16:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:52.232 02:16:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:52.232 02:16:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:52.232 02:16:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:52.232 02:16:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:52.232 02:16:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:52.232 02:16:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:52.232 02:16:19 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:52.232 02:16:19 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:52.232 02:16:19 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:52.232 02:16:19 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:52.232 02:16:19 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:52.232 02:16:19 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:52.232 02:16:19 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:52.232 02:16:19 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:52.232 02:16:19 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:52.232 02:16:19 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:52.232 02:16:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:52.232 02:16:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:52.232 02:16:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:52.232 02:16:19 -- paths/export.sh@5 -- # export PATH 00:13:52.232 02:16:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:52.232 02:16:19 -- nvmf/common.sh@46 -- # : 0 00:13:52.232 02:16:19 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:52.232 02:16:19 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:52.232 02:16:19 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:52.232 02:16:19 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:52.232 02:16:19 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:52.232 02:16:19 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:52.232 02:16:19 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:52.232 02:16:19 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:52.232 02:16:19 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:52.232 02:16:19 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:52.232 02:16:19 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:13:52.232 02:16:19 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:13:52.232 02:16:19 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:52.232 02:16:19 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:13:52.232 02:16:19 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:52.232 02:16:19 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:52.232 02:16:19 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:52.232 02:16:19 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:52.232 02:16:19 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:52.232 02:16:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:52.232 02:16:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:52.232 02:16:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:52.232 02:16:19 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:52.232 02:16:19 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:52.232 02:16:19 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:52.232 02:16:19 -- common/autotest_common.sh@10 -- # set +x 00:13:54.766 02:16:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:54.766 02:16:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:54.766 02:16:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:54.766 02:16:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:54.766 02:16:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:54.766 02:16:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:54.766 02:16:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:54.766 02:16:22 -- nvmf/common.sh@294 -- # net_devs=() 00:13:54.766 02:16:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:54.766 02:16:22 -- nvmf/common.sh@295 -- # e810=() 00:13:54.766 02:16:22 -- nvmf/common.sh@295 -- # local -ga e810 00:13:54.766 02:16:22 -- nvmf/common.sh@296 -- # x722=() 00:13:54.766 02:16:22 -- nvmf/common.sh@296 -- # local -ga x722 00:13:54.766 02:16:22 -- nvmf/common.sh@297 -- # mlx=() 00:13:54.766 02:16:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:54.766 02:16:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:54.766 02:16:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:54.766 02:16:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:54.766 02:16:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:54.766 02:16:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:54.766 02:16:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:54.766 02:16:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:54.766 02:16:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:54.766 02:16:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:54.766 02:16:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:54.766 02:16:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:54.766 02:16:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:54.766 02:16:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:54.766 02:16:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:54.766 02:16:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:54.766 02:16:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:54.766 02:16:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:54.766 02:16:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:54.766 02:16:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:54.766 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:54.766 02:16:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:54.766 02:16:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:54.766 02:16:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:54.766 02:16:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:54.766 02:16:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:54.766 02:16:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:54.766 02:16:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:54.766 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:54.766 02:16:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:54.766 02:16:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:54.766 02:16:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:54.766 02:16:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:54.766 02:16:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:54.766 02:16:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:54.766 02:16:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:54.766 02:16:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:54.766 02:16:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:54.766 02:16:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:54.766 02:16:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:54.766 02:16:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:54.766 02:16:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:54.766 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:54.766 02:16:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:54.766 02:16:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:54.766 02:16:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:54.766 02:16:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:54.766 02:16:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:54.766 02:16:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:54.766 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:54.766 02:16:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:54.766 02:16:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:54.766 02:16:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:54.766 02:16:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:54.767 02:16:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:54.767 02:16:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:54.767 02:16:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:54.767 02:16:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:54.767 02:16:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:54.767 02:16:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:54.767 02:16:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:54.767 02:16:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:54.767 02:16:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:54.767 02:16:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:54.767 02:16:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:54.767 02:16:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:54.767 02:16:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:54.767 02:16:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:54.767 02:16:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:54.767 02:16:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:54.767 02:16:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:54.767 02:16:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:54.767 02:16:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:54.767 02:16:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:54.767 02:16:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:54.767 02:16:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:54.767 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:54.767 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.189 ms 00:13:54.767 00:13:54.767 --- 10.0.0.2 ping statistics --- 00:13:54.767 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:54.767 rtt min/avg/max/mdev = 0.189/0.189/0.189/0.000 ms 00:13:54.767 02:16:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:54.767 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:54.767 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.161 ms 00:13:54.767 00:13:54.767 --- 10.0.0.1 ping statistics --- 00:13:54.767 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:54.767 rtt min/avg/max/mdev = 0.161/0.161/0.161/0.000 ms 00:13:54.767 02:16:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:54.767 02:16:22 -- nvmf/common.sh@410 -- # return 0 00:13:54.767 02:16:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:54.767 02:16:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:54.767 02:16:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:54.767 02:16:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:54.767 02:16:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:54.767 02:16:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:54.767 02:16:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:54.767 02:16:22 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:13:54.767 02:16:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:54.767 02:16:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:54.767 02:16:22 -- common/autotest_common.sh@10 -- # set +x 00:13:54.767 02:16:22 -- nvmf/common.sh@469 -- # nvmfpid=2086382 00:13:54.767 02:16:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:13:54.767 02:16:22 -- nvmf/common.sh@470 -- # waitforlisten 2086382 00:13:54.767 02:16:22 -- common/autotest_common.sh@829 -- # '[' -z 2086382 ']' 00:13:54.767 02:16:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:54.767 02:16:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:54.767 02:16:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:54.767 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:54.767 02:16:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:54.767 02:16:22 -- common/autotest_common.sh@10 -- # set +x 00:13:54.767 [2024-12-08 02:16:22.286058] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:54.767 [2024-12-08 02:16:22.286128] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:54.767 EAL: No free 2048 kB hugepages reported on node 1 00:13:54.767 [2024-12-08 02:16:22.350513] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:54.767 [2024-12-08 02:16:22.459203] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:54.767 [2024-12-08 02:16:22.459354] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:54.767 [2024-12-08 02:16:22.459372] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:54.767 [2024-12-08 02:16:22.459384] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:54.767 [2024-12-08 02:16:22.459439] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:54.767 [2024-12-08 02:16:22.462557] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:54.767 [2024-12-08 02:16:22.462569] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:55.701 02:16:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:55.701 02:16:23 -- common/autotest_common.sh@862 -- # return 0 00:13:55.701 02:16:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:55.701 02:16:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:55.701 02:16:23 -- common/autotest_common.sh@10 -- # set +x 00:13:55.701 02:16:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:55.701 02:16:23 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:13:55.960 [2024-12-08 02:16:23.571436] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:55.960 02:16:23 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:13:56.218 02:16:23 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:13:56.218 02:16:23 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:13:56.476 02:16:24 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:13:56.476 02:16:24 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:13:56.735 02:16:24 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:13:56.993 02:16:24 -- target/nvmf_lvol.sh@29 -- # lvs=e7c89874-d111-4b30-8e16-7d1fefde60e0 00:13:56.993 02:16:24 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u e7c89874-d111-4b30-8e16-7d1fefde60e0 lvol 20 00:13:57.251 02:16:24 -- target/nvmf_lvol.sh@32 -- # lvol=06897d2f-e2dd-42ea-a0cd-2c5037cdfd21 00:13:57.251 02:16:24 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:13:57.508 02:16:25 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 06897d2f-e2dd-42ea-a0cd-2c5037cdfd21 00:13:57.764 02:16:25 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:13:58.021 [2024-12-08 02:16:25.643378] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:58.021 02:16:25 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:58.279 02:16:25 -- target/nvmf_lvol.sh@42 -- # perf_pid=2086829 00:13:58.279 02:16:25 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:13:58.279 02:16:25 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:13:58.279 EAL: No free 2048 kB hugepages reported on node 1 00:13:59.212 02:16:26 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 06897d2f-e2dd-42ea-a0cd-2c5037cdfd21 MY_SNAPSHOT 00:13:59.471 02:16:27 -- target/nvmf_lvol.sh@47 -- # snapshot=6beb727f-aefb-45da-9266-8993a655fdfd 00:13:59.471 02:16:27 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 06897d2f-e2dd-42ea-a0cd-2c5037cdfd21 30 00:13:59.736 02:16:27 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone 6beb727f-aefb-45da-9266-8993a655fdfd MY_CLONE 00:14:00.040 02:16:27 -- target/nvmf_lvol.sh@49 -- # clone=6d51f068-0a47-4806-91ac-f5036e62bb91 00:14:00.040 02:16:27 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 6d51f068-0a47-4806-91ac-f5036e62bb91 00:14:00.625 02:16:28 -- target/nvmf_lvol.sh@53 -- # wait 2086829 00:14:08.731 Initializing NVMe Controllers 00:14:08.731 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:14:08.731 Controller IO queue size 128, less than required. 00:14:08.731 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:08.731 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:14:08.731 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:14:08.731 Initialization complete. Launching workers. 00:14:08.731 ======================================================== 00:14:08.731 Latency(us) 00:14:08.731 Device Information : IOPS MiB/s Average min max 00:14:08.731 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10789.00 42.14 11866.93 1442.36 63898.96 00:14:08.731 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10662.80 41.65 12006.96 1858.09 61217.12 00:14:08.731 ======================================================== 00:14:08.731 Total : 21451.80 83.80 11936.54 1442.36 63898.96 00:14:08.731 00:14:08.731 02:16:36 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:08.731 02:16:36 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 06897d2f-e2dd-42ea-a0cd-2c5037cdfd21 00:14:08.989 02:16:36 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u e7c89874-d111-4b30-8e16-7d1fefde60e0 00:14:09.248 02:16:36 -- target/nvmf_lvol.sh@60 -- # rm -f 00:14:09.248 02:16:36 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:14:09.248 02:16:36 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:14:09.248 02:16:36 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:09.248 02:16:36 -- nvmf/common.sh@116 -- # sync 00:14:09.248 02:16:36 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:09.248 02:16:36 -- nvmf/common.sh@119 -- # set +e 00:14:09.248 02:16:36 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:09.248 02:16:36 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:09.248 rmmod nvme_tcp 00:14:09.248 rmmod nvme_fabrics 00:14:09.506 rmmod nvme_keyring 00:14:09.506 02:16:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:09.506 02:16:37 -- nvmf/common.sh@123 -- # set -e 00:14:09.506 02:16:37 -- nvmf/common.sh@124 -- # return 0 00:14:09.506 02:16:37 -- nvmf/common.sh@477 -- # '[' -n 2086382 ']' 00:14:09.506 02:16:37 -- nvmf/common.sh@478 -- # killprocess 2086382 00:14:09.506 02:16:37 -- common/autotest_common.sh@936 -- # '[' -z 2086382 ']' 00:14:09.506 02:16:37 -- common/autotest_common.sh@940 -- # kill -0 2086382 00:14:09.506 02:16:37 -- common/autotest_common.sh@941 -- # uname 00:14:09.506 02:16:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:09.506 02:16:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2086382 00:14:09.506 02:16:37 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:09.506 02:16:37 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:09.506 02:16:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2086382' 00:14:09.506 killing process with pid 2086382 00:14:09.506 02:16:37 -- common/autotest_common.sh@955 -- # kill 2086382 00:14:09.506 02:16:37 -- common/autotest_common.sh@960 -- # wait 2086382 00:14:09.765 02:16:37 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:09.765 02:16:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:09.765 02:16:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:09.765 02:16:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:09.765 02:16:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:09.765 02:16:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:09.765 02:16:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:09.765 02:16:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:12.298 02:16:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:12.298 00:14:12.298 real 0m19.665s 00:14:12.298 user 1m6.281s 00:14:12.298 sys 0m5.489s 00:14:12.298 02:16:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:12.298 02:16:39 -- common/autotest_common.sh@10 -- # set +x 00:14:12.298 ************************************ 00:14:12.298 END TEST nvmf_lvol 00:14:12.298 ************************************ 00:14:12.298 02:16:39 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:12.298 02:16:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:12.298 02:16:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:12.298 02:16:39 -- common/autotest_common.sh@10 -- # set +x 00:14:12.298 ************************************ 00:14:12.298 START TEST nvmf_lvs_grow 00:14:12.298 ************************************ 00:14:12.298 02:16:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:12.298 * Looking for test storage... 00:14:12.298 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:12.298 02:16:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:12.298 02:16:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:12.298 02:16:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:12.298 02:16:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:12.298 02:16:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:12.298 02:16:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:12.298 02:16:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:12.298 02:16:39 -- scripts/common.sh@335 -- # IFS=.-: 00:14:12.298 02:16:39 -- scripts/common.sh@335 -- # read -ra ver1 00:14:12.298 02:16:39 -- scripts/common.sh@336 -- # IFS=.-: 00:14:12.298 02:16:39 -- scripts/common.sh@336 -- # read -ra ver2 00:14:12.298 02:16:39 -- scripts/common.sh@337 -- # local 'op=<' 00:14:12.298 02:16:39 -- scripts/common.sh@339 -- # ver1_l=2 00:14:12.298 02:16:39 -- scripts/common.sh@340 -- # ver2_l=1 00:14:12.298 02:16:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:12.298 02:16:39 -- scripts/common.sh@343 -- # case "$op" in 00:14:12.298 02:16:39 -- scripts/common.sh@344 -- # : 1 00:14:12.298 02:16:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:12.298 02:16:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:12.298 02:16:39 -- scripts/common.sh@364 -- # decimal 1 00:14:12.298 02:16:39 -- scripts/common.sh@352 -- # local d=1 00:14:12.298 02:16:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:12.298 02:16:39 -- scripts/common.sh@354 -- # echo 1 00:14:12.298 02:16:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:12.298 02:16:39 -- scripts/common.sh@365 -- # decimal 2 00:14:12.298 02:16:39 -- scripts/common.sh@352 -- # local d=2 00:14:12.298 02:16:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:12.298 02:16:39 -- scripts/common.sh@354 -- # echo 2 00:14:12.298 02:16:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:12.298 02:16:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:12.298 02:16:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:12.298 02:16:39 -- scripts/common.sh@367 -- # return 0 00:14:12.298 02:16:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:12.298 02:16:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:12.298 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:12.298 --rc genhtml_branch_coverage=1 00:14:12.298 --rc genhtml_function_coverage=1 00:14:12.298 --rc genhtml_legend=1 00:14:12.298 --rc geninfo_all_blocks=1 00:14:12.298 --rc geninfo_unexecuted_blocks=1 00:14:12.298 00:14:12.298 ' 00:14:12.298 02:16:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:12.298 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:12.298 --rc genhtml_branch_coverage=1 00:14:12.298 --rc genhtml_function_coverage=1 00:14:12.298 --rc genhtml_legend=1 00:14:12.298 --rc geninfo_all_blocks=1 00:14:12.299 --rc geninfo_unexecuted_blocks=1 00:14:12.299 00:14:12.299 ' 00:14:12.299 02:16:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:12.299 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:12.299 --rc genhtml_branch_coverage=1 00:14:12.299 --rc genhtml_function_coverage=1 00:14:12.299 --rc genhtml_legend=1 00:14:12.299 --rc geninfo_all_blocks=1 00:14:12.299 --rc geninfo_unexecuted_blocks=1 00:14:12.299 00:14:12.299 ' 00:14:12.299 02:16:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:12.299 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:12.299 --rc genhtml_branch_coverage=1 00:14:12.299 --rc genhtml_function_coverage=1 00:14:12.299 --rc genhtml_legend=1 00:14:12.299 --rc geninfo_all_blocks=1 00:14:12.299 --rc geninfo_unexecuted_blocks=1 00:14:12.299 00:14:12.299 ' 00:14:12.299 02:16:39 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:12.299 02:16:39 -- nvmf/common.sh@7 -- # uname -s 00:14:12.299 02:16:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:12.299 02:16:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:12.299 02:16:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:12.299 02:16:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:12.299 02:16:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:12.299 02:16:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:12.299 02:16:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:12.299 02:16:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:12.299 02:16:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:12.299 02:16:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:12.299 02:16:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:12.299 02:16:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:12.299 02:16:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:12.299 02:16:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:12.299 02:16:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:12.299 02:16:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:12.299 02:16:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:12.299 02:16:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:12.299 02:16:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:12.299 02:16:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:12.299 02:16:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:12.299 02:16:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:12.299 02:16:39 -- paths/export.sh@5 -- # export PATH 00:14:12.299 02:16:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:12.299 02:16:39 -- nvmf/common.sh@46 -- # : 0 00:14:12.299 02:16:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:12.299 02:16:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:12.299 02:16:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:12.299 02:16:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:12.299 02:16:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:12.299 02:16:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:12.299 02:16:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:12.299 02:16:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:12.299 02:16:39 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:12.299 02:16:39 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:14:12.299 02:16:39 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:14:12.299 02:16:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:12.299 02:16:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:12.299 02:16:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:12.299 02:16:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:12.299 02:16:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:12.299 02:16:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:12.299 02:16:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:12.299 02:16:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:12.299 02:16:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:12.299 02:16:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:12.299 02:16:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:12.299 02:16:39 -- common/autotest_common.sh@10 -- # set +x 00:14:14.201 02:16:41 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:14.201 02:16:41 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:14.201 02:16:41 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:14.201 02:16:41 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:14.201 02:16:41 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:14.201 02:16:41 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:14.201 02:16:41 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:14.201 02:16:41 -- nvmf/common.sh@294 -- # net_devs=() 00:14:14.201 02:16:41 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:14.201 02:16:41 -- nvmf/common.sh@295 -- # e810=() 00:14:14.201 02:16:41 -- nvmf/common.sh@295 -- # local -ga e810 00:14:14.201 02:16:41 -- nvmf/common.sh@296 -- # x722=() 00:14:14.201 02:16:41 -- nvmf/common.sh@296 -- # local -ga x722 00:14:14.201 02:16:41 -- nvmf/common.sh@297 -- # mlx=() 00:14:14.201 02:16:41 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:14.201 02:16:41 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:14.201 02:16:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:14.201 02:16:41 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:14.201 02:16:41 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:14.201 02:16:41 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:14.201 02:16:41 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:14.201 02:16:41 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:14.201 02:16:41 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:14.201 02:16:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:14.201 02:16:41 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:14.201 02:16:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:14.201 02:16:41 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:14.201 02:16:41 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:14.201 02:16:41 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:14.201 02:16:41 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:14.201 02:16:41 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:14.201 02:16:41 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:14.201 02:16:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:14.201 02:16:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:14.201 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:14.201 02:16:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:14.201 02:16:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:14.201 02:16:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:14.201 02:16:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:14.201 02:16:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:14.201 02:16:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:14.201 02:16:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:14.201 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:14.201 02:16:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:14.201 02:16:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:14.201 02:16:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:14.201 02:16:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:14.201 02:16:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:14.201 02:16:41 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:14.201 02:16:41 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:14.201 02:16:41 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:14.201 02:16:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:14.201 02:16:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:14.201 02:16:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:14.201 02:16:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:14.202 02:16:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:14.202 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:14.202 02:16:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:14.202 02:16:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:14.202 02:16:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:14.202 02:16:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:14.202 02:16:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:14.202 02:16:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:14.202 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:14.202 02:16:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:14.202 02:16:41 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:14.202 02:16:41 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:14.202 02:16:41 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:14.202 02:16:41 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:14.202 02:16:41 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:14.202 02:16:41 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:14.202 02:16:41 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:14.202 02:16:41 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:14.202 02:16:41 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:14.202 02:16:41 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:14.202 02:16:41 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:14.202 02:16:41 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:14.202 02:16:41 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:14.202 02:16:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:14.202 02:16:41 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:14.202 02:16:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:14.202 02:16:41 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:14.202 02:16:41 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:14.202 02:16:41 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:14.202 02:16:41 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:14.202 02:16:41 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:14.202 02:16:41 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:14.202 02:16:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:14.202 02:16:41 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:14.202 02:16:41 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:14.202 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:14.202 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.189 ms 00:14:14.202 00:14:14.202 --- 10.0.0.2 ping statistics --- 00:14:14.202 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:14.202 rtt min/avg/max/mdev = 0.189/0.189/0.189/0.000 ms 00:14:14.202 02:16:41 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:14.202 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:14.202 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.098 ms 00:14:14.202 00:14:14.202 --- 10.0.0.1 ping statistics --- 00:14:14.202 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:14.202 rtt min/avg/max/mdev = 0.098/0.098/0.098/0.000 ms 00:14:14.202 02:16:41 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:14.202 02:16:41 -- nvmf/common.sh@410 -- # return 0 00:14:14.202 02:16:41 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:14.202 02:16:41 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:14.202 02:16:41 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:14.202 02:16:41 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:14.202 02:16:41 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:14.202 02:16:41 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:14.202 02:16:41 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:14.202 02:16:41 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:14:14.202 02:16:41 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:14.202 02:16:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:14.202 02:16:41 -- common/autotest_common.sh@10 -- # set +x 00:14:14.202 02:16:41 -- nvmf/common.sh@469 -- # nvmfpid=2090149 00:14:14.202 02:16:41 -- nvmf/common.sh@470 -- # waitforlisten 2090149 00:14:14.202 02:16:41 -- common/autotest_common.sh@829 -- # '[' -z 2090149 ']' 00:14:14.202 02:16:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:14.202 02:16:41 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:14:14.202 02:16:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:14.202 02:16:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:14.202 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:14.202 02:16:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:14.202 02:16:41 -- common/autotest_common.sh@10 -- # set +x 00:14:14.202 [2024-12-08 02:16:41.918466] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:14.202 [2024-12-08 02:16:41.918553] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:14.202 EAL: No free 2048 kB hugepages reported on node 1 00:14:14.461 [2024-12-08 02:16:41.986706] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:14.461 [2024-12-08 02:16:42.102714] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:14.461 [2024-12-08 02:16:42.102888] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:14.461 [2024-12-08 02:16:42.102906] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:14.461 [2024-12-08 02:16:42.102918] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:14.461 [2024-12-08 02:16:42.102946] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:15.395 02:16:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:15.395 02:16:42 -- common/autotest_common.sh@862 -- # return 0 00:14:15.395 02:16:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:15.395 02:16:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:15.395 02:16:42 -- common/autotest_common.sh@10 -- # set +x 00:14:15.395 02:16:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:15.395 02:16:42 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:15.395 [2024-12-08 02:16:43.123651] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:15.395 02:16:43 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:14:15.395 02:16:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:14:15.395 02:16:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:15.395 02:16:43 -- common/autotest_common.sh@10 -- # set +x 00:14:15.395 ************************************ 00:14:15.395 START TEST lvs_grow_clean 00:14:15.395 ************************************ 00:14:15.395 02:16:43 -- common/autotest_common.sh@1114 -- # lvs_grow 00:14:15.395 02:16:43 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:15.395 02:16:43 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:15.395 02:16:43 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:15.395 02:16:43 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:15.395 02:16:43 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:15.395 02:16:43 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:15.395 02:16:43 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:15.395 02:16:43 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:15.395 02:16:43 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:15.962 02:16:43 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:15.962 02:16:43 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:15.962 02:16:43 -- target/nvmf_lvs_grow.sh@28 -- # lvs=cc7f3fc5-2c59-4206-8248-a88a52cd5d00 00:14:15.962 02:16:43 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u cc7f3fc5-2c59-4206-8248-a88a52cd5d00 00:14:15.962 02:16:43 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:16.530 02:16:44 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:16.530 02:16:44 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:16.530 02:16:44 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u cc7f3fc5-2c59-4206-8248-a88a52cd5d00 lvol 150 00:14:16.530 02:16:44 -- target/nvmf_lvs_grow.sh@33 -- # lvol=bdfdd348-0769-43d2-be60-173e841d814f 00:14:16.530 02:16:44 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:16.530 02:16:44 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:16.788 [2024-12-08 02:16:44.558115] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:16.788 [2024-12-08 02:16:44.558215] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:16.788 true 00:14:17.047 02:16:44 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u cc7f3fc5-2c59-4206-8248-a88a52cd5d00 00:14:17.047 02:16:44 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:17.304 02:16:44 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:17.304 02:16:44 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:17.304 02:16:45 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdfdd348-0769-43d2-be60-173e841d814f 00:14:17.561 02:16:45 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:17.818 [2024-12-08 02:16:45.561241] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:17.818 02:16:45 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:18.076 02:16:45 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=2090607 00:14:18.076 02:16:45 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:18.076 02:16:45 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:18.076 02:16:45 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 2090607 /var/tmp/bdevperf.sock 00:14:18.076 02:16:45 -- common/autotest_common.sh@829 -- # '[' -z 2090607 ']' 00:14:18.076 02:16:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:18.076 02:16:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:18.076 02:16:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:18.076 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:18.076 02:16:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:18.076 02:16:45 -- common/autotest_common.sh@10 -- # set +x 00:14:18.334 [2024-12-08 02:16:45.856000] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:18.334 [2024-12-08 02:16:45.856105] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2090607 ] 00:14:18.334 EAL: No free 2048 kB hugepages reported on node 1 00:14:18.334 [2024-12-08 02:16:45.918791] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:18.334 [2024-12-08 02:16:46.033675] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:19.267 02:16:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:19.267 02:16:46 -- common/autotest_common.sh@862 -- # return 0 00:14:19.267 02:16:46 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:19.525 Nvme0n1 00:14:19.525 02:16:47 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:14:19.783 [ 00:14:19.783 { 00:14:19.783 "name": "Nvme0n1", 00:14:19.783 "aliases": [ 00:14:19.783 "bdfdd348-0769-43d2-be60-173e841d814f" 00:14:19.783 ], 00:14:19.783 "product_name": "NVMe disk", 00:14:19.783 "block_size": 4096, 00:14:19.783 "num_blocks": 38912, 00:14:19.783 "uuid": "bdfdd348-0769-43d2-be60-173e841d814f", 00:14:19.783 "assigned_rate_limits": { 00:14:19.783 "rw_ios_per_sec": 0, 00:14:19.783 "rw_mbytes_per_sec": 0, 00:14:19.783 "r_mbytes_per_sec": 0, 00:14:19.783 "w_mbytes_per_sec": 0 00:14:19.783 }, 00:14:19.783 "claimed": false, 00:14:19.783 "zoned": false, 00:14:19.783 "supported_io_types": { 00:14:19.783 "read": true, 00:14:19.783 "write": true, 00:14:19.783 "unmap": true, 00:14:19.783 "write_zeroes": true, 00:14:19.783 "flush": true, 00:14:19.783 "reset": true, 00:14:19.783 "compare": true, 00:14:19.783 "compare_and_write": true, 00:14:19.783 "abort": true, 00:14:19.783 "nvme_admin": true, 00:14:19.783 "nvme_io": true 00:14:19.783 }, 00:14:19.783 "driver_specific": { 00:14:19.783 "nvme": [ 00:14:19.783 { 00:14:19.783 "trid": { 00:14:19.783 "trtype": "TCP", 00:14:19.783 "adrfam": "IPv4", 00:14:19.783 "traddr": "10.0.0.2", 00:14:19.783 "trsvcid": "4420", 00:14:19.783 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:14:19.783 }, 00:14:19.783 "ctrlr_data": { 00:14:19.783 "cntlid": 1, 00:14:19.783 "vendor_id": "0x8086", 00:14:19.783 "model_number": "SPDK bdev Controller", 00:14:19.783 "serial_number": "SPDK0", 00:14:19.783 "firmware_revision": "24.01.1", 00:14:19.783 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:19.783 "oacs": { 00:14:19.783 "security": 0, 00:14:19.783 "format": 0, 00:14:19.783 "firmware": 0, 00:14:19.783 "ns_manage": 0 00:14:19.783 }, 00:14:19.783 "multi_ctrlr": true, 00:14:19.783 "ana_reporting": false 00:14:19.783 }, 00:14:19.783 "vs": { 00:14:19.783 "nvme_version": "1.3" 00:14:19.783 }, 00:14:19.783 "ns_data": { 00:14:19.783 "id": 1, 00:14:19.783 "can_share": true 00:14:19.783 } 00:14:19.783 } 00:14:19.783 ], 00:14:19.783 "mp_policy": "active_passive" 00:14:19.783 } 00:14:19.783 } 00:14:19.783 ] 00:14:19.783 02:16:47 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=2090874 00:14:19.783 02:16:47 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:19.783 02:16:47 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:14:20.042 Running I/O for 10 seconds... 00:14:20.976 Latency(us) 00:14:20.976 [2024-12-08T01:16:48.757Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:20.976 [2024-12-08T01:16:48.757Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:20.976 Nvme0n1 : 1.00 14956.00 58.42 0.00 0.00 0.00 0.00 0.00 00:14:20.976 [2024-12-08T01:16:48.757Z] =================================================================================================================== 00:14:20.976 [2024-12-08T01:16:48.757Z] Total : 14956.00 58.42 0.00 0.00 0.00 0.00 0.00 00:14:20.976 00:14:21.911 02:16:49 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u cc7f3fc5-2c59-4206-8248-a88a52cd5d00 00:14:21.911 [2024-12-08T01:16:49.692Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:21.911 Nvme0n1 : 2.00 15086.00 58.93 0.00 0.00 0.00 0.00 0.00 00:14:21.911 [2024-12-08T01:16:49.692Z] =================================================================================================================== 00:14:21.911 [2024-12-08T01:16:49.692Z] Total : 15086.00 58.93 0.00 0.00 0.00 0.00 0.00 00:14:21.911 00:14:22.170 true 00:14:22.170 02:16:49 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u cc7f3fc5-2c59-4206-8248-a88a52cd5d00 00:14:22.170 02:16:49 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:14:22.428 02:16:50 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:14:22.428 02:16:50 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:14:22.428 02:16:50 -- target/nvmf_lvs_grow.sh@65 -- # wait 2090874 00:14:22.993 [2024-12-08T01:16:50.774Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:22.993 Nvme0n1 : 3.00 15224.33 59.47 0.00 0.00 0.00 0.00 0.00 00:14:22.993 [2024-12-08T01:16:50.774Z] =================================================================================================================== 00:14:22.993 [2024-12-08T01:16:50.774Z] Total : 15224.33 59.47 0.00 0.00 0.00 0.00 0.00 00:14:22.993 00:14:23.927 [2024-12-08T01:16:51.708Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:23.927 Nvme0n1 : 4.00 15296.50 59.75 0.00 0.00 0.00 0.00 0.00 00:14:23.927 [2024-12-08T01:16:51.708Z] =================================================================================================================== 00:14:23.927 [2024-12-08T01:16:51.708Z] Total : 15296.50 59.75 0.00 0.00 0.00 0.00 0.00 00:14:23.927 00:14:25.303 [2024-12-08T01:16:53.084Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:25.303 Nvme0n1 : 5.00 15371.20 60.04 0.00 0.00 0.00 0.00 0.00 00:14:25.303 [2024-12-08T01:16:53.084Z] =================================================================================================================== 00:14:25.303 [2024-12-08T01:16:53.084Z] Total : 15371.20 60.04 0.00 0.00 0.00 0.00 0.00 00:14:25.303 00:14:26.239 [2024-12-08T01:16:54.020Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:26.239 Nvme0n1 : 6.00 15422.33 60.24 0.00 0.00 0.00 0.00 0.00 00:14:26.239 [2024-12-08T01:16:54.020Z] =================================================================================================================== 00:14:26.239 [2024-12-08T01:16:54.020Z] Total : 15422.33 60.24 0.00 0.00 0.00 0.00 0.00 00:14:26.239 00:14:27.173 [2024-12-08T01:16:54.954Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:27.173 Nvme0n1 : 7.00 15487.57 60.50 0.00 0.00 0.00 0.00 0.00 00:14:27.173 [2024-12-08T01:16:54.954Z] =================================================================================================================== 00:14:27.173 [2024-12-08T01:16:54.954Z] Total : 15487.57 60.50 0.00 0.00 0.00 0.00 0.00 00:14:27.173 00:14:28.108 [2024-12-08T01:16:55.889Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:28.108 Nvme0n1 : 8.00 15523.25 60.64 0.00 0.00 0.00 0.00 0.00 00:14:28.108 [2024-12-08T01:16:55.889Z] =================================================================================================================== 00:14:28.108 [2024-12-08T01:16:55.889Z] Total : 15523.25 60.64 0.00 0.00 0.00 0.00 0.00 00:14:28.108 00:14:29.091 [2024-12-08T01:16:56.872Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:29.091 Nvme0n1 : 9.00 15420.00 60.23 0.00 0.00 0.00 0.00 0.00 00:14:29.091 [2024-12-08T01:16:56.872Z] =================================================================================================================== 00:14:29.091 [2024-12-08T01:16:56.872Z] Total : 15420.00 60.23 0.00 0.00 0.00 0.00 0.00 00:14:29.091 00:14:30.021 [2024-12-08T01:16:57.802Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:30.021 Nvme0n1 : 10.00 15330.80 59.89 0.00 0.00 0.00 0.00 0.00 00:14:30.021 [2024-12-08T01:16:57.802Z] =================================================================================================================== 00:14:30.021 [2024-12-08T01:16:57.802Z] Total : 15330.80 59.89 0.00 0.00 0.00 0.00 0.00 00:14:30.021 00:14:30.021 00:14:30.021 Latency(us) 00:14:30.021 [2024-12-08T01:16:57.802Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:30.021 [2024-12-08T01:16:57.802Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:30.021 Nvme0n1 : 10.01 15325.27 59.86 0.00 0.00 8344.67 2487.94 15728.64 00:14:30.021 [2024-12-08T01:16:57.802Z] =================================================================================================================== 00:14:30.021 [2024-12-08T01:16:57.802Z] Total : 15325.27 59.86 0.00 0.00 8344.67 2487.94 15728.64 00:14:30.021 0 00:14:30.021 02:16:57 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 2090607 00:14:30.021 02:16:57 -- common/autotest_common.sh@936 -- # '[' -z 2090607 ']' 00:14:30.021 02:16:57 -- common/autotest_common.sh@940 -- # kill -0 2090607 00:14:30.021 02:16:57 -- common/autotest_common.sh@941 -- # uname 00:14:30.021 02:16:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:30.021 02:16:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2090607 00:14:30.021 02:16:57 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:30.021 02:16:57 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:30.021 02:16:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2090607' 00:14:30.021 killing process with pid 2090607 00:14:30.021 02:16:57 -- common/autotest_common.sh@955 -- # kill 2090607 00:14:30.021 Received shutdown signal, test time was about 10.000000 seconds 00:14:30.021 00:14:30.021 Latency(us) 00:14:30.021 [2024-12-08T01:16:57.802Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:30.021 [2024-12-08T01:16:57.802Z] =================================================================================================================== 00:14:30.021 [2024-12-08T01:16:57.802Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:14:30.021 02:16:57 -- common/autotest_common.sh@960 -- # wait 2090607 00:14:30.278 02:16:57 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:30.535 02:16:58 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u cc7f3fc5-2c59-4206-8248-a88a52cd5d00 00:14:30.535 02:16:58 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:14:30.794 02:16:58 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:14:30.794 02:16:58 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:14:30.794 02:16:58 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:31.053 [2024-12-08 02:16:58.804497] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:14:31.312 02:16:58 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u cc7f3fc5-2c59-4206-8248-a88a52cd5d00 00:14:31.312 02:16:58 -- common/autotest_common.sh@650 -- # local es=0 00:14:31.312 02:16:58 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u cc7f3fc5-2c59-4206-8248-a88a52cd5d00 00:14:31.312 02:16:58 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:31.312 02:16:58 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:31.312 02:16:58 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:31.312 02:16:58 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:31.312 02:16:58 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:31.312 02:16:58 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:31.312 02:16:58 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:31.312 02:16:58 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:14:31.312 02:16:58 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u cc7f3fc5-2c59-4206-8248-a88a52cd5d00 00:14:31.312 request: 00:14:31.312 { 00:14:31.312 "uuid": "cc7f3fc5-2c59-4206-8248-a88a52cd5d00", 00:14:31.312 "method": "bdev_lvol_get_lvstores", 00:14:31.312 "req_id": 1 00:14:31.312 } 00:14:31.312 Got JSON-RPC error response 00:14:31.312 response: 00:14:31.312 { 00:14:31.312 "code": -19, 00:14:31.312 "message": "No such device" 00:14:31.312 } 00:14:31.570 02:16:59 -- common/autotest_common.sh@653 -- # es=1 00:14:31.570 02:16:59 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:14:31.570 02:16:59 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:14:31.570 02:16:59 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:14:31.570 02:16:59 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:31.570 aio_bdev 00:14:31.864 02:16:59 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev bdfdd348-0769-43d2-be60-173e841d814f 00:14:31.865 02:16:59 -- common/autotest_common.sh@897 -- # local bdev_name=bdfdd348-0769-43d2-be60-173e841d814f 00:14:31.865 02:16:59 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:14:31.865 02:16:59 -- common/autotest_common.sh@899 -- # local i 00:14:31.865 02:16:59 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:14:31.865 02:16:59 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:14:31.865 02:16:59 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:14:31.865 02:16:59 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b bdfdd348-0769-43d2-be60-173e841d814f -t 2000 00:14:32.148 [ 00:14:32.148 { 00:14:32.148 "name": "bdfdd348-0769-43d2-be60-173e841d814f", 00:14:32.148 "aliases": [ 00:14:32.148 "lvs/lvol" 00:14:32.148 ], 00:14:32.148 "product_name": "Logical Volume", 00:14:32.148 "block_size": 4096, 00:14:32.148 "num_blocks": 38912, 00:14:32.148 "uuid": "bdfdd348-0769-43d2-be60-173e841d814f", 00:14:32.148 "assigned_rate_limits": { 00:14:32.148 "rw_ios_per_sec": 0, 00:14:32.148 "rw_mbytes_per_sec": 0, 00:14:32.148 "r_mbytes_per_sec": 0, 00:14:32.148 "w_mbytes_per_sec": 0 00:14:32.148 }, 00:14:32.148 "claimed": false, 00:14:32.148 "zoned": false, 00:14:32.148 "supported_io_types": { 00:14:32.148 "read": true, 00:14:32.148 "write": true, 00:14:32.148 "unmap": true, 00:14:32.148 "write_zeroes": true, 00:14:32.148 "flush": false, 00:14:32.148 "reset": true, 00:14:32.148 "compare": false, 00:14:32.148 "compare_and_write": false, 00:14:32.148 "abort": false, 00:14:32.148 "nvme_admin": false, 00:14:32.148 "nvme_io": false 00:14:32.148 }, 00:14:32.148 "driver_specific": { 00:14:32.148 "lvol": { 00:14:32.148 "lvol_store_uuid": "cc7f3fc5-2c59-4206-8248-a88a52cd5d00", 00:14:32.148 "base_bdev": "aio_bdev", 00:14:32.148 "thin_provision": false, 00:14:32.148 "snapshot": false, 00:14:32.148 "clone": false, 00:14:32.148 "esnap_clone": false 00:14:32.148 } 00:14:32.148 } 00:14:32.148 } 00:14:32.148 ] 00:14:32.148 02:16:59 -- common/autotest_common.sh@905 -- # return 0 00:14:32.148 02:16:59 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u cc7f3fc5-2c59-4206-8248-a88a52cd5d00 00:14:32.148 02:16:59 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:14:32.407 02:17:00 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:14:32.407 02:17:00 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u cc7f3fc5-2c59-4206-8248-a88a52cd5d00 00:14:32.407 02:17:00 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:14:32.664 02:17:00 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:14:32.664 02:17:00 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete bdfdd348-0769-43d2-be60-173e841d814f 00:14:32.923 02:17:00 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u cc7f3fc5-2c59-4206-8248-a88a52cd5d00 00:14:33.489 02:17:00 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:33.489 02:17:01 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:33.489 00:14:33.489 real 0m18.108s 00:14:33.489 user 0m17.071s 00:14:33.489 sys 0m2.191s 00:14:33.489 02:17:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:33.489 02:17:01 -- common/autotest_common.sh@10 -- # set +x 00:14:33.489 ************************************ 00:14:33.489 END TEST lvs_grow_clean 00:14:33.489 ************************************ 00:14:33.747 02:17:01 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:14:33.747 02:17:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:33.747 02:17:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:33.747 02:17:01 -- common/autotest_common.sh@10 -- # set +x 00:14:33.747 ************************************ 00:14:33.747 START TEST lvs_grow_dirty 00:14:33.747 ************************************ 00:14:33.747 02:17:01 -- common/autotest_common.sh@1114 -- # lvs_grow dirty 00:14:33.747 02:17:01 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:33.747 02:17:01 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:33.747 02:17:01 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:33.747 02:17:01 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:33.747 02:17:01 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:33.747 02:17:01 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:33.747 02:17:01 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:33.747 02:17:01 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:33.747 02:17:01 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:34.005 02:17:01 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:34.005 02:17:01 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:34.264 02:17:01 -- target/nvmf_lvs_grow.sh@28 -- # lvs=192b63cd-c9e5-41fd-b598-ec15b1e6f03e 00:14:34.264 02:17:01 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 192b63cd-c9e5-41fd-b598-ec15b1e6f03e 00:14:34.264 02:17:01 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:34.522 02:17:02 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:34.522 02:17:02 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:34.522 02:17:02 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 192b63cd-c9e5-41fd-b598-ec15b1e6f03e lvol 150 00:14:34.780 02:17:02 -- target/nvmf_lvs_grow.sh@33 -- # lvol=8c39f5b0-ac0b-4f53-b489-ca8688b064f5 00:14:34.780 02:17:02 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:34.780 02:17:02 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:35.038 [2024-12-08 02:17:02.629085] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:35.038 [2024-12-08 02:17:02.629161] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:35.038 true 00:14:35.038 02:17:02 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 192b63cd-c9e5-41fd-b598-ec15b1e6f03e 00:14:35.038 02:17:02 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:35.297 02:17:02 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:35.297 02:17:02 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:35.556 02:17:03 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 8c39f5b0-ac0b-4f53-b489-ca8688b064f5 00:14:35.815 02:17:03 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:36.074 02:17:03 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:36.333 02:17:03 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=2092854 00:14:36.333 02:17:03 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:36.333 02:17:03 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:36.333 02:17:03 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 2092854 /var/tmp/bdevperf.sock 00:14:36.333 02:17:03 -- common/autotest_common.sh@829 -- # '[' -z 2092854 ']' 00:14:36.333 02:17:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:36.333 02:17:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:36.333 02:17:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:36.333 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:36.333 02:17:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:36.333 02:17:03 -- common/autotest_common.sh@10 -- # set +x 00:14:36.333 [2024-12-08 02:17:04.015451] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:36.333 [2024-12-08 02:17:04.015556] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2092854 ] 00:14:36.333 EAL: No free 2048 kB hugepages reported on node 1 00:14:36.333 [2024-12-08 02:17:04.078726] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:36.591 [2024-12-08 02:17:04.199389] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:37.524 02:17:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:37.524 02:17:05 -- common/autotest_common.sh@862 -- # return 0 00:14:37.524 02:17:05 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:37.781 Nvme0n1 00:14:37.781 02:17:05 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:14:38.038 [ 00:14:38.038 { 00:14:38.038 "name": "Nvme0n1", 00:14:38.038 "aliases": [ 00:14:38.038 "8c39f5b0-ac0b-4f53-b489-ca8688b064f5" 00:14:38.038 ], 00:14:38.038 "product_name": "NVMe disk", 00:14:38.038 "block_size": 4096, 00:14:38.038 "num_blocks": 38912, 00:14:38.038 "uuid": "8c39f5b0-ac0b-4f53-b489-ca8688b064f5", 00:14:38.038 "assigned_rate_limits": { 00:14:38.038 "rw_ios_per_sec": 0, 00:14:38.038 "rw_mbytes_per_sec": 0, 00:14:38.038 "r_mbytes_per_sec": 0, 00:14:38.038 "w_mbytes_per_sec": 0 00:14:38.038 }, 00:14:38.038 "claimed": false, 00:14:38.038 "zoned": false, 00:14:38.038 "supported_io_types": { 00:14:38.038 "read": true, 00:14:38.038 "write": true, 00:14:38.038 "unmap": true, 00:14:38.038 "write_zeroes": true, 00:14:38.038 "flush": true, 00:14:38.038 "reset": true, 00:14:38.038 "compare": true, 00:14:38.038 "compare_and_write": true, 00:14:38.038 "abort": true, 00:14:38.038 "nvme_admin": true, 00:14:38.038 "nvme_io": true 00:14:38.038 }, 00:14:38.038 "driver_specific": { 00:14:38.038 "nvme": [ 00:14:38.038 { 00:14:38.038 "trid": { 00:14:38.038 "trtype": "TCP", 00:14:38.038 "adrfam": "IPv4", 00:14:38.038 "traddr": "10.0.0.2", 00:14:38.038 "trsvcid": "4420", 00:14:38.038 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:14:38.038 }, 00:14:38.038 "ctrlr_data": { 00:14:38.038 "cntlid": 1, 00:14:38.038 "vendor_id": "0x8086", 00:14:38.038 "model_number": "SPDK bdev Controller", 00:14:38.038 "serial_number": "SPDK0", 00:14:38.038 "firmware_revision": "24.01.1", 00:14:38.038 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:38.038 "oacs": { 00:14:38.038 "security": 0, 00:14:38.038 "format": 0, 00:14:38.038 "firmware": 0, 00:14:38.038 "ns_manage": 0 00:14:38.038 }, 00:14:38.038 "multi_ctrlr": true, 00:14:38.038 "ana_reporting": false 00:14:38.038 }, 00:14:38.038 "vs": { 00:14:38.038 "nvme_version": "1.3" 00:14:38.038 }, 00:14:38.038 "ns_data": { 00:14:38.038 "id": 1, 00:14:38.038 "can_share": true 00:14:38.038 } 00:14:38.038 } 00:14:38.038 ], 00:14:38.038 "mp_policy": "active_passive" 00:14:38.038 } 00:14:38.038 } 00:14:38.038 ] 00:14:38.038 02:17:05 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=2093120 00:14:38.038 02:17:05 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:14:38.038 02:17:05 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:38.296 Running I/O for 10 seconds... 00:14:39.231 Latency(us) 00:14:39.231 [2024-12-08T01:17:07.012Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:39.231 [2024-12-08T01:17:07.012Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:39.231 Nvme0n1 : 1.00 14878.00 58.12 0.00 0.00 0.00 0.00 0.00 00:14:39.231 [2024-12-08T01:17:07.012Z] =================================================================================================================== 00:14:39.231 [2024-12-08T01:17:07.012Z] Total : 14878.00 58.12 0.00 0.00 0.00 0.00 0.00 00:14:39.231 00:14:40.167 02:17:07 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 192b63cd-c9e5-41fd-b598-ec15b1e6f03e 00:14:40.167 [2024-12-08T01:17:07.948Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:40.167 Nvme0n1 : 2.00 15061.50 58.83 0.00 0.00 0.00 0.00 0.00 00:14:40.167 [2024-12-08T01:17:07.948Z] =================================================================================================================== 00:14:40.167 [2024-12-08T01:17:07.948Z] Total : 15061.50 58.83 0.00 0.00 0.00 0.00 0.00 00:14:40.167 00:14:40.424 true 00:14:40.424 02:17:08 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 192b63cd-c9e5-41fd-b598-ec15b1e6f03e 00:14:40.424 02:17:08 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:14:40.682 02:17:08 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:14:40.682 02:17:08 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:14:40.682 02:17:08 -- target/nvmf_lvs_grow.sh@65 -- # wait 2093120 00:14:41.248 [2024-12-08T01:17:09.029Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:41.248 Nvme0n1 : 3.00 15228.67 59.49 0.00 0.00 0.00 0.00 0.00 00:14:41.248 [2024-12-08T01:17:09.029Z] =================================================================================================================== 00:14:41.248 [2024-12-08T01:17:09.029Z] Total : 15228.67 59.49 0.00 0.00 0.00 0.00 0.00 00:14:41.248 00:14:42.182 [2024-12-08T01:17:09.963Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:42.182 Nvme0n1 : 4.00 15288.00 59.72 0.00 0.00 0.00 0.00 0.00 00:14:42.182 [2024-12-08T01:17:09.963Z] =================================================================================================================== 00:14:42.182 [2024-12-08T01:17:09.963Z] Total : 15288.00 59.72 0.00 0.00 0.00 0.00 0.00 00:14:42.182 00:14:43.166 [2024-12-08T01:17:10.947Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:43.166 Nvme0n1 : 5.00 15283.00 59.70 0.00 0.00 0.00 0.00 0.00 00:14:43.166 [2024-12-08T01:17:10.947Z] =================================================================================================================== 00:14:43.166 [2024-12-08T01:17:10.947Z] Total : 15283.00 59.70 0.00 0.00 0.00 0.00 0.00 00:14:43.166 00:14:44.541 [2024-12-08T01:17:12.322Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:44.541 Nvme0n1 : 6.00 15316.83 59.83 0.00 0.00 0.00 0.00 0.00 00:14:44.541 [2024-12-08T01:17:12.322Z] =================================================================================================================== 00:14:44.541 [2024-12-08T01:17:12.322Z] Total : 15316.83 59.83 0.00 0.00 0.00 0.00 0.00 00:14:44.541 00:14:45.475 [2024-12-08T01:17:13.256Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:45.475 Nvme0n1 : 7.00 15363.00 60.01 0.00 0.00 0.00 0.00 0.00 00:14:45.475 [2024-12-08T01:17:13.256Z] =================================================================================================================== 00:14:45.475 [2024-12-08T01:17:13.256Z] Total : 15363.00 60.01 0.00 0.00 0.00 0.00 0.00 00:14:45.475 00:14:46.407 [2024-12-08T01:17:14.188Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:46.407 Nvme0n1 : 8.00 15431.62 60.28 0.00 0.00 0.00 0.00 0.00 00:14:46.407 [2024-12-08T01:17:14.188Z] =================================================================================================================== 00:14:46.407 [2024-12-08T01:17:14.188Z] Total : 15431.62 60.28 0.00 0.00 0.00 0.00 0.00 00:14:46.407 00:14:47.340 [2024-12-08T01:17:15.121Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:47.340 Nvme0n1 : 9.00 15505.22 60.57 0.00 0.00 0.00 0.00 0.00 00:14:47.340 [2024-12-08T01:17:15.121Z] =================================================================================================================== 00:14:47.340 [2024-12-08T01:17:15.121Z] Total : 15505.22 60.57 0.00 0.00 0.00 0.00 0.00 00:14:47.340 00:14:48.272 [2024-12-08T01:17:16.053Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:48.272 Nvme0n1 : 10.00 15518.10 60.62 0.00 0.00 0.00 0.00 0.00 00:14:48.272 [2024-12-08T01:17:16.053Z] =================================================================================================================== 00:14:48.272 [2024-12-08T01:17:16.053Z] Total : 15518.10 60.62 0.00 0.00 0.00 0.00 0.00 00:14:48.272 00:14:48.272 00:14:48.272 Latency(us) 00:14:48.272 [2024-12-08T01:17:16.053Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:48.272 [2024-12-08T01:17:16.053Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:48.272 Nvme0n1 : 10.01 15520.41 60.63 0.00 0.00 8242.74 2281.62 16311.18 00:14:48.272 [2024-12-08T01:17:16.053Z] =================================================================================================================== 00:14:48.272 [2024-12-08T01:17:16.053Z] Total : 15520.41 60.63 0.00 0.00 8242.74 2281.62 16311.18 00:14:48.272 0 00:14:48.272 02:17:15 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 2092854 00:14:48.272 02:17:15 -- common/autotest_common.sh@936 -- # '[' -z 2092854 ']' 00:14:48.272 02:17:15 -- common/autotest_common.sh@940 -- # kill -0 2092854 00:14:48.272 02:17:15 -- common/autotest_common.sh@941 -- # uname 00:14:48.272 02:17:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:48.272 02:17:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2092854 00:14:48.272 02:17:15 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:48.272 02:17:15 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:48.272 02:17:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2092854' 00:14:48.272 killing process with pid 2092854 00:14:48.272 02:17:15 -- common/autotest_common.sh@955 -- # kill 2092854 00:14:48.272 Received shutdown signal, test time was about 10.000000 seconds 00:14:48.272 00:14:48.272 Latency(us) 00:14:48.272 [2024-12-08T01:17:16.053Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:48.272 [2024-12-08T01:17:16.053Z] =================================================================================================================== 00:14:48.272 [2024-12-08T01:17:16.053Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:14:48.272 02:17:15 -- common/autotest_common.sh@960 -- # wait 2092854 00:14:48.529 02:17:16 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:48.786 02:17:16 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:14:48.786 02:17:16 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 192b63cd-c9e5-41fd-b598-ec15b1e6f03e 00:14:49.354 02:17:16 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:14:49.354 02:17:16 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:14:49.354 02:17:16 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 2090149 00:14:49.354 02:17:16 -- target/nvmf_lvs_grow.sh@74 -- # wait 2090149 00:14:49.354 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 2090149 Killed "${NVMF_APP[@]}" "$@" 00:14:49.354 02:17:16 -- target/nvmf_lvs_grow.sh@74 -- # true 00:14:49.354 02:17:16 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:14:49.354 02:17:16 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:49.354 02:17:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:49.354 02:17:16 -- common/autotest_common.sh@10 -- # set +x 00:14:49.354 02:17:16 -- nvmf/common.sh@469 -- # nvmfpid=2094484 00:14:49.354 02:17:16 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:14:49.354 02:17:16 -- nvmf/common.sh@470 -- # waitforlisten 2094484 00:14:49.354 02:17:16 -- common/autotest_common.sh@829 -- # '[' -z 2094484 ']' 00:14:49.354 02:17:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:49.354 02:17:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:49.354 02:17:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:49.354 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:49.354 02:17:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:49.354 02:17:16 -- common/autotest_common.sh@10 -- # set +x 00:14:49.354 [2024-12-08 02:17:16.906979] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:49.354 [2024-12-08 02:17:16.907076] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:49.354 EAL: No free 2048 kB hugepages reported on node 1 00:14:49.354 [2024-12-08 02:17:16.971773] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:49.354 [2024-12-08 02:17:17.081605] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:49.354 [2024-12-08 02:17:17.081775] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:49.354 [2024-12-08 02:17:17.081794] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:49.354 [2024-12-08 02:17:17.081806] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:49.354 [2024-12-08 02:17:17.081849] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:50.289 02:17:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:50.289 02:17:17 -- common/autotest_common.sh@862 -- # return 0 00:14:50.289 02:17:17 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:50.289 02:17:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:50.289 02:17:17 -- common/autotest_common.sh@10 -- # set +x 00:14:50.289 02:17:17 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:50.289 02:17:17 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:50.547 [2024-12-08 02:17:18.183901] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:14:50.547 [2024-12-08 02:17:18.184044] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:14:50.547 [2024-12-08 02:17:18.184102] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:14:50.547 02:17:18 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:14:50.547 02:17:18 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev 8c39f5b0-ac0b-4f53-b489-ca8688b064f5 00:14:50.547 02:17:18 -- common/autotest_common.sh@897 -- # local bdev_name=8c39f5b0-ac0b-4f53-b489-ca8688b064f5 00:14:50.547 02:17:18 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:14:50.547 02:17:18 -- common/autotest_common.sh@899 -- # local i 00:14:50.547 02:17:18 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:14:50.547 02:17:18 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:14:50.547 02:17:18 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:14:50.805 02:17:18 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 8c39f5b0-ac0b-4f53-b489-ca8688b064f5 -t 2000 00:14:51.064 [ 00:14:51.064 { 00:14:51.064 "name": "8c39f5b0-ac0b-4f53-b489-ca8688b064f5", 00:14:51.064 "aliases": [ 00:14:51.064 "lvs/lvol" 00:14:51.064 ], 00:14:51.064 "product_name": "Logical Volume", 00:14:51.064 "block_size": 4096, 00:14:51.064 "num_blocks": 38912, 00:14:51.064 "uuid": "8c39f5b0-ac0b-4f53-b489-ca8688b064f5", 00:14:51.064 "assigned_rate_limits": { 00:14:51.064 "rw_ios_per_sec": 0, 00:14:51.064 "rw_mbytes_per_sec": 0, 00:14:51.064 "r_mbytes_per_sec": 0, 00:14:51.064 "w_mbytes_per_sec": 0 00:14:51.064 }, 00:14:51.064 "claimed": false, 00:14:51.064 "zoned": false, 00:14:51.064 "supported_io_types": { 00:14:51.064 "read": true, 00:14:51.064 "write": true, 00:14:51.064 "unmap": true, 00:14:51.064 "write_zeroes": true, 00:14:51.064 "flush": false, 00:14:51.064 "reset": true, 00:14:51.064 "compare": false, 00:14:51.064 "compare_and_write": false, 00:14:51.064 "abort": false, 00:14:51.064 "nvme_admin": false, 00:14:51.064 "nvme_io": false 00:14:51.064 }, 00:14:51.064 "driver_specific": { 00:14:51.064 "lvol": { 00:14:51.064 "lvol_store_uuid": "192b63cd-c9e5-41fd-b598-ec15b1e6f03e", 00:14:51.064 "base_bdev": "aio_bdev", 00:14:51.064 "thin_provision": false, 00:14:51.064 "snapshot": false, 00:14:51.064 "clone": false, 00:14:51.064 "esnap_clone": false 00:14:51.064 } 00:14:51.064 } 00:14:51.064 } 00:14:51.064 ] 00:14:51.064 02:17:18 -- common/autotest_common.sh@905 -- # return 0 00:14:51.064 02:17:18 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 192b63cd-c9e5-41fd-b598-ec15b1e6f03e 00:14:51.064 02:17:18 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:14:51.323 02:17:19 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:14:51.323 02:17:19 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 192b63cd-c9e5-41fd-b598-ec15b1e6f03e 00:14:51.323 02:17:19 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:14:51.582 02:17:19 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:14:51.582 02:17:19 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:52.149 [2024-12-08 02:17:19.621412] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:14:52.149 02:17:19 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 192b63cd-c9e5-41fd-b598-ec15b1e6f03e 00:14:52.149 02:17:19 -- common/autotest_common.sh@650 -- # local es=0 00:14:52.149 02:17:19 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 192b63cd-c9e5-41fd-b598-ec15b1e6f03e 00:14:52.149 02:17:19 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:52.149 02:17:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:52.149 02:17:19 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:52.149 02:17:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:52.149 02:17:19 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:52.149 02:17:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:52.149 02:17:19 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:52.149 02:17:19 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:14:52.149 02:17:19 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 192b63cd-c9e5-41fd-b598-ec15b1e6f03e 00:14:52.418 request: 00:14:52.418 { 00:14:52.418 "uuid": "192b63cd-c9e5-41fd-b598-ec15b1e6f03e", 00:14:52.418 "method": "bdev_lvol_get_lvstores", 00:14:52.418 "req_id": 1 00:14:52.418 } 00:14:52.418 Got JSON-RPC error response 00:14:52.418 response: 00:14:52.418 { 00:14:52.418 "code": -19, 00:14:52.418 "message": "No such device" 00:14:52.418 } 00:14:52.418 02:17:19 -- common/autotest_common.sh@653 -- # es=1 00:14:52.418 02:17:19 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:14:52.418 02:17:19 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:14:52.418 02:17:19 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:14:52.418 02:17:19 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:52.677 aio_bdev 00:14:52.677 02:17:20 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 8c39f5b0-ac0b-4f53-b489-ca8688b064f5 00:14:52.677 02:17:20 -- common/autotest_common.sh@897 -- # local bdev_name=8c39f5b0-ac0b-4f53-b489-ca8688b064f5 00:14:52.677 02:17:20 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:14:52.677 02:17:20 -- common/autotest_common.sh@899 -- # local i 00:14:52.677 02:17:20 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:14:52.677 02:17:20 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:14:52.677 02:17:20 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:14:52.935 02:17:20 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 8c39f5b0-ac0b-4f53-b489-ca8688b064f5 -t 2000 00:14:53.193 [ 00:14:53.193 { 00:14:53.193 "name": "8c39f5b0-ac0b-4f53-b489-ca8688b064f5", 00:14:53.193 "aliases": [ 00:14:53.193 "lvs/lvol" 00:14:53.193 ], 00:14:53.193 "product_name": "Logical Volume", 00:14:53.193 "block_size": 4096, 00:14:53.193 "num_blocks": 38912, 00:14:53.193 "uuid": "8c39f5b0-ac0b-4f53-b489-ca8688b064f5", 00:14:53.193 "assigned_rate_limits": { 00:14:53.193 "rw_ios_per_sec": 0, 00:14:53.193 "rw_mbytes_per_sec": 0, 00:14:53.193 "r_mbytes_per_sec": 0, 00:14:53.193 "w_mbytes_per_sec": 0 00:14:53.193 }, 00:14:53.193 "claimed": false, 00:14:53.193 "zoned": false, 00:14:53.193 "supported_io_types": { 00:14:53.193 "read": true, 00:14:53.193 "write": true, 00:14:53.193 "unmap": true, 00:14:53.193 "write_zeroes": true, 00:14:53.193 "flush": false, 00:14:53.193 "reset": true, 00:14:53.193 "compare": false, 00:14:53.193 "compare_and_write": false, 00:14:53.193 "abort": false, 00:14:53.193 "nvme_admin": false, 00:14:53.193 "nvme_io": false 00:14:53.193 }, 00:14:53.193 "driver_specific": { 00:14:53.193 "lvol": { 00:14:53.193 "lvol_store_uuid": "192b63cd-c9e5-41fd-b598-ec15b1e6f03e", 00:14:53.193 "base_bdev": "aio_bdev", 00:14:53.193 "thin_provision": false, 00:14:53.193 "snapshot": false, 00:14:53.193 "clone": false, 00:14:53.193 "esnap_clone": false 00:14:53.193 } 00:14:53.193 } 00:14:53.193 } 00:14:53.193 ] 00:14:53.193 02:17:20 -- common/autotest_common.sh@905 -- # return 0 00:14:53.193 02:17:20 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 192b63cd-c9e5-41fd-b598-ec15b1e6f03e 00:14:53.193 02:17:20 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:14:53.451 02:17:21 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:14:53.451 02:17:21 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 192b63cd-c9e5-41fd-b598-ec15b1e6f03e 00:14:53.451 02:17:21 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:14:53.710 02:17:21 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:14:53.710 02:17:21 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 8c39f5b0-ac0b-4f53-b489-ca8688b064f5 00:14:53.968 02:17:21 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 192b63cd-c9e5-41fd-b598-ec15b1e6f03e 00:14:54.225 02:17:21 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:54.483 02:17:22 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:54.483 00:14:54.483 real 0m20.947s 00:14:54.483 user 0m52.067s 00:14:54.483 sys 0m4.680s 00:14:54.483 02:17:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:54.483 02:17:22 -- common/autotest_common.sh@10 -- # set +x 00:14:54.483 ************************************ 00:14:54.483 END TEST lvs_grow_dirty 00:14:54.483 ************************************ 00:14:54.483 02:17:22 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:14:54.483 02:17:22 -- common/autotest_common.sh@806 -- # type=--id 00:14:54.483 02:17:22 -- common/autotest_common.sh@807 -- # id=0 00:14:54.483 02:17:22 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:14:54.483 02:17:22 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:14:54.483 02:17:22 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:14:54.483 02:17:22 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:14:54.483 02:17:22 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:14:54.483 02:17:22 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:14:54.483 nvmf_trace.0 00:14:54.740 02:17:22 -- common/autotest_common.sh@821 -- # return 0 00:14:54.741 02:17:22 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:14:54.741 02:17:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:54.741 02:17:22 -- nvmf/common.sh@116 -- # sync 00:14:54.741 02:17:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:54.741 02:17:22 -- nvmf/common.sh@119 -- # set +e 00:14:54.741 02:17:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:54.741 02:17:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:54.741 rmmod nvme_tcp 00:14:54.741 rmmod nvme_fabrics 00:14:54.741 rmmod nvme_keyring 00:14:54.741 02:17:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:54.741 02:17:22 -- nvmf/common.sh@123 -- # set -e 00:14:54.741 02:17:22 -- nvmf/common.sh@124 -- # return 0 00:14:54.741 02:17:22 -- nvmf/common.sh@477 -- # '[' -n 2094484 ']' 00:14:54.741 02:17:22 -- nvmf/common.sh@478 -- # killprocess 2094484 00:14:54.741 02:17:22 -- common/autotest_common.sh@936 -- # '[' -z 2094484 ']' 00:14:54.741 02:17:22 -- common/autotest_common.sh@940 -- # kill -0 2094484 00:14:54.741 02:17:22 -- common/autotest_common.sh@941 -- # uname 00:14:54.741 02:17:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:54.741 02:17:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2094484 00:14:54.741 02:17:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:54.741 02:17:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:54.741 02:17:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2094484' 00:14:54.741 killing process with pid 2094484 00:14:54.741 02:17:22 -- common/autotest_common.sh@955 -- # kill 2094484 00:14:54.741 02:17:22 -- common/autotest_common.sh@960 -- # wait 2094484 00:14:54.999 02:17:22 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:54.999 02:17:22 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:54.999 02:17:22 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:54.999 02:17:22 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:54.999 02:17:22 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:54.999 02:17:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:54.999 02:17:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:54.999 02:17:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:57.532 02:17:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:57.532 00:14:57.532 real 0m45.221s 00:14:57.532 user 1m16.320s 00:14:57.532 sys 0m8.768s 00:14:57.532 02:17:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:57.532 02:17:24 -- common/autotest_common.sh@10 -- # set +x 00:14:57.532 ************************************ 00:14:57.532 END TEST nvmf_lvs_grow 00:14:57.532 ************************************ 00:14:57.533 02:17:24 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:14:57.533 02:17:24 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:57.533 02:17:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:57.533 02:17:24 -- common/autotest_common.sh@10 -- # set +x 00:14:57.533 ************************************ 00:14:57.533 START TEST nvmf_bdev_io_wait 00:14:57.533 ************************************ 00:14:57.533 02:17:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:14:57.533 * Looking for test storage... 00:14:57.533 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:57.533 02:17:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:57.533 02:17:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:57.533 02:17:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:57.533 02:17:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:57.533 02:17:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:57.533 02:17:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:57.533 02:17:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:57.533 02:17:24 -- scripts/common.sh@335 -- # IFS=.-: 00:14:57.533 02:17:24 -- scripts/common.sh@335 -- # read -ra ver1 00:14:57.533 02:17:24 -- scripts/common.sh@336 -- # IFS=.-: 00:14:57.533 02:17:24 -- scripts/common.sh@336 -- # read -ra ver2 00:14:57.533 02:17:24 -- scripts/common.sh@337 -- # local 'op=<' 00:14:57.533 02:17:24 -- scripts/common.sh@339 -- # ver1_l=2 00:14:57.533 02:17:24 -- scripts/common.sh@340 -- # ver2_l=1 00:14:57.533 02:17:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:57.533 02:17:24 -- scripts/common.sh@343 -- # case "$op" in 00:14:57.533 02:17:24 -- scripts/common.sh@344 -- # : 1 00:14:57.533 02:17:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:57.533 02:17:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:57.533 02:17:24 -- scripts/common.sh@364 -- # decimal 1 00:14:57.533 02:17:24 -- scripts/common.sh@352 -- # local d=1 00:14:57.533 02:17:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:57.533 02:17:24 -- scripts/common.sh@354 -- # echo 1 00:14:57.533 02:17:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:57.533 02:17:24 -- scripts/common.sh@365 -- # decimal 2 00:14:57.533 02:17:24 -- scripts/common.sh@352 -- # local d=2 00:14:57.533 02:17:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:57.533 02:17:24 -- scripts/common.sh@354 -- # echo 2 00:14:57.533 02:17:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:57.533 02:17:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:57.533 02:17:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:57.533 02:17:24 -- scripts/common.sh@367 -- # return 0 00:14:57.533 02:17:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:57.533 02:17:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:57.533 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:57.533 --rc genhtml_branch_coverage=1 00:14:57.533 --rc genhtml_function_coverage=1 00:14:57.533 --rc genhtml_legend=1 00:14:57.533 --rc geninfo_all_blocks=1 00:14:57.533 --rc geninfo_unexecuted_blocks=1 00:14:57.533 00:14:57.533 ' 00:14:57.533 02:17:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:57.533 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:57.533 --rc genhtml_branch_coverage=1 00:14:57.533 --rc genhtml_function_coverage=1 00:14:57.533 --rc genhtml_legend=1 00:14:57.533 --rc geninfo_all_blocks=1 00:14:57.533 --rc geninfo_unexecuted_blocks=1 00:14:57.533 00:14:57.533 ' 00:14:57.533 02:17:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:57.533 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:57.533 --rc genhtml_branch_coverage=1 00:14:57.533 --rc genhtml_function_coverage=1 00:14:57.533 --rc genhtml_legend=1 00:14:57.533 --rc geninfo_all_blocks=1 00:14:57.533 --rc geninfo_unexecuted_blocks=1 00:14:57.533 00:14:57.533 ' 00:14:57.533 02:17:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:57.533 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:57.533 --rc genhtml_branch_coverage=1 00:14:57.533 --rc genhtml_function_coverage=1 00:14:57.533 --rc genhtml_legend=1 00:14:57.533 --rc geninfo_all_blocks=1 00:14:57.533 --rc geninfo_unexecuted_blocks=1 00:14:57.533 00:14:57.533 ' 00:14:57.533 02:17:24 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:57.533 02:17:24 -- nvmf/common.sh@7 -- # uname -s 00:14:57.533 02:17:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:57.533 02:17:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:57.533 02:17:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:57.533 02:17:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:57.533 02:17:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:57.533 02:17:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:57.533 02:17:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:57.533 02:17:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:57.533 02:17:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:57.533 02:17:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:57.533 02:17:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:57.533 02:17:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:57.533 02:17:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:57.533 02:17:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:57.533 02:17:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:57.533 02:17:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:57.533 02:17:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:57.533 02:17:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:57.533 02:17:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:57.533 02:17:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:57.533 02:17:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:57.533 02:17:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:57.533 02:17:24 -- paths/export.sh@5 -- # export PATH 00:14:57.533 02:17:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:57.533 02:17:24 -- nvmf/common.sh@46 -- # : 0 00:14:57.533 02:17:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:57.533 02:17:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:57.533 02:17:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:57.533 02:17:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:57.533 02:17:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:57.533 02:17:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:57.533 02:17:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:57.533 02:17:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:57.533 02:17:24 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:57.533 02:17:24 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:57.533 02:17:24 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:14:57.533 02:17:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:57.533 02:17:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:57.533 02:17:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:57.533 02:17:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:57.533 02:17:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:57.533 02:17:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:57.533 02:17:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:57.533 02:17:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:57.533 02:17:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:57.533 02:17:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:57.533 02:17:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:57.533 02:17:24 -- common/autotest_common.sh@10 -- # set +x 00:14:59.432 02:17:26 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:59.432 02:17:26 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:59.432 02:17:26 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:59.432 02:17:26 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:59.432 02:17:26 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:59.432 02:17:26 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:59.432 02:17:26 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:59.432 02:17:26 -- nvmf/common.sh@294 -- # net_devs=() 00:14:59.432 02:17:26 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:59.432 02:17:26 -- nvmf/common.sh@295 -- # e810=() 00:14:59.432 02:17:26 -- nvmf/common.sh@295 -- # local -ga e810 00:14:59.432 02:17:26 -- nvmf/common.sh@296 -- # x722=() 00:14:59.432 02:17:26 -- nvmf/common.sh@296 -- # local -ga x722 00:14:59.432 02:17:26 -- nvmf/common.sh@297 -- # mlx=() 00:14:59.432 02:17:26 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:59.432 02:17:26 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:59.432 02:17:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:59.432 02:17:26 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:59.432 02:17:26 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:59.432 02:17:26 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:59.432 02:17:26 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:59.432 02:17:26 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:59.432 02:17:26 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:59.432 02:17:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:59.432 02:17:26 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:59.432 02:17:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:59.432 02:17:26 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:59.432 02:17:26 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:59.432 02:17:26 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:59.432 02:17:26 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:59.432 02:17:26 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:59.432 02:17:26 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:59.432 02:17:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:59.432 02:17:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:59.432 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:59.432 02:17:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:59.432 02:17:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:59.432 02:17:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:59.432 02:17:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:59.432 02:17:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:59.432 02:17:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:59.432 02:17:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:59.432 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:59.432 02:17:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:59.432 02:17:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:59.432 02:17:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:59.432 02:17:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:59.432 02:17:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:59.432 02:17:26 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:59.432 02:17:26 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:59.432 02:17:26 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:59.432 02:17:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:59.432 02:17:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:59.432 02:17:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:59.432 02:17:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:59.432 02:17:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:59.432 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:59.432 02:17:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:59.432 02:17:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:59.432 02:17:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:59.432 02:17:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:59.433 02:17:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:59.433 02:17:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:59.433 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:59.433 02:17:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:59.433 02:17:26 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:59.433 02:17:26 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:59.433 02:17:26 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:59.433 02:17:26 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:59.433 02:17:26 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:59.433 02:17:26 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:59.433 02:17:26 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:59.433 02:17:26 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:59.433 02:17:26 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:59.433 02:17:26 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:59.433 02:17:26 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:59.433 02:17:26 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:59.433 02:17:26 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:59.433 02:17:26 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:59.433 02:17:26 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:59.433 02:17:26 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:59.433 02:17:26 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:59.433 02:17:26 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:59.433 02:17:26 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:59.433 02:17:26 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:59.433 02:17:26 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:59.433 02:17:26 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:59.433 02:17:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:59.433 02:17:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:59.433 02:17:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:59.433 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:59.433 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.341 ms 00:14:59.433 00:14:59.433 --- 10.0.0.2 ping statistics --- 00:14:59.433 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:59.433 rtt min/avg/max/mdev = 0.341/0.341/0.341/0.000 ms 00:14:59.433 02:17:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:59.433 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:59.433 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.151 ms 00:14:59.433 00:14:59.433 --- 10.0.0.1 ping statistics --- 00:14:59.433 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:59.433 rtt min/avg/max/mdev = 0.151/0.151/0.151/0.000 ms 00:14:59.433 02:17:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:59.433 02:17:27 -- nvmf/common.sh@410 -- # return 0 00:14:59.433 02:17:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:59.433 02:17:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:59.433 02:17:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:59.433 02:17:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:59.433 02:17:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:59.433 02:17:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:59.433 02:17:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:59.433 02:17:27 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:14:59.433 02:17:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:59.433 02:17:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:59.433 02:17:27 -- common/autotest_common.sh@10 -- # set +x 00:14:59.433 02:17:27 -- nvmf/common.sh@469 -- # nvmfpid=2097173 00:14:59.433 02:17:27 -- nvmf/common.sh@470 -- # waitforlisten 2097173 00:14:59.433 02:17:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:14:59.433 02:17:27 -- common/autotest_common.sh@829 -- # '[' -z 2097173 ']' 00:14:59.433 02:17:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:59.433 02:17:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:59.433 02:17:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:59.433 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:59.433 02:17:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:59.433 02:17:27 -- common/autotest_common.sh@10 -- # set +x 00:14:59.433 [2024-12-08 02:17:27.121645] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:59.433 [2024-12-08 02:17:27.121729] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:59.433 EAL: No free 2048 kB hugepages reported on node 1 00:14:59.433 [2024-12-08 02:17:27.195867] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:59.691 [2024-12-08 02:17:27.309865] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:59.691 [2024-12-08 02:17:27.310028] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:59.691 [2024-12-08 02:17:27.310047] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:59.691 [2024-12-08 02:17:27.310059] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:59.691 [2024-12-08 02:17:27.310144] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:59.691 [2024-12-08 02:17:27.310185] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:59.691 [2024-12-08 02:17:27.310214] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:59.691 [2024-12-08 02:17:27.310216] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:59.691 02:17:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:59.691 02:17:27 -- common/autotest_common.sh@862 -- # return 0 00:14:59.691 02:17:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:59.691 02:17:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:59.691 02:17:27 -- common/autotest_common.sh@10 -- # set +x 00:14:59.691 02:17:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:59.691 02:17:27 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:14:59.691 02:17:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:59.691 02:17:27 -- common/autotest_common.sh@10 -- # set +x 00:14:59.691 02:17:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:59.691 02:17:27 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:14:59.691 02:17:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:59.691 02:17:27 -- common/autotest_common.sh@10 -- # set +x 00:14:59.691 02:17:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:59.691 02:17:27 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:59.691 02:17:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:59.691 02:17:27 -- common/autotest_common.sh@10 -- # set +x 00:14:59.949 [2024-12-08 02:17:27.471849] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:59.949 02:17:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:59.949 02:17:27 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:14:59.949 02:17:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:59.949 02:17:27 -- common/autotest_common.sh@10 -- # set +x 00:14:59.949 Malloc0 00:14:59.949 02:17:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:59.949 02:17:27 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:14:59.949 02:17:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:59.949 02:17:27 -- common/autotest_common.sh@10 -- # set +x 00:14:59.949 02:17:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:59.949 02:17:27 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:59.949 02:17:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:59.949 02:17:27 -- common/autotest_common.sh@10 -- # set +x 00:14:59.949 02:17:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:59.949 02:17:27 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:59.949 02:17:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:59.949 02:17:27 -- common/autotest_common.sh@10 -- # set +x 00:14:59.949 [2024-12-08 02:17:27.533199] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:59.949 02:17:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:59.949 02:17:27 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=2097201 00:14:59.949 02:17:27 -- target/bdev_io_wait.sh@30 -- # READ_PID=2097202 00:14:59.950 02:17:27 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:14:59.950 02:17:27 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:14:59.950 02:17:27 -- nvmf/common.sh@520 -- # config=() 00:14:59.950 02:17:27 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=2097205 00:14:59.950 02:17:27 -- nvmf/common.sh@520 -- # local subsystem config 00:14:59.950 02:17:27 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:14:59.950 02:17:27 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:14:59.950 02:17:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:59.950 02:17:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:59.950 { 00:14:59.950 "params": { 00:14:59.950 "name": "Nvme$subsystem", 00:14:59.950 "trtype": "$TEST_TRANSPORT", 00:14:59.950 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:59.950 "adrfam": "ipv4", 00:14:59.950 "trsvcid": "$NVMF_PORT", 00:14:59.950 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:59.950 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:59.950 "hdgst": ${hdgst:-false}, 00:14:59.950 "ddgst": ${ddgst:-false} 00:14:59.950 }, 00:14:59.950 "method": "bdev_nvme_attach_controller" 00:14:59.950 } 00:14:59.950 EOF 00:14:59.950 )") 00:14:59.950 02:17:27 -- nvmf/common.sh@520 -- # config=() 00:14:59.950 02:17:27 -- nvmf/common.sh@520 -- # local subsystem config 00:14:59.950 02:17:27 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:14:59.950 02:17:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:59.950 02:17:27 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:14:59.950 02:17:27 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=2097207 00:14:59.950 02:17:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:59.950 { 00:14:59.950 "params": { 00:14:59.950 "name": "Nvme$subsystem", 00:14:59.950 "trtype": "$TEST_TRANSPORT", 00:14:59.950 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:59.950 "adrfam": "ipv4", 00:14:59.950 "trsvcid": "$NVMF_PORT", 00:14:59.950 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:59.950 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:59.950 "hdgst": ${hdgst:-false}, 00:14:59.950 "ddgst": ${ddgst:-false} 00:14:59.950 }, 00:14:59.950 "method": "bdev_nvme_attach_controller" 00:14:59.950 } 00:14:59.950 EOF 00:14:59.950 )") 00:14:59.950 02:17:27 -- target/bdev_io_wait.sh@35 -- # sync 00:14:59.950 02:17:27 -- nvmf/common.sh@520 -- # config=() 00:14:59.950 02:17:27 -- nvmf/common.sh@520 -- # local subsystem config 00:14:59.950 02:17:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:59.950 02:17:27 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:14:59.950 02:17:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:59.950 { 00:14:59.950 "params": { 00:14:59.950 "name": "Nvme$subsystem", 00:14:59.950 "trtype": "$TEST_TRANSPORT", 00:14:59.950 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:59.950 "adrfam": "ipv4", 00:14:59.950 "trsvcid": "$NVMF_PORT", 00:14:59.950 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:59.950 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:59.950 "hdgst": ${hdgst:-false}, 00:14:59.950 "ddgst": ${ddgst:-false} 00:14:59.950 }, 00:14:59.950 "method": "bdev_nvme_attach_controller" 00:14:59.950 } 00:14:59.950 EOF 00:14:59.950 )") 00:14:59.950 02:17:27 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:14:59.950 02:17:27 -- nvmf/common.sh@542 -- # cat 00:14:59.950 02:17:27 -- nvmf/common.sh@520 -- # config=() 00:14:59.950 02:17:27 -- nvmf/common.sh@520 -- # local subsystem config 00:14:59.950 02:17:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:59.950 02:17:27 -- nvmf/common.sh@542 -- # cat 00:14:59.950 02:17:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:59.950 { 00:14:59.950 "params": { 00:14:59.950 "name": "Nvme$subsystem", 00:14:59.950 "trtype": "$TEST_TRANSPORT", 00:14:59.950 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:59.950 "adrfam": "ipv4", 00:14:59.950 "trsvcid": "$NVMF_PORT", 00:14:59.950 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:59.950 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:59.950 "hdgst": ${hdgst:-false}, 00:14:59.950 "ddgst": ${ddgst:-false} 00:14:59.950 }, 00:14:59.950 "method": "bdev_nvme_attach_controller" 00:14:59.950 } 00:14:59.950 EOF 00:14:59.950 )") 00:14:59.950 02:17:27 -- nvmf/common.sh@542 -- # cat 00:14:59.950 02:17:27 -- target/bdev_io_wait.sh@37 -- # wait 2097201 00:14:59.950 02:17:27 -- nvmf/common.sh@542 -- # cat 00:14:59.950 02:17:27 -- nvmf/common.sh@544 -- # jq . 00:14:59.950 02:17:27 -- nvmf/common.sh@544 -- # jq . 00:14:59.950 02:17:27 -- nvmf/common.sh@544 -- # jq . 00:14:59.950 02:17:27 -- nvmf/common.sh@544 -- # jq . 00:14:59.950 02:17:27 -- nvmf/common.sh@545 -- # IFS=, 00:14:59.950 02:17:27 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:59.950 "params": { 00:14:59.950 "name": "Nvme1", 00:14:59.950 "trtype": "tcp", 00:14:59.950 "traddr": "10.0.0.2", 00:14:59.950 "adrfam": "ipv4", 00:14:59.950 "trsvcid": "4420", 00:14:59.950 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:59.950 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:59.950 "hdgst": false, 00:14:59.950 "ddgst": false 00:14:59.950 }, 00:14:59.950 "method": "bdev_nvme_attach_controller" 00:14:59.950 }' 00:14:59.950 02:17:27 -- nvmf/common.sh@545 -- # IFS=, 00:14:59.950 02:17:27 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:59.950 "params": { 00:14:59.950 "name": "Nvme1", 00:14:59.950 "trtype": "tcp", 00:14:59.950 "traddr": "10.0.0.2", 00:14:59.950 "adrfam": "ipv4", 00:14:59.950 "trsvcid": "4420", 00:14:59.950 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:59.950 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:59.950 "hdgst": false, 00:14:59.950 "ddgst": false 00:14:59.950 }, 00:14:59.950 "method": "bdev_nvme_attach_controller" 00:14:59.950 }' 00:14:59.950 02:17:27 -- nvmf/common.sh@545 -- # IFS=, 00:14:59.950 02:17:27 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:59.950 "params": { 00:14:59.950 "name": "Nvme1", 00:14:59.950 "trtype": "tcp", 00:14:59.950 "traddr": "10.0.0.2", 00:14:59.950 "adrfam": "ipv4", 00:14:59.950 "trsvcid": "4420", 00:14:59.950 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:59.950 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:59.950 "hdgst": false, 00:14:59.950 "ddgst": false 00:14:59.950 }, 00:14:59.950 "method": "bdev_nvme_attach_controller" 00:14:59.950 }' 00:14:59.950 02:17:27 -- nvmf/common.sh@545 -- # IFS=, 00:14:59.950 02:17:27 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:59.950 "params": { 00:14:59.950 "name": "Nvme1", 00:14:59.950 "trtype": "tcp", 00:14:59.950 "traddr": "10.0.0.2", 00:14:59.950 "adrfam": "ipv4", 00:14:59.950 "trsvcid": "4420", 00:14:59.950 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:59.950 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:59.950 "hdgst": false, 00:14:59.950 "ddgst": false 00:14:59.950 }, 00:14:59.950 "method": "bdev_nvme_attach_controller" 00:14:59.950 }' 00:14:59.950 [2024-12-08 02:17:27.577033] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:59.950 [2024-12-08 02:17:27.577033] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:59.950 [2024-12-08 02:17:27.577030] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:59.950 [2024-12-08 02:17:27.577030] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:59.950 [2024-12-08 02:17:27.577116] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-12-08 02:17:27.577116] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:14:59.950 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:14:59.950 [2024-12-08 02:17:27.577125] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-12-08 02:17:27.577126] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:14:59.950 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:14:59.950 EAL: No free 2048 kB hugepages reported on node 1 00:15:00.214 EAL: No free 2048 kB hugepages reported on node 1 00:15:00.214 [2024-12-08 02:17:27.757660] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:00.214 EAL: No free 2048 kB hugepages reported on node 1 00:15:00.214 [2024-12-08 02:17:27.851923] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:15:00.214 [2024-12-08 02:17:27.857627] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:00.214 EAL: No free 2048 kB hugepages reported on node 1 00:15:00.214 [2024-12-08 02:17:27.924658] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:00.214 [2024-12-08 02:17:27.949343] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:15:00.214 [2024-12-08 02:17:27.993743] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:00.471 [2024-12-08 02:17:28.017148] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:15:00.471 [2024-12-08 02:17:28.084615] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:15:00.471 Running I/O for 1 seconds... 00:15:00.471 Running I/O for 1 seconds... 00:15:00.729 Running I/O for 1 seconds... 00:15:00.729 Running I/O for 1 seconds... 00:15:01.661 00:15:01.661 Latency(us) 00:15:01.661 [2024-12-08T01:17:29.442Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:01.661 [2024-12-08T01:17:29.442Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:15:01.661 Nvme1n1 : 1.02 7150.81 27.93 0.00 0.00 17724.73 8252.68 30098.01 00:15:01.661 [2024-12-08T01:17:29.442Z] =================================================================================================================== 00:15:01.661 [2024-12-08T01:17:29.442Z] Total : 7150.81 27.93 0.00 0.00 17724.73 8252.68 30098.01 00:15:01.661 00:15:01.661 Latency(us) 00:15:01.661 [2024-12-08T01:17:29.442Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:01.661 [2024-12-08T01:17:29.442Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:15:01.661 Nvme1n1 : 1.00 191667.77 748.70 0.00 0.00 665.30 276.10 831.34 00:15:01.661 [2024-12-08T01:17:29.442Z] =================================================================================================================== 00:15:01.661 [2024-12-08T01:17:29.442Z] Total : 191667.77 748.70 0.00 0.00 665.30 276.10 831.34 00:15:01.661 00:15:01.661 Latency(us) 00:15:01.661 [2024-12-08T01:17:29.442Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:01.661 [2024-12-08T01:17:29.442Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:15:01.661 Nvme1n1 : 1.01 6824.24 26.66 0.00 0.00 18694.90 5849.69 39030.33 00:15:01.661 [2024-12-08T01:17:29.442Z] =================================================================================================================== 00:15:01.661 [2024-12-08T01:17:29.442Z] Total : 6824.24 26.66 0.00 0.00 18694.90 5849.69 39030.33 00:15:01.661 00:15:01.661 Latency(us) 00:15:01.661 [2024-12-08T01:17:29.442Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:01.661 [2024-12-08T01:17:29.442Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:15:01.661 Nvme1n1 : 1.01 9694.61 37.87 0.00 0.00 13149.61 6893.42 25631.86 00:15:01.661 [2024-12-08T01:17:29.442Z] =================================================================================================================== 00:15:01.661 [2024-12-08T01:17:29.442Z] Total : 9694.61 37.87 0.00 0.00 13149.61 6893.42 25631.86 00:15:01.920 02:17:29 -- target/bdev_io_wait.sh@38 -- # wait 2097202 00:15:01.920 02:17:29 -- target/bdev_io_wait.sh@39 -- # wait 2097205 00:15:01.920 02:17:29 -- target/bdev_io_wait.sh@40 -- # wait 2097207 00:15:01.920 02:17:29 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:01.920 02:17:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:01.920 02:17:29 -- common/autotest_common.sh@10 -- # set +x 00:15:01.920 02:17:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:01.920 02:17:29 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:15:01.920 02:17:29 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:15:01.920 02:17:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:01.920 02:17:29 -- nvmf/common.sh@116 -- # sync 00:15:01.920 02:17:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:01.920 02:17:29 -- nvmf/common.sh@119 -- # set +e 00:15:01.920 02:17:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:01.920 02:17:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:01.920 rmmod nvme_tcp 00:15:01.920 rmmod nvme_fabrics 00:15:02.179 rmmod nvme_keyring 00:15:02.179 02:17:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:02.179 02:17:29 -- nvmf/common.sh@123 -- # set -e 00:15:02.179 02:17:29 -- nvmf/common.sh@124 -- # return 0 00:15:02.179 02:17:29 -- nvmf/common.sh@477 -- # '[' -n 2097173 ']' 00:15:02.179 02:17:29 -- nvmf/common.sh@478 -- # killprocess 2097173 00:15:02.179 02:17:29 -- common/autotest_common.sh@936 -- # '[' -z 2097173 ']' 00:15:02.179 02:17:29 -- common/autotest_common.sh@940 -- # kill -0 2097173 00:15:02.179 02:17:29 -- common/autotest_common.sh@941 -- # uname 00:15:02.179 02:17:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:02.179 02:17:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2097173 00:15:02.179 02:17:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:02.179 02:17:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:02.179 02:17:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2097173' 00:15:02.179 killing process with pid 2097173 00:15:02.179 02:17:29 -- common/autotest_common.sh@955 -- # kill 2097173 00:15:02.179 02:17:29 -- common/autotest_common.sh@960 -- # wait 2097173 00:15:02.438 02:17:30 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:02.438 02:17:30 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:02.438 02:17:30 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:02.438 02:17:30 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:02.438 02:17:30 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:02.438 02:17:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:02.438 02:17:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:02.438 02:17:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:04.338 02:17:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:04.338 00:15:04.338 real 0m7.331s 00:15:04.338 user 0m17.029s 00:15:04.338 sys 0m3.399s 00:15:04.338 02:17:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:04.338 02:17:32 -- common/autotest_common.sh@10 -- # set +x 00:15:04.338 ************************************ 00:15:04.338 END TEST nvmf_bdev_io_wait 00:15:04.338 ************************************ 00:15:04.338 02:17:32 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:04.338 02:17:32 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:04.338 02:17:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:04.338 02:17:32 -- common/autotest_common.sh@10 -- # set +x 00:15:04.338 ************************************ 00:15:04.338 START TEST nvmf_queue_depth 00:15:04.338 ************************************ 00:15:04.338 02:17:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:04.597 * Looking for test storage... 00:15:04.597 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:04.597 02:17:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:04.597 02:17:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:04.597 02:17:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:04.597 02:17:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:04.597 02:17:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:04.597 02:17:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:04.597 02:17:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:04.597 02:17:32 -- scripts/common.sh@335 -- # IFS=.-: 00:15:04.597 02:17:32 -- scripts/common.sh@335 -- # read -ra ver1 00:15:04.597 02:17:32 -- scripts/common.sh@336 -- # IFS=.-: 00:15:04.597 02:17:32 -- scripts/common.sh@336 -- # read -ra ver2 00:15:04.597 02:17:32 -- scripts/common.sh@337 -- # local 'op=<' 00:15:04.597 02:17:32 -- scripts/common.sh@339 -- # ver1_l=2 00:15:04.597 02:17:32 -- scripts/common.sh@340 -- # ver2_l=1 00:15:04.597 02:17:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:04.597 02:17:32 -- scripts/common.sh@343 -- # case "$op" in 00:15:04.597 02:17:32 -- scripts/common.sh@344 -- # : 1 00:15:04.597 02:17:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:04.597 02:17:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:04.597 02:17:32 -- scripts/common.sh@364 -- # decimal 1 00:15:04.597 02:17:32 -- scripts/common.sh@352 -- # local d=1 00:15:04.597 02:17:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:04.597 02:17:32 -- scripts/common.sh@354 -- # echo 1 00:15:04.597 02:17:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:04.597 02:17:32 -- scripts/common.sh@365 -- # decimal 2 00:15:04.597 02:17:32 -- scripts/common.sh@352 -- # local d=2 00:15:04.597 02:17:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:04.597 02:17:32 -- scripts/common.sh@354 -- # echo 2 00:15:04.597 02:17:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:04.597 02:17:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:04.597 02:17:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:04.597 02:17:32 -- scripts/common.sh@367 -- # return 0 00:15:04.597 02:17:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:04.597 02:17:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:04.597 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:04.597 --rc genhtml_branch_coverage=1 00:15:04.597 --rc genhtml_function_coverage=1 00:15:04.597 --rc genhtml_legend=1 00:15:04.597 --rc geninfo_all_blocks=1 00:15:04.597 --rc geninfo_unexecuted_blocks=1 00:15:04.597 00:15:04.597 ' 00:15:04.597 02:17:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:04.597 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:04.597 --rc genhtml_branch_coverage=1 00:15:04.597 --rc genhtml_function_coverage=1 00:15:04.597 --rc genhtml_legend=1 00:15:04.597 --rc geninfo_all_blocks=1 00:15:04.597 --rc geninfo_unexecuted_blocks=1 00:15:04.597 00:15:04.597 ' 00:15:04.597 02:17:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:04.597 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:04.597 --rc genhtml_branch_coverage=1 00:15:04.597 --rc genhtml_function_coverage=1 00:15:04.597 --rc genhtml_legend=1 00:15:04.597 --rc geninfo_all_blocks=1 00:15:04.597 --rc geninfo_unexecuted_blocks=1 00:15:04.597 00:15:04.597 ' 00:15:04.597 02:17:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:04.597 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:04.597 --rc genhtml_branch_coverage=1 00:15:04.597 --rc genhtml_function_coverage=1 00:15:04.597 --rc genhtml_legend=1 00:15:04.597 --rc geninfo_all_blocks=1 00:15:04.597 --rc geninfo_unexecuted_blocks=1 00:15:04.597 00:15:04.597 ' 00:15:04.597 02:17:32 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:04.597 02:17:32 -- nvmf/common.sh@7 -- # uname -s 00:15:04.597 02:17:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:04.597 02:17:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:04.597 02:17:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:04.597 02:17:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:04.597 02:17:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:04.597 02:17:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:04.597 02:17:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:04.597 02:17:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:04.597 02:17:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:04.597 02:17:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:04.597 02:17:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:04.597 02:17:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:04.597 02:17:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:04.597 02:17:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:04.597 02:17:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:04.597 02:17:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:04.597 02:17:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:04.597 02:17:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:04.597 02:17:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:04.597 02:17:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:04.597 02:17:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:04.597 02:17:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:04.597 02:17:32 -- paths/export.sh@5 -- # export PATH 00:15:04.597 02:17:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:04.597 02:17:32 -- nvmf/common.sh@46 -- # : 0 00:15:04.597 02:17:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:04.597 02:17:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:04.597 02:17:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:04.597 02:17:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:04.597 02:17:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:04.597 02:17:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:04.597 02:17:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:04.597 02:17:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:04.597 02:17:32 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:15:04.597 02:17:32 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:15:04.597 02:17:32 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:15:04.597 02:17:32 -- target/queue_depth.sh@19 -- # nvmftestinit 00:15:04.597 02:17:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:04.597 02:17:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:04.597 02:17:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:04.597 02:17:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:04.597 02:17:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:04.597 02:17:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:04.597 02:17:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:04.597 02:17:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:04.597 02:17:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:04.597 02:17:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:04.597 02:17:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:04.597 02:17:32 -- common/autotest_common.sh@10 -- # set +x 00:15:06.495 02:17:34 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:06.495 02:17:34 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:06.495 02:17:34 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:06.495 02:17:34 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:06.495 02:17:34 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:06.495 02:17:34 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:06.495 02:17:34 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:06.495 02:17:34 -- nvmf/common.sh@294 -- # net_devs=() 00:15:06.495 02:17:34 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:06.495 02:17:34 -- nvmf/common.sh@295 -- # e810=() 00:15:06.495 02:17:34 -- nvmf/common.sh@295 -- # local -ga e810 00:15:06.495 02:17:34 -- nvmf/common.sh@296 -- # x722=() 00:15:06.495 02:17:34 -- nvmf/common.sh@296 -- # local -ga x722 00:15:06.495 02:17:34 -- nvmf/common.sh@297 -- # mlx=() 00:15:06.495 02:17:34 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:06.495 02:17:34 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:06.495 02:17:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:06.495 02:17:34 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:06.495 02:17:34 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:06.495 02:17:34 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:06.495 02:17:34 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:06.495 02:17:34 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:06.495 02:17:34 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:06.495 02:17:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:06.495 02:17:34 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:06.495 02:17:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:06.495 02:17:34 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:06.495 02:17:34 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:06.495 02:17:34 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:06.495 02:17:34 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:06.495 02:17:34 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:06.495 02:17:34 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:06.495 02:17:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:06.495 02:17:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:06.495 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:06.495 02:17:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:06.495 02:17:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:06.495 02:17:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:06.495 02:17:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:06.495 02:17:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:06.495 02:17:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:06.495 02:17:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:06.495 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:06.495 02:17:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:06.495 02:17:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:06.495 02:17:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:06.495 02:17:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:06.495 02:17:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:06.495 02:17:34 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:06.495 02:17:34 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:06.495 02:17:34 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:06.495 02:17:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:06.495 02:17:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:06.495 02:17:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:06.495 02:17:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:06.495 02:17:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:06.495 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:06.495 02:17:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:06.495 02:17:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:06.495 02:17:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:06.495 02:17:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:06.495 02:17:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:06.495 02:17:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:06.495 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:06.495 02:17:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:06.495 02:17:34 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:06.495 02:17:34 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:06.495 02:17:34 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:06.495 02:17:34 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:06.495 02:17:34 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:06.495 02:17:34 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:06.495 02:17:34 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:06.495 02:17:34 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:06.495 02:17:34 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:06.495 02:17:34 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:06.495 02:17:34 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:06.495 02:17:34 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:06.495 02:17:34 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:06.495 02:17:34 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:06.495 02:17:34 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:06.495 02:17:34 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:06.495 02:17:34 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:06.495 02:17:34 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:06.754 02:17:34 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:06.754 02:17:34 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:06.754 02:17:34 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:06.754 02:17:34 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:06.754 02:17:34 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:06.754 02:17:34 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:06.754 02:17:34 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:06.754 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:06.754 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.218 ms 00:15:06.754 00:15:06.754 --- 10.0.0.2 ping statistics --- 00:15:06.754 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:06.754 rtt min/avg/max/mdev = 0.218/0.218/0.218/0.000 ms 00:15:06.754 02:17:34 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:06.754 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:06.754 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.051 ms 00:15:06.754 00:15:06.754 --- 10.0.0.1 ping statistics --- 00:15:06.754 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:06.754 rtt min/avg/max/mdev = 0.051/0.051/0.051/0.000 ms 00:15:06.754 02:17:34 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:06.754 02:17:34 -- nvmf/common.sh@410 -- # return 0 00:15:06.754 02:17:34 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:06.754 02:17:34 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:06.754 02:17:34 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:06.754 02:17:34 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:06.754 02:17:34 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:06.754 02:17:34 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:06.754 02:17:34 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:06.754 02:17:34 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:15:06.754 02:17:34 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:06.754 02:17:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:06.754 02:17:34 -- common/autotest_common.sh@10 -- # set +x 00:15:06.754 02:17:34 -- nvmf/common.sh@469 -- # nvmfpid=2099453 00:15:06.754 02:17:34 -- nvmf/common.sh@470 -- # waitforlisten 2099453 00:15:06.754 02:17:34 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:06.754 02:17:34 -- common/autotest_common.sh@829 -- # '[' -z 2099453 ']' 00:15:06.754 02:17:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:06.754 02:17:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:06.754 02:17:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:06.754 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:06.754 02:17:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:06.754 02:17:34 -- common/autotest_common.sh@10 -- # set +x 00:15:06.754 [2024-12-08 02:17:34.446841] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:06.754 [2024-12-08 02:17:34.446927] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:06.754 EAL: No free 2048 kB hugepages reported on node 1 00:15:06.754 [2024-12-08 02:17:34.513457] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:07.013 [2024-12-08 02:17:34.629026] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:07.013 [2024-12-08 02:17:34.629204] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:07.013 [2024-12-08 02:17:34.629224] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:07.013 [2024-12-08 02:17:34.629237] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:07.013 [2024-12-08 02:17:34.629264] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:07.946 02:17:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:07.946 02:17:35 -- common/autotest_common.sh@862 -- # return 0 00:15:07.946 02:17:35 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:07.946 02:17:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:07.946 02:17:35 -- common/autotest_common.sh@10 -- # set +x 00:15:07.946 02:17:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:07.946 02:17:35 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:07.946 02:17:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:07.946 02:17:35 -- common/autotest_common.sh@10 -- # set +x 00:15:07.946 [2024-12-08 02:17:35.432031] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:07.946 02:17:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:07.946 02:17:35 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:07.946 02:17:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:07.946 02:17:35 -- common/autotest_common.sh@10 -- # set +x 00:15:07.946 Malloc0 00:15:07.946 02:17:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:07.946 02:17:35 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:07.946 02:17:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:07.946 02:17:35 -- common/autotest_common.sh@10 -- # set +x 00:15:07.946 02:17:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:07.946 02:17:35 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:07.946 02:17:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:07.946 02:17:35 -- common/autotest_common.sh@10 -- # set +x 00:15:07.946 02:17:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:07.946 02:17:35 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:07.946 02:17:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:07.946 02:17:35 -- common/autotest_common.sh@10 -- # set +x 00:15:07.946 [2024-12-08 02:17:35.494434] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:07.946 02:17:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:07.946 02:17:35 -- target/queue_depth.sh@30 -- # bdevperf_pid=2099626 00:15:07.946 02:17:35 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:15:07.946 02:17:35 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:07.946 02:17:35 -- target/queue_depth.sh@33 -- # waitforlisten 2099626 /var/tmp/bdevperf.sock 00:15:07.946 02:17:35 -- common/autotest_common.sh@829 -- # '[' -z 2099626 ']' 00:15:07.946 02:17:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:07.946 02:17:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:07.946 02:17:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:07.946 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:07.946 02:17:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:07.946 02:17:35 -- common/autotest_common.sh@10 -- # set +x 00:15:07.946 [2024-12-08 02:17:35.536263] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:07.947 [2024-12-08 02:17:35.536336] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2099626 ] 00:15:07.947 EAL: No free 2048 kB hugepages reported on node 1 00:15:07.947 [2024-12-08 02:17:35.597702] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:07.947 [2024-12-08 02:17:35.712557] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:08.879 02:17:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:08.879 02:17:36 -- common/autotest_common.sh@862 -- # return 0 00:15:08.879 02:17:36 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:15:08.879 02:17:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:08.879 02:17:36 -- common/autotest_common.sh@10 -- # set +x 00:15:09.137 NVMe0n1 00:15:09.137 02:17:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:09.137 02:17:36 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:09.396 Running I/O for 10 seconds... 00:15:19.366 00:15:19.367 Latency(us) 00:15:19.367 [2024-12-08T01:17:47.148Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:19.367 [2024-12-08T01:17:47.148Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:15:19.367 Verification LBA range: start 0x0 length 0x4000 00:15:19.367 NVMe0n1 : 10.06 12893.01 50.36 0.00 0.00 79126.36 12913.02 58254.22 00:15:19.367 [2024-12-08T01:17:47.148Z] =================================================================================================================== 00:15:19.367 [2024-12-08T01:17:47.148Z] Total : 12893.01 50.36 0.00 0.00 79126.36 12913.02 58254.22 00:15:19.367 0 00:15:19.367 02:17:47 -- target/queue_depth.sh@39 -- # killprocess 2099626 00:15:19.367 02:17:47 -- common/autotest_common.sh@936 -- # '[' -z 2099626 ']' 00:15:19.367 02:17:47 -- common/autotest_common.sh@940 -- # kill -0 2099626 00:15:19.367 02:17:47 -- common/autotest_common.sh@941 -- # uname 00:15:19.367 02:17:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:19.367 02:17:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2099626 00:15:19.367 02:17:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:19.367 02:17:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:19.367 02:17:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2099626' 00:15:19.367 killing process with pid 2099626 00:15:19.367 02:17:47 -- common/autotest_common.sh@955 -- # kill 2099626 00:15:19.367 Received shutdown signal, test time was about 10.000000 seconds 00:15:19.367 00:15:19.367 Latency(us) 00:15:19.367 [2024-12-08T01:17:47.148Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:19.367 [2024-12-08T01:17:47.148Z] =================================================================================================================== 00:15:19.367 [2024-12-08T01:17:47.148Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:19.367 02:17:47 -- common/autotest_common.sh@960 -- # wait 2099626 00:15:19.625 02:17:47 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:15:19.625 02:17:47 -- target/queue_depth.sh@43 -- # nvmftestfini 00:15:19.625 02:17:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:19.625 02:17:47 -- nvmf/common.sh@116 -- # sync 00:15:19.625 02:17:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:19.625 02:17:47 -- nvmf/common.sh@119 -- # set +e 00:15:19.625 02:17:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:19.625 02:17:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:19.625 rmmod nvme_tcp 00:15:19.625 rmmod nvme_fabrics 00:15:19.625 rmmod nvme_keyring 00:15:19.625 02:17:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:19.625 02:17:47 -- nvmf/common.sh@123 -- # set -e 00:15:19.625 02:17:47 -- nvmf/common.sh@124 -- # return 0 00:15:19.625 02:17:47 -- nvmf/common.sh@477 -- # '[' -n 2099453 ']' 00:15:19.625 02:17:47 -- nvmf/common.sh@478 -- # killprocess 2099453 00:15:19.625 02:17:47 -- common/autotest_common.sh@936 -- # '[' -z 2099453 ']' 00:15:19.625 02:17:47 -- common/autotest_common.sh@940 -- # kill -0 2099453 00:15:19.625 02:17:47 -- common/autotest_common.sh@941 -- # uname 00:15:19.625 02:17:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:19.625 02:17:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2099453 00:15:19.883 02:17:47 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:19.883 02:17:47 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:19.883 02:17:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2099453' 00:15:19.883 killing process with pid 2099453 00:15:19.883 02:17:47 -- common/autotest_common.sh@955 -- # kill 2099453 00:15:19.883 02:17:47 -- common/autotest_common.sh@960 -- # wait 2099453 00:15:20.142 02:17:47 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:20.142 02:17:47 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:20.142 02:17:47 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:20.142 02:17:47 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:20.142 02:17:47 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:20.142 02:17:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:20.142 02:17:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:20.142 02:17:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:22.045 02:17:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:22.045 00:15:22.045 real 0m17.668s 00:15:22.045 user 0m25.448s 00:15:22.045 sys 0m3.135s 00:15:22.045 02:17:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:22.045 02:17:49 -- common/autotest_common.sh@10 -- # set +x 00:15:22.045 ************************************ 00:15:22.045 END TEST nvmf_queue_depth 00:15:22.045 ************************************ 00:15:22.045 02:17:49 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:22.045 02:17:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:22.045 02:17:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:22.045 02:17:49 -- common/autotest_common.sh@10 -- # set +x 00:15:22.045 ************************************ 00:15:22.045 START TEST nvmf_multipath 00:15:22.045 ************************************ 00:15:22.045 02:17:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:22.303 * Looking for test storage... 00:15:22.303 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:22.303 02:17:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:22.303 02:17:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:22.303 02:17:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:22.303 02:17:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:22.303 02:17:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:22.303 02:17:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:22.303 02:17:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:22.303 02:17:49 -- scripts/common.sh@335 -- # IFS=.-: 00:15:22.303 02:17:49 -- scripts/common.sh@335 -- # read -ra ver1 00:15:22.303 02:17:49 -- scripts/common.sh@336 -- # IFS=.-: 00:15:22.303 02:17:49 -- scripts/common.sh@336 -- # read -ra ver2 00:15:22.303 02:17:49 -- scripts/common.sh@337 -- # local 'op=<' 00:15:22.303 02:17:49 -- scripts/common.sh@339 -- # ver1_l=2 00:15:22.303 02:17:49 -- scripts/common.sh@340 -- # ver2_l=1 00:15:22.303 02:17:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:22.303 02:17:49 -- scripts/common.sh@343 -- # case "$op" in 00:15:22.303 02:17:49 -- scripts/common.sh@344 -- # : 1 00:15:22.303 02:17:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:22.303 02:17:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:22.303 02:17:49 -- scripts/common.sh@364 -- # decimal 1 00:15:22.303 02:17:49 -- scripts/common.sh@352 -- # local d=1 00:15:22.303 02:17:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:22.303 02:17:49 -- scripts/common.sh@354 -- # echo 1 00:15:22.303 02:17:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:22.303 02:17:49 -- scripts/common.sh@365 -- # decimal 2 00:15:22.303 02:17:49 -- scripts/common.sh@352 -- # local d=2 00:15:22.303 02:17:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:22.303 02:17:49 -- scripts/common.sh@354 -- # echo 2 00:15:22.303 02:17:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:22.303 02:17:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:22.303 02:17:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:22.303 02:17:49 -- scripts/common.sh@367 -- # return 0 00:15:22.303 02:17:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:22.303 02:17:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:22.303 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:22.303 --rc genhtml_branch_coverage=1 00:15:22.303 --rc genhtml_function_coverage=1 00:15:22.303 --rc genhtml_legend=1 00:15:22.303 --rc geninfo_all_blocks=1 00:15:22.303 --rc geninfo_unexecuted_blocks=1 00:15:22.303 00:15:22.303 ' 00:15:22.303 02:17:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:22.303 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:22.303 --rc genhtml_branch_coverage=1 00:15:22.303 --rc genhtml_function_coverage=1 00:15:22.303 --rc genhtml_legend=1 00:15:22.303 --rc geninfo_all_blocks=1 00:15:22.303 --rc geninfo_unexecuted_blocks=1 00:15:22.303 00:15:22.303 ' 00:15:22.303 02:17:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:22.303 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:22.303 --rc genhtml_branch_coverage=1 00:15:22.303 --rc genhtml_function_coverage=1 00:15:22.303 --rc genhtml_legend=1 00:15:22.303 --rc geninfo_all_blocks=1 00:15:22.303 --rc geninfo_unexecuted_blocks=1 00:15:22.303 00:15:22.303 ' 00:15:22.303 02:17:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:22.303 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:22.303 --rc genhtml_branch_coverage=1 00:15:22.303 --rc genhtml_function_coverage=1 00:15:22.303 --rc genhtml_legend=1 00:15:22.303 --rc geninfo_all_blocks=1 00:15:22.303 --rc geninfo_unexecuted_blocks=1 00:15:22.303 00:15:22.303 ' 00:15:22.303 02:17:49 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:22.303 02:17:49 -- nvmf/common.sh@7 -- # uname -s 00:15:22.303 02:17:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:22.303 02:17:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:22.303 02:17:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:22.303 02:17:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:22.303 02:17:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:22.303 02:17:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:22.303 02:17:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:22.303 02:17:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:22.303 02:17:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:22.303 02:17:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:22.303 02:17:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:22.303 02:17:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:22.303 02:17:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:22.303 02:17:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:22.303 02:17:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:22.303 02:17:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:22.303 02:17:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:22.303 02:17:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:22.304 02:17:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:22.304 02:17:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:22.304 02:17:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:22.304 02:17:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:22.304 02:17:49 -- paths/export.sh@5 -- # export PATH 00:15:22.304 02:17:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:22.304 02:17:49 -- nvmf/common.sh@46 -- # : 0 00:15:22.304 02:17:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:22.304 02:17:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:22.304 02:17:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:22.304 02:17:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:22.304 02:17:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:22.304 02:17:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:22.304 02:17:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:22.304 02:17:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:22.304 02:17:49 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:22.304 02:17:49 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:22.304 02:17:49 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:15:22.304 02:17:49 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:22.304 02:17:49 -- target/multipath.sh@43 -- # nvmftestinit 00:15:22.304 02:17:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:22.304 02:17:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:22.304 02:17:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:22.304 02:17:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:22.304 02:17:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:22.304 02:17:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:22.304 02:17:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:22.304 02:17:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:22.304 02:17:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:22.304 02:17:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:22.304 02:17:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:22.304 02:17:49 -- common/autotest_common.sh@10 -- # set +x 00:15:24.260 02:17:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:24.260 02:17:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:24.260 02:17:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:24.260 02:17:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:24.260 02:17:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:24.260 02:17:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:24.260 02:17:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:24.260 02:17:51 -- nvmf/common.sh@294 -- # net_devs=() 00:15:24.260 02:17:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:24.260 02:17:51 -- nvmf/common.sh@295 -- # e810=() 00:15:24.260 02:17:51 -- nvmf/common.sh@295 -- # local -ga e810 00:15:24.260 02:17:51 -- nvmf/common.sh@296 -- # x722=() 00:15:24.260 02:17:51 -- nvmf/common.sh@296 -- # local -ga x722 00:15:24.260 02:17:51 -- nvmf/common.sh@297 -- # mlx=() 00:15:24.260 02:17:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:24.260 02:17:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:24.260 02:17:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:24.260 02:17:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:24.260 02:17:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:24.260 02:17:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:24.260 02:17:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:24.260 02:17:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:24.260 02:17:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:24.260 02:17:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:24.260 02:17:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:24.260 02:17:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:24.260 02:17:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:24.260 02:17:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:24.260 02:17:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:24.260 02:17:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:24.260 02:17:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:24.260 02:17:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:24.260 02:17:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:24.260 02:17:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:24.260 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:24.260 02:17:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:24.260 02:17:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:24.260 02:17:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:24.260 02:17:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:24.260 02:17:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:24.260 02:17:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:24.260 02:17:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:24.260 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:24.260 02:17:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:24.260 02:17:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:24.260 02:17:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:24.260 02:17:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:24.260 02:17:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:24.260 02:17:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:24.260 02:17:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:24.260 02:17:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:24.260 02:17:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:24.260 02:17:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:24.260 02:17:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:24.260 02:17:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:24.260 02:17:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:24.260 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:24.260 02:17:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:24.260 02:17:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:24.260 02:17:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:24.260 02:17:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:24.260 02:17:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:24.260 02:17:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:24.260 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:24.260 02:17:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:24.260 02:17:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:24.260 02:17:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:24.260 02:17:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:24.260 02:17:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:24.260 02:17:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:24.260 02:17:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:24.260 02:17:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:24.260 02:17:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:24.260 02:17:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:24.260 02:17:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:24.260 02:17:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:24.260 02:17:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:24.260 02:17:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:24.260 02:17:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:24.260 02:17:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:24.260 02:17:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:24.260 02:17:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:24.260 02:17:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:24.260 02:17:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:24.260 02:17:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:24.260 02:17:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:24.260 02:17:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:24.517 02:17:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:24.517 02:17:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:24.517 02:17:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:24.517 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:24.517 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.279 ms 00:15:24.517 00:15:24.517 --- 10.0.0.2 ping statistics --- 00:15:24.517 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:24.517 rtt min/avg/max/mdev = 0.279/0.279/0.279/0.000 ms 00:15:24.517 02:17:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:24.517 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:24.517 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.159 ms 00:15:24.517 00:15:24.517 --- 10.0.0.1 ping statistics --- 00:15:24.517 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:24.517 rtt min/avg/max/mdev = 0.159/0.159/0.159/0.000 ms 00:15:24.517 02:17:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:24.517 02:17:52 -- nvmf/common.sh@410 -- # return 0 00:15:24.517 02:17:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:24.517 02:17:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:24.517 02:17:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:24.517 02:17:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:24.517 02:17:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:24.517 02:17:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:24.517 02:17:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:24.517 02:17:52 -- target/multipath.sh@45 -- # '[' -z ']' 00:15:24.517 02:17:52 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:15:24.517 only one NIC for nvmf test 00:15:24.517 02:17:52 -- target/multipath.sh@47 -- # nvmftestfini 00:15:24.517 02:17:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:24.517 02:17:52 -- nvmf/common.sh@116 -- # sync 00:15:24.517 02:17:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:24.517 02:17:52 -- nvmf/common.sh@119 -- # set +e 00:15:24.517 02:17:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:24.517 02:17:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:24.517 rmmod nvme_tcp 00:15:24.517 rmmod nvme_fabrics 00:15:24.517 rmmod nvme_keyring 00:15:24.517 02:17:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:24.517 02:17:52 -- nvmf/common.sh@123 -- # set -e 00:15:24.517 02:17:52 -- nvmf/common.sh@124 -- # return 0 00:15:24.517 02:17:52 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:24.517 02:17:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:24.517 02:17:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:24.517 02:17:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:24.517 02:17:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:24.517 02:17:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:24.517 02:17:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:24.517 02:17:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:24.517 02:17:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:26.422 02:17:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:26.422 02:17:54 -- target/multipath.sh@48 -- # exit 0 00:15:26.422 02:17:54 -- target/multipath.sh@1 -- # nvmftestfini 00:15:26.422 02:17:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:26.422 02:17:54 -- nvmf/common.sh@116 -- # sync 00:15:26.422 02:17:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:26.422 02:17:54 -- nvmf/common.sh@119 -- # set +e 00:15:26.422 02:17:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:26.422 02:17:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:26.422 02:17:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:26.422 02:17:54 -- nvmf/common.sh@123 -- # set -e 00:15:26.422 02:17:54 -- nvmf/common.sh@124 -- # return 0 00:15:26.422 02:17:54 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:26.422 02:17:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:26.422 02:17:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:26.422 02:17:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:26.422 02:17:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:26.422 02:17:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:26.422 02:17:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:26.422 02:17:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:26.422 02:17:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:26.422 02:17:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:26.680 00:15:26.680 real 0m4.405s 00:15:26.680 user 0m0.886s 00:15:26.680 sys 0m1.512s 00:15:26.680 02:17:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:26.680 02:17:54 -- common/autotest_common.sh@10 -- # set +x 00:15:26.680 ************************************ 00:15:26.680 END TEST nvmf_multipath 00:15:26.680 ************************************ 00:15:26.680 02:17:54 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:15:26.680 02:17:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:26.680 02:17:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:26.680 02:17:54 -- common/autotest_common.sh@10 -- # set +x 00:15:26.680 ************************************ 00:15:26.681 START TEST nvmf_zcopy 00:15:26.681 ************************************ 00:15:26.681 02:17:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:15:26.681 * Looking for test storage... 00:15:26.681 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:26.681 02:17:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:26.681 02:17:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:26.681 02:17:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:26.681 02:17:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:26.681 02:17:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:26.681 02:17:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:26.681 02:17:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:26.681 02:17:54 -- scripts/common.sh@335 -- # IFS=.-: 00:15:26.681 02:17:54 -- scripts/common.sh@335 -- # read -ra ver1 00:15:26.681 02:17:54 -- scripts/common.sh@336 -- # IFS=.-: 00:15:26.681 02:17:54 -- scripts/common.sh@336 -- # read -ra ver2 00:15:26.681 02:17:54 -- scripts/common.sh@337 -- # local 'op=<' 00:15:26.681 02:17:54 -- scripts/common.sh@339 -- # ver1_l=2 00:15:26.681 02:17:54 -- scripts/common.sh@340 -- # ver2_l=1 00:15:26.681 02:17:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:26.681 02:17:54 -- scripts/common.sh@343 -- # case "$op" in 00:15:26.681 02:17:54 -- scripts/common.sh@344 -- # : 1 00:15:26.681 02:17:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:26.681 02:17:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:26.681 02:17:54 -- scripts/common.sh@364 -- # decimal 1 00:15:26.681 02:17:54 -- scripts/common.sh@352 -- # local d=1 00:15:26.681 02:17:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:26.681 02:17:54 -- scripts/common.sh@354 -- # echo 1 00:15:26.681 02:17:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:26.681 02:17:54 -- scripts/common.sh@365 -- # decimal 2 00:15:26.681 02:17:54 -- scripts/common.sh@352 -- # local d=2 00:15:26.681 02:17:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:26.681 02:17:54 -- scripts/common.sh@354 -- # echo 2 00:15:26.681 02:17:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:26.681 02:17:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:26.681 02:17:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:26.681 02:17:54 -- scripts/common.sh@367 -- # return 0 00:15:26.681 02:17:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:26.681 02:17:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:26.681 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:26.681 --rc genhtml_branch_coverage=1 00:15:26.681 --rc genhtml_function_coverage=1 00:15:26.681 --rc genhtml_legend=1 00:15:26.681 --rc geninfo_all_blocks=1 00:15:26.681 --rc geninfo_unexecuted_blocks=1 00:15:26.681 00:15:26.681 ' 00:15:26.681 02:17:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:26.681 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:26.681 --rc genhtml_branch_coverage=1 00:15:26.681 --rc genhtml_function_coverage=1 00:15:26.681 --rc genhtml_legend=1 00:15:26.681 --rc geninfo_all_blocks=1 00:15:26.681 --rc geninfo_unexecuted_blocks=1 00:15:26.681 00:15:26.681 ' 00:15:26.681 02:17:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:26.681 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:26.681 --rc genhtml_branch_coverage=1 00:15:26.681 --rc genhtml_function_coverage=1 00:15:26.681 --rc genhtml_legend=1 00:15:26.681 --rc geninfo_all_blocks=1 00:15:26.681 --rc geninfo_unexecuted_blocks=1 00:15:26.681 00:15:26.681 ' 00:15:26.681 02:17:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:26.681 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:26.681 --rc genhtml_branch_coverage=1 00:15:26.681 --rc genhtml_function_coverage=1 00:15:26.681 --rc genhtml_legend=1 00:15:26.681 --rc geninfo_all_blocks=1 00:15:26.681 --rc geninfo_unexecuted_blocks=1 00:15:26.681 00:15:26.681 ' 00:15:26.681 02:17:54 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:26.681 02:17:54 -- nvmf/common.sh@7 -- # uname -s 00:15:26.681 02:17:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:26.681 02:17:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:26.681 02:17:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:26.681 02:17:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:26.681 02:17:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:26.681 02:17:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:26.681 02:17:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:26.681 02:17:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:26.681 02:17:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:26.681 02:17:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:26.681 02:17:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:26.681 02:17:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:26.681 02:17:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:26.681 02:17:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:26.681 02:17:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:26.681 02:17:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:26.681 02:17:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:26.681 02:17:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:26.681 02:17:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:26.681 02:17:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:26.681 02:17:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:26.681 02:17:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:26.681 02:17:54 -- paths/export.sh@5 -- # export PATH 00:15:26.681 02:17:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:26.681 02:17:54 -- nvmf/common.sh@46 -- # : 0 00:15:26.681 02:17:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:26.681 02:17:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:26.681 02:17:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:26.681 02:17:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:26.681 02:17:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:26.681 02:17:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:26.681 02:17:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:26.681 02:17:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:26.681 02:17:54 -- target/zcopy.sh@12 -- # nvmftestinit 00:15:26.681 02:17:54 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:26.681 02:17:54 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:26.681 02:17:54 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:26.681 02:17:54 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:26.681 02:17:54 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:26.681 02:17:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:26.681 02:17:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:26.681 02:17:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:26.681 02:17:54 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:26.681 02:17:54 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:26.681 02:17:54 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:26.681 02:17:54 -- common/autotest_common.sh@10 -- # set +x 00:15:29.216 02:17:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:29.216 02:17:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:29.216 02:17:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:29.216 02:17:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:29.216 02:17:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:29.216 02:17:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:29.216 02:17:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:29.216 02:17:56 -- nvmf/common.sh@294 -- # net_devs=() 00:15:29.216 02:17:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:29.216 02:17:56 -- nvmf/common.sh@295 -- # e810=() 00:15:29.216 02:17:56 -- nvmf/common.sh@295 -- # local -ga e810 00:15:29.216 02:17:56 -- nvmf/common.sh@296 -- # x722=() 00:15:29.216 02:17:56 -- nvmf/common.sh@296 -- # local -ga x722 00:15:29.216 02:17:56 -- nvmf/common.sh@297 -- # mlx=() 00:15:29.216 02:17:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:29.216 02:17:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:29.216 02:17:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:29.216 02:17:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:29.216 02:17:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:29.216 02:17:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:29.216 02:17:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:29.216 02:17:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:29.216 02:17:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:29.216 02:17:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:29.216 02:17:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:29.216 02:17:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:29.216 02:17:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:29.216 02:17:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:29.216 02:17:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:29.216 02:17:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:29.216 02:17:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:29.216 02:17:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:29.216 02:17:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:29.216 02:17:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:29.216 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:29.216 02:17:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:29.216 02:17:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:29.216 02:17:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:29.216 02:17:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:29.216 02:17:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:29.216 02:17:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:29.216 02:17:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:29.216 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:29.216 02:17:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:29.216 02:17:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:29.216 02:17:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:29.216 02:17:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:29.216 02:17:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:29.216 02:17:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:29.216 02:17:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:29.216 02:17:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:29.216 02:17:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:29.216 02:17:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:29.216 02:17:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:29.216 02:17:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:29.216 02:17:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:29.216 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:29.216 02:17:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:29.216 02:17:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:29.216 02:17:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:29.216 02:17:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:29.216 02:17:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:29.216 02:17:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:29.216 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:29.216 02:17:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:29.216 02:17:56 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:29.216 02:17:56 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:29.216 02:17:56 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:29.216 02:17:56 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:29.216 02:17:56 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:29.216 02:17:56 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:29.216 02:17:56 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:29.216 02:17:56 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:29.216 02:17:56 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:29.216 02:17:56 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:29.216 02:17:56 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:29.216 02:17:56 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:29.216 02:17:56 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:29.216 02:17:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:29.216 02:17:56 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:29.216 02:17:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:29.216 02:17:56 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:29.216 02:17:56 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:29.216 02:17:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:29.216 02:17:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:29.216 02:17:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:29.216 02:17:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:29.216 02:17:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:29.216 02:17:56 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:29.216 02:17:56 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:29.216 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:29.216 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.223 ms 00:15:29.216 00:15:29.216 --- 10.0.0.2 ping statistics --- 00:15:29.216 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:29.216 rtt min/avg/max/mdev = 0.223/0.223/0.223/0.000 ms 00:15:29.216 02:17:56 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:29.216 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:29.216 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.097 ms 00:15:29.216 00:15:29.216 --- 10.0.0.1 ping statistics --- 00:15:29.216 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:29.216 rtt min/avg/max/mdev = 0.097/0.097/0.097/0.000 ms 00:15:29.216 02:17:56 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:29.216 02:17:56 -- nvmf/common.sh@410 -- # return 0 00:15:29.216 02:17:56 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:29.216 02:17:56 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:29.216 02:17:56 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:29.216 02:17:56 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:29.216 02:17:56 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:29.216 02:17:56 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:29.216 02:17:56 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:29.216 02:17:56 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:15:29.216 02:17:56 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:29.216 02:17:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:29.216 02:17:56 -- common/autotest_common.sh@10 -- # set +x 00:15:29.216 02:17:56 -- nvmf/common.sh@469 -- # nvmfpid=2105002 00:15:29.216 02:17:56 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:29.216 02:17:56 -- nvmf/common.sh@470 -- # waitforlisten 2105002 00:15:29.216 02:17:56 -- common/autotest_common.sh@829 -- # '[' -z 2105002 ']' 00:15:29.216 02:17:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:29.216 02:17:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:29.216 02:17:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:29.216 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:29.216 02:17:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:29.216 02:17:56 -- common/autotest_common.sh@10 -- # set +x 00:15:29.216 [2024-12-08 02:17:56.647142] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:29.216 [2024-12-08 02:17:56.647222] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:29.216 EAL: No free 2048 kB hugepages reported on node 1 00:15:29.216 [2024-12-08 02:17:56.715066] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:29.216 [2024-12-08 02:17:56.833242] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:29.216 [2024-12-08 02:17:56.833405] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:29.216 [2024-12-08 02:17:56.833424] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:29.216 [2024-12-08 02:17:56.833438] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:29.216 [2024-12-08 02:17:56.833477] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:30.153 02:17:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:30.153 02:17:57 -- common/autotest_common.sh@862 -- # return 0 00:15:30.153 02:17:57 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:30.153 02:17:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:30.153 02:17:57 -- common/autotest_common.sh@10 -- # set +x 00:15:30.153 02:17:57 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:30.153 02:17:57 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:15:30.153 02:17:57 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:15:30.153 02:17:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:30.153 02:17:57 -- common/autotest_common.sh@10 -- # set +x 00:15:30.153 [2024-12-08 02:17:57.646102] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:30.153 02:17:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:30.153 02:17:57 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:30.153 02:17:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:30.153 02:17:57 -- common/autotest_common.sh@10 -- # set +x 00:15:30.153 02:17:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:30.153 02:17:57 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:30.153 02:17:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:30.153 02:17:57 -- common/autotest_common.sh@10 -- # set +x 00:15:30.153 [2024-12-08 02:17:57.662285] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:30.153 02:17:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:30.153 02:17:57 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:30.153 02:17:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:30.153 02:17:57 -- common/autotest_common.sh@10 -- # set +x 00:15:30.153 02:17:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:30.153 02:17:57 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:15:30.153 02:17:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:30.153 02:17:57 -- common/autotest_common.sh@10 -- # set +x 00:15:30.153 malloc0 00:15:30.153 02:17:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:30.153 02:17:57 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:15:30.153 02:17:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:30.153 02:17:57 -- common/autotest_common.sh@10 -- # set +x 00:15:30.153 02:17:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:30.153 02:17:57 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:15:30.153 02:17:57 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:15:30.153 02:17:57 -- nvmf/common.sh@520 -- # config=() 00:15:30.153 02:17:57 -- nvmf/common.sh@520 -- # local subsystem config 00:15:30.153 02:17:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:30.153 02:17:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:30.153 { 00:15:30.153 "params": { 00:15:30.153 "name": "Nvme$subsystem", 00:15:30.153 "trtype": "$TEST_TRANSPORT", 00:15:30.153 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:30.153 "adrfam": "ipv4", 00:15:30.153 "trsvcid": "$NVMF_PORT", 00:15:30.153 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:30.153 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:30.153 "hdgst": ${hdgst:-false}, 00:15:30.153 "ddgst": ${ddgst:-false} 00:15:30.153 }, 00:15:30.153 "method": "bdev_nvme_attach_controller" 00:15:30.153 } 00:15:30.153 EOF 00:15:30.153 )") 00:15:30.153 02:17:57 -- nvmf/common.sh@542 -- # cat 00:15:30.153 02:17:57 -- nvmf/common.sh@544 -- # jq . 00:15:30.153 02:17:57 -- nvmf/common.sh@545 -- # IFS=, 00:15:30.153 02:17:57 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:30.153 "params": { 00:15:30.153 "name": "Nvme1", 00:15:30.153 "trtype": "tcp", 00:15:30.153 "traddr": "10.0.0.2", 00:15:30.153 "adrfam": "ipv4", 00:15:30.153 "trsvcid": "4420", 00:15:30.153 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:30.153 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:30.153 "hdgst": false, 00:15:30.153 "ddgst": false 00:15:30.153 }, 00:15:30.153 "method": "bdev_nvme_attach_controller" 00:15:30.153 }' 00:15:30.153 [2024-12-08 02:17:57.736399] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:30.153 [2024-12-08 02:17:57.736475] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2105131 ] 00:15:30.153 EAL: No free 2048 kB hugepages reported on node 1 00:15:30.153 [2024-12-08 02:17:57.800310] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:30.153 [2024-12-08 02:17:57.917881] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:30.722 Running I/O for 10 seconds... 00:15:40.722 00:15:40.722 Latency(us) 00:15:40.722 [2024-12-08T01:18:08.503Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:40.722 [2024-12-08T01:18:08.503Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:15:40.722 Verification LBA range: start 0x0 length 0x1000 00:15:40.722 Nvme1n1 : 10.01 8712.74 68.07 0.00 0.00 14657.08 1207.56 23107.51 00:15:40.722 [2024-12-08T01:18:08.503Z] =================================================================================================================== 00:15:40.722 [2024-12-08T01:18:08.503Z] Total : 8712.74 68.07 0.00 0.00 14657.08 1207.56 23107.51 00:15:40.979 02:18:08 -- target/zcopy.sh@39 -- # perfpid=2106867 00:15:40.979 02:18:08 -- target/zcopy.sh@41 -- # xtrace_disable 00:15:40.979 02:18:08 -- common/autotest_common.sh@10 -- # set +x 00:15:40.979 02:18:08 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:15:40.979 02:18:08 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:15:40.979 02:18:08 -- nvmf/common.sh@520 -- # config=() 00:15:40.979 02:18:08 -- nvmf/common.sh@520 -- # local subsystem config 00:15:40.979 02:18:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:40.979 02:18:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:40.979 { 00:15:40.980 "params": { 00:15:40.980 "name": "Nvme$subsystem", 00:15:40.980 "trtype": "$TEST_TRANSPORT", 00:15:40.980 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:40.980 "adrfam": "ipv4", 00:15:40.980 "trsvcid": "$NVMF_PORT", 00:15:40.980 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:40.980 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:40.980 "hdgst": ${hdgst:-false}, 00:15:40.980 "ddgst": ${ddgst:-false} 00:15:40.980 }, 00:15:40.980 "method": "bdev_nvme_attach_controller" 00:15:40.980 } 00:15:40.980 EOF 00:15:40.980 )") 00:15:40.980 02:18:08 -- nvmf/common.sh@542 -- # cat 00:15:40.980 [2024-12-08 02:18:08.530252] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.980 [2024-12-08 02:18:08.530296] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.980 02:18:08 -- nvmf/common.sh@544 -- # jq . 00:15:40.980 02:18:08 -- nvmf/common.sh@545 -- # IFS=, 00:15:40.980 02:18:08 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:40.980 "params": { 00:15:40.980 "name": "Nvme1", 00:15:40.980 "trtype": "tcp", 00:15:40.980 "traddr": "10.0.0.2", 00:15:40.980 "adrfam": "ipv4", 00:15:40.980 "trsvcid": "4420", 00:15:40.980 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:40.980 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:40.980 "hdgst": false, 00:15:40.980 "ddgst": false 00:15:40.980 }, 00:15:40.980 "method": "bdev_nvme_attach_controller" 00:15:40.980 }' 00:15:40.980 [2024-12-08 02:18:08.538213] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.980 [2024-12-08 02:18:08.538235] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.980 [2024-12-08 02:18:08.546232] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.980 [2024-12-08 02:18:08.546253] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.980 [2024-12-08 02:18:08.554253] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.980 [2024-12-08 02:18:08.554272] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.980 [2024-12-08 02:18:08.562274] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.980 [2024-12-08 02:18:08.562294] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.980 [2024-12-08 02:18:08.565391] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:40.980 [2024-12-08 02:18:08.565461] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2106867 ] 00:15:40.980 [2024-12-08 02:18:08.570295] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.980 [2024-12-08 02:18:08.570316] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.980 [2024-12-08 02:18:08.578317] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.980 [2024-12-08 02:18:08.578337] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.980 [2024-12-08 02:18:08.586339] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.980 [2024-12-08 02:18:08.586358] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.980 EAL: No free 2048 kB hugepages reported on node 1 00:15:40.980 [2024-12-08 02:18:08.594362] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.980 [2024-12-08 02:18:08.594382] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.980 [2024-12-08 02:18:08.602386] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.980 [2024-12-08 02:18:08.602407] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.980 [2024-12-08 02:18:08.610408] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.980 [2024-12-08 02:18:08.610428] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.980 [2024-12-08 02:18:08.618442] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.980 [2024-12-08 02:18:08.618464] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.980 [2024-12-08 02:18:08.625980] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:40.980 [2024-12-08 02:18:08.626474] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.980 [2024-12-08 02:18:08.626498] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.980 [2024-12-08 02:18:08.634532] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.980 [2024-12-08 02:18:08.634609] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.980 [2024-12-08 02:18:08.642558] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.980 [2024-12-08 02:18:08.642617] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.980 [2024-12-08 02:18:08.650567] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.980 [2024-12-08 02:18:08.650603] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.980 [2024-12-08 02:18:08.658599] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.980 [2024-12-08 02:18:08.658621] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.980 [2024-12-08 02:18:08.666609] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.980 [2024-12-08 02:18:08.666631] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.980 [2024-12-08 02:18:08.674626] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.980 [2024-12-08 02:18:08.674647] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.980 [2024-12-08 02:18:08.682638] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.980 [2024-12-08 02:18:08.682658] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.980 [2024-12-08 02:18:08.690662] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.980 [2024-12-08 02:18:08.690685] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.980 [2024-12-08 02:18:08.698719] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.980 [2024-12-08 02:18:08.698756] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.980 [2024-12-08 02:18:08.706713] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.980 [2024-12-08 02:18:08.706736] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.980 [2024-12-08 02:18:08.714726] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.980 [2024-12-08 02:18:08.714748] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.980 [2024-12-08 02:18:08.722747] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.980 [2024-12-08 02:18:08.722770] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.980 [2024-12-08 02:18:08.730767] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.980 [2024-12-08 02:18:08.730789] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.980 [2024-12-08 02:18:08.738788] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.980 [2024-12-08 02:18:08.738810] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.980 [2024-12-08 02:18:08.746617] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:40.980 [2024-12-08 02:18:08.746811] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.980 [2024-12-08 02:18:08.746850] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.980 [2024-12-08 02:18:08.754850] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.980 [2024-12-08 02:18:08.754876] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.239 [2024-12-08 02:18:08.762911] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.239 [2024-12-08 02:18:08.762952] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.239 [2024-12-08 02:18:08.770948] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.239 [2024-12-08 02:18:08.770990] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.239 [2024-12-08 02:18:08.778953] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.239 [2024-12-08 02:18:08.778996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.239 [2024-12-08 02:18:08.786974] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.239 [2024-12-08 02:18:08.787018] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.239 [2024-12-08 02:18:08.795015] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.239 [2024-12-08 02:18:08.795060] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.239 [2024-12-08 02:18:08.803023] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.239 [2024-12-08 02:18:08.803069] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.239 [2024-12-08 02:18:08.811049] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.239 [2024-12-08 02:18:08.811087] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.239 [2024-12-08 02:18:08.819031] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.239 [2024-12-08 02:18:08.819057] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.239 [2024-12-08 02:18:08.827077] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.239 [2024-12-08 02:18:08.827116] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.239 [2024-12-08 02:18:08.835100] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.239 [2024-12-08 02:18:08.835142] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.239 [2024-12-08 02:18:08.843101] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.239 [2024-12-08 02:18:08.843128] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.239 [2024-12-08 02:18:08.851121] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.239 [2024-12-08 02:18:08.851145] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.239 [2024-12-08 02:18:08.859165] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.239 [2024-12-08 02:18:08.859194] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.239 [2024-12-08 02:18:08.867175] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.239 [2024-12-08 02:18:08.867203] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.239 [2024-12-08 02:18:08.875198] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.240 [2024-12-08 02:18:08.875225] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.240 [2024-12-08 02:18:08.883225] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.240 [2024-12-08 02:18:08.883252] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.240 [2024-12-08 02:18:08.891244] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.240 [2024-12-08 02:18:08.891270] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.240 [2024-12-08 02:18:08.899267] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.240 [2024-12-08 02:18:08.899292] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.240 [2024-12-08 02:18:08.907290] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.240 [2024-12-08 02:18:08.907315] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.240 [2024-12-08 02:18:08.915313] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.240 [2024-12-08 02:18:08.915338] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.240 [2024-12-08 02:18:08.923340] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.240 [2024-12-08 02:18:08.923365] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.240 [2024-12-08 02:18:08.931374] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.240 [2024-12-08 02:18:08.931400] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.240 [2024-12-08 02:18:08.939388] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.240 [2024-12-08 02:18:08.939416] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.240 [2024-12-08 02:18:08.947406] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.240 [2024-12-08 02:18:08.947434] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.240 [2024-12-08 02:18:08.955427] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.240 [2024-12-08 02:18:08.955453] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.240 [2024-12-08 02:18:08.963454] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.240 [2024-12-08 02:18:08.963483] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.240 Running I/O for 5 seconds... 00:15:41.240 [2024-12-08 02:18:08.971474] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.240 [2024-12-08 02:18:08.971501] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.240 [2024-12-08 02:18:08.985716] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.240 [2024-12-08 02:18:08.985746] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.240 [2024-12-08 02:18:08.996753] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.240 [2024-12-08 02:18:08.996784] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.240 [2024-12-08 02:18:09.007898] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.240 [2024-12-08 02:18:09.007929] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.499 [2024-12-08 02:18:09.019352] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.499 [2024-12-08 02:18:09.019392] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.499 [2024-12-08 02:18:09.031316] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.499 [2024-12-08 02:18:09.031345] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.499 [2024-12-08 02:18:09.042616] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.499 [2024-12-08 02:18:09.042644] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.499 [2024-12-08 02:18:09.054194] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.499 [2024-12-08 02:18:09.054221] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.499 [2024-12-08 02:18:09.065186] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.499 [2024-12-08 02:18:09.065216] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.499 [2024-12-08 02:18:09.076085] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.499 [2024-12-08 02:18:09.076123] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.499 [2024-12-08 02:18:09.086697] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.499 [2024-12-08 02:18:09.086725] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.499 [2024-12-08 02:18:09.097977] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.499 [2024-12-08 02:18:09.098003] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.499 [2024-12-08 02:18:09.111328] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.499 [2024-12-08 02:18:09.111355] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.499 [2024-12-08 02:18:09.121413] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.499 [2024-12-08 02:18:09.121455] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.499 [2024-12-08 02:18:09.132174] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.499 [2024-12-08 02:18:09.132215] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.499 [2024-12-08 02:18:09.144843] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.499 [2024-12-08 02:18:09.144870] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.499 [2024-12-08 02:18:09.154804] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.499 [2024-12-08 02:18:09.154830] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.499 [2024-12-08 02:18:09.165739] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.499 [2024-12-08 02:18:09.165766] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.499 [2024-12-08 02:18:09.176451] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.499 [2024-12-08 02:18:09.176481] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.499 [2024-12-08 02:18:09.187583] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.499 [2024-12-08 02:18:09.187616] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.499 [2024-12-08 02:18:09.200490] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.499 [2024-12-08 02:18:09.200517] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.499 [2024-12-08 02:18:09.210621] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.499 [2024-12-08 02:18:09.210662] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.499 [2024-12-08 02:18:09.221736] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.499 [2024-12-08 02:18:09.221777] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.499 [2024-12-08 02:18:09.234678] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.499 [2024-12-08 02:18:09.234709] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.499 [2024-12-08 02:18:09.244659] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.499 [2024-12-08 02:18:09.244686] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.499 [2024-12-08 02:18:09.255693] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.499 [2024-12-08 02:18:09.255720] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.499 [2024-12-08 02:18:09.266648] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.499 [2024-12-08 02:18:09.266674] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.499 [2024-12-08 02:18:09.277972] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.499 [2024-12-08 02:18:09.278003] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.783 [2024-12-08 02:18:09.289130] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.783 [2024-12-08 02:18:09.289164] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.783 [2024-12-08 02:18:09.301821] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.783 [2024-12-08 02:18:09.301849] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.783 [2024-12-08 02:18:09.312512] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.783 [2024-12-08 02:18:09.312552] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.783 [2024-12-08 02:18:09.323411] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.783 [2024-12-08 02:18:09.323441] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.783 [2024-12-08 02:18:09.335859] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.784 [2024-12-08 02:18:09.335886] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.784 [2024-12-08 02:18:09.346197] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.784 [2024-12-08 02:18:09.346223] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.784 [2024-12-08 02:18:09.357177] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.784 [2024-12-08 02:18:09.357206] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.784 [2024-12-08 02:18:09.367962] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.784 [2024-12-08 02:18:09.367988] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.784 [2024-12-08 02:18:09.378674] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.784 [2024-12-08 02:18:09.378701] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.784 [2024-12-08 02:18:09.391301] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.784 [2024-12-08 02:18:09.391328] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.784 [2024-12-08 02:18:09.401105] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.784 [2024-12-08 02:18:09.401131] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.784 [2024-12-08 02:18:09.412035] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.784 [2024-12-08 02:18:09.412061] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.784 [2024-12-08 02:18:09.424451] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.784 [2024-12-08 02:18:09.424477] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.784 [2024-12-08 02:18:09.434509] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.784 [2024-12-08 02:18:09.434542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.784 [2024-12-08 02:18:09.445755] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.784 [2024-12-08 02:18:09.445781] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.784 [2024-12-08 02:18:09.456704] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.784 [2024-12-08 02:18:09.456730] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.784 [2024-12-08 02:18:09.467186] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.784 [2024-12-08 02:18:09.467216] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.784 [2024-12-08 02:18:09.477664] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.784 [2024-12-08 02:18:09.477691] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.784 [2024-12-08 02:18:09.487949] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.784 [2024-12-08 02:18:09.487975] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.784 [2024-12-08 02:18:09.498099] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.784 [2024-12-08 02:18:09.498133] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.784 [2024-12-08 02:18:09.508790] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.784 [2024-12-08 02:18:09.508839] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.784 [2024-12-08 02:18:09.520968] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.784 [2024-12-08 02:18:09.520994] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.784 [2024-12-08 02:18:09.530584] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.784 [2024-12-08 02:18:09.530610] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.784 [2024-12-08 02:18:09.543646] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.784 [2024-12-08 02:18:09.543673] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.784 [2024-12-08 02:18:09.553726] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.784 [2024-12-08 02:18:09.553753] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.043 [2024-12-08 02:18:09.564348] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.043 [2024-12-08 02:18:09.564375] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.043 [2024-12-08 02:18:09.575733] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.043 [2024-12-08 02:18:09.575761] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.043 [2024-12-08 02:18:09.586276] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.043 [2024-12-08 02:18:09.586304] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.043 [2024-12-08 02:18:09.596877] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.043 [2024-12-08 02:18:09.596905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.043 [2024-12-08 02:18:09.608179] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.043 [2024-12-08 02:18:09.608205] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.043 [2024-12-08 02:18:09.618885] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.043 [2024-12-08 02:18:09.618911] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.043 [2024-12-08 02:18:09.629176] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.043 [2024-12-08 02:18:09.629202] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.043 [2024-12-08 02:18:09.640067] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.043 [2024-12-08 02:18:09.640094] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.043 [2024-12-08 02:18:09.650022] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.043 [2024-12-08 02:18:09.650049] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.043 [2024-12-08 02:18:09.660242] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.043 [2024-12-08 02:18:09.660269] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.043 [2024-12-08 02:18:09.670022] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.043 [2024-12-08 02:18:09.670065] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.043 [2024-12-08 02:18:09.680069] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.043 [2024-12-08 02:18:09.680096] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.043 [2024-12-08 02:18:09.690140] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.043 [2024-12-08 02:18:09.690167] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.043 [2024-12-08 02:18:09.700254] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.043 [2024-12-08 02:18:09.700287] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.043 [2024-12-08 02:18:09.710453] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.043 [2024-12-08 02:18:09.710480] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.043 [2024-12-08 02:18:09.722786] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.043 [2024-12-08 02:18:09.722813] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.043 [2024-12-08 02:18:09.732797] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.043 [2024-12-08 02:18:09.732824] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.043 [2024-12-08 02:18:09.743244] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.043 [2024-12-08 02:18:09.743271] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.043 [2024-12-08 02:18:09.755427] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.043 [2024-12-08 02:18:09.755454] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.043 [2024-12-08 02:18:09.764603] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.043 [2024-12-08 02:18:09.764631] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.043 [2024-12-08 02:18:09.774578] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.043 [2024-12-08 02:18:09.774605] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.043 [2024-12-08 02:18:09.784551] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.043 [2024-12-08 02:18:09.784579] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.043 [2024-12-08 02:18:09.794488] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.043 [2024-12-08 02:18:09.794516] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.043 [2024-12-08 02:18:09.804344] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.043 [2024-12-08 02:18:09.804371] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.043 [2024-12-08 02:18:09.814228] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.043 [2024-12-08 02:18:09.814255] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.302 [2024-12-08 02:18:09.824732] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.302 [2024-12-08 02:18:09.824766] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.302 [2024-12-08 02:18:09.837395] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.302 [2024-12-08 02:18:09.837422] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.302 [2024-12-08 02:18:09.847283] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.302 [2024-12-08 02:18:09.847311] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.302 [2024-12-08 02:18:09.856941] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.302 [2024-12-08 02:18:09.856967] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.302 [2024-12-08 02:18:09.867396] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.302 [2024-12-08 02:18:09.867423] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.302 [2024-12-08 02:18:09.879807] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.302 [2024-12-08 02:18:09.879834] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.302 [2024-12-08 02:18:09.891045] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.302 [2024-12-08 02:18:09.891072] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.302 [2024-12-08 02:18:09.899425] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.302 [2024-12-08 02:18:09.899452] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.302 [2024-12-08 02:18:09.911736] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.302 [2024-12-08 02:18:09.911762] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.302 [2024-12-08 02:18:09.921444] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.302 [2024-12-08 02:18:09.921471] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.302 [2024-12-08 02:18:09.930979] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.302 [2024-12-08 02:18:09.931006] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.302 [2024-12-08 02:18:09.941093] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.302 [2024-12-08 02:18:09.941120] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.302 [2024-12-08 02:18:09.950932] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.302 [2024-12-08 02:18:09.950959] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.302 [2024-12-08 02:18:09.961273] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.302 [2024-12-08 02:18:09.961316] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.302 [2024-12-08 02:18:09.973573] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.302 [2024-12-08 02:18:09.973601] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.302 [2024-12-08 02:18:09.982946] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.302 [2024-12-08 02:18:09.982972] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.302 [2024-12-08 02:18:09.994973] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.302 [2024-12-08 02:18:09.995000] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.302 [2024-12-08 02:18:10.006578] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.302 [2024-12-08 02:18:10.006608] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.302 [2024-12-08 02:18:10.015400] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.302 [2024-12-08 02:18:10.015450] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.302 [2024-12-08 02:18:10.026653] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.302 [2024-12-08 02:18:10.026683] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.302 [2024-12-08 02:18:10.038781] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.302 [2024-12-08 02:18:10.038810] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.302 [2024-12-08 02:18:10.048200] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.302 [2024-12-08 02:18:10.048228] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.302 [2024-12-08 02:18:10.058018] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.302 [2024-12-08 02:18:10.058045] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.302 [2024-12-08 02:18:10.068298] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.302 [2024-12-08 02:18:10.068325] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.302 [2024-12-08 02:18:10.078439] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.302 [2024-12-08 02:18:10.078468] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.560 [2024-12-08 02:18:10.089050] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.560 [2024-12-08 02:18:10.089080] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.560 [2024-12-08 02:18:10.098918] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.560 [2024-12-08 02:18:10.098946] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.560 [2024-12-08 02:18:10.109026] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.560 [2024-12-08 02:18:10.109054] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.560 [2024-12-08 02:18:10.119207] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.560 [2024-12-08 02:18:10.119234] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.560 [2024-12-08 02:18:10.129622] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.560 [2024-12-08 02:18:10.129649] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.560 [2024-12-08 02:18:10.139575] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.560 [2024-12-08 02:18:10.139604] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.560 [2024-12-08 02:18:10.149600] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.560 [2024-12-08 02:18:10.149628] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.560 [2024-12-08 02:18:10.159744] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.560 [2024-12-08 02:18:10.159771] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.560 [2024-12-08 02:18:10.170240] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.560 [2024-12-08 02:18:10.170275] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.560 [2024-12-08 02:18:10.182719] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.560 [2024-12-08 02:18:10.182747] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.560 [2024-12-08 02:18:10.194697] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.560 [2024-12-08 02:18:10.194724] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.560 [2024-12-08 02:18:10.204018] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.560 [2024-12-08 02:18:10.204049] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.560 [2024-12-08 02:18:10.216221] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.560 [2024-12-08 02:18:10.216251] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.560 [2024-12-08 02:18:10.227054] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.560 [2024-12-08 02:18:10.227081] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.560 [2024-12-08 02:18:10.237832] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.560 [2024-12-08 02:18:10.237859] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.560 [2024-12-08 02:18:10.248911] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.560 [2024-12-08 02:18:10.248941] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.560 [2024-12-08 02:18:10.259813] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.560 [2024-12-08 02:18:10.259841] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.560 [2024-12-08 02:18:10.273127] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.560 [2024-12-08 02:18:10.273157] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.560 [2024-12-08 02:18:10.283329] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.560 [2024-12-08 02:18:10.283359] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.560 [2024-12-08 02:18:10.294036] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.560 [2024-12-08 02:18:10.294063] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.560 [2024-12-08 02:18:10.304501] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.560 [2024-12-08 02:18:10.304531] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.560 [2024-12-08 02:18:10.315339] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.560 [2024-12-08 02:18:10.315369] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.560 [2024-12-08 02:18:10.327100] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.560 [2024-12-08 02:18:10.327130] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.560 [2024-12-08 02:18:10.335785] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.561 [2024-12-08 02:18:10.335812] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.818 [2024-12-08 02:18:10.348942] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.818 [2024-12-08 02:18:10.348972] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.818 [2024-12-08 02:18:10.359663] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.818 [2024-12-08 02:18:10.359690] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.818 [2024-12-08 02:18:10.370347] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.818 [2024-12-08 02:18:10.370377] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.818 [2024-12-08 02:18:10.380739] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.818 [2024-12-08 02:18:10.380767] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.818 [2024-12-08 02:18:10.391469] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.818 [2024-12-08 02:18:10.391497] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.818 [2024-12-08 02:18:10.403809] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.818 [2024-12-08 02:18:10.403850] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.818 [2024-12-08 02:18:10.413178] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.818 [2024-12-08 02:18:10.413208] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.818 [2024-12-08 02:18:10.426728] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.818 [2024-12-08 02:18:10.426755] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.818 [2024-12-08 02:18:10.437254] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.818 [2024-12-08 02:18:10.437285] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.818 [2024-12-08 02:18:10.447873] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.818 [2024-12-08 02:18:10.447900] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.818 [2024-12-08 02:18:10.458588] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.818 [2024-12-08 02:18:10.458615] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.818 [2024-12-08 02:18:10.469224] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.818 [2024-12-08 02:18:10.469255] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.818 [2024-12-08 02:18:10.479834] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.818 [2024-12-08 02:18:10.479875] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.818 [2024-12-08 02:18:10.492208] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.818 [2024-12-08 02:18:10.492238] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.818 [2024-12-08 02:18:10.501224] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.818 [2024-12-08 02:18:10.501254] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.818 [2024-12-08 02:18:10.514891] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.818 [2024-12-08 02:18:10.514922] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.818 [2024-12-08 02:18:10.526020] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.818 [2024-12-08 02:18:10.526052] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.818 [2024-12-08 02:18:10.539201] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.818 [2024-12-08 02:18:10.539231] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.818 [2024-12-08 02:18:10.549286] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.818 [2024-12-08 02:18:10.549316] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.818 [2024-12-08 02:18:10.559981] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.818 [2024-12-08 02:18:10.560011] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.818 [2024-12-08 02:18:10.571107] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.818 [2024-12-08 02:18:10.571138] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.818 [2024-12-08 02:18:10.582134] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.818 [2024-12-08 02:18:10.582163] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.818 [2024-12-08 02:18:10.593225] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.819 [2024-12-08 02:18:10.593255] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.076 [2024-12-08 02:18:10.604159] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.076 [2024-12-08 02:18:10.604190] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.076 [2024-12-08 02:18:10.617520] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.076 [2024-12-08 02:18:10.617571] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.076 [2024-12-08 02:18:10.628255] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.076 [2024-12-08 02:18:10.628286] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.076 [2024-12-08 02:18:10.638869] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.076 [2024-12-08 02:18:10.638895] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.076 [2024-12-08 02:18:10.651671] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.076 [2024-12-08 02:18:10.651699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.076 [2024-12-08 02:18:10.661638] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.076 [2024-12-08 02:18:10.661665] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.076 [2024-12-08 02:18:10.673317] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.076 [2024-12-08 02:18:10.673347] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.076 [2024-12-08 02:18:10.683933] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.076 [2024-12-08 02:18:10.683965] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.076 [2024-12-08 02:18:10.694571] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.076 [2024-12-08 02:18:10.694602] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.076 [2024-12-08 02:18:10.705635] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.076 [2024-12-08 02:18:10.705662] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.076 [2024-12-08 02:18:10.716857] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.076 [2024-12-08 02:18:10.716891] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.076 [2024-12-08 02:18:10.727697] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.076 [2024-12-08 02:18:10.727724] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.076 [2024-12-08 02:18:10.740432] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.076 [2024-12-08 02:18:10.740463] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.077 [2024-12-08 02:18:10.749684] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.077 [2024-12-08 02:18:10.749711] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.077 [2024-12-08 02:18:10.760932] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.077 [2024-12-08 02:18:10.760974] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.077 [2024-12-08 02:18:10.771572] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.077 [2024-12-08 02:18:10.771599] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.077 [2024-12-08 02:18:10.782646] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.077 [2024-12-08 02:18:10.782673] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.077 [2024-12-08 02:18:10.795232] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.077 [2024-12-08 02:18:10.795261] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.077 [2024-12-08 02:18:10.804304] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.077 [2024-12-08 02:18:10.804333] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.077 [2024-12-08 02:18:10.817451] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.077 [2024-12-08 02:18:10.817477] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.077 [2024-12-08 02:18:10.827703] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.077 [2024-12-08 02:18:10.827730] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.077 [2024-12-08 02:18:10.838247] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.077 [2024-12-08 02:18:10.838276] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.077 [2024-12-08 02:18:10.851148] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.077 [2024-12-08 02:18:10.851178] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.334 [2024-12-08 02:18:10.861626] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.334 [2024-12-08 02:18:10.861654] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.334 [2024-12-08 02:18:10.872452] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.334 [2024-12-08 02:18:10.872482] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.334 [2024-12-08 02:18:10.885497] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.334 [2024-12-08 02:18:10.885527] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.334 [2024-12-08 02:18:10.895738] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.334 [2024-12-08 02:18:10.895765] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.334 [2024-12-08 02:18:10.906776] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.334 [2024-12-08 02:18:10.906804] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.334 [2024-12-08 02:18:10.918104] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.334 [2024-12-08 02:18:10.918134] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.334 [2024-12-08 02:18:10.928624] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.334 [2024-12-08 02:18:10.928659] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.334 [2024-12-08 02:18:10.940866] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.334 [2024-12-08 02:18:10.940892] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.334 [2024-12-08 02:18:10.950718] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.334 [2024-12-08 02:18:10.950748] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.334 [2024-12-08 02:18:10.961720] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.335 [2024-12-08 02:18:10.961748] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.335 [2024-12-08 02:18:10.972662] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.335 [2024-12-08 02:18:10.972689] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.335 [2024-12-08 02:18:10.984804] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.335 [2024-12-08 02:18:10.984831] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.335 [2024-12-08 02:18:10.994971] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.335 [2024-12-08 02:18:10.995001] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.335 [2024-12-08 02:18:11.005582] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.335 [2024-12-08 02:18:11.005609] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.335 [2024-12-08 02:18:11.016352] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.335 [2024-12-08 02:18:11.016383] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.335 [2024-12-08 02:18:11.027045] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.335 [2024-12-08 02:18:11.027071] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.335 [2024-12-08 02:18:11.039657] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.335 [2024-12-08 02:18:11.039685] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.335 [2024-12-08 02:18:11.049255] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.335 [2024-12-08 02:18:11.049286] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.335 [2024-12-08 02:18:11.060643] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.335 [2024-12-08 02:18:11.060671] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.335 [2024-12-08 02:18:11.071531] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.335 [2024-12-08 02:18:11.071569] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.335 [2024-12-08 02:18:11.082373] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.335 [2024-12-08 02:18:11.082399] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.335 [2024-12-08 02:18:11.095709] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.335 [2024-12-08 02:18:11.095740] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.335 [2024-12-08 02:18:11.106219] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.335 [2024-12-08 02:18:11.106249] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.592 [2024-12-08 02:18:11.117956] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.592 [2024-12-08 02:18:11.117987] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.592 [2024-12-08 02:18:11.129184] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.592 [2024-12-08 02:18:11.129214] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.592 [2024-12-08 02:18:11.140140] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.592 [2024-12-08 02:18:11.140179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.592 [2024-12-08 02:18:11.152907] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.592 [2024-12-08 02:18:11.152950] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.592 [2024-12-08 02:18:11.163063] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.592 [2024-12-08 02:18:11.163094] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.592 [2024-12-08 02:18:11.174009] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.592 [2024-12-08 02:18:11.174035] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.592 [2024-12-08 02:18:11.184391] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.592 [2024-12-08 02:18:11.184423] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.592 [2024-12-08 02:18:11.195087] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.592 [2024-12-08 02:18:11.195118] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.593 [2024-12-08 02:18:11.208108] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.593 [2024-12-08 02:18:11.208149] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.593 [2024-12-08 02:18:11.218435] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.593 [2024-12-08 02:18:11.218465] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.593 [2024-12-08 02:18:11.229367] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.593 [2024-12-08 02:18:11.229398] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.593 [2024-12-08 02:18:11.240387] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.593 [2024-12-08 02:18:11.240418] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.593 [2024-12-08 02:18:11.251379] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.593 [2024-12-08 02:18:11.251409] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.593 [2024-12-08 02:18:11.263953] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.593 [2024-12-08 02:18:11.263983] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.593 [2024-12-08 02:18:11.273747] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.593 [2024-12-08 02:18:11.273775] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.593 [2024-12-08 02:18:11.285244] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.593 [2024-12-08 02:18:11.285275] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.593 [2024-12-08 02:18:11.296123] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.593 [2024-12-08 02:18:11.296154] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.593 [2024-12-08 02:18:11.307315] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.593 [2024-12-08 02:18:11.307347] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.593 [2024-12-08 02:18:11.320136] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.593 [2024-12-08 02:18:11.320166] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.593 [2024-12-08 02:18:11.330361] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.593 [2024-12-08 02:18:11.330392] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.593 [2024-12-08 02:18:11.340974] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.593 [2024-12-08 02:18:11.341001] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.593 [2024-12-08 02:18:11.354266] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.593 [2024-12-08 02:18:11.354305] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.593 [2024-12-08 02:18:11.365052] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.593 [2024-12-08 02:18:11.365082] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.909 [2024-12-08 02:18:11.376158] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.909 [2024-12-08 02:18:11.376188] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.909 [2024-12-08 02:18:11.388665] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.909 [2024-12-08 02:18:11.388692] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.909 [2024-12-08 02:18:11.398109] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.909 [2024-12-08 02:18:11.398140] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.909 [2024-12-08 02:18:11.409844] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.909 [2024-12-08 02:18:11.409874] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.909 [2024-12-08 02:18:11.421162] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.909 [2024-12-08 02:18:11.421193] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.909 [2024-12-08 02:18:11.432461] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.910 [2024-12-08 02:18:11.432487] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.910 [2024-12-08 02:18:11.443855] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.910 [2024-12-08 02:18:11.443886] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.910 [2024-12-08 02:18:11.454805] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.910 [2024-12-08 02:18:11.454832] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.910 [2024-12-08 02:18:11.467403] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.910 [2024-12-08 02:18:11.467433] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.910 [2024-12-08 02:18:11.477585] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.910 [2024-12-08 02:18:11.477613] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.910 [2024-12-08 02:18:11.488399] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.910 [2024-12-08 02:18:11.488430] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.910 [2024-12-08 02:18:11.498757] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.910 [2024-12-08 02:18:11.498784] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.910 [2024-12-08 02:18:11.509439] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.910 [2024-12-08 02:18:11.509469] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.910 [2024-12-08 02:18:11.520123] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.910 [2024-12-08 02:18:11.520151] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.910 [2024-12-08 02:18:11.532794] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.910 [2024-12-08 02:18:11.532825] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.910 [2024-12-08 02:18:11.542825] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.910 [2024-12-08 02:18:11.542862] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.910 [2024-12-08 02:18:11.553981] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.910 [2024-12-08 02:18:11.554008] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.910 [2024-12-08 02:18:11.566920] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.910 [2024-12-08 02:18:11.566950] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.910 [2024-12-08 02:18:11.576279] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.910 [2024-12-08 02:18:11.576305] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.910 [2024-12-08 02:18:11.587623] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.910 [2024-12-08 02:18:11.587651] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.910 [2024-12-08 02:18:11.598647] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.910 [2024-12-08 02:18:11.598675] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.910 [2024-12-08 02:18:11.609442] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.910 [2024-12-08 02:18:11.609472] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.910 [2024-12-08 02:18:11.622214] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.910 [2024-12-08 02:18:11.622240] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.169 [2024-12-08 02:18:11.632687] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.169 [2024-12-08 02:18:11.632715] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.169 [2024-12-08 02:18:11.643663] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.169 [2024-12-08 02:18:11.643690] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.169 [2024-12-08 02:18:11.654409] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.169 [2024-12-08 02:18:11.654440] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.169 [2024-12-08 02:18:11.665882] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.169 [2024-12-08 02:18:11.665912] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.169 [2024-12-08 02:18:11.678822] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.169 [2024-12-08 02:18:11.678864] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.169 [2024-12-08 02:18:11.688649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.169 [2024-12-08 02:18:11.688692] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.170 [2024-12-08 02:18:11.699702] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.170 [2024-12-08 02:18:11.699730] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.170 [2024-12-08 02:18:11.712675] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.170 [2024-12-08 02:18:11.712702] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.170 [2024-12-08 02:18:11.722942] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.170 [2024-12-08 02:18:11.722970] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.170 [2024-12-08 02:18:11.733834] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.170 [2024-12-08 02:18:11.733861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.170 [2024-12-08 02:18:11.746401] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.170 [2024-12-08 02:18:11.746430] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.170 [2024-12-08 02:18:11.756259] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.170 [2024-12-08 02:18:11.756290] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.170 [2024-12-08 02:18:11.767562] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.170 [2024-12-08 02:18:11.767589] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.170 [2024-12-08 02:18:11.778380] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.170 [2024-12-08 02:18:11.778410] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.170 [2024-12-08 02:18:11.789581] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.170 [2024-12-08 02:18:11.789623] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.170 [2024-12-08 02:18:11.802156] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.170 [2024-12-08 02:18:11.802186] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.170 [2024-12-08 02:18:11.812451] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.170 [2024-12-08 02:18:11.812481] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.170 [2024-12-08 02:18:11.823279] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.170 [2024-12-08 02:18:11.823309] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.170 [2024-12-08 02:18:11.836630] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.170 [2024-12-08 02:18:11.836657] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.170 [2024-12-08 02:18:11.846831] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.170 [2024-12-08 02:18:11.846872] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.170 [2024-12-08 02:18:11.858158] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.170 [2024-12-08 02:18:11.858188] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.170 [2024-12-08 02:18:11.870943] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.170 [2024-12-08 02:18:11.870973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.170 [2024-12-08 02:18:11.881205] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.170 [2024-12-08 02:18:11.881236] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.170 [2024-12-08 02:18:11.892559] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.170 [2024-12-08 02:18:11.892586] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.170 [2024-12-08 02:18:11.905411] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.170 [2024-12-08 02:18:11.905441] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.170 [2024-12-08 02:18:11.915998] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.170 [2024-12-08 02:18:11.916028] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.170 [2024-12-08 02:18:11.926719] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.170 [2024-12-08 02:18:11.926746] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.170 [2024-12-08 02:18:11.939379] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.170 [2024-12-08 02:18:11.939405] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.428 [2024-12-08 02:18:11.949699] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.429 [2024-12-08 02:18:11.949727] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.429 [2024-12-08 02:18:11.960676] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.429 [2024-12-08 02:18:11.960705] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.429 [2024-12-08 02:18:11.973084] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.429 [2024-12-08 02:18:11.973110] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.429 [2024-12-08 02:18:11.984935] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.429 [2024-12-08 02:18:11.984965] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.429 [2024-12-08 02:18:11.993781] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.429 [2024-12-08 02:18:11.993808] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.429 [2024-12-08 02:18:12.005305] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.429 [2024-12-08 02:18:12.005331] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.429 [2024-12-08 02:18:12.018269] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.429 [2024-12-08 02:18:12.018300] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.429 [2024-12-08 02:18:12.028732] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.429 [2024-12-08 02:18:12.028759] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.429 [2024-12-08 02:18:12.039203] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.429 [2024-12-08 02:18:12.039229] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.429 [2024-12-08 02:18:12.049895] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.429 [2024-12-08 02:18:12.049921] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.429 [2024-12-08 02:18:12.060758] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.429 [2024-12-08 02:18:12.060785] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.429 [2024-12-08 02:18:12.073925] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.429 [2024-12-08 02:18:12.073952] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.429 [2024-12-08 02:18:12.083600] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.429 [2024-12-08 02:18:12.083627] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.429 [2024-12-08 02:18:12.094548] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.429 [2024-12-08 02:18:12.094575] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.429 [2024-12-08 02:18:12.107191] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.429 [2024-12-08 02:18:12.107221] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.429 [2024-12-08 02:18:12.117374] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.429 [2024-12-08 02:18:12.117404] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.429 [2024-12-08 02:18:12.127955] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.429 [2024-12-08 02:18:12.127981] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.429 [2024-12-08 02:18:12.139081] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.429 [2024-12-08 02:18:12.139122] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.429 [2024-12-08 02:18:12.149859] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.429 [2024-12-08 02:18:12.149885] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.429 [2024-12-08 02:18:12.163071] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.429 [2024-12-08 02:18:12.163101] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.429 [2024-12-08 02:18:12.173651] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.429 [2024-12-08 02:18:12.173678] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.429 [2024-12-08 02:18:12.183964] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.429 [2024-12-08 02:18:12.183990] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.429 [2024-12-08 02:18:12.194728] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.429 [2024-12-08 02:18:12.194754] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.429 [2024-12-08 02:18:12.205631] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.429 [2024-12-08 02:18:12.205659] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.687 [2024-12-08 02:18:12.218574] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.687 [2024-12-08 02:18:12.218602] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.687 [2024-12-08 02:18:12.228107] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.687 [2024-12-08 02:18:12.228134] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.687 [2024-12-08 02:18:12.239157] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.687 [2024-12-08 02:18:12.239184] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.687 [2024-12-08 02:18:12.252306] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.687 [2024-12-08 02:18:12.252336] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.687 [2024-12-08 02:18:12.262814] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.687 [2024-12-08 02:18:12.262844] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.687 [2024-12-08 02:18:12.273306] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.687 [2024-12-08 02:18:12.273336] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.687 [2024-12-08 02:18:12.284052] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.687 [2024-12-08 02:18:12.284079] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.687 [2024-12-08 02:18:12.294744] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.687 [2024-12-08 02:18:12.294771] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.687 [2024-12-08 02:18:12.307897] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.687 [2024-12-08 02:18:12.307927] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.687 [2024-12-08 02:18:12.318110] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.687 [2024-12-08 02:18:12.318140] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.687 [2024-12-08 02:18:12.329060] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.687 [2024-12-08 02:18:12.329090] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.687 [2024-12-08 02:18:12.342210] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.687 [2024-12-08 02:18:12.342240] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.687 [2024-12-08 02:18:12.352896] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.687 [2024-12-08 02:18:12.352922] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.687 [2024-12-08 02:18:12.363779] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.687 [2024-12-08 02:18:12.363806] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.687 [2024-12-08 02:18:12.376738] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.687 [2024-12-08 02:18:12.376767] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.687 [2024-12-08 02:18:12.387192] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.687 [2024-12-08 02:18:12.387223] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.687 [2024-12-08 02:18:12.398061] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.687 [2024-12-08 02:18:12.398091] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.688 [2024-12-08 02:18:12.411420] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.688 [2024-12-08 02:18:12.411458] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.688 [2024-12-08 02:18:12.422060] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.688 [2024-12-08 02:18:12.422090] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.688 [2024-12-08 02:18:12.432432] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.688 [2024-12-08 02:18:12.432458] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.688 [2024-12-08 02:18:12.443546] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.688 [2024-12-08 02:18:12.443588] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.688 [2024-12-08 02:18:12.454244] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.688 [2024-12-08 02:18:12.454274] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.688 [2024-12-08 02:18:12.465549] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.688 [2024-12-08 02:18:12.465587] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.946 [2024-12-08 02:18:12.476741] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.946 [2024-12-08 02:18:12.476772] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.946 [2024-12-08 02:18:12.487829] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.946 [2024-12-08 02:18:12.487871] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.946 [2024-12-08 02:18:12.498785] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.946 [2024-12-08 02:18:12.498813] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.946 [2024-12-08 02:18:12.509802] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.946 [2024-12-08 02:18:12.509844] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.946 [2024-12-08 02:18:12.522463] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.946 [2024-12-08 02:18:12.522493] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.946 [2024-12-08 02:18:12.531646] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.946 [2024-12-08 02:18:12.531674] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.946 [2024-12-08 02:18:12.543992] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.946 [2024-12-08 02:18:12.544022] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.946 [2024-12-08 02:18:12.555019] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.946 [2024-12-08 02:18:12.555049] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.946 [2024-12-08 02:18:12.565565] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.946 [2024-12-08 02:18:12.565592] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.946 [2024-12-08 02:18:12.576325] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.946 [2024-12-08 02:18:12.576355] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.946 [2024-12-08 02:18:12.586958] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.946 [2024-12-08 02:18:12.587002] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.946 [2024-12-08 02:18:12.597392] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.946 [2024-12-08 02:18:12.597422] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.946 [2024-12-08 02:18:12.608586] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.946 [2024-12-08 02:18:12.608613] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.946 [2024-12-08 02:18:12.621563] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.946 [2024-12-08 02:18:12.621598] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.946 [2024-12-08 02:18:12.631942] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.946 [2024-12-08 02:18:12.631968] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.946 [2024-12-08 02:18:12.642786] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.946 [2024-12-08 02:18:12.642813] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.946 [2024-12-08 02:18:12.655914] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.946 [2024-12-08 02:18:12.655942] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.946 [2024-12-08 02:18:12.666826] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.946 [2024-12-08 02:18:12.666854] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.946 [2024-12-08 02:18:12.677657] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.946 [2024-12-08 02:18:12.677684] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.946 [2024-12-08 02:18:12.690460] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.946 [2024-12-08 02:18:12.690490] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.946 [2024-12-08 02:18:12.700649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.946 [2024-12-08 02:18:12.700691] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.946 [2024-12-08 02:18:12.711566] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.946 [2024-12-08 02:18:12.711593] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.946 [2024-12-08 02:18:12.724570] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.946 [2024-12-08 02:18:12.724598] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.258 [2024-12-08 02:18:12.735184] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.258 [2024-12-08 02:18:12.735216] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.258 [2024-12-08 02:18:12.746254] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.258 [2024-12-08 02:18:12.746284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.258 [2024-12-08 02:18:12.759435] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.258 [2024-12-08 02:18:12.759476] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.258 [2024-12-08 02:18:12.769667] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.258 [2024-12-08 02:18:12.769695] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.258 [2024-12-08 02:18:12.779995] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.258 [2024-12-08 02:18:12.780026] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.258 [2024-12-08 02:18:12.791126] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.258 [2024-12-08 02:18:12.791168] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.258 [2024-12-08 02:18:12.801657] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.258 [2024-12-08 02:18:12.801685] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.258 [2024-12-08 02:18:12.812113] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.258 [2024-12-08 02:18:12.812143] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.258 [2024-12-08 02:18:12.823144] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.258 [2024-12-08 02:18:12.823174] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.258 [2024-12-08 02:18:12.834415] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.258 [2024-12-08 02:18:12.834454] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.258 [2024-12-08 02:18:12.845113] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.258 [2024-12-08 02:18:12.845143] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.258 [2024-12-08 02:18:12.856018] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.258 [2024-12-08 02:18:12.856049] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.258 [2024-12-08 02:18:12.867005] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.258 [2024-12-08 02:18:12.867036] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.258 [2024-12-08 02:18:12.878299] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.258 [2024-12-08 02:18:12.878329] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.258 [2024-12-08 02:18:12.891020] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.258 [2024-12-08 02:18:12.891051] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.258 [2024-12-08 02:18:12.901487] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.258 [2024-12-08 02:18:12.901517] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.258 [2024-12-08 02:18:12.912205] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.258 [2024-12-08 02:18:12.912235] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.258 [2024-12-08 02:18:12.925219] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.258 [2024-12-08 02:18:12.925250] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.258 [2024-12-08 02:18:12.935438] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.258 [2024-12-08 02:18:12.935467] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.258 [2024-12-08 02:18:12.945978] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.258 [2024-12-08 02:18:12.946009] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.258 [2024-12-08 02:18:12.956678] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.258 [2024-12-08 02:18:12.956719] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.258 [2024-12-08 02:18:12.967418] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.258 [2024-12-08 02:18:12.967447] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.258 [2024-12-08 02:18:12.978117] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.258 [2024-12-08 02:18:12.978148] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.258 [2024-12-08 02:18:12.990620] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.258 [2024-12-08 02:18:12.990647] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.258 [2024-12-08 02:18:13.000820] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.258 [2024-12-08 02:18:13.000862] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.258 [2024-12-08 02:18:13.011531] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.258 [2024-12-08 02:18:13.011565] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.595 [2024-12-08 02:18:13.022463] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.595 [2024-12-08 02:18:13.022491] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.595 [2024-12-08 02:18:13.033031] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.595 [2024-12-08 02:18:13.033061] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.595 [2024-12-08 02:18:13.044091] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.595 [2024-12-08 02:18:13.044126] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.595 [2024-12-08 02:18:13.055185] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.595 [2024-12-08 02:18:13.055212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.595 [2024-12-08 02:18:13.068681] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.595 [2024-12-08 02:18:13.068708] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.595 [2024-12-08 02:18:13.078942] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.595 [2024-12-08 02:18:13.078968] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.595 [2024-12-08 02:18:13.089267] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.595 [2024-12-08 02:18:13.089297] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.595 [2024-12-08 02:18:13.099922] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.595 [2024-12-08 02:18:13.099952] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.595 [2024-12-08 02:18:13.110599] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.595 [2024-12-08 02:18:13.110626] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.595 [2024-12-08 02:18:13.121410] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.595 [2024-12-08 02:18:13.121436] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.595 [2024-12-08 02:18:13.134032] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.595 [2024-12-08 02:18:13.134058] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.595 [2024-12-08 02:18:13.144491] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.595 [2024-12-08 02:18:13.144521] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.595 [2024-12-08 02:18:13.155289] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.595 [2024-12-08 02:18:13.155315] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.595 [2024-12-08 02:18:13.166065] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.595 [2024-12-08 02:18:13.166095] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.595 [2024-12-08 02:18:13.176623] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.595 [2024-12-08 02:18:13.176651] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.595 [2024-12-08 02:18:13.187662] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.595 [2024-12-08 02:18:13.187689] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.595 [2024-12-08 02:18:13.198557] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.595 [2024-12-08 02:18:13.198584] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.595 [2024-12-08 02:18:13.211811] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.595 [2024-12-08 02:18:13.211852] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.595 [2024-12-08 02:18:13.222137] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.595 [2024-12-08 02:18:13.222167] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.595 [2024-12-08 02:18:13.232983] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.595 [2024-12-08 02:18:13.233009] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.595 [2024-12-08 02:18:13.243719] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.595 [2024-12-08 02:18:13.243747] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.595 [2024-12-08 02:18:13.254436] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.595 [2024-12-08 02:18:13.254466] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.595 [2024-12-08 02:18:13.265466] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.595 [2024-12-08 02:18:13.265492] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.595 [2024-12-08 02:18:13.276703] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.595 [2024-12-08 02:18:13.276745] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.595 [2024-12-08 02:18:13.289392] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.595 [2024-12-08 02:18:13.289422] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.595 [2024-12-08 02:18:13.299229] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.595 [2024-12-08 02:18:13.299258] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.595 [2024-12-08 02:18:13.310260] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.595 [2024-12-08 02:18:13.310290] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.595 [2024-12-08 02:18:13.322798] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.595 [2024-12-08 02:18:13.322825] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.595 [2024-12-08 02:18:13.332091] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.595 [2024-12-08 02:18:13.332121] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.595 [2024-12-08 02:18:13.343576] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.595 [2024-12-08 02:18:13.343602] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.856 [2024-12-08 02:18:13.356275] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.856 [2024-12-08 02:18:13.356306] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.856 [2024-12-08 02:18:13.366889] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.856 [2024-12-08 02:18:13.366932] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.856 [2024-12-08 02:18:13.377775] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.856 [2024-12-08 02:18:13.377802] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.856 [2024-12-08 02:18:13.390291] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.856 [2024-12-08 02:18:13.390321] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.856 [2024-12-08 02:18:13.399722] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.856 [2024-12-08 02:18:13.399749] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.856 [2024-12-08 02:18:13.411242] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.856 [2024-12-08 02:18:13.411271] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.856 [2024-12-08 02:18:13.424038] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.856 [2024-12-08 02:18:13.424068] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.856 [2024-12-08 02:18:13.433824] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.856 [2024-12-08 02:18:13.433866] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.856 [2024-12-08 02:18:13.444999] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.856 [2024-12-08 02:18:13.445029] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.856 [2024-12-08 02:18:13.457641] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.856 [2024-12-08 02:18:13.457669] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.856 [2024-12-08 02:18:13.467942] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.856 [2024-12-08 02:18:13.467973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.856 [2024-12-08 02:18:13.478675] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.856 [2024-12-08 02:18:13.478702] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.856 [2024-12-08 02:18:13.491912] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.856 [2024-12-08 02:18:13.491939] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.856 [2024-12-08 02:18:13.502291] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.856 [2024-12-08 02:18:13.502323] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.856 [2024-12-08 02:18:13.512910] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.856 [2024-12-08 02:18:13.512940] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.856 [2024-12-08 02:18:13.524112] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.856 [2024-12-08 02:18:13.524142] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.856 [2024-12-08 02:18:13.534778] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.856 [2024-12-08 02:18:13.534805] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.856 [2024-12-08 02:18:13.547731] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.856 [2024-12-08 02:18:13.547759] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.856 [2024-12-08 02:18:13.557484] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.856 [2024-12-08 02:18:13.557511] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.856 [2024-12-08 02:18:13.568909] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.856 [2024-12-08 02:18:13.568939] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.856 [2024-12-08 02:18:13.581760] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.856 [2024-12-08 02:18:13.581803] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.856 [2024-12-08 02:18:13.591731] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.856 [2024-12-08 02:18:13.591758] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.856 [2024-12-08 02:18:13.602578] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.856 [2024-12-08 02:18:13.602606] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.856 [2024-12-08 02:18:13.613751] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.857 [2024-12-08 02:18:13.613778] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.857 [2024-12-08 02:18:13.624963] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.857 [2024-12-08 02:18:13.624994] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:45.857 [2024-12-08 02:18:13.636026] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:45.857 [2024-12-08 02:18:13.636068] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.115 [2024-12-08 02:18:13.647112] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.115 [2024-12-08 02:18:13.647143] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.115 [2024-12-08 02:18:13.659979] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.115 [2024-12-08 02:18:13.660005] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.115 [2024-12-08 02:18:13.670433] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.115 [2024-12-08 02:18:13.670463] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.115 [2024-12-08 02:18:13.681703] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.115 [2024-12-08 02:18:13.681730] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.115 [2024-12-08 02:18:13.694310] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.115 [2024-12-08 02:18:13.694340] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.115 [2024-12-08 02:18:13.703865] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.115 [2024-12-08 02:18:13.703892] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.115 [2024-12-08 02:18:13.714642] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.115 [2024-12-08 02:18:13.714670] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.115 [2024-12-08 02:18:13.725852] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.115 [2024-12-08 02:18:13.725884] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.115 [2024-12-08 02:18:13.738531] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.115 [2024-12-08 02:18:13.738573] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.115 [2024-12-08 02:18:13.748341] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.115 [2024-12-08 02:18:13.748371] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.115 [2024-12-08 02:18:13.759020] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.115 [2024-12-08 02:18:13.759050] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.116 [2024-12-08 02:18:13.772351] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.116 [2024-12-08 02:18:13.772381] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.116 [2024-12-08 02:18:13.782469] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.116 [2024-12-08 02:18:13.782499] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.116 [2024-12-08 02:18:13.793196] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.116 [2024-12-08 02:18:13.793226] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.116 [2024-12-08 02:18:13.803963] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.116 [2024-12-08 02:18:13.803994] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.116 [2024-12-08 02:18:13.815131] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.116 [2024-12-08 02:18:13.815161] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.116 [2024-12-08 02:18:13.825327] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.116 [2024-12-08 02:18:13.825357] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.116 [2024-12-08 02:18:13.835895] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.116 [2024-12-08 02:18:13.835937] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.116 [2024-12-08 02:18:13.846486] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.116 [2024-12-08 02:18:13.846516] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.116 [2024-12-08 02:18:13.857364] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.116 [2024-12-08 02:18:13.857393] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.116 [2024-12-08 02:18:13.870118] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.116 [2024-12-08 02:18:13.870148] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.116 [2024-12-08 02:18:13.880435] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.116 [2024-12-08 02:18:13.880464] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.116 [2024-12-08 02:18:13.895048] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.116 [2024-12-08 02:18:13.895090] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.375 [2024-12-08 02:18:13.905980] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.375 [2024-12-08 02:18:13.906011] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.375 [2024-12-08 02:18:13.916684] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.375 [2024-12-08 02:18:13.916712] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.375 [2024-12-08 02:18:13.927644] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.375 [2024-12-08 02:18:13.927671] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.375 [2024-12-08 02:18:13.938247] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.375 [2024-12-08 02:18:13.938278] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.375 [2024-12-08 02:18:13.949286] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.375 [2024-12-08 02:18:13.949316] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.375 [2024-12-08 02:18:13.962002] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.375 [2024-12-08 02:18:13.962044] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.375 [2024-12-08 02:18:13.972363] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.375 [2024-12-08 02:18:13.972394] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.375 [2024-12-08 02:18:13.983446] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.375 [2024-12-08 02:18:13.983476] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.375 [2024-12-08 02:18:13.991675] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.375 [2024-12-08 02:18:13.991702] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.375 00:15:46.375 Latency(us) 00:15:46.375 [2024-12-08T01:18:14.156Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:46.375 [2024-12-08T01:18:14.156Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:15:46.375 Nvme1n1 : 5.01 11795.33 92.15 0.00 0.00 10837.53 4538.97 23301.69 00:15:46.375 [2024-12-08T01:18:14.156Z] =================================================================================================================== 00:15:46.375 [2024-12-08T01:18:14.156Z] Total : 11795.33 92.15 0.00 0.00 10837.53 4538.97 23301.69 00:15:46.375 [2024-12-08 02:18:13.999560] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.375 [2024-12-08 02:18:13.999600] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.375 [2024-12-08 02:18:14.007578] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.375 [2024-12-08 02:18:14.007619] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.375 [2024-12-08 02:18:14.015604] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.375 [2024-12-08 02:18:14.015631] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.375 [2024-12-08 02:18:14.023676] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.375 [2024-12-08 02:18:14.023733] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.375 [2024-12-08 02:18:14.031692] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.375 [2024-12-08 02:18:14.031747] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.375 [2024-12-08 02:18:14.039721] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.375 [2024-12-08 02:18:14.039792] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.375 [2024-12-08 02:18:14.047745] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.375 [2024-12-08 02:18:14.047798] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.375 [2024-12-08 02:18:14.055770] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.375 [2024-12-08 02:18:14.055825] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.375 [2024-12-08 02:18:14.063802] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.375 [2024-12-08 02:18:14.063859] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.375 [2024-12-08 02:18:14.071805] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.375 [2024-12-08 02:18:14.071856] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.375 [2024-12-08 02:18:14.079836] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.375 [2024-12-08 02:18:14.079890] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.375 [2024-12-08 02:18:14.087855] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.375 [2024-12-08 02:18:14.087907] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.375 [2024-12-08 02:18:14.095875] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.375 [2024-12-08 02:18:14.095927] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.375 [2024-12-08 02:18:14.103916] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.375 [2024-12-08 02:18:14.103972] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.375 [2024-12-08 02:18:14.111924] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.375 [2024-12-08 02:18:14.111976] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.375 [2024-12-08 02:18:14.119946] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.375 [2024-12-08 02:18:14.119998] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.375 [2024-12-08 02:18:14.127962] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.375 [2024-12-08 02:18:14.128012] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.375 [2024-12-08 02:18:14.135990] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.375 [2024-12-08 02:18:14.136044] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.375 [2024-12-08 02:18:14.143972] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.375 [2024-12-08 02:18:14.143999] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.375 [2024-12-08 02:18:14.152001] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.375 [2024-12-08 02:18:14.152032] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.634 [2024-12-08 02:18:14.160020] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.634 [2024-12-08 02:18:14.160051] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.634 [2024-12-08 02:18:14.168034] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.634 [2024-12-08 02:18:14.168060] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.634 [2024-12-08 02:18:14.176048] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.634 [2024-12-08 02:18:14.176071] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.634 [2024-12-08 02:18:14.184146] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.634 [2024-12-08 02:18:14.184199] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.634 [2024-12-08 02:18:14.192171] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.634 [2024-12-08 02:18:14.192234] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.634 [2024-12-08 02:18:14.200123] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.634 [2024-12-08 02:18:14.200149] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.634 [2024-12-08 02:18:14.208144] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.634 [2024-12-08 02:18:14.208169] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.634 [2024-12-08 02:18:14.216165] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.634 [2024-12-08 02:18:14.216189] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.634 [2024-12-08 02:18:14.224189] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.634 [2024-12-08 02:18:14.224213] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.634 [2024-12-08 02:18:14.232217] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.634 [2024-12-08 02:18:14.232244] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.634 [2024-12-08 02:18:14.240292] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.634 [2024-12-08 02:18:14.240345] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.634 [2024-12-08 02:18:14.248320] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.634 [2024-12-08 02:18:14.248370] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.634 [2024-12-08 02:18:14.256279] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.634 [2024-12-08 02:18:14.256304] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.634 [2024-12-08 02:18:14.264301] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.634 [2024-12-08 02:18:14.264325] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.634 [2024-12-08 02:18:14.272326] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:46.634 [2024-12-08 02:18:14.272351] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:46.634 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (2106867) - No such process 00:15:46.635 02:18:14 -- target/zcopy.sh@49 -- # wait 2106867 00:15:46.635 02:18:14 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:46.635 02:18:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:46.635 02:18:14 -- common/autotest_common.sh@10 -- # set +x 00:15:46.635 02:18:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:46.635 02:18:14 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:15:46.635 02:18:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:46.635 02:18:14 -- common/autotest_common.sh@10 -- # set +x 00:15:46.635 delay0 00:15:46.635 02:18:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:46.635 02:18:14 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:15:46.635 02:18:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:46.635 02:18:14 -- common/autotest_common.sh@10 -- # set +x 00:15:46.635 02:18:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:46.635 02:18:14 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:15:46.635 EAL: No free 2048 kB hugepages reported on node 1 00:15:46.635 [2024-12-08 02:18:14.349365] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:15:54.759 Initializing NVMe Controllers 00:15:54.759 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:54.759 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:15:54.759 Initialization complete. Launching workers. 00:15:54.759 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 228, failed: 22332 00:15:54.759 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 22441, failed to submit 119 00:15:54.759 success 22380, unsuccess 61, failed 0 00:15:54.759 02:18:21 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:15:54.759 02:18:21 -- target/zcopy.sh@60 -- # nvmftestfini 00:15:54.759 02:18:21 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:54.759 02:18:21 -- nvmf/common.sh@116 -- # sync 00:15:54.759 02:18:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:54.759 02:18:21 -- nvmf/common.sh@119 -- # set +e 00:15:54.759 02:18:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:54.759 02:18:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:54.759 rmmod nvme_tcp 00:15:54.759 rmmod nvme_fabrics 00:15:54.759 rmmod nvme_keyring 00:15:54.759 02:18:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:54.759 02:18:21 -- nvmf/common.sh@123 -- # set -e 00:15:54.759 02:18:21 -- nvmf/common.sh@124 -- # return 0 00:15:54.759 02:18:21 -- nvmf/common.sh@477 -- # '[' -n 2105002 ']' 00:15:54.759 02:18:21 -- nvmf/common.sh@478 -- # killprocess 2105002 00:15:54.759 02:18:21 -- common/autotest_common.sh@936 -- # '[' -z 2105002 ']' 00:15:54.759 02:18:21 -- common/autotest_common.sh@940 -- # kill -0 2105002 00:15:54.759 02:18:21 -- common/autotest_common.sh@941 -- # uname 00:15:54.759 02:18:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:54.759 02:18:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2105002 00:15:54.759 02:18:21 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:54.759 02:18:21 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:54.759 02:18:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2105002' 00:15:54.759 killing process with pid 2105002 00:15:54.759 02:18:21 -- common/autotest_common.sh@955 -- # kill 2105002 00:15:54.759 02:18:21 -- common/autotest_common.sh@960 -- # wait 2105002 00:15:54.759 02:18:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:54.759 02:18:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:54.759 02:18:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:54.759 02:18:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:54.759 02:18:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:54.759 02:18:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:54.759 02:18:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:54.759 02:18:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:56.665 02:18:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:56.665 00:15:56.665 real 0m29.719s 00:15:56.665 user 0m43.180s 00:15:56.665 sys 0m9.274s 00:15:56.665 02:18:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:56.665 02:18:23 -- common/autotest_common.sh@10 -- # set +x 00:15:56.665 ************************************ 00:15:56.665 END TEST nvmf_zcopy 00:15:56.665 ************************************ 00:15:56.665 02:18:23 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:15:56.665 02:18:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:56.665 02:18:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:56.665 02:18:23 -- common/autotest_common.sh@10 -- # set +x 00:15:56.665 ************************************ 00:15:56.665 START TEST nvmf_nmic 00:15:56.665 ************************************ 00:15:56.665 02:18:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:15:56.665 * Looking for test storage... 00:15:56.665 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:56.665 02:18:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:56.665 02:18:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:56.665 02:18:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:56.665 02:18:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:56.665 02:18:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:56.665 02:18:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:56.665 02:18:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:56.665 02:18:24 -- scripts/common.sh@335 -- # IFS=.-: 00:15:56.665 02:18:24 -- scripts/common.sh@335 -- # read -ra ver1 00:15:56.665 02:18:24 -- scripts/common.sh@336 -- # IFS=.-: 00:15:56.665 02:18:24 -- scripts/common.sh@336 -- # read -ra ver2 00:15:56.665 02:18:24 -- scripts/common.sh@337 -- # local 'op=<' 00:15:56.665 02:18:24 -- scripts/common.sh@339 -- # ver1_l=2 00:15:56.665 02:18:24 -- scripts/common.sh@340 -- # ver2_l=1 00:15:56.665 02:18:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:56.665 02:18:24 -- scripts/common.sh@343 -- # case "$op" in 00:15:56.665 02:18:24 -- scripts/common.sh@344 -- # : 1 00:15:56.665 02:18:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:56.665 02:18:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:56.665 02:18:24 -- scripts/common.sh@364 -- # decimal 1 00:15:56.665 02:18:24 -- scripts/common.sh@352 -- # local d=1 00:15:56.665 02:18:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:56.665 02:18:24 -- scripts/common.sh@354 -- # echo 1 00:15:56.665 02:18:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:56.665 02:18:24 -- scripts/common.sh@365 -- # decimal 2 00:15:56.665 02:18:24 -- scripts/common.sh@352 -- # local d=2 00:15:56.665 02:18:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:56.665 02:18:24 -- scripts/common.sh@354 -- # echo 2 00:15:56.665 02:18:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:56.665 02:18:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:56.665 02:18:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:56.665 02:18:24 -- scripts/common.sh@367 -- # return 0 00:15:56.665 02:18:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:56.665 02:18:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:56.665 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:56.665 --rc genhtml_branch_coverage=1 00:15:56.665 --rc genhtml_function_coverage=1 00:15:56.665 --rc genhtml_legend=1 00:15:56.665 --rc geninfo_all_blocks=1 00:15:56.665 --rc geninfo_unexecuted_blocks=1 00:15:56.665 00:15:56.665 ' 00:15:56.665 02:18:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:56.665 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:56.665 --rc genhtml_branch_coverage=1 00:15:56.665 --rc genhtml_function_coverage=1 00:15:56.665 --rc genhtml_legend=1 00:15:56.665 --rc geninfo_all_blocks=1 00:15:56.665 --rc geninfo_unexecuted_blocks=1 00:15:56.665 00:15:56.665 ' 00:15:56.665 02:18:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:56.665 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:56.665 --rc genhtml_branch_coverage=1 00:15:56.665 --rc genhtml_function_coverage=1 00:15:56.665 --rc genhtml_legend=1 00:15:56.665 --rc geninfo_all_blocks=1 00:15:56.665 --rc geninfo_unexecuted_blocks=1 00:15:56.665 00:15:56.665 ' 00:15:56.665 02:18:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:56.665 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:56.665 --rc genhtml_branch_coverage=1 00:15:56.665 --rc genhtml_function_coverage=1 00:15:56.665 --rc genhtml_legend=1 00:15:56.665 --rc geninfo_all_blocks=1 00:15:56.665 --rc geninfo_unexecuted_blocks=1 00:15:56.665 00:15:56.665 ' 00:15:56.665 02:18:24 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:56.665 02:18:24 -- nvmf/common.sh@7 -- # uname -s 00:15:56.665 02:18:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:56.665 02:18:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:56.665 02:18:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:56.665 02:18:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:56.665 02:18:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:56.665 02:18:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:56.665 02:18:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:56.665 02:18:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:56.665 02:18:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:56.665 02:18:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:56.665 02:18:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:56.665 02:18:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:56.665 02:18:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:56.665 02:18:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:56.665 02:18:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:56.665 02:18:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:56.665 02:18:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:56.665 02:18:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:56.665 02:18:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:56.665 02:18:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:56.665 02:18:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:56.665 02:18:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:56.665 02:18:24 -- paths/export.sh@5 -- # export PATH 00:15:56.666 02:18:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:56.666 02:18:24 -- nvmf/common.sh@46 -- # : 0 00:15:56.666 02:18:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:56.666 02:18:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:56.666 02:18:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:56.666 02:18:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:56.666 02:18:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:56.666 02:18:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:56.666 02:18:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:56.666 02:18:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:56.666 02:18:24 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:56.666 02:18:24 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:56.666 02:18:24 -- target/nmic.sh@14 -- # nvmftestinit 00:15:56.666 02:18:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:56.666 02:18:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:56.666 02:18:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:56.666 02:18:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:56.666 02:18:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:56.666 02:18:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:56.666 02:18:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:56.666 02:18:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:56.666 02:18:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:56.666 02:18:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:56.666 02:18:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:56.666 02:18:24 -- common/autotest_common.sh@10 -- # set +x 00:15:58.565 02:18:26 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:58.565 02:18:26 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:58.565 02:18:26 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:58.565 02:18:26 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:58.565 02:18:26 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:58.565 02:18:26 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:58.565 02:18:26 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:58.565 02:18:26 -- nvmf/common.sh@294 -- # net_devs=() 00:15:58.565 02:18:26 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:58.565 02:18:26 -- nvmf/common.sh@295 -- # e810=() 00:15:58.565 02:18:26 -- nvmf/common.sh@295 -- # local -ga e810 00:15:58.565 02:18:26 -- nvmf/common.sh@296 -- # x722=() 00:15:58.565 02:18:26 -- nvmf/common.sh@296 -- # local -ga x722 00:15:58.565 02:18:26 -- nvmf/common.sh@297 -- # mlx=() 00:15:58.565 02:18:26 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:58.565 02:18:26 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:58.565 02:18:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:58.565 02:18:26 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:58.565 02:18:26 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:58.565 02:18:26 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:58.565 02:18:26 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:58.565 02:18:26 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:58.565 02:18:26 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:58.565 02:18:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:58.565 02:18:26 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:58.565 02:18:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:58.565 02:18:26 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:58.565 02:18:26 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:58.565 02:18:26 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:58.565 02:18:26 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:58.565 02:18:26 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:58.565 02:18:26 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:58.565 02:18:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:58.565 02:18:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:58.565 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:58.565 02:18:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:58.565 02:18:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:58.565 02:18:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:58.565 02:18:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:58.565 02:18:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:58.565 02:18:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:58.565 02:18:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:58.565 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:58.565 02:18:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:58.565 02:18:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:58.565 02:18:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:58.565 02:18:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:58.565 02:18:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:58.565 02:18:26 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:58.565 02:18:26 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:58.565 02:18:26 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:58.565 02:18:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:58.565 02:18:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:58.565 02:18:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:58.565 02:18:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:58.565 02:18:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:58.565 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:58.565 02:18:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:58.565 02:18:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:58.565 02:18:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:58.565 02:18:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:58.565 02:18:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:58.565 02:18:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:58.565 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:58.565 02:18:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:58.565 02:18:26 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:58.565 02:18:26 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:58.565 02:18:26 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:58.565 02:18:26 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:58.565 02:18:26 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:58.565 02:18:26 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:58.565 02:18:26 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:58.565 02:18:26 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:58.565 02:18:26 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:58.565 02:18:26 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:58.565 02:18:26 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:58.565 02:18:26 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:58.565 02:18:26 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:58.565 02:18:26 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:58.565 02:18:26 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:58.565 02:18:26 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:58.565 02:18:26 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:58.565 02:18:26 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:58.565 02:18:26 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:58.565 02:18:26 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:58.565 02:18:26 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:58.565 02:18:26 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:58.823 02:18:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:58.823 02:18:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:58.823 02:18:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:58.823 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:58.823 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.261 ms 00:15:58.823 00:15:58.823 --- 10.0.0.2 ping statistics --- 00:15:58.823 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:58.823 rtt min/avg/max/mdev = 0.261/0.261/0.261/0.000 ms 00:15:58.823 02:18:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:58.823 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:58.823 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.134 ms 00:15:58.823 00:15:58.823 --- 10.0.0.1 ping statistics --- 00:15:58.823 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:58.823 rtt min/avg/max/mdev = 0.134/0.134/0.134/0.000 ms 00:15:58.823 02:18:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:58.823 02:18:26 -- nvmf/common.sh@410 -- # return 0 00:15:58.823 02:18:26 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:58.823 02:18:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:58.823 02:18:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:58.823 02:18:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:58.823 02:18:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:58.823 02:18:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:58.823 02:18:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:58.823 02:18:26 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:15:58.823 02:18:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:58.823 02:18:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:58.823 02:18:26 -- common/autotest_common.sh@10 -- # set +x 00:15:58.823 02:18:26 -- nvmf/common.sh@469 -- # nvmfpid=2110593 00:15:58.823 02:18:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:15:58.823 02:18:26 -- nvmf/common.sh@470 -- # waitforlisten 2110593 00:15:58.823 02:18:26 -- common/autotest_common.sh@829 -- # '[' -z 2110593 ']' 00:15:58.823 02:18:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:58.823 02:18:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:58.823 02:18:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:58.823 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:58.823 02:18:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:58.823 02:18:26 -- common/autotest_common.sh@10 -- # set +x 00:15:58.823 [2024-12-08 02:18:26.447108] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:58.823 [2024-12-08 02:18:26.447176] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:58.823 EAL: No free 2048 kB hugepages reported on node 1 00:15:58.823 [2024-12-08 02:18:26.520831] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:59.081 [2024-12-08 02:18:26.646450] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:59.081 [2024-12-08 02:18:26.646633] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:59.081 [2024-12-08 02:18:26.646654] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:59.081 [2024-12-08 02:18:26.646668] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:59.081 [2024-12-08 02:18:26.646748] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:59.081 [2024-12-08 02:18:26.646769] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:59.081 [2024-12-08 02:18:26.646820] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:59.081 [2024-12-08 02:18:26.646824] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:00.014 02:18:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:00.014 02:18:27 -- common/autotest_common.sh@862 -- # return 0 00:16:00.014 02:18:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:00.014 02:18:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:00.014 02:18:27 -- common/autotest_common.sh@10 -- # set +x 00:16:00.014 02:18:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:00.014 02:18:27 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:00.014 02:18:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:00.014 02:18:27 -- common/autotest_common.sh@10 -- # set +x 00:16:00.014 [2024-12-08 02:18:27.545426] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:00.014 02:18:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:00.014 02:18:27 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:00.014 02:18:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:00.014 02:18:27 -- common/autotest_common.sh@10 -- # set +x 00:16:00.014 Malloc0 00:16:00.014 02:18:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:00.014 02:18:27 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:00.014 02:18:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:00.014 02:18:27 -- common/autotest_common.sh@10 -- # set +x 00:16:00.014 02:18:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:00.014 02:18:27 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:00.014 02:18:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:00.014 02:18:27 -- common/autotest_common.sh@10 -- # set +x 00:16:00.014 02:18:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:00.014 02:18:27 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:00.014 02:18:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:00.014 02:18:27 -- common/autotest_common.sh@10 -- # set +x 00:16:00.014 [2024-12-08 02:18:27.597550] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:00.014 02:18:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:00.014 02:18:27 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:16:00.014 test case1: single bdev can't be used in multiple subsystems 00:16:00.014 02:18:27 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:16:00.014 02:18:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:00.014 02:18:27 -- common/autotest_common.sh@10 -- # set +x 00:16:00.014 02:18:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:00.014 02:18:27 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:16:00.014 02:18:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:00.014 02:18:27 -- common/autotest_common.sh@10 -- # set +x 00:16:00.014 02:18:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:00.014 02:18:27 -- target/nmic.sh@28 -- # nmic_status=0 00:16:00.014 02:18:27 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:16:00.014 02:18:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:00.014 02:18:27 -- common/autotest_common.sh@10 -- # set +x 00:16:00.014 [2024-12-08 02:18:27.621399] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:16:00.014 [2024-12-08 02:18:27.621428] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:16:00.014 [2024-12-08 02:18:27.621458] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.014 request: 00:16:00.014 { 00:16:00.014 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:16:00.014 "namespace": { 00:16:00.014 "bdev_name": "Malloc0" 00:16:00.014 }, 00:16:00.014 "method": "nvmf_subsystem_add_ns", 00:16:00.014 "req_id": 1 00:16:00.014 } 00:16:00.014 Got JSON-RPC error response 00:16:00.014 response: 00:16:00.014 { 00:16:00.014 "code": -32602, 00:16:00.014 "message": "Invalid parameters" 00:16:00.014 } 00:16:00.014 02:18:27 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:16:00.014 02:18:27 -- target/nmic.sh@29 -- # nmic_status=1 00:16:00.014 02:18:27 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:16:00.014 02:18:27 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:16:00.014 Adding namespace failed - expected result. 00:16:00.014 02:18:27 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:16:00.014 test case2: host connect to nvmf target in multiple paths 00:16:00.014 02:18:27 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:16:00.014 02:18:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:00.014 02:18:27 -- common/autotest_common.sh@10 -- # set +x 00:16:00.014 [2024-12-08 02:18:27.629528] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:16:00.014 02:18:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:00.014 02:18:27 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:00.579 02:18:28 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:16:01.514 02:18:29 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:16:01.514 02:18:29 -- common/autotest_common.sh@1187 -- # local i=0 00:16:01.514 02:18:29 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:16:01.514 02:18:29 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:16:01.514 02:18:29 -- common/autotest_common.sh@1194 -- # sleep 2 00:16:03.415 02:18:31 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:16:03.415 02:18:31 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:16:03.415 02:18:31 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:16:03.415 02:18:31 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:16:03.415 02:18:31 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:16:03.415 02:18:31 -- common/autotest_common.sh@1197 -- # return 0 00:16:03.415 02:18:31 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:03.415 [global] 00:16:03.415 thread=1 00:16:03.415 invalidate=1 00:16:03.415 rw=write 00:16:03.415 time_based=1 00:16:03.415 runtime=1 00:16:03.415 ioengine=libaio 00:16:03.415 direct=1 00:16:03.415 bs=4096 00:16:03.415 iodepth=1 00:16:03.415 norandommap=0 00:16:03.415 numjobs=1 00:16:03.415 00:16:03.415 verify_dump=1 00:16:03.415 verify_backlog=512 00:16:03.415 verify_state_save=0 00:16:03.415 do_verify=1 00:16:03.415 verify=crc32c-intel 00:16:03.415 [job0] 00:16:03.415 filename=/dev/nvme0n1 00:16:03.415 Could not set queue depth (nvme0n1) 00:16:03.672 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:03.673 fio-3.35 00:16:03.673 Starting 1 thread 00:16:04.605 00:16:04.605 job0: (groupid=0, jobs=1): err= 0: pid=2111260: Sun Dec 8 02:18:32 2024 00:16:04.605 read: IOPS=455, BW=1822KiB/s (1866kB/s)(1824KiB/1001msec) 00:16:04.605 slat (nsec): min=4282, max=45789, avg=6102.01, stdev=5141.20 00:16:04.605 clat (usec): min=183, max=42020, avg=1926.50, stdev=8242.14 00:16:04.605 lat (usec): min=188, max=42038, avg=1932.60, stdev=8246.47 00:16:04.605 clat percentiles (usec): 00:16:04.605 | 1.00th=[ 188], 5.00th=[ 194], 10.00th=[ 198], 20.00th=[ 200], 00:16:04.605 | 30.00th=[ 204], 40.00th=[ 208], 50.00th=[ 210], 60.00th=[ 215], 00:16:04.605 | 70.00th=[ 217], 80.00th=[ 221], 90.00th=[ 227], 95.00th=[ 239], 00:16:04.605 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:04.605 | 99.99th=[42206] 00:16:04.605 write: IOPS=511, BW=2046KiB/s (2095kB/s)(2048KiB/1001msec); 0 zone resets 00:16:04.605 slat (usec): min=6, max=27827, avg=69.81, stdev=1229.13 00:16:04.605 clat (usec): min=122, max=390, avg=157.20, stdev=27.00 00:16:04.605 lat (usec): min=129, max=28009, avg=227.01, stdev=1230.54 00:16:04.605 clat percentiles (usec): 00:16:04.605 | 1.00th=[ 131], 5.00th=[ 135], 10.00th=[ 139], 20.00th=[ 143], 00:16:04.605 | 30.00th=[ 147], 40.00th=[ 149], 50.00th=[ 153], 60.00th=[ 157], 00:16:04.605 | 70.00th=[ 159], 80.00th=[ 161], 90.00th=[ 167], 95.00th=[ 225], 00:16:04.605 | 99.00th=[ 260], 99.50th=[ 322], 99.90th=[ 392], 99.95th=[ 392], 00:16:04.605 | 99.99th=[ 392] 00:16:04.605 bw ( KiB/s): min= 4096, max= 4096, per=100.00%, avg=4096.00, stdev= 0.00, samples=1 00:16:04.605 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:04.605 lat (usec) : 250=96.59%, 500=1.45% 00:16:04.605 lat (msec) : 50=1.96% 00:16:04.605 cpu : usr=0.50%, sys=1.00%, ctx=971, majf=0, minf=1 00:16:04.605 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:04.605 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:04.605 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:04.605 issued rwts: total=456,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:04.605 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:04.605 00:16:04.605 Run status group 0 (all jobs): 00:16:04.605 READ: bw=1822KiB/s (1866kB/s), 1822KiB/s-1822KiB/s (1866kB/s-1866kB/s), io=1824KiB (1868kB), run=1001-1001msec 00:16:04.605 WRITE: bw=2046KiB/s (2095kB/s), 2046KiB/s-2046KiB/s (2095kB/s-2095kB/s), io=2048KiB (2097kB), run=1001-1001msec 00:16:04.605 00:16:04.605 Disk stats (read/write): 00:16:04.605 nvme0n1: ios=44/512, merge=0/0, ticks=1736/84, in_queue=1820, util=98.60% 00:16:04.605 02:18:32 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:04.865 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:16:04.865 02:18:32 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:04.865 02:18:32 -- common/autotest_common.sh@1208 -- # local i=0 00:16:04.865 02:18:32 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:16:04.865 02:18:32 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:04.865 02:18:32 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:16:04.865 02:18:32 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:04.865 02:18:32 -- common/autotest_common.sh@1220 -- # return 0 00:16:04.865 02:18:32 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:16:04.865 02:18:32 -- target/nmic.sh@53 -- # nvmftestfini 00:16:04.865 02:18:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:04.865 02:18:32 -- nvmf/common.sh@116 -- # sync 00:16:04.865 02:18:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:04.865 02:18:32 -- nvmf/common.sh@119 -- # set +e 00:16:04.865 02:18:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:04.865 02:18:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:04.865 rmmod nvme_tcp 00:16:04.865 rmmod nvme_fabrics 00:16:04.865 rmmod nvme_keyring 00:16:04.865 02:18:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:04.865 02:18:32 -- nvmf/common.sh@123 -- # set -e 00:16:04.865 02:18:32 -- nvmf/common.sh@124 -- # return 0 00:16:04.865 02:18:32 -- nvmf/common.sh@477 -- # '[' -n 2110593 ']' 00:16:04.865 02:18:32 -- nvmf/common.sh@478 -- # killprocess 2110593 00:16:04.865 02:18:32 -- common/autotest_common.sh@936 -- # '[' -z 2110593 ']' 00:16:04.865 02:18:32 -- common/autotest_common.sh@940 -- # kill -0 2110593 00:16:04.865 02:18:32 -- common/autotest_common.sh@941 -- # uname 00:16:04.865 02:18:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:04.865 02:18:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2110593 00:16:04.865 02:18:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:04.865 02:18:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:04.865 02:18:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2110593' 00:16:04.865 killing process with pid 2110593 00:16:04.865 02:18:32 -- common/autotest_common.sh@955 -- # kill 2110593 00:16:04.865 02:18:32 -- common/autotest_common.sh@960 -- # wait 2110593 00:16:05.124 02:18:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:05.124 02:18:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:05.124 02:18:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:05.124 02:18:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:05.124 02:18:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:05.383 02:18:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:05.383 02:18:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:05.383 02:18:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:07.286 02:18:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:07.286 00:16:07.286 real 0m10.967s 00:16:07.286 user 0m26.192s 00:16:07.286 sys 0m2.393s 00:16:07.286 02:18:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:07.286 02:18:34 -- common/autotest_common.sh@10 -- # set +x 00:16:07.286 ************************************ 00:16:07.286 END TEST nvmf_nmic 00:16:07.286 ************************************ 00:16:07.286 02:18:34 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:07.286 02:18:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:07.286 02:18:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:07.286 02:18:34 -- common/autotest_common.sh@10 -- # set +x 00:16:07.286 ************************************ 00:16:07.286 START TEST nvmf_fio_target 00:16:07.286 ************************************ 00:16:07.286 02:18:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:07.286 * Looking for test storage... 00:16:07.286 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:07.286 02:18:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:07.286 02:18:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:07.286 02:18:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:07.543 02:18:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:07.543 02:18:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:07.543 02:18:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:07.543 02:18:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:07.543 02:18:35 -- scripts/common.sh@335 -- # IFS=.-: 00:16:07.543 02:18:35 -- scripts/common.sh@335 -- # read -ra ver1 00:16:07.543 02:18:35 -- scripts/common.sh@336 -- # IFS=.-: 00:16:07.543 02:18:35 -- scripts/common.sh@336 -- # read -ra ver2 00:16:07.543 02:18:35 -- scripts/common.sh@337 -- # local 'op=<' 00:16:07.543 02:18:35 -- scripts/common.sh@339 -- # ver1_l=2 00:16:07.543 02:18:35 -- scripts/common.sh@340 -- # ver2_l=1 00:16:07.543 02:18:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:07.543 02:18:35 -- scripts/common.sh@343 -- # case "$op" in 00:16:07.543 02:18:35 -- scripts/common.sh@344 -- # : 1 00:16:07.543 02:18:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:07.543 02:18:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:07.543 02:18:35 -- scripts/common.sh@364 -- # decimal 1 00:16:07.543 02:18:35 -- scripts/common.sh@352 -- # local d=1 00:16:07.543 02:18:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:07.543 02:18:35 -- scripts/common.sh@354 -- # echo 1 00:16:07.543 02:18:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:07.543 02:18:35 -- scripts/common.sh@365 -- # decimal 2 00:16:07.543 02:18:35 -- scripts/common.sh@352 -- # local d=2 00:16:07.543 02:18:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:07.543 02:18:35 -- scripts/common.sh@354 -- # echo 2 00:16:07.543 02:18:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:07.543 02:18:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:07.543 02:18:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:07.543 02:18:35 -- scripts/common.sh@367 -- # return 0 00:16:07.543 02:18:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:07.543 02:18:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:07.543 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:07.543 --rc genhtml_branch_coverage=1 00:16:07.543 --rc genhtml_function_coverage=1 00:16:07.543 --rc genhtml_legend=1 00:16:07.543 --rc geninfo_all_blocks=1 00:16:07.543 --rc geninfo_unexecuted_blocks=1 00:16:07.543 00:16:07.543 ' 00:16:07.543 02:18:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:07.543 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:07.543 --rc genhtml_branch_coverage=1 00:16:07.543 --rc genhtml_function_coverage=1 00:16:07.543 --rc genhtml_legend=1 00:16:07.543 --rc geninfo_all_blocks=1 00:16:07.543 --rc geninfo_unexecuted_blocks=1 00:16:07.543 00:16:07.543 ' 00:16:07.543 02:18:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:07.543 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:07.543 --rc genhtml_branch_coverage=1 00:16:07.543 --rc genhtml_function_coverage=1 00:16:07.543 --rc genhtml_legend=1 00:16:07.543 --rc geninfo_all_blocks=1 00:16:07.543 --rc geninfo_unexecuted_blocks=1 00:16:07.543 00:16:07.543 ' 00:16:07.543 02:18:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:07.543 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:07.543 --rc genhtml_branch_coverage=1 00:16:07.543 --rc genhtml_function_coverage=1 00:16:07.543 --rc genhtml_legend=1 00:16:07.543 --rc geninfo_all_blocks=1 00:16:07.543 --rc geninfo_unexecuted_blocks=1 00:16:07.543 00:16:07.543 ' 00:16:07.543 02:18:35 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:07.543 02:18:35 -- nvmf/common.sh@7 -- # uname -s 00:16:07.543 02:18:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:07.543 02:18:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:07.543 02:18:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:07.543 02:18:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:07.543 02:18:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:07.543 02:18:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:07.543 02:18:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:07.543 02:18:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:07.543 02:18:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:07.543 02:18:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:07.543 02:18:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:07.543 02:18:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:07.543 02:18:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:07.543 02:18:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:07.543 02:18:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:07.543 02:18:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:07.543 02:18:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:07.543 02:18:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:07.543 02:18:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:07.543 02:18:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:07.543 02:18:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:07.543 02:18:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:07.544 02:18:35 -- paths/export.sh@5 -- # export PATH 00:16:07.544 02:18:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:07.544 02:18:35 -- nvmf/common.sh@46 -- # : 0 00:16:07.544 02:18:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:07.544 02:18:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:07.544 02:18:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:07.544 02:18:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:07.544 02:18:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:07.544 02:18:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:07.544 02:18:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:07.544 02:18:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:07.544 02:18:35 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:07.544 02:18:35 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:07.544 02:18:35 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:07.544 02:18:35 -- target/fio.sh@16 -- # nvmftestinit 00:16:07.544 02:18:35 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:07.544 02:18:35 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:07.544 02:18:35 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:07.544 02:18:35 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:07.544 02:18:35 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:07.544 02:18:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:07.544 02:18:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:07.544 02:18:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:07.544 02:18:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:07.544 02:18:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:07.544 02:18:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:07.544 02:18:35 -- common/autotest_common.sh@10 -- # set +x 00:16:09.443 02:18:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:09.443 02:18:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:09.443 02:18:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:09.443 02:18:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:09.443 02:18:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:09.443 02:18:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:09.443 02:18:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:09.443 02:18:37 -- nvmf/common.sh@294 -- # net_devs=() 00:16:09.443 02:18:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:09.443 02:18:37 -- nvmf/common.sh@295 -- # e810=() 00:16:09.443 02:18:37 -- nvmf/common.sh@295 -- # local -ga e810 00:16:09.443 02:18:37 -- nvmf/common.sh@296 -- # x722=() 00:16:09.443 02:18:37 -- nvmf/common.sh@296 -- # local -ga x722 00:16:09.443 02:18:37 -- nvmf/common.sh@297 -- # mlx=() 00:16:09.443 02:18:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:09.443 02:18:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:09.443 02:18:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:09.443 02:18:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:09.443 02:18:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:09.443 02:18:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:09.443 02:18:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:09.443 02:18:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:09.443 02:18:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:09.443 02:18:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:09.443 02:18:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:09.443 02:18:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:09.443 02:18:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:09.443 02:18:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:09.443 02:18:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:09.443 02:18:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:09.443 02:18:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:09.443 02:18:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:09.443 02:18:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:09.443 02:18:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:09.443 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:09.443 02:18:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:09.443 02:18:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:09.443 02:18:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:09.443 02:18:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:09.443 02:18:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:09.443 02:18:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:09.443 02:18:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:09.443 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:09.443 02:18:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:09.443 02:18:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:09.443 02:18:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:09.443 02:18:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:09.443 02:18:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:09.443 02:18:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:09.443 02:18:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:09.443 02:18:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:09.443 02:18:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:09.443 02:18:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:09.443 02:18:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:09.443 02:18:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:09.443 02:18:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:09.443 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:09.443 02:18:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:09.443 02:18:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:09.443 02:18:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:09.443 02:18:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:09.443 02:18:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:09.443 02:18:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:09.443 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:09.443 02:18:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:09.443 02:18:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:09.443 02:18:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:09.443 02:18:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:09.443 02:18:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:09.443 02:18:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:09.443 02:18:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:09.443 02:18:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:09.443 02:18:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:09.443 02:18:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:09.443 02:18:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:09.443 02:18:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:09.443 02:18:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:09.443 02:18:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:09.443 02:18:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:09.443 02:18:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:09.443 02:18:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:09.443 02:18:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:09.443 02:18:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:09.702 02:18:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:09.702 02:18:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:09.702 02:18:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:09.702 02:18:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:09.702 02:18:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:09.702 02:18:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:09.702 02:18:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:09.702 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:09.702 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.292 ms 00:16:09.702 00:16:09.702 --- 10.0.0.2 ping statistics --- 00:16:09.702 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:09.702 rtt min/avg/max/mdev = 0.292/0.292/0.292/0.000 ms 00:16:09.702 02:18:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:09.702 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:09.702 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.076 ms 00:16:09.702 00:16:09.702 --- 10.0.0.1 ping statistics --- 00:16:09.702 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:09.702 rtt min/avg/max/mdev = 0.076/0.076/0.076/0.000 ms 00:16:09.702 02:18:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:09.702 02:18:37 -- nvmf/common.sh@410 -- # return 0 00:16:09.702 02:18:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:09.702 02:18:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:09.702 02:18:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:09.702 02:18:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:09.702 02:18:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:09.702 02:18:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:09.702 02:18:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:09.702 02:18:37 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:16:09.702 02:18:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:09.702 02:18:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:09.702 02:18:37 -- common/autotest_common.sh@10 -- # set +x 00:16:09.702 02:18:37 -- nvmf/common.sh@469 -- # nvmfpid=2113357 00:16:09.702 02:18:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:09.702 02:18:37 -- nvmf/common.sh@470 -- # waitforlisten 2113357 00:16:09.702 02:18:37 -- common/autotest_common.sh@829 -- # '[' -z 2113357 ']' 00:16:09.702 02:18:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:09.702 02:18:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:09.702 02:18:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:09.702 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:09.702 02:18:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:09.702 02:18:37 -- common/autotest_common.sh@10 -- # set +x 00:16:09.702 [2024-12-08 02:18:37.457343] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:09.702 [2024-12-08 02:18:37.457412] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:09.962 EAL: No free 2048 kB hugepages reported on node 1 00:16:09.962 [2024-12-08 02:18:37.523123] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:09.962 [2024-12-08 02:18:37.642417] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:09.962 [2024-12-08 02:18:37.642586] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:09.962 [2024-12-08 02:18:37.642608] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:09.962 [2024-12-08 02:18:37.642623] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:09.962 [2024-12-08 02:18:37.642683] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:09.962 [2024-12-08 02:18:37.642751] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:09.962 [2024-12-08 02:18:37.642801] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:09.962 [2024-12-08 02:18:37.642804] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:10.896 02:18:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:10.896 02:18:38 -- common/autotest_common.sh@862 -- # return 0 00:16:10.896 02:18:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:10.896 02:18:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:10.896 02:18:38 -- common/autotest_common.sh@10 -- # set +x 00:16:10.896 02:18:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:10.896 02:18:38 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:16:11.154 [2024-12-08 02:18:38.700945] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:11.154 02:18:38 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:11.412 02:18:38 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:16:11.412 02:18:38 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:11.671 02:18:39 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:16:11.671 02:18:39 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:11.929 02:18:39 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:16:11.929 02:18:39 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:12.188 02:18:39 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:16:12.188 02:18:39 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:16:12.447 02:18:40 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:12.705 02:18:40 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:16:12.705 02:18:40 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:12.964 02:18:40 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:16:12.964 02:18:40 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:13.223 02:18:40 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:16:13.223 02:18:40 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:16:13.485 02:18:41 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:13.744 02:18:41 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:13.744 02:18:41 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:14.001 02:18:41 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:14.001 02:18:41 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:16:14.258 02:18:41 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:14.515 [2024-12-08 02:18:42.158461] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:14.515 02:18:42 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:16:14.772 02:18:42 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:16:15.028 02:18:42 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:15.593 02:18:43 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:16:15.593 02:18:43 -- common/autotest_common.sh@1187 -- # local i=0 00:16:15.593 02:18:43 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:16:15.593 02:18:43 -- common/autotest_common.sh@1189 -- # [[ -n 4 ]] 00:16:15.593 02:18:43 -- common/autotest_common.sh@1190 -- # nvme_device_counter=4 00:16:15.593 02:18:43 -- common/autotest_common.sh@1194 -- # sleep 2 00:16:17.549 02:18:45 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:16:17.549 02:18:45 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:16:17.549 02:18:45 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:16:17.549 02:18:45 -- common/autotest_common.sh@1196 -- # nvme_devices=4 00:16:17.549 02:18:45 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:16:17.549 02:18:45 -- common/autotest_common.sh@1197 -- # return 0 00:16:17.549 02:18:45 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:17.549 [global] 00:16:17.549 thread=1 00:16:17.549 invalidate=1 00:16:17.549 rw=write 00:16:17.549 time_based=1 00:16:17.549 runtime=1 00:16:17.549 ioengine=libaio 00:16:17.549 direct=1 00:16:17.549 bs=4096 00:16:17.549 iodepth=1 00:16:17.549 norandommap=0 00:16:17.549 numjobs=1 00:16:17.549 00:16:17.549 verify_dump=1 00:16:17.549 verify_backlog=512 00:16:17.549 verify_state_save=0 00:16:17.549 do_verify=1 00:16:17.549 verify=crc32c-intel 00:16:17.549 [job0] 00:16:17.549 filename=/dev/nvme0n1 00:16:17.549 [job1] 00:16:17.549 filename=/dev/nvme0n2 00:16:17.549 [job2] 00:16:17.549 filename=/dev/nvme0n3 00:16:17.549 [job3] 00:16:17.549 filename=/dev/nvme0n4 00:16:17.805 Could not set queue depth (nvme0n1) 00:16:17.805 Could not set queue depth (nvme0n2) 00:16:17.805 Could not set queue depth (nvme0n3) 00:16:17.805 Could not set queue depth (nvme0n4) 00:16:17.805 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:17.805 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:17.805 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:17.805 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:17.805 fio-3.35 00:16:17.805 Starting 4 threads 00:16:19.177 00:16:19.177 job0: (groupid=0, jobs=1): err= 0: pid=2114585: Sun Dec 8 02:18:46 2024 00:16:19.177 read: IOPS=2058, BW=8236KiB/s (8433kB/s)(8244KiB/1001msec) 00:16:19.177 slat (nsec): min=5419, max=34334, avg=9882.48, stdev=4559.91 00:16:19.177 clat (usec): min=178, max=598, avg=234.17, stdev=39.34 00:16:19.177 lat (usec): min=184, max=610, avg=244.05, stdev=41.30 00:16:19.177 clat percentiles (usec): 00:16:19.177 | 1.00th=[ 192], 5.00th=[ 198], 10.00th=[ 202], 20.00th=[ 208], 00:16:19.177 | 30.00th=[ 212], 40.00th=[ 219], 50.00th=[ 225], 60.00th=[ 233], 00:16:19.177 | 70.00th=[ 241], 80.00th=[ 251], 90.00th=[ 277], 95.00th=[ 310], 00:16:19.177 | 99.00th=[ 392], 99.50th=[ 437], 99.90th=[ 570], 99.95th=[ 578], 00:16:19.177 | 99.99th=[ 603] 00:16:19.177 write: IOPS=2557, BW=9.99MiB/s (10.5MB/s)(10.0MiB/1001msec); 0 zone resets 00:16:19.177 slat (nsec): min=6855, max=53260, avg=13857.73, stdev=6123.23 00:16:19.177 clat (usec): min=134, max=621, avg=174.30, stdev=22.46 00:16:19.177 lat (usec): min=141, max=632, avg=188.16, stdev=26.32 00:16:19.177 clat percentiles (usec): 00:16:19.177 | 1.00th=[ 139], 5.00th=[ 147], 10.00th=[ 151], 20.00th=[ 157], 00:16:19.177 | 30.00th=[ 161], 40.00th=[ 167], 50.00th=[ 172], 60.00th=[ 178], 00:16:19.177 | 70.00th=[ 184], 80.00th=[ 192], 90.00th=[ 202], 95.00th=[ 210], 00:16:19.177 | 99.00th=[ 227], 99.50th=[ 233], 99.90th=[ 281], 99.95th=[ 461], 00:16:19.177 | 99.99th=[ 619] 00:16:19.177 bw ( KiB/s): min=11904, max=11904, per=41.69%, avg=11904.00, stdev= 0.00, samples=1 00:16:19.177 iops : min= 2976, max= 2976, avg=2976.00, stdev= 0.00, samples=1 00:16:19.177 lat (usec) : 250=90.98%, 500=8.85%, 750=0.17% 00:16:19.177 cpu : usr=4.90%, sys=6.80%, ctx=4621, majf=0, minf=1 00:16:19.177 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:19.177 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:19.177 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:19.177 issued rwts: total=2061,2560,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:19.177 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:19.177 job1: (groupid=0, jobs=1): err= 0: pid=2114586: Sun Dec 8 02:18:46 2024 00:16:19.177 read: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec) 00:16:19.177 slat (nsec): min=4151, max=58008, avg=12401.29, stdev=8454.58 00:16:19.177 clat (usec): min=163, max=543, avg=259.08, stdev=73.41 00:16:19.177 lat (usec): min=172, max=557, avg=271.48, stdev=76.87 00:16:19.177 clat percentiles (usec): 00:16:19.177 | 1.00th=[ 176], 5.00th=[ 186], 10.00th=[ 194], 20.00th=[ 204], 00:16:19.177 | 30.00th=[ 212], 40.00th=[ 223], 50.00th=[ 237], 60.00th=[ 251], 00:16:19.177 | 70.00th=[ 273], 80.00th=[ 310], 90.00th=[ 371], 95.00th=[ 416], 00:16:19.177 | 99.00th=[ 502], 99.50th=[ 510], 99.90th=[ 537], 99.95th=[ 537], 00:16:19.177 | 99.99th=[ 545] 00:16:19.177 write: IOPS=2243, BW=8975KiB/s (9190kB/s)(8984KiB/1001msec); 0 zone resets 00:16:19.177 slat (nsec): min=5394, max=44195, avg=10839.03, stdev=4369.87 00:16:19.177 clat (usec): min=125, max=929, avg=180.18, stdev=47.63 00:16:19.177 lat (usec): min=134, max=937, avg=191.02, stdev=48.55 00:16:19.177 clat percentiles (usec): 00:16:19.177 | 1.00th=[ 135], 5.00th=[ 141], 10.00th=[ 143], 20.00th=[ 149], 00:16:19.177 | 30.00th=[ 153], 40.00th=[ 159], 50.00th=[ 165], 60.00th=[ 174], 00:16:19.177 | 70.00th=[ 190], 80.00th=[ 202], 90.00th=[ 235], 95.00th=[ 277], 00:16:19.177 | 99.00th=[ 359], 99.50th=[ 383], 99.90th=[ 437], 99.95th=[ 445], 00:16:19.177 | 99.99th=[ 930] 00:16:19.177 bw ( KiB/s): min= 8864, max= 8864, per=31.05%, avg=8864.00, stdev= 0.00, samples=1 00:16:19.177 iops : min= 2216, max= 2216, avg=2216.00, stdev= 0.00, samples=1 00:16:19.178 lat (usec) : 250=76.50%, 500=22.92%, 750=0.56%, 1000=0.02% 00:16:19.178 cpu : usr=2.90%, sys=5.10%, ctx=4294, majf=0, minf=1 00:16:19.178 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:19.178 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:19.178 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:19.178 issued rwts: total=2048,2246,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:19.178 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:19.178 job2: (groupid=0, jobs=1): err= 0: pid=2114587: Sun Dec 8 02:18:46 2024 00:16:19.178 read: IOPS=1566, BW=6266KiB/s (6416kB/s)(6272KiB/1001msec) 00:16:19.178 slat (nsec): min=5991, max=49798, avg=11905.41, stdev=5127.55 00:16:19.178 clat (usec): min=194, max=41836, avg=350.31, stdev=1470.98 00:16:19.178 lat (usec): min=200, max=41853, avg=362.22, stdev=1471.03 00:16:19.178 clat percentiles (usec): 00:16:19.178 | 1.00th=[ 204], 5.00th=[ 212], 10.00th=[ 217], 20.00th=[ 227], 00:16:19.178 | 30.00th=[ 243], 40.00th=[ 265], 50.00th=[ 285], 60.00th=[ 302], 00:16:19.178 | 70.00th=[ 318], 80.00th=[ 351], 90.00th=[ 424], 95.00th=[ 457], 00:16:19.178 | 99.00th=[ 562], 99.50th=[ 603], 99.90th=[41157], 99.95th=[41681], 00:16:19.178 | 99.99th=[41681] 00:16:19.178 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:16:19.178 slat (nsec): min=7481, max=60114, avg=14237.37, stdev=6350.36 00:16:19.178 clat (usec): min=142, max=466, avg=190.38, stdev=29.74 00:16:19.178 lat (usec): min=150, max=475, avg=204.61, stdev=31.80 00:16:19.178 clat percentiles (usec): 00:16:19.178 | 1.00th=[ 149], 5.00th=[ 155], 10.00th=[ 159], 20.00th=[ 165], 00:16:19.178 | 30.00th=[ 174], 40.00th=[ 182], 50.00th=[ 188], 60.00th=[ 196], 00:16:19.178 | 70.00th=[ 202], 80.00th=[ 208], 90.00th=[ 221], 95.00th=[ 237], 00:16:19.178 | 99.00th=[ 289], 99.50th=[ 302], 99.90th=[ 396], 99.95th=[ 400], 00:16:19.178 | 99.99th=[ 465] 00:16:19.178 bw ( KiB/s): min= 8192, max= 8192, per=28.69%, avg=8192.00, stdev= 0.00, samples=1 00:16:19.178 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:19.178 lat (usec) : 250=69.66%, 500=28.98%, 750=1.30% 00:16:19.178 lat (msec) : 50=0.06% 00:16:19.178 cpu : usr=4.00%, sys=5.90%, ctx=3616, majf=0, minf=1 00:16:19.178 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:19.178 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:19.178 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:19.178 issued rwts: total=1568,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:19.178 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:19.178 job3: (groupid=0, jobs=1): err= 0: pid=2114589: Sun Dec 8 02:18:46 2024 00:16:19.178 read: IOPS=21, BW=85.3KiB/s (87.3kB/s)(88.0KiB/1032msec) 00:16:19.178 slat (nsec): min=7346, max=36259, avg=21857.36, stdev=9123.86 00:16:19.178 clat (usec): min=40889, max=41975, avg=41034.20, stdev=234.96 00:16:19.178 lat (usec): min=40906, max=42012, avg=41056.06, stdev=236.20 00:16:19.178 clat percentiles (usec): 00:16:19.178 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:16:19.178 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:19.178 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:16:19.178 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:19.178 | 99.99th=[42206] 00:16:19.178 write: IOPS=496, BW=1984KiB/s (2032kB/s)(2048KiB/1032msec); 0 zone resets 00:16:19.178 slat (nsec): min=7406, max=33542, avg=12818.97, stdev=4737.12 00:16:19.178 clat (usec): min=135, max=389, avg=234.54, stdev=47.91 00:16:19.178 lat (usec): min=143, max=409, avg=247.36, stdev=48.31 00:16:19.178 clat percentiles (usec): 00:16:19.178 | 1.00th=[ 145], 5.00th=[ 155], 10.00th=[ 176], 20.00th=[ 198], 00:16:19.178 | 30.00th=[ 208], 40.00th=[ 223], 50.00th=[ 233], 60.00th=[ 241], 00:16:19.178 | 70.00th=[ 247], 80.00th=[ 277], 90.00th=[ 285], 95.00th=[ 343], 00:16:19.178 | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 392], 99.95th=[ 392], 00:16:19.178 | 99.99th=[ 392] 00:16:19.178 bw ( KiB/s): min= 4096, max= 4096, per=14.35%, avg=4096.00, stdev= 0.00, samples=1 00:16:19.178 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:19.178 lat (usec) : 250=68.54%, 500=27.34% 00:16:19.178 lat (msec) : 50=4.12% 00:16:19.178 cpu : usr=0.39%, sys=0.58%, ctx=537, majf=0, minf=1 00:16:19.178 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:19.178 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:19.178 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:19.178 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:19.178 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:19.178 00:16:19.178 Run status group 0 (all jobs): 00:16:19.178 READ: bw=21.6MiB/s (22.6MB/s), 85.3KiB/s-8236KiB/s (87.3kB/s-8433kB/s), io=22.3MiB (23.3MB), run=1001-1032msec 00:16:19.178 WRITE: bw=27.9MiB/s (29.2MB/s), 1984KiB/s-9.99MiB/s (2032kB/s-10.5MB/s), io=28.8MiB (30.2MB), run=1001-1032msec 00:16:19.178 00:16:19.178 Disk stats (read/write): 00:16:19.178 nvme0n1: ios=1842/2048, merge=0/0, ticks=419/321, in_queue=740, util=82.46% 00:16:19.178 nvme0n2: ios=1536/1828, merge=0/0, ticks=407/328, in_queue=735, util=83.35% 00:16:19.178 nvme0n3: ios=1300/1536, merge=0/0, ticks=461/282, in_queue=743, util=87.90% 00:16:19.178 nvme0n4: ios=73/512, merge=0/0, ticks=1517/119, in_queue=1636, util=97.57% 00:16:19.178 02:18:46 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:16:19.178 [global] 00:16:19.178 thread=1 00:16:19.178 invalidate=1 00:16:19.178 rw=randwrite 00:16:19.178 time_based=1 00:16:19.178 runtime=1 00:16:19.178 ioengine=libaio 00:16:19.178 direct=1 00:16:19.178 bs=4096 00:16:19.178 iodepth=1 00:16:19.178 norandommap=0 00:16:19.178 numjobs=1 00:16:19.178 00:16:19.178 verify_dump=1 00:16:19.178 verify_backlog=512 00:16:19.178 verify_state_save=0 00:16:19.178 do_verify=1 00:16:19.178 verify=crc32c-intel 00:16:19.178 [job0] 00:16:19.178 filename=/dev/nvme0n1 00:16:19.178 [job1] 00:16:19.178 filename=/dev/nvme0n2 00:16:19.178 [job2] 00:16:19.178 filename=/dev/nvme0n3 00:16:19.178 [job3] 00:16:19.178 filename=/dev/nvme0n4 00:16:19.178 Could not set queue depth (nvme0n1) 00:16:19.178 Could not set queue depth (nvme0n2) 00:16:19.178 Could not set queue depth (nvme0n3) 00:16:19.178 Could not set queue depth (nvme0n4) 00:16:19.436 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:19.436 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:19.436 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:19.436 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:19.436 fio-3.35 00:16:19.436 Starting 4 threads 00:16:20.807 00:16:20.807 job0: (groupid=0, jobs=1): err= 0: pid=2114820: Sun Dec 8 02:18:48 2024 00:16:20.807 read: IOPS=21, BW=85.4KiB/s (87.5kB/s)(88.0KiB/1030msec) 00:16:20.807 slat (nsec): min=5819, max=34882, avg=23437.68, stdev=10638.44 00:16:20.807 clat (usec): min=40839, max=42048, avg=41291.36, stdev=497.96 00:16:20.807 lat (usec): min=40873, max=42076, avg=41314.80, stdev=499.85 00:16:20.807 clat percentiles (usec): 00:16:20.807 | 1.00th=[40633], 5.00th=[40633], 10.00th=[41157], 20.00th=[41157], 00:16:20.807 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:20.807 | 70.00th=[41681], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:16:20.807 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:20.807 | 99.99th=[42206] 00:16:20.807 write: IOPS=497, BW=1988KiB/s (2036kB/s)(2048KiB/1030msec); 0 zone resets 00:16:20.807 slat (nsec): min=6039, max=24718, avg=7159.83, stdev=1745.72 00:16:20.807 clat (usec): min=157, max=378, avg=225.87, stdev=29.93 00:16:20.807 lat (usec): min=173, max=385, avg=233.03, stdev=30.13 00:16:20.807 clat percentiles (usec): 00:16:20.807 | 1.00th=[ 176], 5.00th=[ 182], 10.00th=[ 186], 20.00th=[ 206], 00:16:20.807 | 30.00th=[ 219], 40.00th=[ 223], 50.00th=[ 227], 60.00th=[ 231], 00:16:20.807 | 70.00th=[ 235], 80.00th=[ 241], 90.00th=[ 255], 95.00th=[ 285], 00:16:20.807 | 99.00th=[ 322], 99.50th=[ 338], 99.90th=[ 379], 99.95th=[ 379], 00:16:20.807 | 99.99th=[ 379] 00:16:20.807 bw ( KiB/s): min= 4096, max= 4096, per=51.50%, avg=4096.00, stdev= 0.00, samples=1 00:16:20.807 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:20.807 lat (usec) : 250=85.77%, 500=10.11% 00:16:20.807 lat (msec) : 50=4.12% 00:16:20.807 cpu : usr=0.10%, sys=0.39%, ctx=536, majf=0, minf=1 00:16:20.807 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:20.807 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:20.807 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:20.807 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:20.807 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:20.807 job1: (groupid=0, jobs=1): err= 0: pid=2114821: Sun Dec 8 02:18:48 2024 00:16:20.807 read: IOPS=21, BW=87.3KiB/s (89.4kB/s)(88.0KiB/1008msec) 00:16:20.807 slat (nsec): min=6159, max=34194, avg=22268.45, stdev=10296.02 00:16:20.807 clat (usec): min=40396, max=41998, avg=41260.47, stdev=504.98 00:16:20.807 lat (usec): min=40402, max=42015, avg=41282.74, stdev=510.27 00:16:20.807 clat percentiles (usec): 00:16:20.807 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:16:20.807 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:20.807 | 70.00th=[41681], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:16:20.807 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:20.807 | 99.99th=[42206] 00:16:20.807 write: IOPS=507, BW=2032KiB/s (2081kB/s)(2048KiB/1008msec); 0 zone resets 00:16:20.807 slat (nsec): min=5887, max=28483, avg=6822.34, stdev=1453.61 00:16:20.807 clat (usec): min=149, max=329, avg=184.54, stdev=30.93 00:16:20.807 lat (usec): min=155, max=335, avg=191.36, stdev=31.19 00:16:20.807 clat percentiles (usec): 00:16:20.807 | 1.00th=[ 157], 5.00th=[ 161], 10.00th=[ 163], 20.00th=[ 167], 00:16:20.807 | 30.00th=[ 172], 40.00th=[ 174], 50.00th=[ 178], 60.00th=[ 180], 00:16:20.807 | 70.00th=[ 186], 80.00th=[ 192], 90.00th=[ 206], 95.00th=[ 277], 00:16:20.807 | 99.00th=[ 318], 99.50th=[ 322], 99.90th=[ 330], 99.95th=[ 330], 00:16:20.807 | 99.99th=[ 330] 00:16:20.807 bw ( KiB/s): min= 4096, max= 4096, per=51.50%, avg=4096.00, stdev= 0.00, samples=1 00:16:20.807 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:20.807 lat (usec) : 250=90.64%, 500=5.24% 00:16:20.807 lat (msec) : 50=4.12% 00:16:20.807 cpu : usr=0.00%, sys=0.50%, ctx=535, majf=0, minf=1 00:16:20.807 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:20.807 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:20.807 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:20.807 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:20.807 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:20.807 job2: (groupid=0, jobs=1): err= 0: pid=2114822: Sun Dec 8 02:18:48 2024 00:16:20.807 read: IOPS=22, BW=89.4KiB/s (91.6kB/s)(92.0KiB/1029msec) 00:16:20.807 slat (nsec): min=6196, max=34909, avg=24102.39, stdev=10591.05 00:16:20.807 clat (usec): min=284, max=42058, avg=39430.82, stdev=8547.05 00:16:20.807 lat (usec): min=318, max=42075, avg=39454.92, stdev=8544.92 00:16:20.807 clat percentiles (usec): 00:16:20.807 | 1.00th=[ 285], 5.00th=[40633], 10.00th=[40633], 20.00th=[40633], 00:16:20.807 | 30.00th=[40633], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:20.807 | 70.00th=[41157], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:16:20.807 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:20.807 | 99.99th=[42206] 00:16:20.807 write: IOPS=497, BW=1990KiB/s (2038kB/s)(2048KiB/1029msec); 0 zone resets 00:16:20.807 slat (nsec): min=6386, max=24647, avg=7961.14, stdev=2230.40 00:16:20.807 clat (usec): min=133, max=390, avg=225.53, stdev=33.92 00:16:20.807 lat (usec): min=140, max=407, avg=233.49, stdev=34.69 00:16:20.807 clat percentiles (usec): 00:16:20.807 | 1.00th=[ 174], 5.00th=[ 180], 10.00th=[ 184], 20.00th=[ 202], 00:16:20.807 | 30.00th=[ 219], 40.00th=[ 223], 50.00th=[ 227], 60.00th=[ 231], 00:16:20.807 | 70.00th=[ 233], 80.00th=[ 237], 90.00th=[ 247], 95.00th=[ 281], 00:16:20.807 | 99.00th=[ 383], 99.50th=[ 388], 99.90th=[ 392], 99.95th=[ 392], 00:16:20.807 | 99.99th=[ 392] 00:16:20.807 bw ( KiB/s): min= 4096, max= 4096, per=51.50%, avg=4096.00, stdev= 0.00, samples=1 00:16:20.807 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:20.807 lat (usec) : 250=87.29%, 500=8.60% 00:16:20.807 lat (msec) : 50=4.11% 00:16:20.807 cpu : usr=0.10%, sys=0.49%, ctx=536, majf=0, minf=1 00:16:20.807 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:20.807 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:20.807 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:20.807 issued rwts: total=23,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:20.807 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:20.807 job3: (groupid=0, jobs=1): err= 0: pid=2114823: Sun Dec 8 02:18:48 2024 00:16:20.807 read: IOPS=21, BW=87.2KiB/s (89.3kB/s)(88.0KiB/1009msec) 00:16:20.807 slat (nsec): min=7302, max=45448, avg=23823.95, stdev=11854.25 00:16:20.807 clat (usec): min=40759, max=42001, avg=41226.37, stdev=459.29 00:16:20.807 lat (usec): min=40766, max=42036, avg=41250.19, stdev=464.45 00:16:20.807 clat percentiles (usec): 00:16:20.807 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:16:20.807 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:20.807 | 70.00th=[41157], 80.00th=[41681], 90.00th=[42206], 95.00th=[42206], 00:16:20.807 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:20.807 | 99.99th=[42206] 00:16:20.807 write: IOPS=507, BW=2030KiB/s (2078kB/s)(2048KiB/1009msec); 0 zone resets 00:16:20.807 slat (nsec): min=7387, max=72439, avg=8774.89, stdev=3466.56 00:16:20.807 clat (usec): min=148, max=259, avg=185.40, stdev=20.61 00:16:20.807 lat (usec): min=157, max=290, avg=194.17, stdev=21.15 00:16:20.807 clat percentiles (usec): 00:16:20.807 | 1.00th=[ 153], 5.00th=[ 161], 10.00th=[ 165], 20.00th=[ 169], 00:16:20.807 | 30.00th=[ 174], 40.00th=[ 180], 50.00th=[ 182], 60.00th=[ 186], 00:16:20.807 | 70.00th=[ 190], 80.00th=[ 196], 90.00th=[ 210], 95.00th=[ 239], 00:16:20.807 | 99.00th=[ 247], 99.50th=[ 258], 99.90th=[ 260], 99.95th=[ 260], 00:16:20.807 | 99.99th=[ 260] 00:16:20.807 bw ( KiB/s): min= 4096, max= 4096, per=51.50%, avg=4096.00, stdev= 0.00, samples=1 00:16:20.807 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:20.807 lat (usec) : 250=94.94%, 500=0.94% 00:16:20.807 lat (msec) : 50=4.12% 00:16:20.807 cpu : usr=0.50%, sys=0.50%, ctx=534, majf=0, minf=2 00:16:20.807 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:20.807 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:20.807 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:20.807 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:20.807 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:20.807 00:16:20.807 Run status group 0 (all jobs): 00:16:20.807 READ: bw=346KiB/s (354kB/s), 85.4KiB/s-89.4KiB/s (87.5kB/s-91.6kB/s), io=356KiB (365kB), run=1008-1030msec 00:16:20.807 WRITE: bw=7953KiB/s (8144kB/s), 1988KiB/s-2032KiB/s (2036kB/s-2081kB/s), io=8192KiB (8389kB), run=1008-1030msec 00:16:20.807 00:16:20.807 Disk stats (read/write): 00:16:20.807 nvme0n1: ios=67/512, merge=0/0, ticks=1180/112, in_queue=1292, util=90.28% 00:16:20.807 nvme0n2: ios=68/512, merge=0/0, ticks=1255/93, in_queue=1348, util=94.31% 00:16:20.807 nvme0n3: ios=41/512, merge=0/0, ticks=1686/112, in_queue=1798, util=99.48% 00:16:20.807 nvme0n4: ios=75/512, merge=0/0, ticks=817/94, in_queue=911, util=95.28% 00:16:20.808 02:18:48 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:16:20.808 [global] 00:16:20.808 thread=1 00:16:20.808 invalidate=1 00:16:20.808 rw=write 00:16:20.808 time_based=1 00:16:20.808 runtime=1 00:16:20.808 ioengine=libaio 00:16:20.808 direct=1 00:16:20.808 bs=4096 00:16:20.808 iodepth=128 00:16:20.808 norandommap=0 00:16:20.808 numjobs=1 00:16:20.808 00:16:20.808 verify_dump=1 00:16:20.808 verify_backlog=512 00:16:20.808 verify_state_save=0 00:16:20.808 do_verify=1 00:16:20.808 verify=crc32c-intel 00:16:20.808 [job0] 00:16:20.808 filename=/dev/nvme0n1 00:16:20.808 [job1] 00:16:20.808 filename=/dev/nvme0n2 00:16:20.808 [job2] 00:16:20.808 filename=/dev/nvme0n3 00:16:20.808 [job3] 00:16:20.808 filename=/dev/nvme0n4 00:16:20.808 Could not set queue depth (nvme0n1) 00:16:20.808 Could not set queue depth (nvme0n2) 00:16:20.808 Could not set queue depth (nvme0n3) 00:16:20.808 Could not set queue depth (nvme0n4) 00:16:20.808 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:20.808 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:20.808 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:20.808 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:20.808 fio-3.35 00:16:20.808 Starting 4 threads 00:16:22.186 00:16:22.186 job0: (groupid=0, jobs=1): err= 0: pid=2115060: Sun Dec 8 02:18:49 2024 00:16:22.186 read: IOPS=2529, BW=9.88MiB/s (10.4MB/s)(10.0MiB/1012msec) 00:16:22.186 slat (usec): min=3, max=21370, avg=134.83, stdev=915.11 00:16:22.186 clat (usec): min=8400, max=55339, avg=16516.06, stdev=8000.23 00:16:22.186 lat (usec): min=8406, max=55375, avg=16650.89, stdev=8084.92 00:16:22.186 clat percentiles (usec): 00:16:22.186 | 1.00th=[ 9372], 5.00th=[11469], 10.00th=[11994], 20.00th=[12256], 00:16:22.186 | 30.00th=[12387], 40.00th=[12649], 50.00th=[12780], 60.00th=[13698], 00:16:22.186 | 70.00th=[15139], 80.00th=[18482], 90.00th=[27919], 95.00th=[35914], 00:16:22.186 | 99.00th=[44827], 99.50th=[47973], 99.90th=[49546], 99.95th=[49546], 00:16:22.186 | 99.99th=[55313] 00:16:22.186 write: IOPS=2686, BW=10.5MiB/s (11.0MB/s)(10.6MiB/1012msec); 0 zone resets 00:16:22.186 slat (usec): min=4, max=29489, avg=232.00, stdev=1234.86 00:16:22.186 clat (usec): min=7614, max=99766, avg=31583.90, stdev=16871.97 00:16:22.186 lat (usec): min=7621, max=99791, avg=31815.90, stdev=16957.12 00:16:22.186 clat percentiles (msec): 00:16:22.186 | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 20], 00:16:22.186 | 30.00th=[ 21], 40.00th=[ 21], 50.00th=[ 28], 60.00th=[ 30], 00:16:22.186 | 70.00th=[ 36], 80.00th=[ 45], 90.00th=[ 54], 95.00th=[ 61], 00:16:22.186 | 99.00th=[ 94], 99.50th=[ 100], 99.90th=[ 101], 99.95th=[ 101], 00:16:22.186 | 99.99th=[ 101] 00:16:22.186 bw ( KiB/s): min= 8440, max=12288, per=19.00%, avg=10364.00, stdev=2720.95, samples=2 00:16:22.186 iops : min= 2110, max= 3072, avg=2591.00, stdev=680.24, samples=2 00:16:22.186 lat (msec) : 10=1.21%, 20=53.38%, 50=37.17%, 100=8.24% 00:16:22.186 cpu : usr=3.07%, sys=5.74%, ctx=363, majf=0, minf=1 00:16:22.186 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:16:22.186 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:22.186 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:22.186 issued rwts: total=2560,2719,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:22.186 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:22.186 job1: (groupid=0, jobs=1): err= 0: pid=2115061: Sun Dec 8 02:18:49 2024 00:16:22.186 read: IOPS=3676, BW=14.4MiB/s (15.1MB/s)(14.5MiB/1009msec) 00:16:22.186 slat (usec): min=2, max=9064, avg=114.87, stdev=662.97 00:16:22.186 clat (usec): min=4115, max=41229, avg=14073.23, stdev=4400.72 00:16:22.186 lat (usec): min=4776, max=41239, avg=14188.10, stdev=4452.97 00:16:22.186 clat percentiles (usec): 00:16:22.186 | 1.00th=[ 6456], 5.00th=[ 9896], 10.00th=[10290], 20.00th=[10814], 00:16:22.186 | 30.00th=[11338], 40.00th=[11863], 50.00th=[12649], 60.00th=[14091], 00:16:22.186 | 70.00th=[15664], 80.00th=[16319], 90.00th=[19268], 95.00th=[21365], 00:16:22.186 | 99.00th=[30016], 99.50th=[34866], 99.90th=[41157], 99.95th=[41157], 00:16:22.186 | 99.99th=[41157] 00:16:22.186 write: IOPS=4059, BW=15.9MiB/s (16.6MB/s)(16.0MiB/1009msec); 0 zone resets 00:16:22.186 slat (usec): min=4, max=12492, avg=130.77, stdev=669.96 00:16:22.186 clat (usec): min=5486, max=73631, avg=18285.70, stdev=11151.66 00:16:22.186 lat (usec): min=5500, max=73654, avg=18416.48, stdev=11227.01 00:16:22.186 clat percentiles (usec): 00:16:22.186 | 1.00th=[ 8586], 5.00th=[ 9503], 10.00th=[ 9634], 20.00th=[10683], 00:16:22.186 | 30.00th=[11207], 40.00th=[13173], 50.00th=[15008], 60.00th=[19792], 00:16:22.186 | 70.00th=[20317], 80.00th=[20579], 90.00th=[28967], 95.00th=[38536], 00:16:22.186 | 99.00th=[69731], 99.50th=[72877], 99.90th=[73925], 99.95th=[73925], 00:16:22.186 | 99.99th=[73925] 00:16:22.186 bw ( KiB/s): min=16368, max=16384, per=30.03%, avg=16376.00, stdev=11.31, samples=2 00:16:22.186 iops : min= 4092, max= 4096, avg=4094.00, stdev= 2.83, samples=2 00:16:22.186 lat (msec) : 10=9.34%, 20=68.47%, 50=20.20%, 100=1.99% 00:16:22.186 cpu : usr=5.95%, sys=5.95%, ctx=388, majf=0, minf=1 00:16:22.186 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:16:22.186 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:22.186 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:22.186 issued rwts: total=3710,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:22.186 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:22.186 job2: (groupid=0, jobs=1): err= 0: pid=2115062: Sun Dec 8 02:18:49 2024 00:16:22.186 read: IOPS=3020, BW=11.8MiB/s (12.4MB/s)(12.0MiB/1017msec) 00:16:22.186 slat (usec): min=3, max=14130, avg=126.11, stdev=798.11 00:16:22.186 clat (usec): min=4726, max=41433, avg=14535.72, stdev=6103.40 00:16:22.186 lat (usec): min=4745, max=41450, avg=14661.83, stdev=6155.29 00:16:22.186 clat percentiles (usec): 00:16:22.186 | 1.00th=[ 5211], 5.00th=[ 8586], 10.00th=[10028], 20.00th=[10814], 00:16:22.186 | 30.00th=[11076], 40.00th=[11731], 50.00th=[12649], 60.00th=[14353], 00:16:22.186 | 70.00th=[14615], 80.00th=[16450], 90.00th=[22414], 95.00th=[28181], 00:16:22.186 | 99.00th=[38011], 99.50th=[39584], 99.90th=[41681], 99.95th=[41681], 00:16:22.186 | 99.99th=[41681] 00:16:22.186 write: IOPS=3372, BW=13.2MiB/s (13.8MB/s)(13.4MiB/1017msec); 0 zone resets 00:16:22.186 slat (usec): min=4, max=14582, avg=169.20, stdev=774.54 00:16:22.186 clat (usec): min=2644, max=99868, avg=24468.76, stdev=15109.17 00:16:22.186 lat (usec): min=2651, max=99886, avg=24637.96, stdev=15204.57 00:16:22.186 clat percentiles (msec): 00:16:22.186 | 1.00th=[ 5], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], 00:16:22.186 | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 21], 60.00th=[ 25], 00:16:22.186 | 70.00th=[ 29], 80.00th=[ 32], 90.00th=[ 36], 95.00th=[ 50], 00:16:22.186 | 99.00th=[ 93], 99.50th=[ 94], 99.90th=[ 101], 99.95th=[ 101], 00:16:22.186 | 99.99th=[ 101] 00:16:22.186 bw ( KiB/s): min=10880, max=15567, per=24.24%, avg=13223.50, stdev=3314.21, samples=2 00:16:22.186 iops : min= 2720, max= 3891, avg=3305.50, stdev=828.02, samples=2 00:16:22.186 lat (msec) : 4=0.52%, 10=7.74%, 20=55.44%, 50=33.77%, 100=2.52% 00:16:22.186 cpu : usr=4.43%, sys=5.91%, ctx=403, majf=0, minf=1 00:16:22.186 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:16:22.186 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:22.186 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:22.186 issued rwts: total=3072,3430,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:22.186 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:22.186 job3: (groupid=0, jobs=1): err= 0: pid=2115063: Sun Dec 8 02:18:49 2024 00:16:22.187 read: IOPS=3580, BW=14.0MiB/s (14.7MB/s)(14.0MiB/1001msec) 00:16:22.187 slat (usec): min=3, max=10776, avg=149.69, stdev=800.64 00:16:22.187 clat (usec): min=5235, max=45759, avg=18824.13, stdev=9346.79 00:16:22.187 lat (usec): min=5252, max=48610, avg=18973.82, stdev=9396.69 00:16:22.187 clat percentiles (usec): 00:16:22.187 | 1.00th=[ 8094], 5.00th=[ 9896], 10.00th=[10683], 20.00th=[10945], 00:16:22.187 | 30.00th=[11469], 40.00th=[11731], 50.00th=[19006], 60.00th=[20317], 00:16:22.187 | 70.00th=[20579], 80.00th=[22414], 90.00th=[36439], 95.00th=[41157], 00:16:22.187 | 99.00th=[43779], 99.50th=[43779], 99.90th=[45876], 99.95th=[45876], 00:16:22.187 | 99.99th=[45876] 00:16:22.187 write: IOPS=3618, BW=14.1MiB/s (14.8MB/s)(14.1MiB/1001msec); 0 zone resets 00:16:22.187 slat (usec): min=3, max=10049, avg=115.67, stdev=671.14 00:16:22.187 clat (usec): min=311, max=38459, avg=16444.91, stdev=6888.34 00:16:22.187 lat (usec): min=847, max=45222, avg=16560.58, stdev=6910.60 00:16:22.187 clat percentiles (usec): 00:16:22.187 | 1.00th=[ 3261], 5.00th=[ 9372], 10.00th=[ 9634], 20.00th=[10945], 00:16:22.187 | 30.00th=[11469], 40.00th=[11731], 50.00th=[13173], 60.00th=[18482], 00:16:22.187 | 70.00th=[20579], 80.00th=[21365], 90.00th=[25560], 95.00th=[29492], 00:16:22.187 | 99.00th=[37487], 99.50th=[38536], 99.90th=[38536], 99.95th=[38536], 00:16:22.187 | 99.99th=[38536] 00:16:22.187 bw ( KiB/s): min=12288, max=12288, per=22.53%, avg=12288.00, stdev= 0.00, samples=1 00:16:22.187 iops : min= 3072, max= 3072, avg=3072.00, stdev= 0.00, samples=1 00:16:22.187 lat (usec) : 500=0.01%, 1000=0.04% 00:16:22.187 lat (msec) : 4=0.47%, 10=9.16%, 20=51.54%, 50=38.77% 00:16:22.187 cpu : usr=4.00%, sys=6.90%, ctx=328, majf=0, minf=1 00:16:22.187 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:16:22.187 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:22.187 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:22.187 issued rwts: total=3584,3622,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:22.187 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:22.187 00:16:22.187 Run status group 0 (all jobs): 00:16:22.187 READ: bw=49.6MiB/s (52.1MB/s), 9.88MiB/s-14.4MiB/s (10.4MB/s-15.1MB/s), io=50.5MiB (52.9MB), run=1001-1017msec 00:16:22.187 WRITE: bw=53.3MiB/s (55.8MB/s), 10.5MiB/s-15.9MiB/s (11.0MB/s-16.6MB/s), io=54.2MiB (56.8MB), run=1001-1017msec 00:16:22.187 00:16:22.187 Disk stats (read/write): 00:16:22.187 nvme0n1: ios=2098/2447, merge=0/0, ticks=14978/37760, in_queue=52738, util=87.27% 00:16:22.187 nvme0n2: ios=3634/3687, merge=0/0, ticks=28373/29187, in_queue=57560, util=91.17% 00:16:22.187 nvme0n3: ios=2619/2959, merge=0/0, ticks=34787/69029, in_queue=103816, util=94.90% 00:16:22.187 nvme0n4: ios=2617/2964, merge=0/0, ticks=14635/14009, in_queue=28644, util=95.60% 00:16:22.187 02:18:49 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:16:22.187 [global] 00:16:22.187 thread=1 00:16:22.187 invalidate=1 00:16:22.187 rw=randwrite 00:16:22.187 time_based=1 00:16:22.187 runtime=1 00:16:22.187 ioengine=libaio 00:16:22.187 direct=1 00:16:22.187 bs=4096 00:16:22.187 iodepth=128 00:16:22.187 norandommap=0 00:16:22.187 numjobs=1 00:16:22.187 00:16:22.187 verify_dump=1 00:16:22.187 verify_backlog=512 00:16:22.187 verify_state_save=0 00:16:22.187 do_verify=1 00:16:22.187 verify=crc32c-intel 00:16:22.187 [job0] 00:16:22.187 filename=/dev/nvme0n1 00:16:22.187 [job1] 00:16:22.187 filename=/dev/nvme0n2 00:16:22.187 [job2] 00:16:22.187 filename=/dev/nvme0n3 00:16:22.187 [job3] 00:16:22.187 filename=/dev/nvme0n4 00:16:22.187 Could not set queue depth (nvme0n1) 00:16:22.187 Could not set queue depth (nvme0n2) 00:16:22.187 Could not set queue depth (nvme0n3) 00:16:22.187 Could not set queue depth (nvme0n4) 00:16:22.445 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:22.445 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:22.445 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:22.445 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:22.445 fio-3.35 00:16:22.445 Starting 4 threads 00:16:23.817 00:16:23.817 job0: (groupid=0, jobs=1): err= 0: pid=2115415: Sun Dec 8 02:18:51 2024 00:16:23.817 read: IOPS=4618, BW=18.0MiB/s (18.9MB/s)(18.1MiB/1003msec) 00:16:23.817 slat (usec): min=2, max=13526, avg=93.01, stdev=625.00 00:16:23.817 clat (usec): min=1976, max=42502, avg=11637.30, stdev=3808.51 00:16:23.817 lat (usec): min=4290, max=42508, avg=11730.31, stdev=3860.91 00:16:23.817 clat percentiles (usec): 00:16:23.817 | 1.00th=[ 5997], 5.00th=[ 8094], 10.00th=[ 8848], 20.00th=[10421], 00:16:23.817 | 30.00th=[10814], 40.00th=[10814], 50.00th=[11076], 60.00th=[11207], 00:16:23.817 | 70.00th=[11731], 80.00th=[12518], 90.00th=[13435], 95.00th=[15401], 00:16:23.817 | 99.00th=[35390], 99.50th=[42206], 99.90th=[42730], 99.95th=[42730], 00:16:23.817 | 99.99th=[42730] 00:16:23.817 write: IOPS=5104, BW=19.9MiB/s (20.9MB/s)(20.0MiB/1003msec); 0 zone resets 00:16:23.817 slat (usec): min=3, max=26719, avg=97.91, stdev=760.88 00:16:23.817 clat (usec): min=2925, max=75047, avg=14063.13, stdev=9670.47 00:16:23.817 lat (usec): min=2934, max=75065, avg=14161.04, stdev=9729.32 00:16:23.817 clat percentiles (usec): 00:16:23.817 | 1.00th=[ 3916], 5.00th=[ 7046], 10.00th=[ 8717], 20.00th=[11207], 00:16:23.817 | 30.00th=[11600], 40.00th=[11863], 50.00th=[11994], 60.00th=[12125], 00:16:23.817 | 70.00th=[12256], 80.00th=[13173], 90.00th=[16712], 95.00th=[31589], 00:16:23.817 | 99.00th=[65274], 99.50th=[74974], 99.90th=[74974], 99.95th=[74974], 00:16:23.817 | 99.99th=[74974] 00:16:23.817 bw ( KiB/s): min=17144, max=22992, per=25.86%, avg=20068.00, stdev=4135.16, samples=2 00:16:23.817 iops : min= 4286, max= 5748, avg=5017.00, stdev=1033.79, samples=2 00:16:23.817 lat (msec) : 2=0.01%, 4=0.53%, 10=12.83%, 20=81.89%, 50=3.39% 00:16:23.817 lat (msec) : 100=1.34% 00:16:23.817 cpu : usr=5.09%, sys=7.09%, ctx=477, majf=0, minf=1 00:16:23.817 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:16:23.817 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:23.817 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:23.817 issued rwts: total=4632,5120,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:23.817 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:23.817 job1: (groupid=0, jobs=1): err= 0: pid=2115416: Sun Dec 8 02:18:51 2024 00:16:23.817 read: IOPS=5264, BW=20.6MiB/s (21.6MB/s)(20.6MiB/1003msec) 00:16:23.817 slat (usec): min=2, max=6451, avg=90.66, stdev=439.93 00:16:23.817 clat (usec): min=401, max=31662, avg=11621.85, stdev=3055.99 00:16:23.817 lat (usec): min=2905, max=31668, avg=11712.51, stdev=3047.46 00:16:23.817 clat percentiles (usec): 00:16:23.817 | 1.00th=[ 5800], 5.00th=[ 9241], 10.00th=[ 9765], 20.00th=[10421], 00:16:23.817 | 30.00th=[10814], 40.00th=[11076], 50.00th=[11338], 60.00th=[11600], 00:16:23.817 | 70.00th=[11731], 80.00th=[12256], 90.00th=[12649], 95.00th=[13304], 00:16:23.817 | 99.00th=[30802], 99.50th=[31589], 99.90th=[31589], 99.95th=[31589], 00:16:23.817 | 99.99th=[31589] 00:16:23.817 write: IOPS=5615, BW=21.9MiB/s (23.0MB/s)(22.0MiB/1003msec); 0 zone resets 00:16:23.817 slat (usec): min=3, max=3797, avg=85.01, stdev=388.21 00:16:23.817 clat (usec): min=8124, max=14876, avg=11605.94, stdev=1047.24 00:16:23.817 lat (usec): min=8589, max=14881, avg=11690.96, stdev=1004.79 00:16:23.817 clat percentiles (usec): 00:16:23.817 | 1.00th=[ 8848], 5.00th=[ 9765], 10.00th=[10290], 20.00th=[10814], 00:16:23.817 | 30.00th=[10945], 40.00th=[11338], 50.00th=[11731], 60.00th=[11994], 00:16:23.817 | 70.00th=[12256], 80.00th=[12387], 90.00th=[12911], 95.00th=[13173], 00:16:23.817 | 99.00th=[13829], 99.50th=[13960], 99.90th=[14615], 99.95th=[14877], 00:16:23.817 | 99.99th=[14877] 00:16:23.817 bw ( KiB/s): min=21248, max=23808, per=29.03%, avg=22528.00, stdev=1810.19, samples=2 00:16:23.817 iops : min= 5312, max= 5952, avg=5632.00, stdev=452.55, samples=2 00:16:23.817 lat (usec) : 500=0.01% 00:16:23.817 lat (msec) : 4=0.29%, 10=9.63%, 20=88.81%, 50=1.26% 00:16:23.817 cpu : usr=5.39%, sys=9.18%, ctx=603, majf=0, minf=1 00:16:23.817 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:16:23.817 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:23.817 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:23.817 issued rwts: total=5280,5632,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:23.817 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:23.817 job2: (groupid=0, jobs=1): err= 0: pid=2115417: Sun Dec 8 02:18:51 2024 00:16:23.817 read: IOPS=4376, BW=17.1MiB/s (17.9MB/s)(17.1MiB/1002msec) 00:16:23.817 slat (usec): min=2, max=9691, avg=102.26, stdev=529.95 00:16:23.817 clat (usec): min=471, max=23930, avg=13641.67, stdev=1699.08 00:16:23.817 lat (usec): min=3682, max=23942, avg=13743.93, stdev=1655.90 00:16:23.817 clat percentiles (usec): 00:16:23.817 | 1.00th=[ 7177], 5.00th=[10814], 10.00th=[11863], 20.00th=[13042], 00:16:23.817 | 30.00th=[13435], 40.00th=[13566], 50.00th=[13829], 60.00th=[13960], 00:16:23.818 | 70.00th=[14222], 80.00th=[14484], 90.00th=[15270], 95.00th=[16188], 00:16:23.818 | 99.00th=[17957], 99.50th=[18482], 99.90th=[18482], 99.95th=[18482], 00:16:23.818 | 99.99th=[23987] 00:16:23.818 write: IOPS=4598, BW=18.0MiB/s (18.8MB/s)(18.0MiB/1002msec); 0 zone resets 00:16:23.818 slat (usec): min=3, max=12989, avg=102.66, stdev=632.08 00:16:23.818 clat (usec): min=2498, max=51723, avg=14624.15, stdev=5748.34 00:16:23.818 lat (usec): min=2505, max=51727, avg=14726.81, stdev=5762.97 00:16:23.818 clat percentiles (usec): 00:16:23.818 | 1.00th=[ 4080], 5.00th=[ 8291], 10.00th=[10683], 20.00th=[11994], 00:16:23.818 | 30.00th=[12780], 40.00th=[13698], 50.00th=[14091], 60.00th=[14222], 00:16:23.818 | 70.00th=[14615], 80.00th=[15139], 90.00th=[17433], 95.00th=[27132], 00:16:23.818 | 99.00th=[39584], 99.50th=[45351], 99.90th=[51643], 99.95th=[51643], 00:16:23.818 | 99.99th=[51643] 00:16:23.818 bw ( KiB/s): min=17216, max=19648, per=23.76%, avg=18432.00, stdev=1719.68, samples=2 00:16:23.818 iops : min= 4304, max= 4912, avg=4608.00, stdev=429.92, samples=2 00:16:23.818 lat (usec) : 500=0.01% 00:16:23.818 lat (msec) : 4=0.63%, 10=3.30%, 20=91.79%, 50=4.19%, 100=0.07% 00:16:23.818 cpu : usr=4.20%, sys=6.99%, ctx=442, majf=0, minf=1 00:16:23.818 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:16:23.818 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:23.818 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:23.818 issued rwts: total=4385,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:23.818 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:23.818 job3: (groupid=0, jobs=1): err= 0: pid=2115418: Sun Dec 8 02:18:51 2024 00:16:23.818 read: IOPS=4038, BW=15.8MiB/s (16.5MB/s)(15.8MiB/1002msec) 00:16:23.818 slat (usec): min=3, max=18062, avg=129.38, stdev=808.30 00:16:23.818 clat (usec): min=588, max=94347, avg=15621.17, stdev=9403.90 00:16:23.818 lat (usec): min=3222, max=94362, avg=15750.54, stdev=9498.74 00:16:23.818 clat percentiles (usec): 00:16:23.818 | 1.00th=[ 7046], 5.00th=[11207], 10.00th=[11600], 20.00th=[12256], 00:16:23.818 | 30.00th=[12911], 40.00th=[13829], 50.00th=[13960], 60.00th=[14222], 00:16:23.818 | 70.00th=[14484], 80.00th=[15270], 90.00th=[17695], 95.00th=[22414], 00:16:23.818 | 99.00th=[82314], 99.50th=[82314], 99.90th=[82314], 99.95th=[82314], 00:16:23.818 | 99.99th=[93848] 00:16:23.818 write: IOPS=4087, BW=16.0MiB/s (16.7MB/s)(16.0MiB/1002msec); 0 zone resets 00:16:23.818 slat (usec): min=4, max=12406, avg=108.59, stdev=606.72 00:16:23.818 clat (usec): min=8346, max=83062, avg=15453.52, stdev=7871.16 00:16:23.818 lat (usec): min=8354, max=83075, avg=15562.11, stdev=7911.38 00:16:23.818 clat percentiles (usec): 00:16:23.818 | 1.00th=[ 9765], 5.00th=[11731], 10.00th=[12387], 20.00th=[12780], 00:16:23.818 | 30.00th=[13435], 40.00th=[13960], 50.00th=[14353], 60.00th=[14484], 00:16:23.818 | 70.00th=[14877], 80.00th=[15139], 90.00th=[15533], 95.00th=[18744], 00:16:23.818 | 99.00th=[70779], 99.50th=[71828], 99.90th=[71828], 99.95th=[71828], 00:16:23.818 | 99.99th=[83362] 00:16:23.818 bw ( KiB/s): min=12608, max=20160, per=21.12%, avg=16384.00, stdev=5340.07, samples=2 00:16:23.818 iops : min= 3152, max= 5040, avg=4096.00, stdev=1335.02, samples=2 00:16:23.818 lat (usec) : 750=0.01% 00:16:23.818 lat (msec) : 4=0.26%, 10=1.15%, 20=91.86%, 50=4.63%, 100=2.09% 00:16:23.818 cpu : usr=4.10%, sys=6.49%, ctx=370, majf=0, minf=1 00:16:23.818 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:16:23.818 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:23.818 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:23.818 issued rwts: total=4047,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:23.818 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:23.818 00:16:23.818 Run status group 0 (all jobs): 00:16:23.818 READ: bw=71.4MiB/s (74.9MB/s), 15.8MiB/s-20.6MiB/s (16.5MB/s-21.6MB/s), io=71.7MiB (75.1MB), run=1002-1003msec 00:16:23.818 WRITE: bw=75.8MiB/s (79.5MB/s), 16.0MiB/s-21.9MiB/s (16.7MB/s-23.0MB/s), io=76.0MiB (79.7MB), run=1002-1003msec 00:16:23.818 00:16:23.818 Disk stats (read/write): 00:16:23.818 nvme0n1: ios=4114/4096, merge=0/0, ticks=24444/25476, in_queue=49920, util=86.67% 00:16:23.818 nvme0n2: ios=4572/4608, merge=0/0, ticks=14059/12586, in_queue=26645, util=96.95% 00:16:23.818 nvme0n3: ios=3584/3928, merge=0/0, ticks=17464/22059, in_queue=39523, util=88.84% 00:16:23.818 nvme0n4: ios=3640/4033, merge=0/0, ticks=15952/17870, in_queue=33822, util=95.37% 00:16:23.818 02:18:51 -- target/fio.sh@55 -- # sync 00:16:23.818 02:18:51 -- target/fio.sh@59 -- # fio_pid=2115558 00:16:23.818 02:18:51 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:16:23.818 02:18:51 -- target/fio.sh@61 -- # sleep 3 00:16:23.818 [global] 00:16:23.818 thread=1 00:16:23.818 invalidate=1 00:16:23.818 rw=read 00:16:23.818 time_based=1 00:16:23.818 runtime=10 00:16:23.818 ioengine=libaio 00:16:23.818 direct=1 00:16:23.818 bs=4096 00:16:23.818 iodepth=1 00:16:23.818 norandommap=1 00:16:23.818 numjobs=1 00:16:23.818 00:16:23.818 [job0] 00:16:23.818 filename=/dev/nvme0n1 00:16:23.818 [job1] 00:16:23.818 filename=/dev/nvme0n2 00:16:23.818 [job2] 00:16:23.818 filename=/dev/nvme0n3 00:16:23.818 [job3] 00:16:23.818 filename=/dev/nvme0n4 00:16:23.818 Could not set queue depth (nvme0n1) 00:16:23.818 Could not set queue depth (nvme0n2) 00:16:23.818 Could not set queue depth (nvme0n3) 00:16:23.818 Could not set queue depth (nvme0n4) 00:16:23.818 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:23.818 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:23.818 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:23.818 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:23.818 fio-3.35 00:16:23.818 Starting 4 threads 00:16:27.101 02:18:54 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:16:27.101 02:18:54 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:16:27.101 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=1306624, buflen=4096 00:16:27.101 fio: pid=2115655, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:27.101 02:18:54 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:27.101 02:18:54 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:16:27.101 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=10997760, buflen=4096 00:16:27.101 fio: pid=2115654, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:27.359 02:18:55 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:27.359 02:18:55 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:16:27.359 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=376832, buflen=4096 00:16:27.359 fio: pid=2115652, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:27.618 02:18:55 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:27.618 02:18:55 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:16:27.618 fio: io_u error on file /dev/nvme0n2: Operation not supported: read offset=9273344, buflen=4096 00:16:27.618 fio: pid=2115653, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:27.618 00:16:27.618 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2115652: Sun Dec 8 02:18:55 2024 00:16:27.618 read: IOPS=26, BW=106KiB/s (108kB/s)(368KiB/3480msec) 00:16:27.618 slat (usec): min=7, max=13837, avg=273.45, stdev=1748.47 00:16:27.618 clat (usec): min=209, max=42418, avg=37298.68, stdev=12229.18 00:16:27.618 lat (usec): min=224, max=54998, avg=37574.90, stdev=12437.99 00:16:27.618 clat percentiles (usec): 00:16:27.618 | 1.00th=[ 210], 5.00th=[ 383], 10.00th=[40633], 20.00th=[41157], 00:16:27.618 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:27.618 | 70.00th=[41157], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:16:27.618 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:27.618 | 99.99th=[42206] 00:16:27.618 bw ( KiB/s): min= 96, max= 128, per=1.84%, avg=105.33, stdev=11.78, samples=6 00:16:27.618 iops : min= 24, max= 32, avg=26.33, stdev= 2.94, samples=6 00:16:27.618 lat (usec) : 250=3.23%, 500=3.23%, 750=3.23% 00:16:27.618 lat (msec) : 50=89.25% 00:16:27.618 cpu : usr=0.09%, sys=0.00%, ctx=95, majf=0, minf=2 00:16:27.618 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:27.618 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:27.618 complete : 0=1.1%, 4=98.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:27.618 issued rwts: total=93,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:27.618 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:27.618 job1: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2115653: Sun Dec 8 02:18:55 2024 00:16:27.618 read: IOPS=603, BW=2412KiB/s (2470kB/s)(9056KiB/3754msec) 00:16:27.618 slat (usec): min=5, max=7887, avg=16.73, stdev=166.78 00:16:27.618 clat (usec): min=178, max=42196, avg=1632.30, stdev=7169.14 00:16:27.618 lat (usec): min=184, max=48984, avg=1649.03, stdev=7193.56 00:16:27.618 clat percentiles (usec): 00:16:27.618 | 1.00th=[ 192], 5.00th=[ 206], 10.00th=[ 221], 20.00th=[ 243], 00:16:27.618 | 30.00th=[ 265], 40.00th=[ 347], 50.00th=[ 355], 60.00th=[ 359], 00:16:27.618 | 70.00th=[ 363], 80.00th=[ 367], 90.00th=[ 375], 95.00th=[ 437], 00:16:27.618 | 99.00th=[41157], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:27.618 | 99.99th=[42206] 00:16:27.618 bw ( KiB/s): min= 96, max= 6552, per=43.86%, avg=2505.86, stdev=2235.37, samples=7 00:16:27.618 iops : min= 24, max= 1638, avg=626.43, stdev=558.84, samples=7 00:16:27.618 lat (usec) : 250=23.89%, 500=72.41%, 750=0.35% 00:16:27.618 lat (msec) : 10=0.04%, 50=3.27% 00:16:27.618 cpu : usr=0.51%, sys=1.20%, ctx=2270, majf=0, minf=2 00:16:27.618 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:27.618 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:27.618 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:27.618 issued rwts: total=2265,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:27.618 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:27.618 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2115654: Sun Dec 8 02:18:55 2024 00:16:27.618 read: IOPS=843, BW=3374KiB/s (3455kB/s)(10.5MiB/3183msec) 00:16:27.618 slat (nsec): min=5038, max=49468, avg=11887.39, stdev=6477.44 00:16:27.618 clat (usec): min=186, max=44957, avg=1161.27, stdev=5861.19 00:16:27.618 lat (usec): min=192, max=44975, avg=1173.16, stdev=5862.34 00:16:27.618 clat percentiles (usec): 00:16:27.618 | 1.00th=[ 196], 5.00th=[ 206], 10.00th=[ 215], 20.00th=[ 235], 00:16:27.618 | 30.00th=[ 249], 40.00th=[ 273], 50.00th=[ 343], 60.00th=[ 355], 00:16:27.618 | 70.00th=[ 359], 80.00th=[ 363], 90.00th=[ 371], 95.00th=[ 408], 00:16:27.618 | 99.00th=[41157], 99.50th=[41681], 99.90th=[42206], 99.95th=[42206], 00:16:27.618 | 99.99th=[44827] 00:16:27.618 bw ( KiB/s): min= 96, max= 6560, per=48.20%, avg=2753.33, stdev=2702.25, samples=6 00:16:27.618 iops : min= 24, max= 1640, avg=688.33, stdev=675.56, samples=6 00:16:27.618 lat (usec) : 250=31.20%, 500=65.64%, 750=1.04% 00:16:27.618 lat (msec) : 50=2.08% 00:16:27.618 cpu : usr=0.50%, sys=1.70%, ctx=2686, majf=0, minf=1 00:16:27.618 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:27.618 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:27.618 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:27.618 issued rwts: total=2686,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:27.618 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:27.618 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2115655: Sun Dec 8 02:18:55 2024 00:16:27.618 read: IOPS=109, BW=437KiB/s (447kB/s)(1276KiB/2921msec) 00:16:27.618 slat (nsec): min=5266, max=80136, avg=11282.00, stdev=9582.27 00:16:27.618 clat (usec): min=224, max=42199, avg=9068.57, stdev=16807.22 00:16:27.618 lat (usec): min=229, max=42230, avg=9079.86, stdev=16812.95 00:16:27.618 clat percentiles (usec): 00:16:27.618 | 1.00th=[ 231], 5.00th=[ 241], 10.00th=[ 247], 20.00th=[ 255], 00:16:27.618 | 30.00th=[ 262], 40.00th=[ 269], 50.00th=[ 281], 60.00th=[ 285], 00:16:27.618 | 70.00th=[ 297], 80.00th=[41157], 90.00th=[41157], 95.00th=[41681], 00:16:27.618 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:27.618 | 99.99th=[42206] 00:16:27.618 bw ( KiB/s): min= 96, max= 160, per=1.96%, avg=112.00, stdev=27.71, samples=5 00:16:27.618 iops : min= 24, max= 40, avg=28.00, stdev= 6.93, samples=5 00:16:27.618 lat (usec) : 250=13.75%, 500=64.38% 00:16:27.618 lat (msec) : 50=21.56% 00:16:27.618 cpu : usr=0.03%, sys=0.21%, ctx=320, majf=0, minf=1 00:16:27.618 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:27.618 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:27.618 complete : 0=0.3%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:27.618 issued rwts: total=320,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:27.618 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:27.618 00:16:27.618 Run status group 0 (all jobs): 00:16:27.618 READ: bw=5711KiB/s (5848kB/s), 106KiB/s-3374KiB/s (108kB/s-3455kB/s), io=20.9MiB (22.0MB), run=2921-3754msec 00:16:27.618 00:16:27.618 Disk stats (read/write): 00:16:27.618 nvme0n1: ios=89/0, merge=0/0, ticks=3310/0, in_queue=3310, util=95.42% 00:16:27.618 nvme0n2: ios=2300/0, merge=0/0, ticks=4546/0, in_queue=4546, util=99.41% 00:16:27.618 nvme0n3: ios=2491/0, merge=0/0, ticks=3040/0, in_queue=3040, util=96.82% 00:16:27.618 nvme0n4: ios=226/0, merge=0/0, ticks=2827/0, in_queue=2827, util=96.75% 00:16:27.876 02:18:55 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:27.876 02:18:55 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:16:28.133 02:18:55 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:28.133 02:18:55 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:16:28.391 02:18:56 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:28.391 02:18:56 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:16:28.649 02:18:56 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:28.649 02:18:56 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:16:28.907 02:18:56 -- target/fio.sh@69 -- # fio_status=0 00:16:28.907 02:18:56 -- target/fio.sh@70 -- # wait 2115558 00:16:28.907 02:18:56 -- target/fio.sh@70 -- # fio_status=4 00:16:28.907 02:18:56 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:29.165 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:16:29.165 02:18:56 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:29.165 02:18:56 -- common/autotest_common.sh@1208 -- # local i=0 00:16:29.165 02:18:56 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:16:29.165 02:18:56 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:29.165 02:18:56 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:16:29.165 02:18:56 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:29.165 02:18:56 -- common/autotest_common.sh@1220 -- # return 0 00:16:29.165 02:18:56 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:16:29.165 02:18:56 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:16:29.165 nvmf hotplug test: fio failed as expected 00:16:29.165 02:18:56 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:29.423 02:18:57 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:16:29.423 02:18:57 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:16:29.423 02:18:57 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:16:29.423 02:18:57 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:16:29.423 02:18:57 -- target/fio.sh@91 -- # nvmftestfini 00:16:29.423 02:18:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:29.423 02:18:57 -- nvmf/common.sh@116 -- # sync 00:16:29.423 02:18:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:29.423 02:18:57 -- nvmf/common.sh@119 -- # set +e 00:16:29.423 02:18:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:29.423 02:18:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:29.423 rmmod nvme_tcp 00:16:29.423 rmmod nvme_fabrics 00:16:29.423 rmmod nvme_keyring 00:16:29.423 02:18:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:29.423 02:18:57 -- nvmf/common.sh@123 -- # set -e 00:16:29.423 02:18:57 -- nvmf/common.sh@124 -- # return 0 00:16:29.423 02:18:57 -- nvmf/common.sh@477 -- # '[' -n 2113357 ']' 00:16:29.423 02:18:57 -- nvmf/common.sh@478 -- # killprocess 2113357 00:16:29.423 02:18:57 -- common/autotest_common.sh@936 -- # '[' -z 2113357 ']' 00:16:29.423 02:18:57 -- common/autotest_common.sh@940 -- # kill -0 2113357 00:16:29.423 02:18:57 -- common/autotest_common.sh@941 -- # uname 00:16:29.423 02:18:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:29.423 02:18:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2113357 00:16:29.423 02:18:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:29.423 02:18:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:29.423 02:18:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2113357' 00:16:29.423 killing process with pid 2113357 00:16:29.423 02:18:57 -- common/autotest_common.sh@955 -- # kill 2113357 00:16:29.423 02:18:57 -- common/autotest_common.sh@960 -- # wait 2113357 00:16:29.682 02:18:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:29.682 02:18:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:29.682 02:18:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:29.682 02:18:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:29.683 02:18:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:29.683 02:18:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:29.683 02:18:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:29.683 02:18:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:32.219 02:18:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:32.219 00:16:32.219 real 0m24.450s 00:16:32.219 user 1m26.252s 00:16:32.219 sys 0m6.195s 00:16:32.219 02:18:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:32.219 02:18:59 -- common/autotest_common.sh@10 -- # set +x 00:16:32.219 ************************************ 00:16:32.219 END TEST nvmf_fio_target 00:16:32.219 ************************************ 00:16:32.219 02:18:59 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:16:32.219 02:18:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:32.219 02:18:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:32.219 02:18:59 -- common/autotest_common.sh@10 -- # set +x 00:16:32.219 ************************************ 00:16:32.219 START TEST nvmf_bdevio 00:16:32.219 ************************************ 00:16:32.219 02:18:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:16:32.219 * Looking for test storage... 00:16:32.219 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:32.219 02:18:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:32.219 02:18:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:32.219 02:18:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:32.219 02:18:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:32.219 02:18:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:32.219 02:18:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:32.219 02:18:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:32.219 02:18:59 -- scripts/common.sh@335 -- # IFS=.-: 00:16:32.219 02:18:59 -- scripts/common.sh@335 -- # read -ra ver1 00:16:32.219 02:18:59 -- scripts/common.sh@336 -- # IFS=.-: 00:16:32.219 02:18:59 -- scripts/common.sh@336 -- # read -ra ver2 00:16:32.219 02:18:59 -- scripts/common.sh@337 -- # local 'op=<' 00:16:32.219 02:18:59 -- scripts/common.sh@339 -- # ver1_l=2 00:16:32.219 02:18:59 -- scripts/common.sh@340 -- # ver2_l=1 00:16:32.219 02:18:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:32.219 02:18:59 -- scripts/common.sh@343 -- # case "$op" in 00:16:32.219 02:18:59 -- scripts/common.sh@344 -- # : 1 00:16:32.219 02:18:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:32.219 02:18:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:32.219 02:18:59 -- scripts/common.sh@364 -- # decimal 1 00:16:32.219 02:18:59 -- scripts/common.sh@352 -- # local d=1 00:16:32.219 02:18:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:32.219 02:18:59 -- scripts/common.sh@354 -- # echo 1 00:16:32.219 02:18:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:32.219 02:18:59 -- scripts/common.sh@365 -- # decimal 2 00:16:32.219 02:18:59 -- scripts/common.sh@352 -- # local d=2 00:16:32.219 02:18:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:32.219 02:18:59 -- scripts/common.sh@354 -- # echo 2 00:16:32.219 02:18:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:32.219 02:18:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:32.219 02:18:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:32.219 02:18:59 -- scripts/common.sh@367 -- # return 0 00:16:32.219 02:18:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:32.219 02:18:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:32.219 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:32.219 --rc genhtml_branch_coverage=1 00:16:32.219 --rc genhtml_function_coverage=1 00:16:32.219 --rc genhtml_legend=1 00:16:32.219 --rc geninfo_all_blocks=1 00:16:32.219 --rc geninfo_unexecuted_blocks=1 00:16:32.219 00:16:32.219 ' 00:16:32.219 02:18:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:32.219 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:32.219 --rc genhtml_branch_coverage=1 00:16:32.219 --rc genhtml_function_coverage=1 00:16:32.219 --rc genhtml_legend=1 00:16:32.219 --rc geninfo_all_blocks=1 00:16:32.219 --rc geninfo_unexecuted_blocks=1 00:16:32.219 00:16:32.219 ' 00:16:32.219 02:18:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:32.219 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:32.219 --rc genhtml_branch_coverage=1 00:16:32.219 --rc genhtml_function_coverage=1 00:16:32.219 --rc genhtml_legend=1 00:16:32.219 --rc geninfo_all_blocks=1 00:16:32.219 --rc geninfo_unexecuted_blocks=1 00:16:32.219 00:16:32.219 ' 00:16:32.219 02:18:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:32.219 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:32.219 --rc genhtml_branch_coverage=1 00:16:32.219 --rc genhtml_function_coverage=1 00:16:32.219 --rc genhtml_legend=1 00:16:32.219 --rc geninfo_all_blocks=1 00:16:32.219 --rc geninfo_unexecuted_blocks=1 00:16:32.219 00:16:32.219 ' 00:16:32.219 02:18:59 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:32.219 02:18:59 -- nvmf/common.sh@7 -- # uname -s 00:16:32.219 02:18:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:32.219 02:18:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:32.219 02:18:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:32.219 02:18:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:32.219 02:18:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:32.219 02:18:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:32.219 02:18:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:32.219 02:18:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:32.219 02:18:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:32.219 02:18:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:32.219 02:18:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:32.219 02:18:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:32.219 02:18:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:32.219 02:18:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:32.219 02:18:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:32.219 02:18:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:32.219 02:18:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:32.219 02:18:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:32.219 02:18:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:32.219 02:18:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:32.220 02:18:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:32.220 02:18:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:32.220 02:18:59 -- paths/export.sh@5 -- # export PATH 00:16:32.220 02:18:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:32.220 02:18:59 -- nvmf/common.sh@46 -- # : 0 00:16:32.220 02:18:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:32.220 02:18:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:32.220 02:18:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:32.220 02:18:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:32.220 02:18:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:32.220 02:18:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:32.220 02:18:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:32.220 02:18:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:32.220 02:18:59 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:32.220 02:18:59 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:32.220 02:18:59 -- target/bdevio.sh@14 -- # nvmftestinit 00:16:32.220 02:18:59 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:32.220 02:18:59 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:32.220 02:18:59 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:32.220 02:18:59 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:32.220 02:18:59 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:32.220 02:18:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:32.220 02:18:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:32.220 02:18:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:32.220 02:18:59 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:32.220 02:18:59 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:32.220 02:18:59 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:32.220 02:18:59 -- common/autotest_common.sh@10 -- # set +x 00:16:34.124 02:19:01 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:34.124 02:19:01 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:34.124 02:19:01 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:34.124 02:19:01 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:34.124 02:19:01 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:34.124 02:19:01 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:34.124 02:19:01 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:34.124 02:19:01 -- nvmf/common.sh@294 -- # net_devs=() 00:16:34.124 02:19:01 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:34.124 02:19:01 -- nvmf/common.sh@295 -- # e810=() 00:16:34.124 02:19:01 -- nvmf/common.sh@295 -- # local -ga e810 00:16:34.124 02:19:01 -- nvmf/common.sh@296 -- # x722=() 00:16:34.124 02:19:01 -- nvmf/common.sh@296 -- # local -ga x722 00:16:34.124 02:19:01 -- nvmf/common.sh@297 -- # mlx=() 00:16:34.124 02:19:01 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:34.124 02:19:01 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:34.124 02:19:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:34.124 02:19:01 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:34.124 02:19:01 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:34.124 02:19:01 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:34.124 02:19:01 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:34.124 02:19:01 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:34.124 02:19:01 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:34.124 02:19:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:34.124 02:19:01 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:34.124 02:19:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:34.124 02:19:01 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:34.124 02:19:01 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:34.124 02:19:01 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:34.124 02:19:01 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:34.124 02:19:01 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:34.124 02:19:01 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:34.124 02:19:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:34.124 02:19:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:34.124 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:34.124 02:19:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:34.124 02:19:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:34.124 02:19:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:34.124 02:19:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:34.124 02:19:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:34.124 02:19:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:34.125 02:19:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:34.125 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:34.125 02:19:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:34.125 02:19:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:34.125 02:19:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:34.125 02:19:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:34.125 02:19:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:34.125 02:19:01 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:34.125 02:19:01 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:34.125 02:19:01 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:34.125 02:19:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:34.125 02:19:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:34.125 02:19:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:34.125 02:19:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:34.125 02:19:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:34.125 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:34.125 02:19:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:34.125 02:19:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:34.125 02:19:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:34.125 02:19:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:34.125 02:19:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:34.125 02:19:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:34.125 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:34.125 02:19:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:34.125 02:19:01 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:34.125 02:19:01 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:34.125 02:19:01 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:34.125 02:19:01 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:34.125 02:19:01 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:34.125 02:19:01 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:34.125 02:19:01 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:34.125 02:19:01 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:34.125 02:19:01 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:34.125 02:19:01 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:34.125 02:19:01 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:34.125 02:19:01 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:34.125 02:19:01 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:34.125 02:19:01 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:34.125 02:19:01 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:34.125 02:19:01 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:34.125 02:19:01 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:34.125 02:19:01 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:34.125 02:19:01 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:34.125 02:19:01 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:34.125 02:19:01 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:34.125 02:19:01 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:34.125 02:19:01 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:34.125 02:19:01 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:34.125 02:19:01 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:34.125 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:34.125 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.242 ms 00:16:34.125 00:16:34.125 --- 10.0.0.2 ping statistics --- 00:16:34.125 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:34.125 rtt min/avg/max/mdev = 0.242/0.242/0.242/0.000 ms 00:16:34.125 02:19:01 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:34.125 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:34.125 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.118 ms 00:16:34.125 00:16:34.125 --- 10.0.0.1 ping statistics --- 00:16:34.125 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:34.125 rtt min/avg/max/mdev = 0.118/0.118/0.118/0.000 ms 00:16:34.125 02:19:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:34.125 02:19:01 -- nvmf/common.sh@410 -- # return 0 00:16:34.125 02:19:01 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:34.125 02:19:01 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:34.125 02:19:01 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:34.125 02:19:01 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:34.125 02:19:01 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:34.125 02:19:01 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:34.125 02:19:01 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:34.125 02:19:01 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:16:34.125 02:19:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:34.125 02:19:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:34.125 02:19:01 -- common/autotest_common.sh@10 -- # set +x 00:16:34.125 02:19:01 -- nvmf/common.sh@469 -- # nvmfpid=2118312 00:16:34.125 02:19:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:16:34.125 02:19:01 -- nvmf/common.sh@470 -- # waitforlisten 2118312 00:16:34.125 02:19:01 -- common/autotest_common.sh@829 -- # '[' -z 2118312 ']' 00:16:34.125 02:19:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:34.125 02:19:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:34.125 02:19:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:34.125 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:34.125 02:19:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:34.125 02:19:01 -- common/autotest_common.sh@10 -- # set +x 00:16:34.125 [2024-12-08 02:19:01.875338] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:34.125 [2024-12-08 02:19:01.875419] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:34.384 EAL: No free 2048 kB hugepages reported on node 1 00:16:34.384 [2024-12-08 02:19:01.944246] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:34.384 [2024-12-08 02:19:02.065948] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:34.384 [2024-12-08 02:19:02.066099] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:34.384 [2024-12-08 02:19:02.066119] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:34.384 [2024-12-08 02:19:02.066133] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:34.384 [2024-12-08 02:19:02.066215] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:16:34.384 [2024-12-08 02:19:02.066268] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:16:34.384 [2024-12-08 02:19:02.066320] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:16:34.384 [2024-12-08 02:19:02.066323] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:35.317 02:19:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:35.317 02:19:02 -- common/autotest_common.sh@862 -- # return 0 00:16:35.317 02:19:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:35.317 02:19:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:35.317 02:19:02 -- common/autotest_common.sh@10 -- # set +x 00:16:35.317 02:19:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:35.317 02:19:02 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:35.317 02:19:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:35.317 02:19:02 -- common/autotest_common.sh@10 -- # set +x 00:16:35.317 [2024-12-08 02:19:02.857010] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:35.317 02:19:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:35.317 02:19:02 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:35.317 02:19:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:35.317 02:19:02 -- common/autotest_common.sh@10 -- # set +x 00:16:35.317 Malloc0 00:16:35.317 02:19:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:35.317 02:19:02 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:16:35.317 02:19:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:35.317 02:19:02 -- common/autotest_common.sh@10 -- # set +x 00:16:35.317 02:19:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:35.317 02:19:02 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:35.317 02:19:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:35.317 02:19:02 -- common/autotest_common.sh@10 -- # set +x 00:16:35.317 02:19:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:35.317 02:19:02 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:35.317 02:19:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:35.317 02:19:02 -- common/autotest_common.sh@10 -- # set +x 00:16:35.317 [2024-12-08 02:19:02.910418] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:35.317 02:19:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:35.317 02:19:02 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:16:35.317 02:19:02 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:16:35.317 02:19:02 -- nvmf/common.sh@520 -- # config=() 00:16:35.317 02:19:02 -- nvmf/common.sh@520 -- # local subsystem config 00:16:35.317 02:19:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:35.317 02:19:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:35.317 { 00:16:35.317 "params": { 00:16:35.317 "name": "Nvme$subsystem", 00:16:35.317 "trtype": "$TEST_TRANSPORT", 00:16:35.317 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:35.317 "adrfam": "ipv4", 00:16:35.317 "trsvcid": "$NVMF_PORT", 00:16:35.317 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:35.317 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:35.317 "hdgst": ${hdgst:-false}, 00:16:35.317 "ddgst": ${ddgst:-false} 00:16:35.317 }, 00:16:35.317 "method": "bdev_nvme_attach_controller" 00:16:35.317 } 00:16:35.317 EOF 00:16:35.317 )") 00:16:35.317 02:19:02 -- nvmf/common.sh@542 -- # cat 00:16:35.317 02:19:02 -- nvmf/common.sh@544 -- # jq . 00:16:35.317 02:19:02 -- nvmf/common.sh@545 -- # IFS=, 00:16:35.317 02:19:02 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:35.317 "params": { 00:16:35.317 "name": "Nvme1", 00:16:35.317 "trtype": "tcp", 00:16:35.317 "traddr": "10.0.0.2", 00:16:35.317 "adrfam": "ipv4", 00:16:35.317 "trsvcid": "4420", 00:16:35.317 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:35.317 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:35.317 "hdgst": false, 00:16:35.317 "ddgst": false 00:16:35.317 }, 00:16:35.317 "method": "bdev_nvme_attach_controller" 00:16:35.317 }' 00:16:35.317 [2024-12-08 02:19:02.952901] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:35.317 [2024-12-08 02:19:02.952968] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2118472 ] 00:16:35.317 EAL: No free 2048 kB hugepages reported on node 1 00:16:35.317 [2024-12-08 02:19:03.013291] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:35.574 [2024-12-08 02:19:03.126615] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:35.574 [2024-12-08 02:19:03.126669] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:35.575 [2024-12-08 02:19:03.126672] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:35.832 [2024-12-08 02:19:03.462018] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:16:35.832 [2024-12-08 02:19:03.462066] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:16:35.832 I/O targets: 00:16:35.832 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:16:35.832 00:16:35.832 00:16:35.832 CUnit - A unit testing framework for C - Version 2.1-3 00:16:35.832 http://cunit.sourceforge.net/ 00:16:35.832 00:16:35.832 00:16:35.832 Suite: bdevio tests on: Nvme1n1 00:16:35.832 Test: blockdev write read block ...passed 00:16:35.832 Test: blockdev write zeroes read block ...passed 00:16:35.832 Test: blockdev write zeroes read no split ...passed 00:16:35.832 Test: blockdev write zeroes read split ...passed 00:16:36.090 Test: blockdev write zeroes read split partial ...passed 00:16:36.090 Test: blockdev reset ...[2024-12-08 02:19:03.618375] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:16:36.090 [2024-12-08 02:19:03.618487] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c16f20 (9): Bad file descriptor 00:16:36.090 [2024-12-08 02:19:03.672693] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:16:36.090 passed 00:16:36.090 Test: blockdev write read 8 blocks ...passed 00:16:36.090 Test: blockdev write read size > 128k ...passed 00:16:36.090 Test: blockdev write read invalid size ...passed 00:16:36.090 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:16:36.090 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:16:36.090 Test: blockdev write read max offset ...passed 00:16:36.090 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:16:36.090 Test: blockdev writev readv 8 blocks ...passed 00:16:36.347 Test: blockdev writev readv 30 x 1block ...passed 00:16:36.347 Test: blockdev writev readv block ...passed 00:16:36.347 Test: blockdev writev readv size > 128k ...passed 00:16:36.347 Test: blockdev writev readv size > 128k in two iovs ...passed 00:16:36.347 Test: blockdev comparev and writev ...[2024-12-08 02:19:03.926865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:36.347 [2024-12-08 02:19:03.926900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:16:36.347 [2024-12-08 02:19:03.926924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:36.347 [2024-12-08 02:19:03.926941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:16:36.347 [2024-12-08 02:19:03.927284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:36.347 [2024-12-08 02:19:03.927309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:16:36.347 [2024-12-08 02:19:03.927330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:36.347 [2024-12-08 02:19:03.927346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:16:36.347 [2024-12-08 02:19:03.927685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:36.347 [2024-12-08 02:19:03.927709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:16:36.347 [2024-12-08 02:19:03.927729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:36.347 [2024-12-08 02:19:03.927745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:16:36.347 [2024-12-08 02:19:03.928063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:36.347 [2024-12-08 02:19:03.928087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:16:36.347 [2024-12-08 02:19:03.928108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:36.347 [2024-12-08 02:19:03.928124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:16:36.347 passed 00:16:36.347 Test: blockdev nvme passthru rw ...passed 00:16:36.347 Test: blockdev nvme passthru vendor specific ...[2024-12-08 02:19:04.009773] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:36.347 [2024-12-08 02:19:04.009801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:16:36.347 [2024-12-08 02:19:04.009947] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:36.347 [2024-12-08 02:19:04.009970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:16:36.347 [2024-12-08 02:19:04.010109] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:36.347 [2024-12-08 02:19:04.010136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:16:36.347 [2024-12-08 02:19:04.010275] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:36.347 [2024-12-08 02:19:04.010297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:16:36.347 passed 00:16:36.347 Test: blockdev nvme admin passthru ...passed 00:16:36.347 Test: blockdev copy ...passed 00:16:36.347 00:16:36.347 Run Summary: Type Total Ran Passed Failed Inactive 00:16:36.347 suites 1 1 n/a 0 0 00:16:36.347 tests 23 23 23 0 0 00:16:36.347 asserts 152 152 152 0 n/a 00:16:36.347 00:16:36.347 Elapsed time = 1.217 seconds 00:16:36.605 02:19:04 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:36.605 02:19:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:36.605 02:19:04 -- common/autotest_common.sh@10 -- # set +x 00:16:36.605 02:19:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:36.605 02:19:04 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:16:36.605 02:19:04 -- target/bdevio.sh@30 -- # nvmftestfini 00:16:36.605 02:19:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:36.605 02:19:04 -- nvmf/common.sh@116 -- # sync 00:16:36.605 02:19:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:36.605 02:19:04 -- nvmf/common.sh@119 -- # set +e 00:16:36.605 02:19:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:36.605 02:19:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:36.605 rmmod nvme_tcp 00:16:36.605 rmmod nvme_fabrics 00:16:36.605 rmmod nvme_keyring 00:16:36.605 02:19:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:36.605 02:19:04 -- nvmf/common.sh@123 -- # set -e 00:16:36.605 02:19:04 -- nvmf/common.sh@124 -- # return 0 00:16:36.605 02:19:04 -- nvmf/common.sh@477 -- # '[' -n 2118312 ']' 00:16:36.605 02:19:04 -- nvmf/common.sh@478 -- # killprocess 2118312 00:16:36.605 02:19:04 -- common/autotest_common.sh@936 -- # '[' -z 2118312 ']' 00:16:36.605 02:19:04 -- common/autotest_common.sh@940 -- # kill -0 2118312 00:16:36.605 02:19:04 -- common/autotest_common.sh@941 -- # uname 00:16:36.605 02:19:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:36.605 02:19:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2118312 00:16:36.863 02:19:04 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:16:36.863 02:19:04 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:16:36.863 02:19:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2118312' 00:16:36.863 killing process with pid 2118312 00:16:36.863 02:19:04 -- common/autotest_common.sh@955 -- # kill 2118312 00:16:36.863 02:19:04 -- common/autotest_common.sh@960 -- # wait 2118312 00:16:37.122 02:19:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:37.123 02:19:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:37.123 02:19:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:37.123 02:19:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:37.123 02:19:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:37.123 02:19:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:37.123 02:19:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:37.123 02:19:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:39.021 02:19:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:39.021 00:16:39.021 real 0m7.291s 00:16:39.021 user 0m13.955s 00:16:39.021 sys 0m2.187s 00:16:39.021 02:19:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:39.021 02:19:06 -- common/autotest_common.sh@10 -- # set +x 00:16:39.021 ************************************ 00:16:39.021 END TEST nvmf_bdevio 00:16:39.021 ************************************ 00:16:39.021 02:19:06 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:16:39.021 02:19:06 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:16:39.021 02:19:06 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:16:39.021 02:19:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:39.021 02:19:06 -- common/autotest_common.sh@10 -- # set +x 00:16:39.022 ************************************ 00:16:39.022 START TEST nvmf_bdevio_no_huge 00:16:39.022 ************************************ 00:16:39.022 02:19:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:16:39.279 * Looking for test storage... 00:16:39.279 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:39.279 02:19:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:39.279 02:19:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:39.279 02:19:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:39.279 02:19:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:39.279 02:19:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:39.279 02:19:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:39.279 02:19:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:39.279 02:19:06 -- scripts/common.sh@335 -- # IFS=.-: 00:16:39.279 02:19:06 -- scripts/common.sh@335 -- # read -ra ver1 00:16:39.279 02:19:06 -- scripts/common.sh@336 -- # IFS=.-: 00:16:39.279 02:19:06 -- scripts/common.sh@336 -- # read -ra ver2 00:16:39.279 02:19:06 -- scripts/common.sh@337 -- # local 'op=<' 00:16:39.279 02:19:06 -- scripts/common.sh@339 -- # ver1_l=2 00:16:39.279 02:19:06 -- scripts/common.sh@340 -- # ver2_l=1 00:16:39.279 02:19:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:39.279 02:19:06 -- scripts/common.sh@343 -- # case "$op" in 00:16:39.279 02:19:06 -- scripts/common.sh@344 -- # : 1 00:16:39.279 02:19:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:39.279 02:19:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:39.279 02:19:06 -- scripts/common.sh@364 -- # decimal 1 00:16:39.279 02:19:06 -- scripts/common.sh@352 -- # local d=1 00:16:39.279 02:19:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:39.279 02:19:06 -- scripts/common.sh@354 -- # echo 1 00:16:39.279 02:19:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:39.279 02:19:06 -- scripts/common.sh@365 -- # decimal 2 00:16:39.279 02:19:06 -- scripts/common.sh@352 -- # local d=2 00:16:39.279 02:19:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:39.279 02:19:06 -- scripts/common.sh@354 -- # echo 2 00:16:39.279 02:19:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:39.279 02:19:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:39.279 02:19:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:39.279 02:19:06 -- scripts/common.sh@367 -- # return 0 00:16:39.279 02:19:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:39.279 02:19:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:39.279 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:39.279 --rc genhtml_branch_coverage=1 00:16:39.279 --rc genhtml_function_coverage=1 00:16:39.279 --rc genhtml_legend=1 00:16:39.279 --rc geninfo_all_blocks=1 00:16:39.279 --rc geninfo_unexecuted_blocks=1 00:16:39.279 00:16:39.279 ' 00:16:39.279 02:19:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:39.279 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:39.279 --rc genhtml_branch_coverage=1 00:16:39.279 --rc genhtml_function_coverage=1 00:16:39.279 --rc genhtml_legend=1 00:16:39.279 --rc geninfo_all_blocks=1 00:16:39.279 --rc geninfo_unexecuted_blocks=1 00:16:39.279 00:16:39.279 ' 00:16:39.280 02:19:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:39.280 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:39.280 --rc genhtml_branch_coverage=1 00:16:39.280 --rc genhtml_function_coverage=1 00:16:39.280 --rc genhtml_legend=1 00:16:39.280 --rc geninfo_all_blocks=1 00:16:39.280 --rc geninfo_unexecuted_blocks=1 00:16:39.280 00:16:39.280 ' 00:16:39.280 02:19:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:39.280 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:39.280 --rc genhtml_branch_coverage=1 00:16:39.280 --rc genhtml_function_coverage=1 00:16:39.280 --rc genhtml_legend=1 00:16:39.280 --rc geninfo_all_blocks=1 00:16:39.280 --rc geninfo_unexecuted_blocks=1 00:16:39.280 00:16:39.280 ' 00:16:39.280 02:19:06 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:39.280 02:19:06 -- nvmf/common.sh@7 -- # uname -s 00:16:39.280 02:19:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:39.280 02:19:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:39.280 02:19:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:39.280 02:19:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:39.280 02:19:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:39.280 02:19:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:39.280 02:19:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:39.280 02:19:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:39.280 02:19:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:39.280 02:19:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:39.280 02:19:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:39.280 02:19:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:39.280 02:19:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:39.280 02:19:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:39.280 02:19:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:39.280 02:19:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:39.280 02:19:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:39.280 02:19:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:39.280 02:19:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:39.280 02:19:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:39.280 02:19:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:39.280 02:19:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:39.280 02:19:06 -- paths/export.sh@5 -- # export PATH 00:16:39.280 02:19:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:39.280 02:19:06 -- nvmf/common.sh@46 -- # : 0 00:16:39.280 02:19:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:39.280 02:19:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:39.280 02:19:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:39.280 02:19:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:39.280 02:19:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:39.280 02:19:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:39.280 02:19:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:39.280 02:19:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:39.280 02:19:06 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:39.280 02:19:06 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:39.280 02:19:06 -- target/bdevio.sh@14 -- # nvmftestinit 00:16:39.280 02:19:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:39.280 02:19:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:39.280 02:19:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:39.280 02:19:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:39.280 02:19:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:39.280 02:19:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:39.280 02:19:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:39.280 02:19:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:39.280 02:19:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:39.280 02:19:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:39.280 02:19:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:39.280 02:19:06 -- common/autotest_common.sh@10 -- # set +x 00:16:41.811 02:19:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:41.811 02:19:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:41.811 02:19:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:41.811 02:19:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:41.811 02:19:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:41.811 02:19:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:41.811 02:19:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:41.811 02:19:09 -- nvmf/common.sh@294 -- # net_devs=() 00:16:41.811 02:19:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:41.811 02:19:09 -- nvmf/common.sh@295 -- # e810=() 00:16:41.811 02:19:09 -- nvmf/common.sh@295 -- # local -ga e810 00:16:41.811 02:19:09 -- nvmf/common.sh@296 -- # x722=() 00:16:41.811 02:19:09 -- nvmf/common.sh@296 -- # local -ga x722 00:16:41.811 02:19:09 -- nvmf/common.sh@297 -- # mlx=() 00:16:41.811 02:19:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:41.811 02:19:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:41.811 02:19:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:41.811 02:19:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:41.811 02:19:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:41.811 02:19:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:41.811 02:19:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:41.811 02:19:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:41.811 02:19:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:41.811 02:19:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:41.811 02:19:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:41.811 02:19:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:41.811 02:19:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:41.811 02:19:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:41.811 02:19:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:41.811 02:19:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:41.811 02:19:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:41.811 02:19:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:41.811 02:19:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:41.811 02:19:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:41.811 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:41.811 02:19:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:41.811 02:19:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:41.811 02:19:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:41.811 02:19:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:41.811 02:19:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:41.811 02:19:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:41.811 02:19:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:41.811 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:41.811 02:19:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:41.812 02:19:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:41.812 02:19:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:41.812 02:19:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:41.812 02:19:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:41.812 02:19:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:41.812 02:19:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:41.812 02:19:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:41.812 02:19:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:41.812 02:19:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:41.812 02:19:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:41.812 02:19:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:41.812 02:19:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:41.812 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:41.812 02:19:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:41.812 02:19:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:41.812 02:19:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:41.812 02:19:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:41.812 02:19:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:41.812 02:19:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:41.812 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:41.812 02:19:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:41.812 02:19:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:41.812 02:19:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:41.812 02:19:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:41.812 02:19:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:41.812 02:19:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:41.812 02:19:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:41.812 02:19:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:41.812 02:19:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:41.812 02:19:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:41.812 02:19:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:41.812 02:19:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:41.812 02:19:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:41.812 02:19:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:41.812 02:19:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:41.812 02:19:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:41.812 02:19:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:41.812 02:19:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:41.812 02:19:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:41.812 02:19:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:41.812 02:19:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:41.812 02:19:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:41.812 02:19:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:41.812 02:19:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:41.812 02:19:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:41.812 02:19:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:41.812 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:41.812 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.231 ms 00:16:41.812 00:16:41.812 --- 10.0.0.2 ping statistics --- 00:16:41.812 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:41.812 rtt min/avg/max/mdev = 0.231/0.231/0.231/0.000 ms 00:16:41.812 02:19:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:41.812 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:41.812 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.052 ms 00:16:41.812 00:16:41.812 --- 10.0.0.1 ping statistics --- 00:16:41.812 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:41.812 rtt min/avg/max/mdev = 0.052/0.052/0.052/0.000 ms 00:16:41.812 02:19:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:41.812 02:19:09 -- nvmf/common.sh@410 -- # return 0 00:16:41.812 02:19:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:41.812 02:19:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:41.812 02:19:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:41.812 02:19:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:41.812 02:19:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:41.812 02:19:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:41.812 02:19:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:41.812 02:19:09 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:16:41.812 02:19:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:41.812 02:19:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:41.812 02:19:09 -- common/autotest_common.sh@10 -- # set +x 00:16:41.812 02:19:09 -- nvmf/common.sh@469 -- # nvmfpid=2120671 00:16:41.812 02:19:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:16:41.812 02:19:09 -- nvmf/common.sh@470 -- # waitforlisten 2120671 00:16:41.812 02:19:09 -- common/autotest_common.sh@829 -- # '[' -z 2120671 ']' 00:16:41.812 02:19:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:41.812 02:19:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:41.812 02:19:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:41.812 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:41.812 02:19:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:41.812 02:19:09 -- common/autotest_common.sh@10 -- # set +x 00:16:41.812 [2024-12-08 02:19:09.237271] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:41.812 [2024-12-08 02:19:09.237355] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:16:41.812 [2024-12-08 02:19:09.307673] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:41.812 [2024-12-08 02:19:09.427583] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:41.812 [2024-12-08 02:19:09.427733] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:41.812 [2024-12-08 02:19:09.427753] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:41.812 [2024-12-08 02:19:09.427767] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:41.812 [2024-12-08 02:19:09.427860] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:16:41.812 [2024-12-08 02:19:09.427916] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:16:41.812 [2024-12-08 02:19:09.427967] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:16:41.812 [2024-12-08 02:19:09.427970] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:42.748 02:19:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:42.749 02:19:10 -- common/autotest_common.sh@862 -- # return 0 00:16:42.749 02:19:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:42.749 02:19:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:42.749 02:19:10 -- common/autotest_common.sh@10 -- # set +x 00:16:42.749 02:19:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:42.749 02:19:10 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:42.749 02:19:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:42.749 02:19:10 -- common/autotest_common.sh@10 -- # set +x 00:16:42.749 [2024-12-08 02:19:10.224954] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:42.749 02:19:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:42.749 02:19:10 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:42.749 02:19:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:42.749 02:19:10 -- common/autotest_common.sh@10 -- # set +x 00:16:42.749 Malloc0 00:16:42.749 02:19:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:42.749 02:19:10 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:16:42.749 02:19:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:42.749 02:19:10 -- common/autotest_common.sh@10 -- # set +x 00:16:42.749 02:19:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:42.749 02:19:10 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:42.749 02:19:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:42.749 02:19:10 -- common/autotest_common.sh@10 -- # set +x 00:16:42.749 02:19:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:42.749 02:19:10 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:42.749 02:19:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:42.749 02:19:10 -- common/autotest_common.sh@10 -- # set +x 00:16:42.749 [2024-12-08 02:19:10.263501] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:42.749 02:19:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:42.749 02:19:10 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:16:42.749 02:19:10 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:16:42.749 02:19:10 -- nvmf/common.sh@520 -- # config=() 00:16:42.749 02:19:10 -- nvmf/common.sh@520 -- # local subsystem config 00:16:42.749 02:19:10 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:42.749 02:19:10 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:42.749 { 00:16:42.749 "params": { 00:16:42.749 "name": "Nvme$subsystem", 00:16:42.749 "trtype": "$TEST_TRANSPORT", 00:16:42.749 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:42.749 "adrfam": "ipv4", 00:16:42.749 "trsvcid": "$NVMF_PORT", 00:16:42.749 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:42.749 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:42.749 "hdgst": ${hdgst:-false}, 00:16:42.749 "ddgst": ${ddgst:-false} 00:16:42.749 }, 00:16:42.749 "method": "bdev_nvme_attach_controller" 00:16:42.749 } 00:16:42.749 EOF 00:16:42.749 )") 00:16:42.749 02:19:10 -- nvmf/common.sh@542 -- # cat 00:16:42.749 02:19:10 -- nvmf/common.sh@544 -- # jq . 00:16:42.749 02:19:10 -- nvmf/common.sh@545 -- # IFS=, 00:16:42.749 02:19:10 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:42.749 "params": { 00:16:42.749 "name": "Nvme1", 00:16:42.749 "trtype": "tcp", 00:16:42.749 "traddr": "10.0.0.2", 00:16:42.749 "adrfam": "ipv4", 00:16:42.749 "trsvcid": "4420", 00:16:42.749 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:42.749 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:42.749 "hdgst": false, 00:16:42.749 "ddgst": false 00:16:42.749 }, 00:16:42.749 "method": "bdev_nvme_attach_controller" 00:16:42.749 }' 00:16:42.749 [2024-12-08 02:19:10.305594] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:42.749 [2024-12-08 02:19:10.305677] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid2120781 ] 00:16:42.749 [2024-12-08 02:19:10.373915] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:42.749 [2024-12-08 02:19:10.488035] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:42.749 [2024-12-08 02:19:10.488062] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:42.749 [2024-12-08 02:19:10.488066] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:43.008 [2024-12-08 02:19:10.767578] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:16:43.008 [2024-12-08 02:19:10.767636] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:16:43.008 I/O targets: 00:16:43.008 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:16:43.008 00:16:43.008 00:16:43.008 CUnit - A unit testing framework for C - Version 2.1-3 00:16:43.008 http://cunit.sourceforge.net/ 00:16:43.008 00:16:43.008 00:16:43.008 Suite: bdevio tests on: Nvme1n1 00:16:43.266 Test: blockdev write read block ...passed 00:16:43.266 Test: blockdev write zeroes read block ...passed 00:16:43.266 Test: blockdev write zeroes read no split ...passed 00:16:43.266 Test: blockdev write zeroes read split ...passed 00:16:43.266 Test: blockdev write zeroes read split partial ...passed 00:16:43.267 Test: blockdev reset ...[2024-12-08 02:19:10.929171] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:16:43.267 [2024-12-08 02:19:10.929277] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfc77d0 (9): Bad file descriptor 00:16:43.267 [2024-12-08 02:19:10.947521] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:16:43.267 passed 00:16:43.267 Test: blockdev write read 8 blocks ...passed 00:16:43.267 Test: blockdev write read size > 128k ...passed 00:16:43.267 Test: blockdev write read invalid size ...passed 00:16:43.267 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:16:43.267 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:16:43.267 Test: blockdev write read max offset ...passed 00:16:43.525 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:16:43.525 Test: blockdev writev readv 8 blocks ...passed 00:16:43.525 Test: blockdev writev readv 30 x 1block ...passed 00:16:43.526 Test: blockdev writev readv block ...passed 00:16:43.526 Test: blockdev writev readv size > 128k ...passed 00:16:43.526 Test: blockdev writev readv size > 128k in two iovs ...passed 00:16:43.526 Test: blockdev comparev and writev ...[2024-12-08 02:19:11.117647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:43.526 [2024-12-08 02:19:11.117683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:16:43.526 [2024-12-08 02:19:11.117707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:43.526 [2024-12-08 02:19:11.117724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:16:43.526 [2024-12-08 02:19:11.118061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:43.526 [2024-12-08 02:19:11.118086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:16:43.526 [2024-12-08 02:19:11.118107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:43.526 [2024-12-08 02:19:11.118123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:16:43.526 [2024-12-08 02:19:11.118446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:43.526 [2024-12-08 02:19:11.118470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:16:43.526 [2024-12-08 02:19:11.118491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:43.526 [2024-12-08 02:19:11.118507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:16:43.526 [2024-12-08 02:19:11.118831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:43.526 [2024-12-08 02:19:11.118855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:16:43.526 [2024-12-08 02:19:11.118877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:43.526 [2024-12-08 02:19:11.118892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:16:43.526 passed 00:16:43.526 Test: blockdev nvme passthru rw ...passed 00:16:43.526 Test: blockdev nvme passthru vendor specific ...[2024-12-08 02:19:11.200789] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:43.526 [2024-12-08 02:19:11.200816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:16:43.526 [2024-12-08 02:19:11.200953] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:43.526 [2024-12-08 02:19:11.200977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:16:43.526 [2024-12-08 02:19:11.201109] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:43.526 [2024-12-08 02:19:11.201132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:16:43.526 [2024-12-08 02:19:11.201275] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:43.526 [2024-12-08 02:19:11.201297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:16:43.526 passed 00:16:43.526 Test: blockdev nvme admin passthru ...passed 00:16:43.526 Test: blockdev copy ...passed 00:16:43.526 00:16:43.526 Run Summary: Type Total Ran Passed Failed Inactive 00:16:43.526 suites 1 1 n/a 0 0 00:16:43.526 tests 23 23 23 0 0 00:16:43.526 asserts 152 152 152 0 n/a 00:16:43.526 00:16:43.526 Elapsed time = 0.987 seconds 00:16:44.093 02:19:11 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:44.093 02:19:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:44.093 02:19:11 -- common/autotest_common.sh@10 -- # set +x 00:16:44.093 02:19:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:44.093 02:19:11 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:16:44.093 02:19:11 -- target/bdevio.sh@30 -- # nvmftestfini 00:16:44.093 02:19:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:44.093 02:19:11 -- nvmf/common.sh@116 -- # sync 00:16:44.093 02:19:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:44.093 02:19:11 -- nvmf/common.sh@119 -- # set +e 00:16:44.093 02:19:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:44.093 02:19:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:44.093 rmmod nvme_tcp 00:16:44.093 rmmod nvme_fabrics 00:16:44.093 rmmod nvme_keyring 00:16:44.093 02:19:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:44.093 02:19:11 -- nvmf/common.sh@123 -- # set -e 00:16:44.093 02:19:11 -- nvmf/common.sh@124 -- # return 0 00:16:44.093 02:19:11 -- nvmf/common.sh@477 -- # '[' -n 2120671 ']' 00:16:44.093 02:19:11 -- nvmf/common.sh@478 -- # killprocess 2120671 00:16:44.093 02:19:11 -- common/autotest_common.sh@936 -- # '[' -z 2120671 ']' 00:16:44.093 02:19:11 -- common/autotest_common.sh@940 -- # kill -0 2120671 00:16:44.093 02:19:11 -- common/autotest_common.sh@941 -- # uname 00:16:44.093 02:19:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:44.093 02:19:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2120671 00:16:44.093 02:19:11 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:16:44.093 02:19:11 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:16:44.093 02:19:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2120671' 00:16:44.093 killing process with pid 2120671 00:16:44.093 02:19:11 -- common/autotest_common.sh@955 -- # kill 2120671 00:16:44.093 02:19:11 -- common/autotest_common.sh@960 -- # wait 2120671 00:16:44.661 02:19:12 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:44.661 02:19:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:44.661 02:19:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:44.661 02:19:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:44.661 02:19:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:44.661 02:19:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:44.661 02:19:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:44.661 02:19:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:46.566 02:19:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:46.566 00:16:46.566 real 0m7.436s 00:16:46.566 user 0m13.729s 00:16:46.566 sys 0m2.658s 00:16:46.566 02:19:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:46.566 02:19:14 -- common/autotest_common.sh@10 -- # set +x 00:16:46.566 ************************************ 00:16:46.566 END TEST nvmf_bdevio_no_huge 00:16:46.566 ************************************ 00:16:46.566 02:19:14 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:16:46.566 02:19:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:46.566 02:19:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:46.566 02:19:14 -- common/autotest_common.sh@10 -- # set +x 00:16:46.566 ************************************ 00:16:46.566 START TEST nvmf_tls 00:16:46.566 ************************************ 00:16:46.566 02:19:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:16:46.566 * Looking for test storage... 00:16:46.566 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:46.566 02:19:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:46.566 02:19:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:46.566 02:19:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:46.824 02:19:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:46.824 02:19:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:46.824 02:19:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:46.824 02:19:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:46.824 02:19:14 -- scripts/common.sh@335 -- # IFS=.-: 00:16:46.824 02:19:14 -- scripts/common.sh@335 -- # read -ra ver1 00:16:46.824 02:19:14 -- scripts/common.sh@336 -- # IFS=.-: 00:16:46.824 02:19:14 -- scripts/common.sh@336 -- # read -ra ver2 00:16:46.824 02:19:14 -- scripts/common.sh@337 -- # local 'op=<' 00:16:46.825 02:19:14 -- scripts/common.sh@339 -- # ver1_l=2 00:16:46.825 02:19:14 -- scripts/common.sh@340 -- # ver2_l=1 00:16:46.825 02:19:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:46.825 02:19:14 -- scripts/common.sh@343 -- # case "$op" in 00:16:46.825 02:19:14 -- scripts/common.sh@344 -- # : 1 00:16:46.825 02:19:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:46.825 02:19:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:46.825 02:19:14 -- scripts/common.sh@364 -- # decimal 1 00:16:46.825 02:19:14 -- scripts/common.sh@352 -- # local d=1 00:16:46.825 02:19:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:46.825 02:19:14 -- scripts/common.sh@354 -- # echo 1 00:16:46.825 02:19:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:46.825 02:19:14 -- scripts/common.sh@365 -- # decimal 2 00:16:46.825 02:19:14 -- scripts/common.sh@352 -- # local d=2 00:16:46.825 02:19:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:46.825 02:19:14 -- scripts/common.sh@354 -- # echo 2 00:16:46.825 02:19:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:46.825 02:19:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:46.825 02:19:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:46.825 02:19:14 -- scripts/common.sh@367 -- # return 0 00:16:46.825 02:19:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:46.825 02:19:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:46.825 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:46.825 --rc genhtml_branch_coverage=1 00:16:46.825 --rc genhtml_function_coverage=1 00:16:46.825 --rc genhtml_legend=1 00:16:46.825 --rc geninfo_all_blocks=1 00:16:46.825 --rc geninfo_unexecuted_blocks=1 00:16:46.825 00:16:46.825 ' 00:16:46.825 02:19:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:46.825 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:46.825 --rc genhtml_branch_coverage=1 00:16:46.825 --rc genhtml_function_coverage=1 00:16:46.825 --rc genhtml_legend=1 00:16:46.825 --rc geninfo_all_blocks=1 00:16:46.825 --rc geninfo_unexecuted_blocks=1 00:16:46.825 00:16:46.825 ' 00:16:46.825 02:19:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:46.825 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:46.825 --rc genhtml_branch_coverage=1 00:16:46.825 --rc genhtml_function_coverage=1 00:16:46.825 --rc genhtml_legend=1 00:16:46.825 --rc geninfo_all_blocks=1 00:16:46.825 --rc geninfo_unexecuted_blocks=1 00:16:46.825 00:16:46.825 ' 00:16:46.825 02:19:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:46.825 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:46.825 --rc genhtml_branch_coverage=1 00:16:46.825 --rc genhtml_function_coverage=1 00:16:46.825 --rc genhtml_legend=1 00:16:46.825 --rc geninfo_all_blocks=1 00:16:46.825 --rc geninfo_unexecuted_blocks=1 00:16:46.825 00:16:46.825 ' 00:16:46.825 02:19:14 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:46.825 02:19:14 -- nvmf/common.sh@7 -- # uname -s 00:16:46.825 02:19:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:46.825 02:19:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:46.825 02:19:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:46.825 02:19:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:46.825 02:19:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:46.825 02:19:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:46.825 02:19:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:46.825 02:19:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:46.825 02:19:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:46.825 02:19:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:46.825 02:19:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:46.825 02:19:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:46.825 02:19:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:46.825 02:19:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:46.825 02:19:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:46.825 02:19:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:46.825 02:19:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:46.825 02:19:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:46.825 02:19:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:46.825 02:19:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:46.825 02:19:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:46.825 02:19:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:46.825 02:19:14 -- paths/export.sh@5 -- # export PATH 00:16:46.825 02:19:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:46.825 02:19:14 -- nvmf/common.sh@46 -- # : 0 00:16:46.825 02:19:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:46.825 02:19:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:46.825 02:19:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:46.825 02:19:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:46.825 02:19:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:46.825 02:19:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:46.825 02:19:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:46.825 02:19:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:46.825 02:19:14 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:46.825 02:19:14 -- target/tls.sh@71 -- # nvmftestinit 00:16:46.825 02:19:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:46.825 02:19:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:46.825 02:19:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:46.825 02:19:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:46.825 02:19:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:46.825 02:19:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:46.825 02:19:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:46.825 02:19:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:46.825 02:19:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:46.825 02:19:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:46.825 02:19:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:46.825 02:19:14 -- common/autotest_common.sh@10 -- # set +x 00:16:48.732 02:19:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:48.732 02:19:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:48.732 02:19:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:48.733 02:19:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:48.733 02:19:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:48.733 02:19:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:48.733 02:19:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:48.733 02:19:16 -- nvmf/common.sh@294 -- # net_devs=() 00:16:48.733 02:19:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:48.733 02:19:16 -- nvmf/common.sh@295 -- # e810=() 00:16:48.733 02:19:16 -- nvmf/common.sh@295 -- # local -ga e810 00:16:48.733 02:19:16 -- nvmf/common.sh@296 -- # x722=() 00:16:48.733 02:19:16 -- nvmf/common.sh@296 -- # local -ga x722 00:16:48.733 02:19:16 -- nvmf/common.sh@297 -- # mlx=() 00:16:48.733 02:19:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:48.733 02:19:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:48.733 02:19:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:48.733 02:19:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:48.733 02:19:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:48.733 02:19:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:48.733 02:19:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:48.733 02:19:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:48.733 02:19:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:48.733 02:19:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:48.733 02:19:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:48.733 02:19:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:48.733 02:19:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:48.733 02:19:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:48.733 02:19:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:48.733 02:19:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:48.733 02:19:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:48.733 02:19:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:48.733 02:19:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:48.733 02:19:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:48.733 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:48.733 02:19:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:48.733 02:19:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:48.733 02:19:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:48.733 02:19:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:48.733 02:19:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:48.733 02:19:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:48.733 02:19:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:48.733 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:48.733 02:19:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:48.733 02:19:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:48.733 02:19:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:48.733 02:19:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:48.733 02:19:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:48.733 02:19:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:48.733 02:19:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:48.733 02:19:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:48.733 02:19:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:48.733 02:19:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:48.733 02:19:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:48.733 02:19:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:48.733 02:19:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:48.733 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:48.733 02:19:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:48.733 02:19:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:48.733 02:19:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:48.733 02:19:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:48.733 02:19:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:48.733 02:19:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:48.733 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:48.733 02:19:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:48.733 02:19:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:48.733 02:19:16 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:48.733 02:19:16 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:48.733 02:19:16 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:48.733 02:19:16 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:48.733 02:19:16 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:48.733 02:19:16 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:48.733 02:19:16 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:48.733 02:19:16 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:48.733 02:19:16 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:48.733 02:19:16 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:48.733 02:19:16 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:48.733 02:19:16 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:48.733 02:19:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:48.733 02:19:16 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:48.733 02:19:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:48.733 02:19:16 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:48.733 02:19:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:48.733 02:19:16 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:48.733 02:19:16 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:48.733 02:19:16 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:48.733 02:19:16 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:48.733 02:19:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:48.733 02:19:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:48.733 02:19:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:48.733 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:48.733 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.220 ms 00:16:48.733 00:16:48.733 --- 10.0.0.2 ping statistics --- 00:16:48.733 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:48.733 rtt min/avg/max/mdev = 0.220/0.220/0.220/0.000 ms 00:16:48.733 02:19:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:48.992 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:48.992 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.111 ms 00:16:48.992 00:16:48.992 --- 10.0.0.1 ping statistics --- 00:16:48.992 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:48.992 rtt min/avg/max/mdev = 0.111/0.111/0.111/0.000 ms 00:16:48.992 02:19:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:48.992 02:19:16 -- nvmf/common.sh@410 -- # return 0 00:16:48.992 02:19:16 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:48.992 02:19:16 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:48.992 02:19:16 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:48.992 02:19:16 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:48.992 02:19:16 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:48.992 02:19:16 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:48.992 02:19:16 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:48.992 02:19:16 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:16:48.992 02:19:16 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:48.992 02:19:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:48.992 02:19:16 -- common/autotest_common.sh@10 -- # set +x 00:16:48.992 02:19:16 -- nvmf/common.sh@469 -- # nvmfpid=2122946 00:16:48.992 02:19:16 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:16:48.992 02:19:16 -- nvmf/common.sh@470 -- # waitforlisten 2122946 00:16:48.992 02:19:16 -- common/autotest_common.sh@829 -- # '[' -z 2122946 ']' 00:16:48.992 02:19:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:48.992 02:19:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:48.992 02:19:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:48.992 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:48.992 02:19:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:48.992 02:19:16 -- common/autotest_common.sh@10 -- # set +x 00:16:48.992 [2024-12-08 02:19:16.576931] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:48.992 [2024-12-08 02:19:16.576998] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:48.992 EAL: No free 2048 kB hugepages reported on node 1 00:16:48.992 [2024-12-08 02:19:16.641020] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:48.992 [2024-12-08 02:19:16.748693] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:48.992 [2024-12-08 02:19:16.748865] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:48.992 [2024-12-08 02:19:16.748883] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:48.992 [2024-12-08 02:19:16.748895] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:48.992 [2024-12-08 02:19:16.748941] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:49.251 02:19:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:49.251 02:19:16 -- common/autotest_common.sh@862 -- # return 0 00:16:49.251 02:19:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:49.251 02:19:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:49.251 02:19:16 -- common/autotest_common.sh@10 -- # set +x 00:16:49.251 02:19:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:49.251 02:19:16 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:16:49.251 02:19:16 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:16:49.508 true 00:16:49.508 02:19:17 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:49.508 02:19:17 -- target/tls.sh@82 -- # jq -r .tls_version 00:16:49.767 02:19:17 -- target/tls.sh@82 -- # version=0 00:16:49.767 02:19:17 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:16:49.767 02:19:17 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:16:50.025 02:19:17 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:50.025 02:19:17 -- target/tls.sh@90 -- # jq -r .tls_version 00:16:50.284 02:19:17 -- target/tls.sh@90 -- # version=13 00:16:50.284 02:19:17 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:16:50.284 02:19:17 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:16:50.542 02:19:18 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:50.542 02:19:18 -- target/tls.sh@98 -- # jq -r .tls_version 00:16:50.800 02:19:18 -- target/tls.sh@98 -- # version=7 00:16:50.800 02:19:18 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:16:50.800 02:19:18 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:50.800 02:19:18 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:16:51.058 02:19:18 -- target/tls.sh@105 -- # ktls=false 00:16:51.058 02:19:18 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:16:51.058 02:19:18 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:16:51.316 02:19:18 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:51.316 02:19:18 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:16:51.575 02:19:19 -- target/tls.sh@113 -- # ktls=true 00:16:51.575 02:19:19 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:16:51.575 02:19:19 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:16:51.834 02:19:19 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:51.834 02:19:19 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:16:52.092 02:19:19 -- target/tls.sh@121 -- # ktls=false 00:16:52.092 02:19:19 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:16:52.093 02:19:19 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:16:52.093 02:19:19 -- target/tls.sh@49 -- # local key hash crc 00:16:52.093 02:19:19 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:16:52.093 02:19:19 -- target/tls.sh@51 -- # hash=01 00:16:52.093 02:19:19 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:16:52.093 02:19:19 -- target/tls.sh@52 -- # gzip -1 -c 00:16:52.093 02:19:19 -- target/tls.sh@52 -- # tail -c8 00:16:52.093 02:19:19 -- target/tls.sh@52 -- # head -c 4 00:16:52.093 02:19:19 -- target/tls.sh@52 -- # crc='p$H�' 00:16:52.093 02:19:19 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:16:52.093 02:19:19 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:16:52.093 02:19:19 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:16:52.093 02:19:19 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:16:52.093 02:19:19 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:16:52.093 02:19:19 -- target/tls.sh@49 -- # local key hash crc 00:16:52.093 02:19:19 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:16:52.093 02:19:19 -- target/tls.sh@51 -- # hash=01 00:16:52.093 02:19:19 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:16:52.093 02:19:19 -- target/tls.sh@52 -- # gzip -1 -c 00:16:52.093 02:19:19 -- target/tls.sh@52 -- # tail -c8 00:16:52.093 02:19:19 -- target/tls.sh@52 -- # head -c 4 00:16:52.093 02:19:19 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:16:52.093 02:19:19 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:16:52.093 02:19:19 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:16:52.093 02:19:19 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:16:52.093 02:19:19 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:16:52.093 02:19:19 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:52.093 02:19:19 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:16:52.093 02:19:19 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:16:52.093 02:19:19 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:16:52.093 02:19:19 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:52.093 02:19:19 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:16:52.093 02:19:19 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:16:52.352 02:19:19 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:16:52.610 02:19:20 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:52.610 02:19:20 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:52.610 02:19:20 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:16:52.869 [2024-12-08 02:19:20.563131] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:52.869 02:19:20 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:16:53.127 02:19:20 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:16:53.692 [2024-12-08 02:19:21.172813] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:16:53.692 [2024-12-08 02:19:21.173085] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:53.692 02:19:21 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:16:53.980 malloc0 00:16:53.980 02:19:21 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:16:54.264 02:19:21 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:54.522 02:19:22 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:54.522 EAL: No free 2048 kB hugepages reported on node 1 00:17:04.490 Initializing NVMe Controllers 00:17:04.490 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:17:04.490 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:17:04.490 Initialization complete. Launching workers. 00:17:04.490 ======================================================== 00:17:04.490 Latency(us) 00:17:04.490 Device Information : IOPS MiB/s Average min max 00:17:04.490 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7799.85 30.47 8207.87 1261.42 9242.01 00:17:04.490 ======================================================== 00:17:04.490 Total : 7799.85 30.47 8207.87 1261.42 9242.01 00:17:04.490 00:17:04.490 02:19:32 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:04.490 02:19:32 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:04.490 02:19:32 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:04.490 02:19:32 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:04.490 02:19:32 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:04.490 02:19:32 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:04.490 02:19:32 -- target/tls.sh@28 -- # bdevperf_pid=2124911 00:17:04.491 02:19:32 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:04.491 02:19:32 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:04.491 02:19:32 -- target/tls.sh@31 -- # waitforlisten 2124911 /var/tmp/bdevperf.sock 00:17:04.491 02:19:32 -- common/autotest_common.sh@829 -- # '[' -z 2124911 ']' 00:17:04.491 02:19:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:04.491 02:19:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:04.491 02:19:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:04.491 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:04.491 02:19:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:04.491 02:19:32 -- common/autotest_common.sh@10 -- # set +x 00:17:04.491 [2024-12-08 02:19:32.185020] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:04.491 [2024-12-08 02:19:32.185100] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2124911 ] 00:17:04.491 EAL: No free 2048 kB hugepages reported on node 1 00:17:04.491 [2024-12-08 02:19:32.242571] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:04.750 [2024-12-08 02:19:32.356296] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:05.685 02:19:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:05.685 02:19:33 -- common/autotest_common.sh@862 -- # return 0 00:17:05.685 02:19:33 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:05.685 [2024-12-08 02:19:33.405402] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:05.944 TLSTESTn1 00:17:05.944 02:19:33 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:05.944 Running I/O for 10 seconds... 00:17:15.907 00:17:15.907 Latency(us) 00:17:15.907 [2024-12-08T01:19:43.688Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:15.907 [2024-12-08T01:19:43.688Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:15.907 Verification LBA range: start 0x0 length 0x2000 00:17:15.907 TLSTESTn1 : 10.02 4593.27 17.94 0.00 0.00 27828.23 4878.79 52040.44 00:17:15.907 [2024-12-08T01:19:43.688Z] =================================================================================================================== 00:17:15.907 [2024-12-08T01:19:43.688Z] Total : 4593.27 17.94 0.00 0.00 27828.23 4878.79 52040.44 00:17:15.907 0 00:17:15.907 02:19:43 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:15.907 02:19:43 -- target/tls.sh@45 -- # killprocess 2124911 00:17:15.907 02:19:43 -- common/autotest_common.sh@936 -- # '[' -z 2124911 ']' 00:17:15.907 02:19:43 -- common/autotest_common.sh@940 -- # kill -0 2124911 00:17:15.907 02:19:43 -- common/autotest_common.sh@941 -- # uname 00:17:15.907 02:19:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:15.907 02:19:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2124911 00:17:16.164 02:19:43 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:16.164 02:19:43 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:16.164 02:19:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2124911' 00:17:16.164 killing process with pid 2124911 00:17:16.164 02:19:43 -- common/autotest_common.sh@955 -- # kill 2124911 00:17:16.164 Received shutdown signal, test time was about 10.000000 seconds 00:17:16.164 00:17:16.164 Latency(us) 00:17:16.164 [2024-12-08T01:19:43.945Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:16.164 [2024-12-08T01:19:43.945Z] =================================================================================================================== 00:17:16.164 [2024-12-08T01:19:43.945Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:16.164 02:19:43 -- common/autotest_common.sh@960 -- # wait 2124911 00:17:16.421 02:19:43 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:16.421 02:19:43 -- common/autotest_common.sh@650 -- # local es=0 00:17:16.421 02:19:43 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:16.421 02:19:43 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:16.421 02:19:43 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:16.421 02:19:43 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:16.421 02:19:43 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:16.421 02:19:43 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:16.421 02:19:43 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:16.421 02:19:43 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:16.421 02:19:43 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:16.421 02:19:43 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:17:16.421 02:19:43 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:16.421 02:19:43 -- target/tls.sh@28 -- # bdevperf_pid=2126285 00:17:16.421 02:19:43 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:16.421 02:19:43 -- target/tls.sh@31 -- # waitforlisten 2126285 /var/tmp/bdevperf.sock 00:17:16.421 02:19:43 -- common/autotest_common.sh@829 -- # '[' -z 2126285 ']' 00:17:16.421 02:19:43 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:16.421 02:19:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:16.421 02:19:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:16.421 02:19:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:16.421 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:16.421 02:19:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:16.421 02:19:43 -- common/autotest_common.sh@10 -- # set +x 00:17:16.421 [2024-12-08 02:19:44.023651] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:16.421 [2024-12-08 02:19:44.023727] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2126285 ] 00:17:16.421 EAL: No free 2048 kB hugepages reported on node 1 00:17:16.421 [2024-12-08 02:19:44.081474] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:16.421 [2024-12-08 02:19:44.188158] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:17.354 02:19:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:17.354 02:19:45 -- common/autotest_common.sh@862 -- # return 0 00:17:17.354 02:19:45 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:17.611 [2024-12-08 02:19:45.331437] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:17.611 [2024-12-08 02:19:45.342159] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:17.611 [2024-12-08 02:19:45.342332] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfe71f0 (107): Transport endpoint is not connected 00:17:17.611 [2024-12-08 02:19:45.343322] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfe71f0 (9): Bad file descriptor 00:17:17.611 [2024-12-08 02:19:45.344321] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:17.611 [2024-12-08 02:19:45.344341] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:17.611 [2024-12-08 02:19:45.344367] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:17.611 request: 00:17:17.611 { 00:17:17.611 "name": "TLSTEST", 00:17:17.611 "trtype": "tcp", 00:17:17.611 "traddr": "10.0.0.2", 00:17:17.611 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:17.611 "adrfam": "ipv4", 00:17:17.611 "trsvcid": "4420", 00:17:17.611 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:17.611 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:17:17.611 "method": "bdev_nvme_attach_controller", 00:17:17.611 "req_id": 1 00:17:17.611 } 00:17:17.611 Got JSON-RPC error response 00:17:17.611 response: 00:17:17.611 { 00:17:17.611 "code": -32602, 00:17:17.611 "message": "Invalid parameters" 00:17:17.611 } 00:17:17.611 02:19:45 -- target/tls.sh@36 -- # killprocess 2126285 00:17:17.611 02:19:45 -- common/autotest_common.sh@936 -- # '[' -z 2126285 ']' 00:17:17.611 02:19:45 -- common/autotest_common.sh@940 -- # kill -0 2126285 00:17:17.611 02:19:45 -- common/autotest_common.sh@941 -- # uname 00:17:17.611 02:19:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:17.611 02:19:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2126285 00:17:17.868 02:19:45 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:17.868 02:19:45 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:17.868 02:19:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2126285' 00:17:17.868 killing process with pid 2126285 00:17:17.868 02:19:45 -- common/autotest_common.sh@955 -- # kill 2126285 00:17:17.868 Received shutdown signal, test time was about 10.000000 seconds 00:17:17.868 00:17:17.868 Latency(us) 00:17:17.868 [2024-12-08T01:19:45.649Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:17.868 [2024-12-08T01:19:45.649Z] =================================================================================================================== 00:17:17.868 [2024-12-08T01:19:45.649Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:17.868 02:19:45 -- common/autotest_common.sh@960 -- # wait 2126285 00:17:18.126 02:19:45 -- target/tls.sh@37 -- # return 1 00:17:18.126 02:19:45 -- common/autotest_common.sh@653 -- # es=1 00:17:18.126 02:19:45 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:18.126 02:19:45 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:18.126 02:19:45 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:18.126 02:19:45 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:18.126 02:19:45 -- common/autotest_common.sh@650 -- # local es=0 00:17:18.126 02:19:45 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:18.126 02:19:45 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:18.126 02:19:45 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:18.126 02:19:45 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:18.126 02:19:45 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:18.126 02:19:45 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:18.126 02:19:45 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:18.126 02:19:45 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:18.126 02:19:45 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:17:18.126 02:19:45 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:18.126 02:19:45 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:18.126 02:19:45 -- target/tls.sh@28 -- # bdevperf_pid=2126555 00:17:18.126 02:19:45 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:18.126 02:19:45 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:18.126 02:19:45 -- target/tls.sh@31 -- # waitforlisten 2126555 /var/tmp/bdevperf.sock 00:17:18.126 02:19:45 -- common/autotest_common.sh@829 -- # '[' -z 2126555 ']' 00:17:18.126 02:19:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:18.126 02:19:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:18.126 02:19:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:18.126 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:18.126 02:19:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:18.126 02:19:45 -- common/autotest_common.sh@10 -- # set +x 00:17:18.126 [2024-12-08 02:19:45.686549] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:18.126 [2024-12-08 02:19:45.686638] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2126555 ] 00:17:18.126 EAL: No free 2048 kB hugepages reported on node 1 00:17:18.126 [2024-12-08 02:19:45.745277] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:18.126 [2024-12-08 02:19:45.852351] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:19.061 02:19:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:19.061 02:19:46 -- common/autotest_common.sh@862 -- # return 0 00:17:19.061 02:19:46 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:19.319 [2024-12-08 02:19:46.915648] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:19.319 [2024-12-08 02:19:46.926183] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:19.319 [2024-12-08 02:19:46.926216] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:19.319 [2024-12-08 02:19:46.926269] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:19.319 [2024-12-08 02:19:46.926384] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdb61f0 (107): Transport endpoint is not connected 00:17:19.319 [2024-12-08 02:19:46.927374] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdb61f0 (9): Bad file descriptor 00:17:19.319 [2024-12-08 02:19:46.928373] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:19.319 [2024-12-08 02:19:46.928393] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:19.319 [2024-12-08 02:19:46.928421] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:19.319 request: 00:17:19.319 { 00:17:19.319 "name": "TLSTEST", 00:17:19.319 "trtype": "tcp", 00:17:19.319 "traddr": "10.0.0.2", 00:17:19.319 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:17:19.319 "adrfam": "ipv4", 00:17:19.319 "trsvcid": "4420", 00:17:19.319 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:19.319 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:19.319 "method": "bdev_nvme_attach_controller", 00:17:19.319 "req_id": 1 00:17:19.319 } 00:17:19.319 Got JSON-RPC error response 00:17:19.319 response: 00:17:19.319 { 00:17:19.319 "code": -32602, 00:17:19.319 "message": "Invalid parameters" 00:17:19.319 } 00:17:19.319 02:19:46 -- target/tls.sh@36 -- # killprocess 2126555 00:17:19.319 02:19:46 -- common/autotest_common.sh@936 -- # '[' -z 2126555 ']' 00:17:19.319 02:19:46 -- common/autotest_common.sh@940 -- # kill -0 2126555 00:17:19.319 02:19:46 -- common/autotest_common.sh@941 -- # uname 00:17:19.319 02:19:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:19.319 02:19:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2126555 00:17:19.319 02:19:46 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:19.319 02:19:46 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:19.319 02:19:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2126555' 00:17:19.319 killing process with pid 2126555 00:17:19.319 02:19:46 -- common/autotest_common.sh@955 -- # kill 2126555 00:17:19.319 Received shutdown signal, test time was about 10.000000 seconds 00:17:19.319 00:17:19.319 Latency(us) 00:17:19.319 [2024-12-08T01:19:47.100Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:19.319 [2024-12-08T01:19:47.100Z] =================================================================================================================== 00:17:19.319 [2024-12-08T01:19:47.100Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:19.319 02:19:46 -- common/autotest_common.sh@960 -- # wait 2126555 00:17:19.578 02:19:47 -- target/tls.sh@37 -- # return 1 00:17:19.578 02:19:47 -- common/autotest_common.sh@653 -- # es=1 00:17:19.578 02:19:47 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:19.578 02:19:47 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:19.578 02:19:47 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:19.578 02:19:47 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:19.578 02:19:47 -- common/autotest_common.sh@650 -- # local es=0 00:17:19.578 02:19:47 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:19.578 02:19:47 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:19.578 02:19:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:19.578 02:19:47 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:19.578 02:19:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:19.578 02:19:47 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:19.578 02:19:47 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:19.578 02:19:47 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:17:19.578 02:19:47 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:19.578 02:19:47 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:19.578 02:19:47 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:19.578 02:19:47 -- target/tls.sh@28 -- # bdevperf_pid=2126709 00:17:19.578 02:19:47 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:19.578 02:19:47 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:19.579 02:19:47 -- target/tls.sh@31 -- # waitforlisten 2126709 /var/tmp/bdevperf.sock 00:17:19.579 02:19:47 -- common/autotest_common.sh@829 -- # '[' -z 2126709 ']' 00:17:19.579 02:19:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:19.579 02:19:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:19.579 02:19:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:19.579 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:19.579 02:19:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:19.579 02:19:47 -- common/autotest_common.sh@10 -- # set +x 00:17:19.579 [2024-12-08 02:19:47.260120] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:19.579 [2024-12-08 02:19:47.260218] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2126709 ] 00:17:19.579 EAL: No free 2048 kB hugepages reported on node 1 00:17:19.579 [2024-12-08 02:19:47.318974] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:19.837 [2024-12-08 02:19:47.421194] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:20.773 02:19:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:20.773 02:19:48 -- common/autotest_common.sh@862 -- # return 0 00:17:20.773 02:19:48 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:20.773 [2024-12-08 02:19:48.494692] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:20.773 [2024-12-08 02:19:48.500218] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:20.773 [2024-12-08 02:19:48.500249] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:20.773 [2024-12-08 02:19:48.500303] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:20.773 [2024-12-08 02:19:48.500462] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1afc1f0 (107): Transport endpoint is not connected 00:17:20.773 [2024-12-08 02:19:48.501449] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1afc1f0 (9): Bad file descriptor 00:17:20.773 [2024-12-08 02:19:48.502447] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:17:20.773 [2024-12-08 02:19:48.502466] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:20.773 [2024-12-08 02:19:48.502494] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:17:20.773 request: 00:17:20.773 { 00:17:20.773 "name": "TLSTEST", 00:17:20.773 "trtype": "tcp", 00:17:20.773 "traddr": "10.0.0.2", 00:17:20.773 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:20.773 "adrfam": "ipv4", 00:17:20.773 "trsvcid": "4420", 00:17:20.773 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:17:20.773 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:20.773 "method": "bdev_nvme_attach_controller", 00:17:20.773 "req_id": 1 00:17:20.773 } 00:17:20.773 Got JSON-RPC error response 00:17:20.773 response: 00:17:20.773 { 00:17:20.773 "code": -32602, 00:17:20.773 "message": "Invalid parameters" 00:17:20.773 } 00:17:20.773 02:19:48 -- target/tls.sh@36 -- # killprocess 2126709 00:17:20.773 02:19:48 -- common/autotest_common.sh@936 -- # '[' -z 2126709 ']' 00:17:20.773 02:19:48 -- common/autotest_common.sh@940 -- # kill -0 2126709 00:17:20.773 02:19:48 -- common/autotest_common.sh@941 -- # uname 00:17:20.773 02:19:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:20.773 02:19:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2126709 00:17:21.032 02:19:48 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:21.032 02:19:48 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:21.032 02:19:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2126709' 00:17:21.032 killing process with pid 2126709 00:17:21.032 02:19:48 -- common/autotest_common.sh@955 -- # kill 2126709 00:17:21.032 Received shutdown signal, test time was about 10.000000 seconds 00:17:21.032 00:17:21.032 Latency(us) 00:17:21.032 [2024-12-08T01:19:48.813Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:21.032 [2024-12-08T01:19:48.813Z] =================================================================================================================== 00:17:21.032 [2024-12-08T01:19:48.813Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:21.032 02:19:48 -- common/autotest_common.sh@960 -- # wait 2126709 00:17:21.032 02:19:48 -- target/tls.sh@37 -- # return 1 00:17:21.032 02:19:48 -- common/autotest_common.sh@653 -- # es=1 00:17:21.032 02:19:48 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:21.032 02:19:48 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:21.032 02:19:48 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:21.032 02:19:48 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:21.032 02:19:48 -- common/autotest_common.sh@650 -- # local es=0 00:17:21.032 02:19:48 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:21.032 02:19:48 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:21.032 02:19:48 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:21.032 02:19:48 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:21.032 02:19:48 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:21.032 02:19:48 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:21.032 02:19:48 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:21.032 02:19:48 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:21.032 02:19:48 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:21.032 02:19:48 -- target/tls.sh@23 -- # psk= 00:17:21.032 02:19:48 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:21.032 02:19:48 -- target/tls.sh@28 -- # bdevperf_pid=2126942 00:17:21.032 02:19:48 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:21.032 02:19:48 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:21.032 02:19:48 -- target/tls.sh@31 -- # waitforlisten 2126942 /var/tmp/bdevperf.sock 00:17:21.032 02:19:48 -- common/autotest_common.sh@829 -- # '[' -z 2126942 ']' 00:17:21.032 02:19:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:21.032 02:19:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:21.032 02:19:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:21.032 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:21.032 02:19:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:21.032 02:19:48 -- common/autotest_common.sh@10 -- # set +x 00:17:21.292 [2024-12-08 02:19:48.830069] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:21.292 [2024-12-08 02:19:48.830147] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2126942 ] 00:17:21.292 EAL: No free 2048 kB hugepages reported on node 1 00:17:21.292 [2024-12-08 02:19:48.889721] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:21.292 [2024-12-08 02:19:48.997146] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:22.226 02:19:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:22.226 02:19:49 -- common/autotest_common.sh@862 -- # return 0 00:17:22.226 02:19:49 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:17:22.484 [2024-12-08 02:19:50.125143] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:22.484 [2024-12-08 02:19:50.127058] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e30050 (9): Bad file descriptor 00:17:22.484 [2024-12-08 02:19:50.128054] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:22.484 [2024-12-08 02:19:50.128073] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:22.484 [2024-12-08 02:19:50.128109] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:22.484 request: 00:17:22.484 { 00:17:22.484 "name": "TLSTEST", 00:17:22.484 "trtype": "tcp", 00:17:22.484 "traddr": "10.0.0.2", 00:17:22.484 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:22.484 "adrfam": "ipv4", 00:17:22.484 "trsvcid": "4420", 00:17:22.484 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:22.484 "method": "bdev_nvme_attach_controller", 00:17:22.484 "req_id": 1 00:17:22.484 } 00:17:22.484 Got JSON-RPC error response 00:17:22.484 response: 00:17:22.484 { 00:17:22.484 "code": -32602, 00:17:22.484 "message": "Invalid parameters" 00:17:22.484 } 00:17:22.484 02:19:50 -- target/tls.sh@36 -- # killprocess 2126942 00:17:22.484 02:19:50 -- common/autotest_common.sh@936 -- # '[' -z 2126942 ']' 00:17:22.484 02:19:50 -- common/autotest_common.sh@940 -- # kill -0 2126942 00:17:22.484 02:19:50 -- common/autotest_common.sh@941 -- # uname 00:17:22.484 02:19:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:22.484 02:19:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2126942 00:17:22.484 02:19:50 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:22.484 02:19:50 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:22.484 02:19:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2126942' 00:17:22.484 killing process with pid 2126942 00:17:22.484 02:19:50 -- common/autotest_common.sh@955 -- # kill 2126942 00:17:22.484 Received shutdown signal, test time was about 10.000000 seconds 00:17:22.484 00:17:22.484 Latency(us) 00:17:22.484 [2024-12-08T01:19:50.265Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:22.484 [2024-12-08T01:19:50.265Z] =================================================================================================================== 00:17:22.484 [2024-12-08T01:19:50.265Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:22.484 02:19:50 -- common/autotest_common.sh@960 -- # wait 2126942 00:17:22.742 02:19:50 -- target/tls.sh@37 -- # return 1 00:17:22.742 02:19:50 -- common/autotest_common.sh@653 -- # es=1 00:17:22.742 02:19:50 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:22.742 02:19:50 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:22.742 02:19:50 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:22.742 02:19:50 -- target/tls.sh@167 -- # killprocess 2122946 00:17:22.742 02:19:50 -- common/autotest_common.sh@936 -- # '[' -z 2122946 ']' 00:17:22.742 02:19:50 -- common/autotest_common.sh@940 -- # kill -0 2122946 00:17:22.742 02:19:50 -- common/autotest_common.sh@941 -- # uname 00:17:22.742 02:19:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:22.742 02:19:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2122946 00:17:22.742 02:19:50 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:22.742 02:19:50 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:22.742 02:19:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2122946' 00:17:22.742 killing process with pid 2122946 00:17:22.742 02:19:50 -- common/autotest_common.sh@955 -- # kill 2122946 00:17:22.742 02:19:50 -- common/autotest_common.sh@960 -- # wait 2122946 00:17:23.001 02:19:50 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:17:23.001 02:19:50 -- target/tls.sh@49 -- # local key hash crc 00:17:23.001 02:19:50 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:17:23.001 02:19:50 -- target/tls.sh@51 -- # hash=02 00:17:23.001 02:19:50 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:17:23.001 02:19:50 -- target/tls.sh@52 -- # gzip -1 -c 00:17:23.001 02:19:50 -- target/tls.sh@52 -- # tail -c8 00:17:23.001 02:19:50 -- target/tls.sh@52 -- # head -c 4 00:17:23.001 02:19:50 -- target/tls.sh@52 -- # crc='�e�'\''' 00:17:23.001 02:19:50 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:23.001 02:19:50 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:17:23.001 02:19:50 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:23.001 02:19:50 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:23.001 02:19:50 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:23.001 02:19:50 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:23.001 02:19:50 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:23.001 02:19:50 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:17:23.001 02:19:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:23.001 02:19:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:23.001 02:19:50 -- common/autotest_common.sh@10 -- # set +x 00:17:23.001 02:19:50 -- nvmf/common.sh@469 -- # nvmfpid=2127150 00:17:23.001 02:19:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:23.001 02:19:50 -- nvmf/common.sh@470 -- # waitforlisten 2127150 00:17:23.001 02:19:50 -- common/autotest_common.sh@829 -- # '[' -z 2127150 ']' 00:17:23.001 02:19:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:23.001 02:19:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:23.001 02:19:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:23.001 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:23.001 02:19:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:23.001 02:19:50 -- common/autotest_common.sh@10 -- # set +x 00:17:23.260 [2024-12-08 02:19:50.805565] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:23.260 [2024-12-08 02:19:50.805665] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:23.260 EAL: No free 2048 kB hugepages reported on node 1 00:17:23.260 [2024-12-08 02:19:50.870973] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:23.260 [2024-12-08 02:19:50.981317] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:23.260 [2024-12-08 02:19:50.981462] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:23.260 [2024-12-08 02:19:50.981479] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:23.260 [2024-12-08 02:19:50.981491] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:23.260 [2024-12-08 02:19:50.981550] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:24.196 02:19:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:24.196 02:19:51 -- common/autotest_common.sh@862 -- # return 0 00:17:24.196 02:19:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:24.196 02:19:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:24.196 02:19:51 -- common/autotest_common.sh@10 -- # set +x 00:17:24.196 02:19:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:24.196 02:19:51 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:24.196 02:19:51 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:24.196 02:19:51 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:24.455 [2024-12-08 02:19:52.032886] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:24.455 02:19:52 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:24.713 02:19:52 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:24.971 [2024-12-08 02:19:52.542246] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:24.971 [2024-12-08 02:19:52.542498] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:24.971 02:19:52 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:25.230 malloc0 00:17:25.230 02:19:52 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:25.488 02:19:53 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:25.746 02:19:53 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:25.746 02:19:53 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:25.746 02:19:53 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:25.746 02:19:53 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:25.746 02:19:53 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:17:25.747 02:19:53 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:25.747 02:19:53 -- target/tls.sh@28 -- # bdevperf_pid=2127554 00:17:25.747 02:19:53 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:25.747 02:19:53 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:25.747 02:19:53 -- target/tls.sh@31 -- # waitforlisten 2127554 /var/tmp/bdevperf.sock 00:17:25.747 02:19:53 -- common/autotest_common.sh@829 -- # '[' -z 2127554 ']' 00:17:25.747 02:19:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:25.747 02:19:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:25.747 02:19:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:25.747 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:25.747 02:19:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:25.747 02:19:53 -- common/autotest_common.sh@10 -- # set +x 00:17:25.747 [2024-12-08 02:19:53.376031] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:25.747 [2024-12-08 02:19:53.376118] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2127554 ] 00:17:25.747 EAL: No free 2048 kB hugepages reported on node 1 00:17:25.747 [2024-12-08 02:19:53.433130] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:26.006 [2024-12-08 02:19:53.538530] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:26.942 02:19:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:26.942 02:19:54 -- common/autotest_common.sh@862 -- # return 0 00:17:26.942 02:19:54 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:26.942 [2024-12-08 02:19:54.621034] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:26.942 TLSTESTn1 00:17:26.942 02:19:54 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:27.200 Running I/O for 10 seconds... 00:17:37.165 00:17:37.165 Latency(us) 00:17:37.165 [2024-12-08T01:20:04.946Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:37.165 [2024-12-08T01:20:04.946Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:37.165 Verification LBA range: start 0x0 length 0x2000 00:17:37.165 TLSTESTn1 : 10.02 3998.45 15.62 0.00 0.00 31968.07 6140.97 40389.59 00:17:37.165 [2024-12-08T01:20:04.946Z] =================================================================================================================== 00:17:37.165 [2024-12-08T01:20:04.946Z] Total : 3998.45 15.62 0.00 0.00 31968.07 6140.97 40389.59 00:17:37.165 0 00:17:37.165 02:20:04 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:37.165 02:20:04 -- target/tls.sh@45 -- # killprocess 2127554 00:17:37.165 02:20:04 -- common/autotest_common.sh@936 -- # '[' -z 2127554 ']' 00:17:37.165 02:20:04 -- common/autotest_common.sh@940 -- # kill -0 2127554 00:17:37.165 02:20:04 -- common/autotest_common.sh@941 -- # uname 00:17:37.165 02:20:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:37.165 02:20:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2127554 00:17:37.165 02:20:04 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:37.165 02:20:04 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:37.165 02:20:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2127554' 00:17:37.165 killing process with pid 2127554 00:17:37.165 02:20:04 -- common/autotest_common.sh@955 -- # kill 2127554 00:17:37.165 Received shutdown signal, test time was about 10.000000 seconds 00:17:37.165 00:17:37.165 Latency(us) 00:17:37.165 [2024-12-08T01:20:04.946Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:37.165 [2024-12-08T01:20:04.946Z] =================================================================================================================== 00:17:37.165 [2024-12-08T01:20:04.946Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:37.165 02:20:04 -- common/autotest_common.sh@960 -- # wait 2127554 00:17:37.423 02:20:05 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:37.423 02:20:05 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:37.423 02:20:05 -- common/autotest_common.sh@650 -- # local es=0 00:17:37.423 02:20:05 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:37.423 02:20:05 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:37.423 02:20:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:37.423 02:20:05 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:37.423 02:20:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:37.423 02:20:05 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:37.423 02:20:05 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:37.423 02:20:05 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:37.423 02:20:05 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:37.423 02:20:05 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:17:37.423 02:20:05 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:37.423 02:20:05 -- target/tls.sh@28 -- # bdevperf_pid=2128946 00:17:37.423 02:20:05 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:37.423 02:20:05 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:37.423 02:20:05 -- target/tls.sh@31 -- # waitforlisten 2128946 /var/tmp/bdevperf.sock 00:17:37.423 02:20:05 -- common/autotest_common.sh@829 -- # '[' -z 2128946 ']' 00:17:37.423 02:20:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:37.423 02:20:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:37.423 02:20:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:37.423 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:37.423 02:20:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:37.423 02:20:05 -- common/autotest_common.sh@10 -- # set +x 00:17:37.681 [2024-12-08 02:20:05.211747] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:37.681 [2024-12-08 02:20:05.211831] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2128946 ] 00:17:37.681 EAL: No free 2048 kB hugepages reported on node 1 00:17:37.681 [2024-12-08 02:20:05.267616] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:37.681 [2024-12-08 02:20:05.371257] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:38.614 02:20:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:38.614 02:20:06 -- common/autotest_common.sh@862 -- # return 0 00:17:38.614 02:20:06 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:38.872 [2024-12-08 02:20:06.502037] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:38.872 [2024-12-08 02:20:06.502097] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:17:38.872 request: 00:17:38.872 { 00:17:38.873 "name": "TLSTEST", 00:17:38.873 "trtype": "tcp", 00:17:38.873 "traddr": "10.0.0.2", 00:17:38.873 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:38.873 "adrfam": "ipv4", 00:17:38.873 "trsvcid": "4420", 00:17:38.873 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:38.873 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:17:38.873 "method": "bdev_nvme_attach_controller", 00:17:38.873 "req_id": 1 00:17:38.873 } 00:17:38.873 Got JSON-RPC error response 00:17:38.873 response: 00:17:38.873 { 00:17:38.873 "code": -22, 00:17:38.873 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:17:38.873 } 00:17:38.873 02:20:06 -- target/tls.sh@36 -- # killprocess 2128946 00:17:38.873 02:20:06 -- common/autotest_common.sh@936 -- # '[' -z 2128946 ']' 00:17:38.873 02:20:06 -- common/autotest_common.sh@940 -- # kill -0 2128946 00:17:38.873 02:20:06 -- common/autotest_common.sh@941 -- # uname 00:17:38.873 02:20:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:38.873 02:20:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2128946 00:17:38.873 02:20:06 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:38.873 02:20:06 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:38.873 02:20:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2128946' 00:17:38.873 killing process with pid 2128946 00:17:38.873 02:20:06 -- common/autotest_common.sh@955 -- # kill 2128946 00:17:38.873 Received shutdown signal, test time was about 10.000000 seconds 00:17:38.873 00:17:38.873 Latency(us) 00:17:38.873 [2024-12-08T01:20:06.654Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:38.873 [2024-12-08T01:20:06.654Z] =================================================================================================================== 00:17:38.873 [2024-12-08T01:20:06.654Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:38.873 02:20:06 -- common/autotest_common.sh@960 -- # wait 2128946 00:17:39.131 02:20:06 -- target/tls.sh@37 -- # return 1 00:17:39.131 02:20:06 -- common/autotest_common.sh@653 -- # es=1 00:17:39.131 02:20:06 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:39.131 02:20:06 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:39.131 02:20:06 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:39.131 02:20:06 -- target/tls.sh@183 -- # killprocess 2127150 00:17:39.131 02:20:06 -- common/autotest_common.sh@936 -- # '[' -z 2127150 ']' 00:17:39.131 02:20:06 -- common/autotest_common.sh@940 -- # kill -0 2127150 00:17:39.131 02:20:06 -- common/autotest_common.sh@941 -- # uname 00:17:39.131 02:20:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:39.131 02:20:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2127150 00:17:39.131 02:20:06 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:39.131 02:20:06 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:39.131 02:20:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2127150' 00:17:39.131 killing process with pid 2127150 00:17:39.131 02:20:06 -- common/autotest_common.sh@955 -- # kill 2127150 00:17:39.131 02:20:06 -- common/autotest_common.sh@960 -- # wait 2127150 00:17:39.390 02:20:07 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:17:39.390 02:20:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:39.390 02:20:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:39.390 02:20:07 -- common/autotest_common.sh@10 -- # set +x 00:17:39.390 02:20:07 -- nvmf/common.sh@469 -- # nvmfpid=2129218 00:17:39.390 02:20:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:39.390 02:20:07 -- nvmf/common.sh@470 -- # waitforlisten 2129218 00:17:39.390 02:20:07 -- common/autotest_common.sh@829 -- # '[' -z 2129218 ']' 00:17:39.390 02:20:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:39.390 02:20:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:39.390 02:20:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:39.390 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:39.390 02:20:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:39.390 02:20:07 -- common/autotest_common.sh@10 -- # set +x 00:17:39.649 [2024-12-08 02:20:07.202341] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:39.649 [2024-12-08 02:20:07.202422] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:39.649 EAL: No free 2048 kB hugepages reported on node 1 00:17:39.649 [2024-12-08 02:20:07.274171] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:39.649 [2024-12-08 02:20:07.382057] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:39.649 [2024-12-08 02:20:07.382212] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:39.649 [2024-12-08 02:20:07.382230] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:39.649 [2024-12-08 02:20:07.382244] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:39.649 [2024-12-08 02:20:07.382269] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:40.584 02:20:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:40.584 02:20:08 -- common/autotest_common.sh@862 -- # return 0 00:17:40.584 02:20:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:40.584 02:20:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:40.584 02:20:08 -- common/autotest_common.sh@10 -- # set +x 00:17:40.584 02:20:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:40.584 02:20:08 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:40.584 02:20:08 -- common/autotest_common.sh@650 -- # local es=0 00:17:40.584 02:20:08 -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:40.584 02:20:08 -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:17:40.584 02:20:08 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:40.584 02:20:08 -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:17:40.584 02:20:08 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:40.584 02:20:08 -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:40.584 02:20:08 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:40.584 02:20:08 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:40.843 [2024-12-08 02:20:08.494307] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:40.843 02:20:08 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:41.101 02:20:08 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:41.359 [2024-12-08 02:20:09.003716] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:41.359 [2024-12-08 02:20:09.004000] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:41.359 02:20:09 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:41.618 malloc0 00:17:41.618 02:20:09 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:41.876 02:20:09 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:42.135 [2024-12-08 02:20:09.909907] tcp.c:3551:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:17:42.135 [2024-12-08 02:20:09.909952] tcp.c:3620:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:17:42.135 [2024-12-08 02:20:09.909977] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:17:42.135 request: 00:17:42.135 { 00:17:42.135 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:42.135 "host": "nqn.2016-06.io.spdk:host1", 00:17:42.135 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:17:42.135 "method": "nvmf_subsystem_add_host", 00:17:42.135 "req_id": 1 00:17:42.135 } 00:17:42.135 Got JSON-RPC error response 00:17:42.135 response: 00:17:42.135 { 00:17:42.135 "code": -32603, 00:17:42.135 "message": "Internal error" 00:17:42.135 } 00:17:42.394 02:20:09 -- common/autotest_common.sh@653 -- # es=1 00:17:42.394 02:20:09 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:42.394 02:20:09 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:42.394 02:20:09 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:42.394 02:20:09 -- target/tls.sh@189 -- # killprocess 2129218 00:17:42.394 02:20:09 -- common/autotest_common.sh@936 -- # '[' -z 2129218 ']' 00:17:42.394 02:20:09 -- common/autotest_common.sh@940 -- # kill -0 2129218 00:17:42.394 02:20:09 -- common/autotest_common.sh@941 -- # uname 00:17:42.394 02:20:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:42.394 02:20:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2129218 00:17:42.394 02:20:09 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:42.394 02:20:09 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:42.394 02:20:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2129218' 00:17:42.394 killing process with pid 2129218 00:17:42.394 02:20:09 -- common/autotest_common.sh@955 -- # kill 2129218 00:17:42.394 02:20:09 -- common/autotest_common.sh@960 -- # wait 2129218 00:17:42.697 02:20:10 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:42.697 02:20:10 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:17:42.697 02:20:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:42.697 02:20:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:42.697 02:20:10 -- common/autotest_common.sh@10 -- # set +x 00:17:42.697 02:20:10 -- nvmf/common.sh@469 -- # nvmfpid=2129567 00:17:42.697 02:20:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:42.697 02:20:10 -- nvmf/common.sh@470 -- # waitforlisten 2129567 00:17:42.697 02:20:10 -- common/autotest_common.sh@829 -- # '[' -z 2129567 ']' 00:17:42.697 02:20:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:42.697 02:20:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:42.697 02:20:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:42.697 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:42.697 02:20:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:42.697 02:20:10 -- common/autotest_common.sh@10 -- # set +x 00:17:42.697 [2024-12-08 02:20:10.321344] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:42.697 [2024-12-08 02:20:10.321422] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:42.697 EAL: No free 2048 kB hugepages reported on node 1 00:17:42.697 [2024-12-08 02:20:10.392332] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:43.004 [2024-12-08 02:20:10.508814] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:43.004 [2024-12-08 02:20:10.508972] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:43.004 [2024-12-08 02:20:10.508998] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:43.004 [2024-12-08 02:20:10.509011] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:43.004 [2024-12-08 02:20:10.509039] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:43.575 02:20:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:43.575 02:20:11 -- common/autotest_common.sh@862 -- # return 0 00:17:43.575 02:20:11 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:43.575 02:20:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:43.575 02:20:11 -- common/autotest_common.sh@10 -- # set +x 00:17:43.575 02:20:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:43.576 02:20:11 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:43.576 02:20:11 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:43.576 02:20:11 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:44.139 [2024-12-08 02:20:11.630202] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:44.139 02:20:11 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:44.396 02:20:11 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:44.653 [2024-12-08 02:20:12.187697] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:44.653 [2024-12-08 02:20:12.187933] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:44.653 02:20:12 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:44.912 malloc0 00:17:44.912 02:20:12 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:45.170 02:20:12 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:45.429 02:20:12 -- target/tls.sh@197 -- # bdevperf_pid=2129965 00:17:45.429 02:20:12 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:45.429 02:20:12 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:45.429 02:20:12 -- target/tls.sh@200 -- # waitforlisten 2129965 /var/tmp/bdevperf.sock 00:17:45.429 02:20:12 -- common/autotest_common.sh@829 -- # '[' -z 2129965 ']' 00:17:45.429 02:20:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:45.429 02:20:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:45.429 02:20:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:45.429 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:45.429 02:20:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:45.429 02:20:12 -- common/autotest_common.sh@10 -- # set +x 00:17:45.429 [2024-12-08 02:20:12.995647] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:45.429 [2024-12-08 02:20:12.995721] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2129965 ] 00:17:45.429 EAL: No free 2048 kB hugepages reported on node 1 00:17:45.429 [2024-12-08 02:20:13.057754] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:45.429 [2024-12-08 02:20:13.175756] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:46.363 02:20:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:46.363 02:20:13 -- common/autotest_common.sh@862 -- # return 0 00:17:46.363 02:20:13 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:46.621 [2024-12-08 02:20:14.179532] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:46.621 TLSTESTn1 00:17:46.621 02:20:14 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:17:46.878 02:20:14 -- target/tls.sh@205 -- # tgtconf='{ 00:17:46.878 "subsystems": [ 00:17:46.878 { 00:17:46.878 "subsystem": "iobuf", 00:17:46.878 "config": [ 00:17:46.878 { 00:17:46.878 "method": "iobuf_set_options", 00:17:46.878 "params": { 00:17:46.878 "small_pool_count": 8192, 00:17:46.878 "large_pool_count": 1024, 00:17:46.878 "small_bufsize": 8192, 00:17:46.878 "large_bufsize": 135168 00:17:46.878 } 00:17:46.878 } 00:17:46.878 ] 00:17:46.878 }, 00:17:46.878 { 00:17:46.878 "subsystem": "sock", 00:17:46.878 "config": [ 00:17:46.878 { 00:17:46.878 "method": "sock_impl_set_options", 00:17:46.878 "params": { 00:17:46.878 "impl_name": "posix", 00:17:46.878 "recv_buf_size": 2097152, 00:17:46.878 "send_buf_size": 2097152, 00:17:46.879 "enable_recv_pipe": true, 00:17:46.879 "enable_quickack": false, 00:17:46.879 "enable_placement_id": 0, 00:17:46.879 "enable_zerocopy_send_server": true, 00:17:46.879 "enable_zerocopy_send_client": false, 00:17:46.879 "zerocopy_threshold": 0, 00:17:46.879 "tls_version": 0, 00:17:46.879 "enable_ktls": false 00:17:46.879 } 00:17:46.879 }, 00:17:46.879 { 00:17:46.879 "method": "sock_impl_set_options", 00:17:46.879 "params": { 00:17:46.879 "impl_name": "ssl", 00:17:46.879 "recv_buf_size": 4096, 00:17:46.879 "send_buf_size": 4096, 00:17:46.879 "enable_recv_pipe": true, 00:17:46.879 "enable_quickack": false, 00:17:46.879 "enable_placement_id": 0, 00:17:46.879 "enable_zerocopy_send_server": true, 00:17:46.879 "enable_zerocopy_send_client": false, 00:17:46.879 "zerocopy_threshold": 0, 00:17:46.879 "tls_version": 0, 00:17:46.879 "enable_ktls": false 00:17:46.879 } 00:17:46.879 } 00:17:46.879 ] 00:17:46.879 }, 00:17:46.879 { 00:17:46.879 "subsystem": "vmd", 00:17:46.879 "config": [] 00:17:46.879 }, 00:17:46.879 { 00:17:46.879 "subsystem": "accel", 00:17:46.879 "config": [ 00:17:46.879 { 00:17:46.879 "method": "accel_set_options", 00:17:46.879 "params": { 00:17:46.879 "small_cache_size": 128, 00:17:46.879 "large_cache_size": 16, 00:17:46.879 "task_count": 2048, 00:17:46.879 "sequence_count": 2048, 00:17:46.879 "buf_count": 2048 00:17:46.879 } 00:17:46.879 } 00:17:46.879 ] 00:17:46.879 }, 00:17:46.879 { 00:17:46.879 "subsystem": "bdev", 00:17:46.879 "config": [ 00:17:46.879 { 00:17:46.879 "method": "bdev_set_options", 00:17:46.879 "params": { 00:17:46.879 "bdev_io_pool_size": 65535, 00:17:46.879 "bdev_io_cache_size": 256, 00:17:46.879 "bdev_auto_examine": true, 00:17:46.879 "iobuf_small_cache_size": 128, 00:17:46.879 "iobuf_large_cache_size": 16 00:17:46.879 } 00:17:46.879 }, 00:17:46.879 { 00:17:46.879 "method": "bdev_raid_set_options", 00:17:46.879 "params": { 00:17:46.879 "process_window_size_kb": 1024 00:17:46.879 } 00:17:46.879 }, 00:17:46.879 { 00:17:46.879 "method": "bdev_iscsi_set_options", 00:17:46.879 "params": { 00:17:46.879 "timeout_sec": 30 00:17:46.879 } 00:17:46.879 }, 00:17:46.879 { 00:17:46.879 "method": "bdev_nvme_set_options", 00:17:46.879 "params": { 00:17:46.879 "action_on_timeout": "none", 00:17:46.879 "timeout_us": 0, 00:17:46.879 "timeout_admin_us": 0, 00:17:46.879 "keep_alive_timeout_ms": 10000, 00:17:46.879 "transport_retry_count": 4, 00:17:46.879 "arbitration_burst": 0, 00:17:46.879 "low_priority_weight": 0, 00:17:46.879 "medium_priority_weight": 0, 00:17:46.879 "high_priority_weight": 0, 00:17:46.879 "nvme_adminq_poll_period_us": 10000, 00:17:46.879 "nvme_ioq_poll_period_us": 0, 00:17:46.879 "io_queue_requests": 0, 00:17:46.879 "delay_cmd_submit": true, 00:17:46.879 "bdev_retry_count": 3, 00:17:46.879 "transport_ack_timeout": 0, 00:17:46.879 "ctrlr_loss_timeout_sec": 0, 00:17:46.879 "reconnect_delay_sec": 0, 00:17:46.879 "fast_io_fail_timeout_sec": 0, 00:17:46.879 "generate_uuids": false, 00:17:46.879 "transport_tos": 0, 00:17:46.879 "io_path_stat": false, 00:17:46.879 "allow_accel_sequence": false 00:17:46.879 } 00:17:46.879 }, 00:17:46.879 { 00:17:46.879 "method": "bdev_nvme_set_hotplug", 00:17:46.879 "params": { 00:17:46.879 "period_us": 100000, 00:17:46.879 "enable": false 00:17:46.879 } 00:17:46.879 }, 00:17:46.879 { 00:17:46.879 "method": "bdev_malloc_create", 00:17:46.879 "params": { 00:17:46.879 "name": "malloc0", 00:17:46.879 "num_blocks": 8192, 00:17:46.879 "block_size": 4096, 00:17:46.879 "physical_block_size": 4096, 00:17:46.879 "uuid": "b0a16204-0a34-4005-af86-e96a23ec8ef6", 00:17:46.879 "optimal_io_boundary": 0 00:17:46.879 } 00:17:46.879 }, 00:17:46.879 { 00:17:46.879 "method": "bdev_wait_for_examine" 00:17:46.879 } 00:17:46.879 ] 00:17:46.879 }, 00:17:46.879 { 00:17:46.879 "subsystem": "nbd", 00:17:46.879 "config": [] 00:17:46.879 }, 00:17:46.879 { 00:17:46.879 "subsystem": "scheduler", 00:17:46.879 "config": [ 00:17:46.879 { 00:17:46.879 "method": "framework_set_scheduler", 00:17:46.879 "params": { 00:17:46.879 "name": "static" 00:17:46.879 } 00:17:46.879 } 00:17:46.879 ] 00:17:46.879 }, 00:17:46.879 { 00:17:46.879 "subsystem": "nvmf", 00:17:46.879 "config": [ 00:17:46.879 { 00:17:46.879 "method": "nvmf_set_config", 00:17:46.879 "params": { 00:17:46.879 "discovery_filter": "match_any", 00:17:46.879 "admin_cmd_passthru": { 00:17:46.879 "identify_ctrlr": false 00:17:46.879 } 00:17:46.879 } 00:17:46.879 }, 00:17:46.879 { 00:17:46.879 "method": "nvmf_set_max_subsystems", 00:17:46.879 "params": { 00:17:46.879 "max_subsystems": 1024 00:17:46.879 } 00:17:46.879 }, 00:17:46.879 { 00:17:46.879 "method": "nvmf_set_crdt", 00:17:46.879 "params": { 00:17:46.879 "crdt1": 0, 00:17:46.879 "crdt2": 0, 00:17:46.879 "crdt3": 0 00:17:46.879 } 00:17:46.879 }, 00:17:46.879 { 00:17:46.879 "method": "nvmf_create_transport", 00:17:46.879 "params": { 00:17:46.879 "trtype": "TCP", 00:17:46.879 "max_queue_depth": 128, 00:17:46.879 "max_io_qpairs_per_ctrlr": 127, 00:17:46.879 "in_capsule_data_size": 4096, 00:17:46.879 "max_io_size": 131072, 00:17:46.879 "io_unit_size": 131072, 00:17:46.879 "max_aq_depth": 128, 00:17:46.879 "num_shared_buffers": 511, 00:17:46.879 "buf_cache_size": 4294967295, 00:17:46.879 "dif_insert_or_strip": false, 00:17:46.879 "zcopy": false, 00:17:46.879 "c2h_success": false, 00:17:46.879 "sock_priority": 0, 00:17:46.879 "abort_timeout_sec": 1 00:17:46.879 } 00:17:46.879 }, 00:17:46.879 { 00:17:46.879 "method": "nvmf_create_subsystem", 00:17:46.879 "params": { 00:17:46.879 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:46.879 "allow_any_host": false, 00:17:46.879 "serial_number": "SPDK00000000000001", 00:17:46.879 "model_number": "SPDK bdev Controller", 00:17:46.879 "max_namespaces": 10, 00:17:46.879 "min_cntlid": 1, 00:17:46.879 "max_cntlid": 65519, 00:17:46.879 "ana_reporting": false 00:17:46.879 } 00:17:46.879 }, 00:17:46.879 { 00:17:46.879 "method": "nvmf_subsystem_add_host", 00:17:46.879 "params": { 00:17:46.879 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:46.879 "host": "nqn.2016-06.io.spdk:host1", 00:17:46.879 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:17:46.879 } 00:17:46.879 }, 00:17:46.879 { 00:17:46.879 "method": "nvmf_subsystem_add_ns", 00:17:46.879 "params": { 00:17:46.879 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:46.879 "namespace": { 00:17:46.879 "nsid": 1, 00:17:46.879 "bdev_name": "malloc0", 00:17:46.879 "nguid": "B0A162040A344005AF86E96A23EC8EF6", 00:17:46.879 "uuid": "b0a16204-0a34-4005-af86-e96a23ec8ef6" 00:17:46.879 } 00:17:46.879 } 00:17:46.879 }, 00:17:46.879 { 00:17:46.879 "method": "nvmf_subsystem_add_listener", 00:17:46.879 "params": { 00:17:46.879 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:46.879 "listen_address": { 00:17:46.879 "trtype": "TCP", 00:17:46.879 "adrfam": "IPv4", 00:17:46.879 "traddr": "10.0.0.2", 00:17:46.879 "trsvcid": "4420" 00:17:46.879 }, 00:17:46.879 "secure_channel": true 00:17:46.879 } 00:17:46.879 } 00:17:46.879 ] 00:17:46.879 } 00:17:46.879 ] 00:17:46.879 }' 00:17:46.880 02:20:14 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:17:47.137 02:20:14 -- target/tls.sh@206 -- # bdevperfconf='{ 00:17:47.137 "subsystems": [ 00:17:47.137 { 00:17:47.137 "subsystem": "iobuf", 00:17:47.137 "config": [ 00:17:47.137 { 00:17:47.137 "method": "iobuf_set_options", 00:17:47.137 "params": { 00:17:47.137 "small_pool_count": 8192, 00:17:47.137 "large_pool_count": 1024, 00:17:47.137 "small_bufsize": 8192, 00:17:47.137 "large_bufsize": 135168 00:17:47.137 } 00:17:47.137 } 00:17:47.137 ] 00:17:47.137 }, 00:17:47.137 { 00:17:47.137 "subsystem": "sock", 00:17:47.137 "config": [ 00:17:47.137 { 00:17:47.137 "method": "sock_impl_set_options", 00:17:47.137 "params": { 00:17:47.137 "impl_name": "posix", 00:17:47.137 "recv_buf_size": 2097152, 00:17:47.137 "send_buf_size": 2097152, 00:17:47.137 "enable_recv_pipe": true, 00:17:47.137 "enable_quickack": false, 00:17:47.137 "enable_placement_id": 0, 00:17:47.137 "enable_zerocopy_send_server": true, 00:17:47.137 "enable_zerocopy_send_client": false, 00:17:47.137 "zerocopy_threshold": 0, 00:17:47.137 "tls_version": 0, 00:17:47.137 "enable_ktls": false 00:17:47.137 } 00:17:47.137 }, 00:17:47.137 { 00:17:47.137 "method": "sock_impl_set_options", 00:17:47.137 "params": { 00:17:47.137 "impl_name": "ssl", 00:17:47.137 "recv_buf_size": 4096, 00:17:47.137 "send_buf_size": 4096, 00:17:47.137 "enable_recv_pipe": true, 00:17:47.137 "enable_quickack": false, 00:17:47.137 "enable_placement_id": 0, 00:17:47.137 "enable_zerocopy_send_server": true, 00:17:47.137 "enable_zerocopy_send_client": false, 00:17:47.137 "zerocopy_threshold": 0, 00:17:47.138 "tls_version": 0, 00:17:47.138 "enable_ktls": false 00:17:47.138 } 00:17:47.138 } 00:17:47.138 ] 00:17:47.138 }, 00:17:47.138 { 00:17:47.138 "subsystem": "vmd", 00:17:47.138 "config": [] 00:17:47.138 }, 00:17:47.138 { 00:17:47.138 "subsystem": "accel", 00:17:47.138 "config": [ 00:17:47.138 { 00:17:47.138 "method": "accel_set_options", 00:17:47.138 "params": { 00:17:47.138 "small_cache_size": 128, 00:17:47.138 "large_cache_size": 16, 00:17:47.138 "task_count": 2048, 00:17:47.138 "sequence_count": 2048, 00:17:47.138 "buf_count": 2048 00:17:47.138 } 00:17:47.138 } 00:17:47.138 ] 00:17:47.138 }, 00:17:47.138 { 00:17:47.138 "subsystem": "bdev", 00:17:47.138 "config": [ 00:17:47.138 { 00:17:47.138 "method": "bdev_set_options", 00:17:47.138 "params": { 00:17:47.138 "bdev_io_pool_size": 65535, 00:17:47.138 "bdev_io_cache_size": 256, 00:17:47.138 "bdev_auto_examine": true, 00:17:47.138 "iobuf_small_cache_size": 128, 00:17:47.138 "iobuf_large_cache_size": 16 00:17:47.138 } 00:17:47.138 }, 00:17:47.138 { 00:17:47.138 "method": "bdev_raid_set_options", 00:17:47.138 "params": { 00:17:47.138 "process_window_size_kb": 1024 00:17:47.138 } 00:17:47.138 }, 00:17:47.138 { 00:17:47.138 "method": "bdev_iscsi_set_options", 00:17:47.138 "params": { 00:17:47.138 "timeout_sec": 30 00:17:47.138 } 00:17:47.138 }, 00:17:47.138 { 00:17:47.138 "method": "bdev_nvme_set_options", 00:17:47.138 "params": { 00:17:47.138 "action_on_timeout": "none", 00:17:47.138 "timeout_us": 0, 00:17:47.138 "timeout_admin_us": 0, 00:17:47.138 "keep_alive_timeout_ms": 10000, 00:17:47.138 "transport_retry_count": 4, 00:17:47.138 "arbitration_burst": 0, 00:17:47.138 "low_priority_weight": 0, 00:17:47.138 "medium_priority_weight": 0, 00:17:47.138 "high_priority_weight": 0, 00:17:47.138 "nvme_adminq_poll_period_us": 10000, 00:17:47.138 "nvme_ioq_poll_period_us": 0, 00:17:47.138 "io_queue_requests": 512, 00:17:47.138 "delay_cmd_submit": true, 00:17:47.138 "bdev_retry_count": 3, 00:17:47.138 "transport_ack_timeout": 0, 00:17:47.138 "ctrlr_loss_timeout_sec": 0, 00:17:47.138 "reconnect_delay_sec": 0, 00:17:47.138 "fast_io_fail_timeout_sec": 0, 00:17:47.138 "generate_uuids": false, 00:17:47.138 "transport_tos": 0, 00:17:47.138 "io_path_stat": false, 00:17:47.138 "allow_accel_sequence": false 00:17:47.138 } 00:17:47.138 }, 00:17:47.138 { 00:17:47.138 "method": "bdev_nvme_attach_controller", 00:17:47.138 "params": { 00:17:47.138 "name": "TLSTEST", 00:17:47.138 "trtype": "TCP", 00:17:47.138 "adrfam": "IPv4", 00:17:47.138 "traddr": "10.0.0.2", 00:17:47.138 "trsvcid": "4420", 00:17:47.138 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:47.138 "prchk_reftag": false, 00:17:47.138 "prchk_guard": false, 00:17:47.138 "ctrlr_loss_timeout_sec": 0, 00:17:47.138 "reconnect_delay_sec": 0, 00:17:47.138 "fast_io_fail_timeout_sec": 0, 00:17:47.138 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:17:47.138 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:47.138 "hdgst": false, 00:17:47.138 "ddgst": false 00:17:47.138 } 00:17:47.138 }, 00:17:47.138 { 00:17:47.138 "method": "bdev_nvme_set_hotplug", 00:17:47.138 "params": { 00:17:47.138 "period_us": 100000, 00:17:47.138 "enable": false 00:17:47.138 } 00:17:47.138 }, 00:17:47.138 { 00:17:47.138 "method": "bdev_wait_for_examine" 00:17:47.138 } 00:17:47.138 ] 00:17:47.138 }, 00:17:47.138 { 00:17:47.138 "subsystem": "nbd", 00:17:47.138 "config": [] 00:17:47.138 } 00:17:47.138 ] 00:17:47.138 }' 00:17:47.138 02:20:14 -- target/tls.sh@208 -- # killprocess 2129965 00:17:47.138 02:20:14 -- common/autotest_common.sh@936 -- # '[' -z 2129965 ']' 00:17:47.138 02:20:14 -- common/autotest_common.sh@940 -- # kill -0 2129965 00:17:47.138 02:20:14 -- common/autotest_common.sh@941 -- # uname 00:17:47.138 02:20:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:47.138 02:20:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2129965 00:17:47.397 02:20:14 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:47.397 02:20:14 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:47.397 02:20:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2129965' 00:17:47.397 killing process with pid 2129965 00:17:47.397 02:20:14 -- common/autotest_common.sh@955 -- # kill 2129965 00:17:47.397 Received shutdown signal, test time was about 10.000000 seconds 00:17:47.397 00:17:47.397 Latency(us) 00:17:47.397 [2024-12-08T01:20:15.178Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:47.397 [2024-12-08T01:20:15.178Z] =================================================================================================================== 00:17:47.397 [2024-12-08T01:20:15.178Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:47.397 02:20:14 -- common/autotest_common.sh@960 -- # wait 2129965 00:17:47.654 02:20:15 -- target/tls.sh@209 -- # killprocess 2129567 00:17:47.654 02:20:15 -- common/autotest_common.sh@936 -- # '[' -z 2129567 ']' 00:17:47.654 02:20:15 -- common/autotest_common.sh@940 -- # kill -0 2129567 00:17:47.654 02:20:15 -- common/autotest_common.sh@941 -- # uname 00:17:47.654 02:20:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:47.654 02:20:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2129567 00:17:47.654 02:20:15 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:47.654 02:20:15 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:47.654 02:20:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2129567' 00:17:47.654 killing process with pid 2129567 00:17:47.654 02:20:15 -- common/autotest_common.sh@955 -- # kill 2129567 00:17:47.654 02:20:15 -- common/autotest_common.sh@960 -- # wait 2129567 00:17:47.912 02:20:15 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:17:47.912 02:20:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:47.912 02:20:15 -- target/tls.sh@212 -- # echo '{ 00:17:47.912 "subsystems": [ 00:17:47.912 { 00:17:47.912 "subsystem": "iobuf", 00:17:47.912 "config": [ 00:17:47.912 { 00:17:47.912 "method": "iobuf_set_options", 00:17:47.912 "params": { 00:17:47.912 "small_pool_count": 8192, 00:17:47.912 "large_pool_count": 1024, 00:17:47.912 "small_bufsize": 8192, 00:17:47.912 "large_bufsize": 135168 00:17:47.912 } 00:17:47.912 } 00:17:47.912 ] 00:17:47.912 }, 00:17:47.912 { 00:17:47.912 "subsystem": "sock", 00:17:47.913 "config": [ 00:17:47.913 { 00:17:47.913 "method": "sock_impl_set_options", 00:17:47.913 "params": { 00:17:47.913 "impl_name": "posix", 00:17:47.913 "recv_buf_size": 2097152, 00:17:47.913 "send_buf_size": 2097152, 00:17:47.913 "enable_recv_pipe": true, 00:17:47.913 "enable_quickack": false, 00:17:47.913 "enable_placement_id": 0, 00:17:47.913 "enable_zerocopy_send_server": true, 00:17:47.913 "enable_zerocopy_send_client": false, 00:17:47.913 "zerocopy_threshold": 0, 00:17:47.913 "tls_version": 0, 00:17:47.913 "enable_ktls": false 00:17:47.913 } 00:17:47.913 }, 00:17:47.913 { 00:17:47.913 "method": "sock_impl_set_options", 00:17:47.913 "params": { 00:17:47.913 "impl_name": "ssl", 00:17:47.913 "recv_buf_size": 4096, 00:17:47.913 "send_buf_size": 4096, 00:17:47.913 "enable_recv_pipe": true, 00:17:47.913 "enable_quickack": false, 00:17:47.913 "enable_placement_id": 0, 00:17:47.913 "enable_zerocopy_send_server": true, 00:17:47.913 "enable_zerocopy_send_client": false, 00:17:47.913 "zerocopy_threshold": 0, 00:17:47.913 "tls_version": 0, 00:17:47.913 "enable_ktls": false 00:17:47.913 } 00:17:47.913 } 00:17:47.913 ] 00:17:47.913 }, 00:17:47.913 { 00:17:47.913 "subsystem": "vmd", 00:17:47.913 "config": [] 00:17:47.913 }, 00:17:47.913 { 00:17:47.913 "subsystem": "accel", 00:17:47.913 "config": [ 00:17:47.913 { 00:17:47.913 "method": "accel_set_options", 00:17:47.913 "params": { 00:17:47.913 "small_cache_size": 128, 00:17:47.913 "large_cache_size": 16, 00:17:47.913 "task_count": 2048, 00:17:47.913 "sequence_count": 2048, 00:17:47.913 "buf_count": 2048 00:17:47.913 } 00:17:47.913 } 00:17:47.913 ] 00:17:47.913 }, 00:17:47.913 { 00:17:47.913 "subsystem": "bdev", 00:17:47.913 "config": [ 00:17:47.913 { 00:17:47.913 "method": "bdev_set_options", 00:17:47.913 "params": { 00:17:47.913 "bdev_io_pool_size": 65535, 00:17:47.913 "bdev_io_cache_size": 256, 00:17:47.913 "bdev_auto_examine": true, 00:17:47.913 "iobuf_small_cache_size": 128, 00:17:47.913 "iobuf_large_cache_size": 16 00:17:47.913 } 00:17:47.913 }, 00:17:47.913 { 00:17:47.913 "method": "bdev_raid_set_options", 00:17:47.913 "params": { 00:17:47.913 "process_window_size_kb": 1024 00:17:47.913 } 00:17:47.913 }, 00:17:47.913 { 00:17:47.913 "method": "bdev_iscsi_set_options", 00:17:47.913 "params": { 00:17:47.913 "timeout_sec": 30 00:17:47.913 } 00:17:47.913 }, 00:17:47.913 { 00:17:47.913 "method": "bdev_nvme_set_options", 00:17:47.913 "params": { 00:17:47.913 "action_on_timeout": "none", 00:17:47.913 "timeout_us": 0, 00:17:47.913 "timeout_admin_us": 0, 00:17:47.913 "keep_alive_timeout_ms": 10000, 00:17:47.913 "transport_retry_count": 4, 00:17:47.913 "arbitration_burst": 0, 00:17:47.913 "low_priority_weight": 0, 00:17:47.913 "medium_priority_weight": 0, 00:17:47.913 "high_priority_weight": 0, 00:17:47.913 "nvme_adminq_poll_period_us": 10000, 00:17:47.913 "nvme_ioq_poll_period_us": 0, 00:17:47.913 "io_queue_requests": 0, 00:17:47.913 "delay_cmd_submit": true, 00:17:47.913 "bdev_retry_count": 3, 00:17:47.913 "transport_ack_timeout": 0, 00:17:47.913 "ctrlr_loss_timeout_sec": 0, 00:17:47.913 "reconnect_delay_sec": 0, 00:17:47.913 "fast_io_fail_timeout_sec": 0, 00:17:47.913 "generate_uuids": false, 00:17:47.913 "transport_tos": 0, 00:17:47.913 "io_path_stat": false, 00:17:47.913 "allow_accel_sequence": false 00:17:47.913 } 00:17:47.913 }, 00:17:47.913 { 00:17:47.913 "method": "bdev_nvme_set_hotplug", 00:17:47.913 "params": { 00:17:47.913 "period_us": 100000, 00:17:47.913 "enable": false 00:17:47.913 } 00:17:47.913 }, 00:17:47.913 { 00:17:47.913 "method": "bdev_malloc_create", 00:17:47.913 "params": { 00:17:47.913 "name": "malloc0", 00:17:47.913 "num_blocks": 8192, 00:17:47.913 "block_size": 4096, 00:17:47.913 "physical_block_size": 4096, 00:17:47.913 "uuid": "b0a16204-0a34-4005-af86-e96a23ec8ef6", 00:17:47.913 "optimal_io_boundary": 0 00:17:47.913 } 00:17:47.913 }, 00:17:47.913 { 00:17:47.913 "method": "bdev_wait_for_examine" 00:17:47.913 } 00:17:47.913 ] 00:17:47.913 }, 00:17:47.913 { 00:17:47.913 "subsystem": "nbd", 00:17:47.913 "config": [] 00:17:47.913 }, 00:17:47.913 { 00:17:47.913 "subsystem": "scheduler", 00:17:47.913 "config": [ 00:17:47.913 { 00:17:47.913 "method": "framework_set_scheduler", 00:17:47.913 "params": { 00:17:47.913 "name": "static" 00:17:47.913 } 00:17:47.913 } 00:17:47.913 ] 00:17:47.913 }, 00:17:47.913 { 00:17:47.913 "subsystem": "nvmf", 00:17:47.913 "config": [ 00:17:47.913 { 00:17:47.913 "method": "nvmf_set_config", 00:17:47.913 "params": { 00:17:47.913 "discovery_filter": "match_any", 00:17:47.913 "admin_cmd_passthru": { 00:17:47.913 "identify_ctrlr": false 00:17:47.913 } 00:17:47.913 } 00:17:47.913 }, 00:17:47.913 { 00:17:47.913 "method": "nvmf_set_max_subsystems", 00:17:47.913 "params": { 00:17:47.913 "max_subsystems": 1024 00:17:47.913 } 00:17:47.913 }, 00:17:47.913 { 00:17:47.913 "method": "nvmf_set_crdt", 00:17:47.913 "params": { 00:17:47.913 "crdt1": 0, 00:17:47.913 "crdt2": 0, 00:17:47.913 "crdt3": 0 00:17:47.913 } 00:17:47.913 }, 00:17:47.913 { 00:17:47.913 "method": "nvmf_create_transport", 00:17:47.913 "params": { 00:17:47.913 "trtype": "TCP", 00:17:47.913 "max_queue_depth": 128, 00:17:47.913 "max_io_qpairs_per_ctrlr": 127, 00:17:47.913 "in_capsule_data_size": 4096, 00:17:47.913 "max_io_size": 131072, 00:17:47.913 "io_unit_size": 131072, 00:17:47.913 "max_aq_depth": 128, 00:17:47.913 "num_shared_buffers": 511, 00:17:47.913 "buf_cache_size": 4294967295, 00:17:47.913 "dif_insert_or_strip": false, 00:17:47.913 "zcopy": false, 00:17:47.913 "c2h_success": false, 00:17:47.913 "sock_priority": 0, 00:17:47.913 "abort_timeout_sec": 1 00:17:47.913 } 00:17:47.913 }, 00:17:47.913 { 00:17:47.913 "method": "nvmf_create_subsystem", 00:17:47.913 "params": { 00:17:47.913 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:47.913 "allow_any_host": false, 00:17:47.913 "serial_number": "SPDK00000000000001", 00:17:47.913 "model_number": "SPDK bdev Controller", 00:17:47.913 "max_namespaces": 10, 00:17:47.913 "min_cntlid": 1, 00:17:47.913 "max_cntlid": 65519, 00:17:47.913 "ana_reporting": false 00:17:47.913 } 00:17:47.913 }, 00:17:47.913 { 00:17:47.913 "method": "nvmf_subsystem_add_host", 00:17:47.913 "params": { 00:17:47.913 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:47.913 "host": "nqn.2016-06.io.spdk:host1", 00:17:47.913 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:17:47.913 } 00:17:47.913 }, 00:17:47.913 { 00:17:47.913 "method": "nvmf_subsystem_add_ns", 00:17:47.913 "params": { 00:17:47.913 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:47.913 "namespace": { 00:17:47.913 "nsid": 1, 00:17:47.913 "bdev_name": "malloc0", 00:17:47.913 "nguid": "B0A162040A344005AF86E96A23EC8EF6", 00:17:47.913 "uuid": "b0a16204-0a34-4005-af86-e96a23ec8ef6" 00:17:47.913 } 00:17:47.913 } 00:17:47.913 }, 00:17:47.913 { 00:17:47.913 "method": "nvmf_subsystem_add_listener", 00:17:47.913 "params": { 00:17:47.913 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:47.913 "listen_address": { 00:17:47.913 "trtype": "TCP", 00:17:47.913 "adrfam": "IPv4", 00:17:47.913 "traddr": "10.0.0.2", 00:17:47.913 "trsvcid": "4420" 00:17:47.913 }, 00:17:47.913 "secure_channel": true 00:17:47.913 } 00:17:47.914 } 00:17:47.914 ] 00:17:47.914 } 00:17:47.914 ] 00:17:47.914 }' 00:17:47.914 02:20:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:47.914 02:20:15 -- common/autotest_common.sh@10 -- # set +x 00:17:47.914 02:20:15 -- nvmf/common.sh@469 -- # nvmfpid=2130268 00:17:47.914 02:20:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:17:47.914 02:20:15 -- nvmf/common.sh@470 -- # waitforlisten 2130268 00:17:47.914 02:20:15 -- common/autotest_common.sh@829 -- # '[' -z 2130268 ']' 00:17:47.914 02:20:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:47.914 02:20:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:47.914 02:20:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:47.914 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:47.914 02:20:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:47.914 02:20:15 -- common/autotest_common.sh@10 -- # set +x 00:17:47.914 [2024-12-08 02:20:15.573578] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:47.914 [2024-12-08 02:20:15.573654] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:47.914 EAL: No free 2048 kB hugepages reported on node 1 00:17:47.914 [2024-12-08 02:20:15.640413] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:48.171 [2024-12-08 02:20:15.764075] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:48.171 [2024-12-08 02:20:15.764250] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:48.171 [2024-12-08 02:20:15.764271] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:48.171 [2024-12-08 02:20:15.764285] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:48.171 [2024-12-08 02:20:15.764319] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:48.429 [2024-12-08 02:20:15.993635] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:48.429 [2024-12-08 02:20:16.025655] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:48.429 [2024-12-08 02:20:16.025927] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:48.994 02:20:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:48.994 02:20:16 -- common/autotest_common.sh@862 -- # return 0 00:17:48.994 02:20:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:48.994 02:20:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:48.994 02:20:16 -- common/autotest_common.sh@10 -- # set +x 00:17:48.994 02:20:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:48.994 02:20:16 -- target/tls.sh@216 -- # bdevperf_pid=2130424 00:17:48.994 02:20:16 -- target/tls.sh@217 -- # waitforlisten 2130424 /var/tmp/bdevperf.sock 00:17:48.994 02:20:16 -- common/autotest_common.sh@829 -- # '[' -z 2130424 ']' 00:17:48.994 02:20:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:48.994 02:20:16 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:17:48.994 02:20:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:48.994 02:20:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:48.994 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:48.994 02:20:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:48.994 02:20:16 -- target/tls.sh@213 -- # echo '{ 00:17:48.994 "subsystems": [ 00:17:48.994 { 00:17:48.994 "subsystem": "iobuf", 00:17:48.994 "config": [ 00:17:48.994 { 00:17:48.994 "method": "iobuf_set_options", 00:17:48.994 "params": { 00:17:48.994 "small_pool_count": 8192, 00:17:48.994 "large_pool_count": 1024, 00:17:48.994 "small_bufsize": 8192, 00:17:48.994 "large_bufsize": 135168 00:17:48.994 } 00:17:48.994 } 00:17:48.994 ] 00:17:48.994 }, 00:17:48.994 { 00:17:48.994 "subsystem": "sock", 00:17:48.994 "config": [ 00:17:48.994 { 00:17:48.994 "method": "sock_impl_set_options", 00:17:48.994 "params": { 00:17:48.994 "impl_name": "posix", 00:17:48.994 "recv_buf_size": 2097152, 00:17:48.994 "send_buf_size": 2097152, 00:17:48.994 "enable_recv_pipe": true, 00:17:48.994 "enable_quickack": false, 00:17:48.994 "enable_placement_id": 0, 00:17:48.994 "enable_zerocopy_send_server": true, 00:17:48.994 "enable_zerocopy_send_client": false, 00:17:48.994 "zerocopy_threshold": 0, 00:17:48.994 "tls_version": 0, 00:17:48.994 "enable_ktls": false 00:17:48.994 } 00:17:48.994 }, 00:17:48.994 { 00:17:48.994 "method": "sock_impl_set_options", 00:17:48.994 "params": { 00:17:48.994 "impl_name": "ssl", 00:17:48.994 "recv_buf_size": 4096, 00:17:48.994 "send_buf_size": 4096, 00:17:48.994 "enable_recv_pipe": true, 00:17:48.994 "enable_quickack": false, 00:17:48.994 "enable_placement_id": 0, 00:17:48.994 "enable_zerocopy_send_server": true, 00:17:48.994 "enable_zerocopy_send_client": false, 00:17:48.994 "zerocopy_threshold": 0, 00:17:48.994 "tls_version": 0, 00:17:48.994 "enable_ktls": false 00:17:48.994 } 00:17:48.994 } 00:17:48.994 ] 00:17:48.994 }, 00:17:48.994 { 00:17:48.994 "subsystem": "vmd", 00:17:48.994 "config": [] 00:17:48.994 }, 00:17:48.994 { 00:17:48.994 "subsystem": "accel", 00:17:48.994 "config": [ 00:17:48.994 { 00:17:48.994 "method": "accel_set_options", 00:17:48.994 "params": { 00:17:48.994 "small_cache_size": 128, 00:17:48.994 "large_cache_size": 16, 00:17:48.994 "task_count": 2048, 00:17:48.994 "sequence_count": 2048, 00:17:48.994 "buf_count": 2048 00:17:48.994 } 00:17:48.994 } 00:17:48.994 ] 00:17:48.994 }, 00:17:48.994 { 00:17:48.994 "subsystem": "bdev", 00:17:48.994 "config": [ 00:17:48.994 { 00:17:48.994 "method": "bdev_set_options", 00:17:48.994 "params": { 00:17:48.994 "bdev_io_pool_size": 65535, 00:17:48.994 "bdev_io_cache_size": 256, 00:17:48.994 "bdev_auto_examine": true, 00:17:48.994 "iobuf_small_cache_size": 128, 00:17:48.994 "iobuf_large_cache_size": 16 00:17:48.994 } 00:17:48.994 }, 00:17:48.994 { 00:17:48.994 "method": "bdev_raid_set_options", 00:17:48.994 "params": { 00:17:48.994 "process_window_size_kb": 1024 00:17:48.994 } 00:17:48.994 }, 00:17:48.994 { 00:17:48.994 "method": "bdev_iscsi_set_options", 00:17:48.995 "params": { 00:17:48.995 "timeout_sec": 30 00:17:48.995 } 00:17:48.995 }, 00:17:48.995 { 00:17:48.995 "method": "bdev_nvme_set_options", 00:17:48.995 "params": { 00:17:48.995 "action_on_timeout": "none", 00:17:48.995 "timeout_us": 0, 00:17:48.995 "timeout_admin_us": 0, 00:17:48.995 "keep_alive_timeout_ms": 10000, 00:17:48.995 "transport_retry_count": 4, 00:17:48.995 "arbitration_burst": 0, 00:17:48.995 "low_priority_weight": 0, 00:17:48.995 "medium_priority_weight": 0, 00:17:48.995 "high_priority_weight": 0, 00:17:48.995 "nvme_adminq_poll_period_us": 10000, 00:17:48.995 "nvme_ioq_poll_period_us": 0, 00:17:48.995 "io_queue_requests": 512, 00:17:48.995 "delay_cmd_submit": true, 00:17:48.995 "bdev_retry_count": 3, 00:17:48.995 "transport_ack_timeout": 0, 00:17:48.995 "ctrlr_loss_timeout_sec": 0, 00:17:48.995 "reconnect_delay_sec": 0, 00:17:48.995 "fast_io_fail_timeout_sec": 0, 00:17:48.995 "generate_uuids": false, 00:17:48.995 "transport_tos": 0, 00:17:48.995 "io_path_stat": false, 00:17:48.995 "allow_accel_sequence": false 00:17:48.995 } 00:17:48.995 }, 00:17:48.995 { 00:17:48.995 "method": "bdev_nvme_attach_controller", 00:17:48.995 "params": { 00:17:48.995 "name": "TLSTEST", 00:17:48.995 "trtype": "TCP", 00:17:48.995 "adrfam": "IPv4", 00:17:48.995 "traddr": "10.0.0.2", 00:17:48.995 "trsvcid": "4420", 00:17:48.995 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:48.995 "prchk_reftag": false, 00:17:48.995 "prchk_guard": false, 00:17:48.995 "ctrlr_loss_timeout_sec": 0, 00:17:48.995 "reconnect_delay_sec": 0, 00:17:48.995 "fast_io_fail_timeout_sec": 0, 00:17:48.995 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:17:48.995 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:48.995 "hdgst": false, 00:17:48.995 "ddgst": false 00:17:48.995 } 00:17:48.995 }, 00:17:48.995 { 00:17:48.995 "method": "bdev_nvme_set_hotplug", 00:17:48.995 "params": { 00:17:48.995 "period_us": 100000, 00:17:48.995 "enable": false 00:17:48.995 } 00:17:48.995 }, 00:17:48.995 { 00:17:48.995 "method": "bdev_wait_for_examine" 00:17:48.995 } 00:17:48.995 ] 00:17:48.995 }, 00:17:48.995 { 00:17:48.995 "subsystem": "nbd", 00:17:48.995 "config": [] 00:17:48.995 } 00:17:48.995 ] 00:17:48.995 }' 00:17:48.995 02:20:16 -- common/autotest_common.sh@10 -- # set +x 00:17:48.995 [2024-12-08 02:20:16.674025] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:48.995 [2024-12-08 02:20:16.674099] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2130424 ] 00:17:48.995 EAL: No free 2048 kB hugepages reported on node 1 00:17:48.995 [2024-12-08 02:20:16.732295] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:49.253 [2024-12-08 02:20:16.840293] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:49.253 [2024-12-08 02:20:16.991824] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:50.186 02:20:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:50.186 02:20:17 -- common/autotest_common.sh@862 -- # return 0 00:17:50.186 02:20:17 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:50.186 Running I/O for 10 seconds... 00:18:00.156 00:18:00.156 Latency(us) 00:18:00.156 [2024-12-08T01:20:27.937Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:00.156 [2024-12-08T01:20:27.937Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:00.156 Verification LBA range: start 0x0 length 0x2000 00:18:00.156 TLSTESTn1 : 10.02 4630.57 18.09 0.00 0.00 27606.81 4878.79 41943.04 00:18:00.156 [2024-12-08T01:20:27.937Z] =================================================================================================================== 00:18:00.156 [2024-12-08T01:20:27.937Z] Total : 4630.57 18.09 0.00 0.00 27606.81 4878.79 41943.04 00:18:00.156 0 00:18:00.156 02:20:27 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:00.156 02:20:27 -- target/tls.sh@223 -- # killprocess 2130424 00:18:00.156 02:20:27 -- common/autotest_common.sh@936 -- # '[' -z 2130424 ']' 00:18:00.156 02:20:27 -- common/autotest_common.sh@940 -- # kill -0 2130424 00:18:00.156 02:20:27 -- common/autotest_common.sh@941 -- # uname 00:18:00.156 02:20:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:00.156 02:20:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2130424 00:18:00.156 02:20:27 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:00.156 02:20:27 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:00.156 02:20:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2130424' 00:18:00.156 killing process with pid 2130424 00:18:00.156 02:20:27 -- common/autotest_common.sh@955 -- # kill 2130424 00:18:00.156 Received shutdown signal, test time was about 10.000000 seconds 00:18:00.156 00:18:00.156 Latency(us) 00:18:00.156 [2024-12-08T01:20:27.937Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:00.156 [2024-12-08T01:20:27.937Z] =================================================================================================================== 00:18:00.156 [2024-12-08T01:20:27.937Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:00.156 02:20:27 -- common/autotest_common.sh@960 -- # wait 2130424 00:18:00.414 02:20:28 -- target/tls.sh@224 -- # killprocess 2130268 00:18:00.414 02:20:28 -- common/autotest_common.sh@936 -- # '[' -z 2130268 ']' 00:18:00.414 02:20:28 -- common/autotest_common.sh@940 -- # kill -0 2130268 00:18:00.414 02:20:28 -- common/autotest_common.sh@941 -- # uname 00:18:00.414 02:20:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:00.414 02:20:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2130268 00:18:00.414 02:20:28 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:00.414 02:20:28 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:00.414 02:20:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2130268' 00:18:00.414 killing process with pid 2130268 00:18:00.414 02:20:28 -- common/autotest_common.sh@955 -- # kill 2130268 00:18:00.414 02:20:28 -- common/autotest_common.sh@960 -- # wait 2130268 00:18:00.982 02:20:28 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:18:00.982 02:20:28 -- target/tls.sh@227 -- # cleanup 00:18:00.982 02:20:28 -- target/tls.sh@15 -- # process_shm --id 0 00:18:00.982 02:20:28 -- common/autotest_common.sh@806 -- # type=--id 00:18:00.982 02:20:28 -- common/autotest_common.sh@807 -- # id=0 00:18:00.982 02:20:28 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:00.982 02:20:28 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:00.982 02:20:28 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:00.982 02:20:28 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:00.982 02:20:28 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:00.982 02:20:28 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:00.982 nvmf_trace.0 00:18:00.982 02:20:28 -- common/autotest_common.sh@821 -- # return 0 00:18:00.982 02:20:28 -- target/tls.sh@16 -- # killprocess 2130424 00:18:00.982 02:20:28 -- common/autotest_common.sh@936 -- # '[' -z 2130424 ']' 00:18:00.982 02:20:28 -- common/autotest_common.sh@940 -- # kill -0 2130424 00:18:00.982 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2130424) - No such process 00:18:00.982 02:20:28 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2130424 is not found' 00:18:00.982 Process with pid 2130424 is not found 00:18:00.982 02:20:28 -- target/tls.sh@17 -- # nvmftestfini 00:18:00.982 02:20:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:00.982 02:20:28 -- nvmf/common.sh@116 -- # sync 00:18:00.982 02:20:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:00.982 02:20:28 -- nvmf/common.sh@119 -- # set +e 00:18:00.982 02:20:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:00.982 02:20:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:00.982 rmmod nvme_tcp 00:18:00.982 rmmod nvme_fabrics 00:18:00.982 rmmod nvme_keyring 00:18:00.982 02:20:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:00.982 02:20:28 -- nvmf/common.sh@123 -- # set -e 00:18:00.982 02:20:28 -- nvmf/common.sh@124 -- # return 0 00:18:00.982 02:20:28 -- nvmf/common.sh@477 -- # '[' -n 2130268 ']' 00:18:00.982 02:20:28 -- nvmf/common.sh@478 -- # killprocess 2130268 00:18:00.982 02:20:28 -- common/autotest_common.sh@936 -- # '[' -z 2130268 ']' 00:18:00.982 02:20:28 -- common/autotest_common.sh@940 -- # kill -0 2130268 00:18:00.982 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2130268) - No such process 00:18:00.982 02:20:28 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2130268 is not found' 00:18:00.982 Process with pid 2130268 is not found 00:18:00.982 02:20:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:00.982 02:20:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:00.982 02:20:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:00.982 02:20:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:00.982 02:20:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:00.982 02:20:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:00.982 02:20:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:00.982 02:20:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:02.905 02:20:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:02.905 02:20:30 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:02.905 00:18:02.905 real 1m16.384s 00:18:02.905 user 2m1.905s 00:18:02.905 sys 0m23.881s 00:18:02.905 02:20:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:02.905 02:20:30 -- common/autotest_common.sh@10 -- # set +x 00:18:02.905 ************************************ 00:18:02.905 END TEST nvmf_tls 00:18:02.905 ************************************ 00:18:02.905 02:20:30 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:18:02.905 02:20:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:02.905 02:20:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:02.905 02:20:30 -- common/autotest_common.sh@10 -- # set +x 00:18:02.905 ************************************ 00:18:02.905 START TEST nvmf_fips 00:18:02.905 ************************************ 00:18:02.905 02:20:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:18:02.905 * Looking for test storage... 00:18:03.164 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:18:03.164 02:20:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:03.164 02:20:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:03.164 02:20:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:03.164 02:20:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:03.164 02:20:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:03.164 02:20:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:03.164 02:20:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:03.164 02:20:30 -- scripts/common.sh@335 -- # IFS=.-: 00:18:03.164 02:20:30 -- scripts/common.sh@335 -- # read -ra ver1 00:18:03.164 02:20:30 -- scripts/common.sh@336 -- # IFS=.-: 00:18:03.164 02:20:30 -- scripts/common.sh@336 -- # read -ra ver2 00:18:03.164 02:20:30 -- scripts/common.sh@337 -- # local 'op=<' 00:18:03.164 02:20:30 -- scripts/common.sh@339 -- # ver1_l=2 00:18:03.164 02:20:30 -- scripts/common.sh@340 -- # ver2_l=1 00:18:03.164 02:20:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:03.164 02:20:30 -- scripts/common.sh@343 -- # case "$op" in 00:18:03.164 02:20:30 -- scripts/common.sh@344 -- # : 1 00:18:03.164 02:20:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:03.164 02:20:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:03.164 02:20:30 -- scripts/common.sh@364 -- # decimal 1 00:18:03.164 02:20:30 -- scripts/common.sh@352 -- # local d=1 00:18:03.164 02:20:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:03.164 02:20:30 -- scripts/common.sh@354 -- # echo 1 00:18:03.164 02:20:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:03.164 02:20:30 -- scripts/common.sh@365 -- # decimal 2 00:18:03.164 02:20:30 -- scripts/common.sh@352 -- # local d=2 00:18:03.164 02:20:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:03.164 02:20:30 -- scripts/common.sh@354 -- # echo 2 00:18:03.164 02:20:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:03.164 02:20:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:03.164 02:20:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:03.164 02:20:30 -- scripts/common.sh@367 -- # return 0 00:18:03.164 02:20:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:03.164 02:20:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:03.164 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:03.164 --rc genhtml_branch_coverage=1 00:18:03.165 --rc genhtml_function_coverage=1 00:18:03.165 --rc genhtml_legend=1 00:18:03.165 --rc geninfo_all_blocks=1 00:18:03.165 --rc geninfo_unexecuted_blocks=1 00:18:03.165 00:18:03.165 ' 00:18:03.165 02:20:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:03.165 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:03.165 --rc genhtml_branch_coverage=1 00:18:03.165 --rc genhtml_function_coverage=1 00:18:03.165 --rc genhtml_legend=1 00:18:03.165 --rc geninfo_all_blocks=1 00:18:03.165 --rc geninfo_unexecuted_blocks=1 00:18:03.165 00:18:03.165 ' 00:18:03.165 02:20:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:03.165 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:03.165 --rc genhtml_branch_coverage=1 00:18:03.165 --rc genhtml_function_coverage=1 00:18:03.165 --rc genhtml_legend=1 00:18:03.165 --rc geninfo_all_blocks=1 00:18:03.165 --rc geninfo_unexecuted_blocks=1 00:18:03.165 00:18:03.165 ' 00:18:03.165 02:20:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:03.165 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:03.165 --rc genhtml_branch_coverage=1 00:18:03.165 --rc genhtml_function_coverage=1 00:18:03.165 --rc genhtml_legend=1 00:18:03.165 --rc geninfo_all_blocks=1 00:18:03.165 --rc geninfo_unexecuted_blocks=1 00:18:03.165 00:18:03.165 ' 00:18:03.165 02:20:30 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:03.165 02:20:30 -- nvmf/common.sh@7 -- # uname -s 00:18:03.165 02:20:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:03.165 02:20:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:03.165 02:20:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:03.165 02:20:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:03.165 02:20:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:03.165 02:20:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:03.165 02:20:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:03.165 02:20:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:03.165 02:20:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:03.165 02:20:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:03.165 02:20:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:03.165 02:20:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:03.165 02:20:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:03.165 02:20:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:03.165 02:20:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:03.165 02:20:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:03.165 02:20:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:03.165 02:20:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:03.165 02:20:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:03.165 02:20:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:03.165 02:20:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:03.165 02:20:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:03.165 02:20:30 -- paths/export.sh@5 -- # export PATH 00:18:03.165 02:20:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:03.165 02:20:30 -- nvmf/common.sh@46 -- # : 0 00:18:03.165 02:20:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:03.165 02:20:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:03.165 02:20:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:03.165 02:20:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:03.165 02:20:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:03.165 02:20:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:03.165 02:20:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:03.165 02:20:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:03.165 02:20:30 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:03.165 02:20:30 -- fips/fips.sh@89 -- # check_openssl_version 00:18:03.165 02:20:30 -- fips/fips.sh@83 -- # local target=3.0.0 00:18:03.165 02:20:30 -- fips/fips.sh@85 -- # openssl version 00:18:03.165 02:20:30 -- fips/fips.sh@85 -- # awk '{print $2}' 00:18:03.165 02:20:30 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:18:03.165 02:20:30 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:18:03.165 02:20:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:03.165 02:20:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:03.165 02:20:30 -- scripts/common.sh@335 -- # IFS=.-: 00:18:03.165 02:20:30 -- scripts/common.sh@335 -- # read -ra ver1 00:18:03.165 02:20:30 -- scripts/common.sh@336 -- # IFS=.-: 00:18:03.165 02:20:30 -- scripts/common.sh@336 -- # read -ra ver2 00:18:03.165 02:20:30 -- scripts/common.sh@337 -- # local 'op=>=' 00:18:03.165 02:20:30 -- scripts/common.sh@339 -- # ver1_l=3 00:18:03.165 02:20:30 -- scripts/common.sh@340 -- # ver2_l=3 00:18:03.165 02:20:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:03.165 02:20:30 -- scripts/common.sh@343 -- # case "$op" in 00:18:03.165 02:20:30 -- scripts/common.sh@347 -- # : 1 00:18:03.165 02:20:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:03.165 02:20:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:03.165 02:20:30 -- scripts/common.sh@364 -- # decimal 3 00:18:03.165 02:20:30 -- scripts/common.sh@352 -- # local d=3 00:18:03.165 02:20:30 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:18:03.165 02:20:30 -- scripts/common.sh@354 -- # echo 3 00:18:03.165 02:20:30 -- scripts/common.sh@364 -- # ver1[v]=3 00:18:03.166 02:20:30 -- scripts/common.sh@365 -- # decimal 3 00:18:03.166 02:20:30 -- scripts/common.sh@352 -- # local d=3 00:18:03.166 02:20:30 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:18:03.166 02:20:30 -- scripts/common.sh@354 -- # echo 3 00:18:03.166 02:20:30 -- scripts/common.sh@365 -- # ver2[v]=3 00:18:03.166 02:20:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:03.166 02:20:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:03.166 02:20:30 -- scripts/common.sh@363 -- # (( v++ )) 00:18:03.166 02:20:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:03.166 02:20:30 -- scripts/common.sh@364 -- # decimal 1 00:18:03.166 02:20:30 -- scripts/common.sh@352 -- # local d=1 00:18:03.166 02:20:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:03.166 02:20:30 -- scripts/common.sh@354 -- # echo 1 00:18:03.166 02:20:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:03.166 02:20:30 -- scripts/common.sh@365 -- # decimal 0 00:18:03.166 02:20:30 -- scripts/common.sh@352 -- # local d=0 00:18:03.166 02:20:30 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:18:03.166 02:20:30 -- scripts/common.sh@354 -- # echo 0 00:18:03.166 02:20:30 -- scripts/common.sh@365 -- # ver2[v]=0 00:18:03.166 02:20:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:03.166 02:20:30 -- scripts/common.sh@366 -- # return 0 00:18:03.166 02:20:30 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:18:03.166 02:20:30 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:18:03.166 02:20:30 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:18:03.166 02:20:30 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:18:03.166 02:20:30 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:18:03.166 02:20:30 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:18:03.166 02:20:30 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:18:03.166 02:20:30 -- fips/fips.sh@113 -- # build_openssl_config 00:18:03.166 02:20:30 -- fips/fips.sh@37 -- # cat 00:18:03.166 02:20:30 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:18:03.166 02:20:30 -- fips/fips.sh@58 -- # cat - 00:18:03.166 02:20:30 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:18:03.166 02:20:30 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:18:03.166 02:20:30 -- fips/fips.sh@116 -- # mapfile -t providers 00:18:03.166 02:20:30 -- fips/fips.sh@116 -- # openssl list -providers 00:18:03.166 02:20:30 -- fips/fips.sh@116 -- # grep name 00:18:03.166 02:20:30 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:18:03.166 02:20:30 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:18:03.166 02:20:30 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:18:03.166 02:20:30 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:18:03.166 02:20:30 -- fips/fips.sh@127 -- # : 00:18:03.166 02:20:30 -- common/autotest_common.sh@650 -- # local es=0 00:18:03.166 02:20:30 -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:18:03.166 02:20:30 -- common/autotest_common.sh@638 -- # local arg=openssl 00:18:03.166 02:20:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:03.166 02:20:30 -- common/autotest_common.sh@642 -- # type -t openssl 00:18:03.166 02:20:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:03.166 02:20:30 -- common/autotest_common.sh@644 -- # type -P openssl 00:18:03.166 02:20:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:03.166 02:20:30 -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:18:03.166 02:20:30 -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:18:03.166 02:20:30 -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:18:03.166 Error setting digest 00:18:03.166 4092EB28A57F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:18:03.166 4092EB28A57F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:18:03.166 02:20:30 -- common/autotest_common.sh@653 -- # es=1 00:18:03.166 02:20:30 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:03.166 02:20:30 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:03.166 02:20:30 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:03.166 02:20:30 -- fips/fips.sh@130 -- # nvmftestinit 00:18:03.166 02:20:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:03.166 02:20:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:03.166 02:20:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:03.166 02:20:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:03.166 02:20:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:03.166 02:20:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:03.166 02:20:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:03.166 02:20:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:03.166 02:20:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:03.166 02:20:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:03.166 02:20:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:03.166 02:20:30 -- common/autotest_common.sh@10 -- # set +x 00:18:05.700 02:20:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:05.700 02:20:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:05.700 02:20:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:05.700 02:20:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:05.700 02:20:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:05.700 02:20:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:05.700 02:20:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:05.700 02:20:32 -- nvmf/common.sh@294 -- # net_devs=() 00:18:05.700 02:20:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:05.700 02:20:32 -- nvmf/common.sh@295 -- # e810=() 00:18:05.700 02:20:32 -- nvmf/common.sh@295 -- # local -ga e810 00:18:05.700 02:20:32 -- nvmf/common.sh@296 -- # x722=() 00:18:05.700 02:20:32 -- nvmf/common.sh@296 -- # local -ga x722 00:18:05.700 02:20:32 -- nvmf/common.sh@297 -- # mlx=() 00:18:05.700 02:20:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:05.700 02:20:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:05.700 02:20:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:05.700 02:20:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:05.700 02:20:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:05.700 02:20:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:05.700 02:20:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:05.700 02:20:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:05.700 02:20:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:05.700 02:20:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:05.700 02:20:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:05.700 02:20:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:05.700 02:20:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:05.700 02:20:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:05.700 02:20:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:05.700 02:20:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:05.700 02:20:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:05.700 02:20:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:05.700 02:20:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:05.700 02:20:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:05.700 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:05.700 02:20:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:05.700 02:20:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:05.700 02:20:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:05.700 02:20:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:05.700 02:20:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:05.700 02:20:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:05.700 02:20:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:05.700 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:05.700 02:20:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:05.700 02:20:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:05.700 02:20:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:05.701 02:20:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:05.701 02:20:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:05.701 02:20:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:05.701 02:20:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:05.701 02:20:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:05.701 02:20:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:05.701 02:20:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:05.701 02:20:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:05.701 02:20:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:05.701 02:20:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:05.701 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:05.701 02:20:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:05.701 02:20:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:05.701 02:20:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:05.701 02:20:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:05.701 02:20:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:05.701 02:20:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:05.701 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:05.701 02:20:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:05.701 02:20:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:05.701 02:20:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:05.701 02:20:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:05.701 02:20:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:05.701 02:20:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:05.701 02:20:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:05.701 02:20:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:05.701 02:20:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:05.701 02:20:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:05.701 02:20:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:05.701 02:20:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:05.701 02:20:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:05.701 02:20:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:05.701 02:20:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:05.701 02:20:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:05.701 02:20:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:05.701 02:20:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:05.701 02:20:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:05.701 02:20:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:05.701 02:20:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:05.701 02:20:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:05.701 02:20:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:05.701 02:20:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:05.701 02:20:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:05.701 02:20:33 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:05.701 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:05.701 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.285 ms 00:18:05.701 00:18:05.701 --- 10.0.0.2 ping statistics --- 00:18:05.701 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:05.701 rtt min/avg/max/mdev = 0.285/0.285/0.285/0.000 ms 00:18:05.701 02:20:33 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:05.701 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:05.701 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.155 ms 00:18:05.701 00:18:05.701 --- 10.0.0.1 ping statistics --- 00:18:05.701 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:05.701 rtt min/avg/max/mdev = 0.155/0.155/0.155/0.000 ms 00:18:05.701 02:20:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:05.701 02:20:33 -- nvmf/common.sh@410 -- # return 0 00:18:05.701 02:20:33 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:05.701 02:20:33 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:05.701 02:20:33 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:05.701 02:20:33 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:05.701 02:20:33 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:05.701 02:20:33 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:05.701 02:20:33 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:05.701 02:20:33 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:18:05.701 02:20:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:05.701 02:20:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:05.701 02:20:33 -- common/autotest_common.sh@10 -- # set +x 00:18:05.701 02:20:33 -- nvmf/common.sh@469 -- # nvmfpid=2133881 00:18:05.701 02:20:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:05.701 02:20:33 -- nvmf/common.sh@470 -- # waitforlisten 2133881 00:18:05.701 02:20:33 -- common/autotest_common.sh@829 -- # '[' -z 2133881 ']' 00:18:05.701 02:20:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:05.701 02:20:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:05.701 02:20:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:05.701 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:05.701 02:20:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:05.701 02:20:33 -- common/autotest_common.sh@10 -- # set +x 00:18:05.701 [2024-12-08 02:20:33.144572] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:05.701 [2024-12-08 02:20:33.144660] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:05.701 EAL: No free 2048 kB hugepages reported on node 1 00:18:05.701 [2024-12-08 02:20:33.208420] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:05.701 [2024-12-08 02:20:33.316049] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:05.701 [2024-12-08 02:20:33.316211] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:05.701 [2024-12-08 02:20:33.316227] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:05.701 [2024-12-08 02:20:33.316239] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:05.701 [2024-12-08 02:20:33.316267] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:06.634 02:20:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:06.634 02:20:34 -- common/autotest_common.sh@862 -- # return 0 00:18:06.634 02:20:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:06.634 02:20:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:06.634 02:20:34 -- common/autotest_common.sh@10 -- # set +x 00:18:06.634 02:20:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:06.634 02:20:34 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:18:06.634 02:20:34 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:06.634 02:20:34 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:06.634 02:20:34 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:06.634 02:20:34 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:06.634 02:20:34 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:06.634 02:20:34 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:06.634 02:20:34 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:06.634 [2024-12-08 02:20:34.344978] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:06.634 [2024-12-08 02:20:34.360989] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:06.634 [2024-12-08 02:20:34.361258] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:06.634 malloc0 00:18:06.634 02:20:34 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:06.634 02:20:34 -- fips/fips.sh@147 -- # bdevperf_pid=2134039 00:18:06.634 02:20:34 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:06.634 02:20:34 -- fips/fips.sh@148 -- # waitforlisten 2134039 /var/tmp/bdevperf.sock 00:18:06.892 02:20:34 -- common/autotest_common.sh@829 -- # '[' -z 2134039 ']' 00:18:06.892 02:20:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:06.892 02:20:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:06.892 02:20:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:06.892 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:06.892 02:20:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:06.892 02:20:34 -- common/autotest_common.sh@10 -- # set +x 00:18:06.892 [2024-12-08 02:20:34.488462] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:06.892 [2024-12-08 02:20:34.488571] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2134039 ] 00:18:06.892 EAL: No free 2048 kB hugepages reported on node 1 00:18:06.892 [2024-12-08 02:20:34.553254] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:06.892 [2024-12-08 02:20:34.661935] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:07.825 02:20:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:07.825 02:20:35 -- common/autotest_common.sh@862 -- # return 0 00:18:07.825 02:20:35 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:08.083 [2024-12-08 02:20:35.755235] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:08.083 TLSTESTn1 00:18:08.083 02:20:35 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:08.340 Running I/O for 10 seconds... 00:18:18.308 00:18:18.308 Latency(us) 00:18:18.308 [2024-12-08T01:20:46.089Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:18.308 [2024-12-08T01:20:46.089Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:18.308 Verification LBA range: start 0x0 length 0x2000 00:18:18.308 TLSTESTn1 : 10.01 4633.30 18.10 0.00 0.00 27590.54 5048.70 43884.85 00:18:18.308 [2024-12-08T01:20:46.089Z] =================================================================================================================== 00:18:18.308 [2024-12-08T01:20:46.089Z] Total : 4633.30 18.10 0.00 0.00 27590.54 5048.70 43884.85 00:18:18.308 0 00:18:18.308 02:20:46 -- fips/fips.sh@1 -- # cleanup 00:18:18.308 02:20:46 -- fips/fips.sh@15 -- # process_shm --id 0 00:18:18.308 02:20:46 -- common/autotest_common.sh@806 -- # type=--id 00:18:18.308 02:20:46 -- common/autotest_common.sh@807 -- # id=0 00:18:18.308 02:20:46 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:18.308 02:20:46 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:18.308 02:20:46 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:18.308 02:20:46 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:18.308 02:20:46 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:18.308 02:20:46 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:18.308 nvmf_trace.0 00:18:18.308 02:20:46 -- common/autotest_common.sh@821 -- # return 0 00:18:18.308 02:20:46 -- fips/fips.sh@16 -- # killprocess 2134039 00:18:18.308 02:20:46 -- common/autotest_common.sh@936 -- # '[' -z 2134039 ']' 00:18:18.308 02:20:46 -- common/autotest_common.sh@940 -- # kill -0 2134039 00:18:18.308 02:20:46 -- common/autotest_common.sh@941 -- # uname 00:18:18.308 02:20:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:18.308 02:20:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2134039 00:18:18.566 02:20:46 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:18.566 02:20:46 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:18.566 02:20:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2134039' 00:18:18.566 killing process with pid 2134039 00:18:18.566 02:20:46 -- common/autotest_common.sh@955 -- # kill 2134039 00:18:18.566 Received shutdown signal, test time was about 10.000000 seconds 00:18:18.566 00:18:18.566 Latency(us) 00:18:18.566 [2024-12-08T01:20:46.347Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:18.566 [2024-12-08T01:20:46.347Z] =================================================================================================================== 00:18:18.566 [2024-12-08T01:20:46.347Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:18.566 02:20:46 -- common/autotest_common.sh@960 -- # wait 2134039 00:18:18.824 02:20:46 -- fips/fips.sh@17 -- # nvmftestfini 00:18:18.824 02:20:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:18.824 02:20:46 -- nvmf/common.sh@116 -- # sync 00:18:18.824 02:20:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:18.824 02:20:46 -- nvmf/common.sh@119 -- # set +e 00:18:18.824 02:20:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:18.824 02:20:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:18.824 rmmod nvme_tcp 00:18:18.824 rmmod nvme_fabrics 00:18:18.824 rmmod nvme_keyring 00:18:18.824 02:20:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:18.824 02:20:46 -- nvmf/common.sh@123 -- # set -e 00:18:18.824 02:20:46 -- nvmf/common.sh@124 -- # return 0 00:18:18.824 02:20:46 -- nvmf/common.sh@477 -- # '[' -n 2133881 ']' 00:18:18.824 02:20:46 -- nvmf/common.sh@478 -- # killprocess 2133881 00:18:18.824 02:20:46 -- common/autotest_common.sh@936 -- # '[' -z 2133881 ']' 00:18:18.824 02:20:46 -- common/autotest_common.sh@940 -- # kill -0 2133881 00:18:18.824 02:20:46 -- common/autotest_common.sh@941 -- # uname 00:18:18.824 02:20:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:18.824 02:20:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2133881 00:18:18.824 02:20:46 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:18.824 02:20:46 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:18.824 02:20:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2133881' 00:18:18.824 killing process with pid 2133881 00:18:18.824 02:20:46 -- common/autotest_common.sh@955 -- # kill 2133881 00:18:18.824 02:20:46 -- common/autotest_common.sh@960 -- # wait 2133881 00:18:19.082 02:20:46 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:19.082 02:20:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:19.082 02:20:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:19.082 02:20:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:19.082 02:20:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:19.082 02:20:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:19.082 02:20:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:19.082 02:20:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:21.615 02:20:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:21.615 02:20:48 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:21.615 00:18:21.615 real 0m18.165s 00:18:21.615 user 0m23.939s 00:18:21.615 sys 0m5.825s 00:18:21.615 02:20:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:21.615 02:20:48 -- common/autotest_common.sh@10 -- # set +x 00:18:21.615 ************************************ 00:18:21.615 END TEST nvmf_fips 00:18:21.615 ************************************ 00:18:21.615 02:20:48 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:18:21.615 02:20:48 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:21.615 02:20:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:21.615 02:20:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:21.615 02:20:48 -- common/autotest_common.sh@10 -- # set +x 00:18:21.615 ************************************ 00:18:21.615 START TEST nvmf_fuzz 00:18:21.615 ************************************ 00:18:21.615 02:20:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:21.615 * Looking for test storage... 00:18:21.615 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:21.615 02:20:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:21.615 02:20:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:21.615 02:20:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:21.615 02:20:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:21.615 02:20:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:21.615 02:20:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:21.615 02:20:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:21.615 02:20:48 -- scripts/common.sh@335 -- # IFS=.-: 00:18:21.615 02:20:48 -- scripts/common.sh@335 -- # read -ra ver1 00:18:21.615 02:20:48 -- scripts/common.sh@336 -- # IFS=.-: 00:18:21.615 02:20:48 -- scripts/common.sh@336 -- # read -ra ver2 00:18:21.615 02:20:48 -- scripts/common.sh@337 -- # local 'op=<' 00:18:21.615 02:20:48 -- scripts/common.sh@339 -- # ver1_l=2 00:18:21.615 02:20:48 -- scripts/common.sh@340 -- # ver2_l=1 00:18:21.615 02:20:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:21.615 02:20:48 -- scripts/common.sh@343 -- # case "$op" in 00:18:21.615 02:20:48 -- scripts/common.sh@344 -- # : 1 00:18:21.615 02:20:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:21.615 02:20:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:21.615 02:20:48 -- scripts/common.sh@364 -- # decimal 1 00:18:21.615 02:20:48 -- scripts/common.sh@352 -- # local d=1 00:18:21.615 02:20:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:21.615 02:20:48 -- scripts/common.sh@354 -- # echo 1 00:18:21.615 02:20:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:21.615 02:20:48 -- scripts/common.sh@365 -- # decimal 2 00:18:21.615 02:20:48 -- scripts/common.sh@352 -- # local d=2 00:18:21.615 02:20:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:21.615 02:20:48 -- scripts/common.sh@354 -- # echo 2 00:18:21.615 02:20:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:21.615 02:20:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:21.615 02:20:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:21.615 02:20:48 -- scripts/common.sh@367 -- # return 0 00:18:21.615 02:20:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:21.615 02:20:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:21.615 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:21.615 --rc genhtml_branch_coverage=1 00:18:21.615 --rc genhtml_function_coverage=1 00:18:21.615 --rc genhtml_legend=1 00:18:21.615 --rc geninfo_all_blocks=1 00:18:21.615 --rc geninfo_unexecuted_blocks=1 00:18:21.615 00:18:21.615 ' 00:18:21.615 02:20:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:21.615 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:21.615 --rc genhtml_branch_coverage=1 00:18:21.615 --rc genhtml_function_coverage=1 00:18:21.615 --rc genhtml_legend=1 00:18:21.615 --rc geninfo_all_blocks=1 00:18:21.615 --rc geninfo_unexecuted_blocks=1 00:18:21.615 00:18:21.615 ' 00:18:21.615 02:20:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:21.615 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:21.615 --rc genhtml_branch_coverage=1 00:18:21.615 --rc genhtml_function_coverage=1 00:18:21.615 --rc genhtml_legend=1 00:18:21.615 --rc geninfo_all_blocks=1 00:18:21.615 --rc geninfo_unexecuted_blocks=1 00:18:21.615 00:18:21.615 ' 00:18:21.615 02:20:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:21.615 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:21.615 --rc genhtml_branch_coverage=1 00:18:21.615 --rc genhtml_function_coverage=1 00:18:21.615 --rc genhtml_legend=1 00:18:21.615 --rc geninfo_all_blocks=1 00:18:21.615 --rc geninfo_unexecuted_blocks=1 00:18:21.615 00:18:21.615 ' 00:18:21.615 02:20:48 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:21.615 02:20:48 -- nvmf/common.sh@7 -- # uname -s 00:18:21.615 02:20:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:21.615 02:20:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:21.615 02:20:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:21.615 02:20:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:21.615 02:20:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:21.615 02:20:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:21.616 02:20:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:21.616 02:20:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:21.616 02:20:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:21.616 02:20:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:21.616 02:20:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:21.616 02:20:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:21.616 02:20:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:21.616 02:20:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:21.616 02:20:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:21.616 02:20:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:21.616 02:20:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:21.616 02:20:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:21.616 02:20:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:21.616 02:20:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:21.616 02:20:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:21.616 02:20:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:21.616 02:20:48 -- paths/export.sh@5 -- # export PATH 00:18:21.616 02:20:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:21.616 02:20:48 -- nvmf/common.sh@46 -- # : 0 00:18:21.616 02:20:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:21.616 02:20:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:21.616 02:20:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:21.616 02:20:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:21.616 02:20:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:21.616 02:20:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:21.616 02:20:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:21.616 02:20:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:21.616 02:20:48 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:18:21.616 02:20:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:21.616 02:20:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:21.616 02:20:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:21.616 02:20:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:21.616 02:20:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:21.616 02:20:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:21.616 02:20:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:21.616 02:20:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:21.616 02:20:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:21.616 02:20:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:21.616 02:20:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:21.616 02:20:48 -- common/autotest_common.sh@10 -- # set +x 00:18:23.519 02:20:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:23.519 02:20:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:23.519 02:20:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:23.519 02:20:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:23.519 02:20:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:23.519 02:20:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:23.519 02:20:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:23.519 02:20:51 -- nvmf/common.sh@294 -- # net_devs=() 00:18:23.519 02:20:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:23.519 02:20:51 -- nvmf/common.sh@295 -- # e810=() 00:18:23.519 02:20:51 -- nvmf/common.sh@295 -- # local -ga e810 00:18:23.519 02:20:51 -- nvmf/common.sh@296 -- # x722=() 00:18:23.519 02:20:51 -- nvmf/common.sh@296 -- # local -ga x722 00:18:23.519 02:20:51 -- nvmf/common.sh@297 -- # mlx=() 00:18:23.519 02:20:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:23.519 02:20:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:23.519 02:20:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:23.519 02:20:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:23.519 02:20:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:23.519 02:20:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:23.519 02:20:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:23.519 02:20:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:23.519 02:20:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:23.519 02:20:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:23.519 02:20:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:23.519 02:20:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:23.519 02:20:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:23.519 02:20:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:23.519 02:20:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:23.520 02:20:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:23.520 02:20:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:23.520 02:20:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:23.520 02:20:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:23.520 02:20:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:23.520 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:23.520 02:20:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:23.520 02:20:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:23.520 02:20:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:23.520 02:20:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:23.520 02:20:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:23.520 02:20:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:23.520 02:20:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:23.520 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:23.520 02:20:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:23.520 02:20:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:23.520 02:20:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:23.520 02:20:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:23.520 02:20:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:23.520 02:20:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:23.520 02:20:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:23.520 02:20:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:23.520 02:20:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:23.520 02:20:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:23.520 02:20:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:23.520 02:20:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:23.520 02:20:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:23.520 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:23.520 02:20:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:23.520 02:20:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:23.520 02:20:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:23.520 02:20:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:23.520 02:20:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:23.520 02:20:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:23.520 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:23.520 02:20:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:23.520 02:20:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:23.520 02:20:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:23.520 02:20:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:23.520 02:20:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:23.520 02:20:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:23.520 02:20:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:23.520 02:20:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:23.520 02:20:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:23.520 02:20:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:23.520 02:20:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:23.520 02:20:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:23.520 02:20:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:23.520 02:20:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:23.520 02:20:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:23.520 02:20:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:23.520 02:20:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:23.520 02:20:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:23.520 02:20:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:23.520 02:20:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:23.520 02:20:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:23.520 02:20:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:23.520 02:20:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:23.779 02:20:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:23.779 02:20:51 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:23.779 02:20:51 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:23.779 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:23.779 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.223 ms 00:18:23.779 00:18:23.779 --- 10.0.0.2 ping statistics --- 00:18:23.779 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:23.779 rtt min/avg/max/mdev = 0.223/0.223/0.223/0.000 ms 00:18:23.779 02:20:51 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:23.779 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:23.779 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.115 ms 00:18:23.779 00:18:23.779 --- 10.0.0.1 ping statistics --- 00:18:23.779 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:23.779 rtt min/avg/max/mdev = 0.115/0.115/0.115/0.000 ms 00:18:23.779 02:20:51 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:23.779 02:20:51 -- nvmf/common.sh@410 -- # return 0 00:18:23.779 02:20:51 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:23.779 02:20:51 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:23.779 02:20:51 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:23.779 02:20:51 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:23.779 02:20:51 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:23.779 02:20:51 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:23.779 02:20:51 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:23.779 02:20:51 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=2137484 00:18:23.779 02:20:51 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:18:23.779 02:20:51 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:23.779 02:20:51 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 2137484 00:18:23.779 02:20:51 -- common/autotest_common.sh@829 -- # '[' -z 2137484 ']' 00:18:23.779 02:20:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:23.779 02:20:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:23.779 02:20:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:23.779 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:23.779 02:20:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:23.779 02:20:51 -- common/autotest_common.sh@10 -- # set +x 00:18:24.727 02:20:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:24.727 02:20:52 -- common/autotest_common.sh@862 -- # return 0 00:18:24.727 02:20:52 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:24.727 02:20:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:24.727 02:20:52 -- common/autotest_common.sh@10 -- # set +x 00:18:24.727 02:20:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:24.728 02:20:52 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:18:24.728 02:20:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:24.728 02:20:52 -- common/autotest_common.sh@10 -- # set +x 00:18:24.728 Malloc0 00:18:24.728 02:20:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:24.728 02:20:52 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:24.728 02:20:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:24.728 02:20:52 -- common/autotest_common.sh@10 -- # set +x 00:18:24.728 02:20:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:24.728 02:20:52 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:24.728 02:20:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:24.728 02:20:52 -- common/autotest_common.sh@10 -- # set +x 00:18:24.728 02:20:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:24.728 02:20:52 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:24.728 02:20:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:24.728 02:20:52 -- common/autotest_common.sh@10 -- # set +x 00:18:24.728 02:20:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:24.728 02:20:52 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:18:24.728 02:20:52 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:18:56.854 Fuzzing completed. Shutting down the fuzz application 00:18:56.854 00:18:56.854 Dumping successful admin opcodes: 00:18:56.854 8, 9, 10, 24, 00:18:56.854 Dumping successful io opcodes: 00:18:56.854 0, 9, 00:18:56.854 NS: 0x200003aeff00 I/O qp, Total commands completed: 479822, total successful commands: 2775, random_seed: 877955520 00:18:56.854 NS: 0x200003aeff00 admin qp, Total commands completed: 58512, total successful commands: 464, random_seed: 481759296 00:18:56.854 02:21:23 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:18:56.854 Fuzzing completed. Shutting down the fuzz application 00:18:56.854 00:18:56.854 Dumping successful admin opcodes: 00:18:56.854 24, 00:18:56.854 Dumping successful io opcodes: 00:18:56.854 00:18:56.854 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 3258322501 00:18:56.854 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 3258474741 00:18:56.854 02:21:24 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:56.854 02:21:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:56.854 02:21:24 -- common/autotest_common.sh@10 -- # set +x 00:18:56.854 02:21:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:56.854 02:21:24 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:18:56.854 02:21:24 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:18:56.854 02:21:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:56.854 02:21:24 -- nvmf/common.sh@116 -- # sync 00:18:56.854 02:21:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:56.854 02:21:24 -- nvmf/common.sh@119 -- # set +e 00:18:56.854 02:21:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:56.854 02:21:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:56.854 rmmod nvme_tcp 00:18:56.854 rmmod nvme_fabrics 00:18:56.854 rmmod nvme_keyring 00:18:56.854 02:21:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:56.854 02:21:24 -- nvmf/common.sh@123 -- # set -e 00:18:56.854 02:21:24 -- nvmf/common.sh@124 -- # return 0 00:18:56.854 02:21:24 -- nvmf/common.sh@477 -- # '[' -n 2137484 ']' 00:18:56.854 02:21:24 -- nvmf/common.sh@478 -- # killprocess 2137484 00:18:56.854 02:21:24 -- common/autotest_common.sh@936 -- # '[' -z 2137484 ']' 00:18:56.854 02:21:24 -- common/autotest_common.sh@940 -- # kill -0 2137484 00:18:56.854 02:21:24 -- common/autotest_common.sh@941 -- # uname 00:18:56.854 02:21:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:56.854 02:21:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2137484 00:18:56.854 02:21:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:56.854 02:21:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:56.854 02:21:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2137484' 00:18:56.854 killing process with pid 2137484 00:18:56.854 02:21:24 -- common/autotest_common.sh@955 -- # kill 2137484 00:18:56.854 02:21:24 -- common/autotest_common.sh@960 -- # wait 2137484 00:18:57.114 02:21:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:57.114 02:21:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:57.114 02:21:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:57.114 02:21:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:57.114 02:21:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:57.114 02:21:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:57.114 02:21:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:57.114 02:21:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:59.644 02:21:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:59.644 02:21:26 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:18:59.644 00:18:59.644 real 0m38.093s 00:18:59.644 user 0m52.747s 00:18:59.644 sys 0m14.515s 00:18:59.644 02:21:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:59.644 02:21:26 -- common/autotest_common.sh@10 -- # set +x 00:18:59.644 ************************************ 00:18:59.644 END TEST nvmf_fuzz 00:18:59.644 ************************************ 00:18:59.644 02:21:26 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:18:59.644 02:21:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:59.644 02:21:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:59.644 02:21:26 -- common/autotest_common.sh@10 -- # set +x 00:18:59.644 ************************************ 00:18:59.644 START TEST nvmf_multiconnection 00:18:59.644 ************************************ 00:18:59.644 02:21:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:18:59.644 * Looking for test storage... 00:18:59.644 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:59.644 02:21:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:59.644 02:21:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:59.644 02:21:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:59.644 02:21:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:59.644 02:21:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:59.644 02:21:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:59.644 02:21:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:59.644 02:21:27 -- scripts/common.sh@335 -- # IFS=.-: 00:18:59.644 02:21:27 -- scripts/common.sh@335 -- # read -ra ver1 00:18:59.644 02:21:27 -- scripts/common.sh@336 -- # IFS=.-: 00:18:59.644 02:21:27 -- scripts/common.sh@336 -- # read -ra ver2 00:18:59.644 02:21:27 -- scripts/common.sh@337 -- # local 'op=<' 00:18:59.644 02:21:27 -- scripts/common.sh@339 -- # ver1_l=2 00:18:59.644 02:21:27 -- scripts/common.sh@340 -- # ver2_l=1 00:18:59.644 02:21:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:59.644 02:21:27 -- scripts/common.sh@343 -- # case "$op" in 00:18:59.644 02:21:27 -- scripts/common.sh@344 -- # : 1 00:18:59.644 02:21:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:59.644 02:21:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:59.644 02:21:27 -- scripts/common.sh@364 -- # decimal 1 00:18:59.644 02:21:27 -- scripts/common.sh@352 -- # local d=1 00:18:59.644 02:21:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:59.644 02:21:27 -- scripts/common.sh@354 -- # echo 1 00:18:59.644 02:21:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:59.644 02:21:27 -- scripts/common.sh@365 -- # decimal 2 00:18:59.644 02:21:27 -- scripts/common.sh@352 -- # local d=2 00:18:59.644 02:21:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:59.644 02:21:27 -- scripts/common.sh@354 -- # echo 2 00:18:59.644 02:21:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:59.644 02:21:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:59.644 02:21:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:59.644 02:21:27 -- scripts/common.sh@367 -- # return 0 00:18:59.644 02:21:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:59.644 02:21:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:59.644 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:59.644 --rc genhtml_branch_coverage=1 00:18:59.644 --rc genhtml_function_coverage=1 00:18:59.644 --rc genhtml_legend=1 00:18:59.644 --rc geninfo_all_blocks=1 00:18:59.644 --rc geninfo_unexecuted_blocks=1 00:18:59.644 00:18:59.644 ' 00:18:59.644 02:21:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:59.644 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:59.644 --rc genhtml_branch_coverage=1 00:18:59.644 --rc genhtml_function_coverage=1 00:18:59.644 --rc genhtml_legend=1 00:18:59.644 --rc geninfo_all_blocks=1 00:18:59.644 --rc geninfo_unexecuted_blocks=1 00:18:59.644 00:18:59.644 ' 00:18:59.644 02:21:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:59.644 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:59.644 --rc genhtml_branch_coverage=1 00:18:59.644 --rc genhtml_function_coverage=1 00:18:59.644 --rc genhtml_legend=1 00:18:59.644 --rc geninfo_all_blocks=1 00:18:59.644 --rc geninfo_unexecuted_blocks=1 00:18:59.644 00:18:59.644 ' 00:18:59.644 02:21:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:59.644 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:59.644 --rc genhtml_branch_coverage=1 00:18:59.644 --rc genhtml_function_coverage=1 00:18:59.644 --rc genhtml_legend=1 00:18:59.644 --rc geninfo_all_blocks=1 00:18:59.644 --rc geninfo_unexecuted_blocks=1 00:18:59.644 00:18:59.644 ' 00:18:59.644 02:21:27 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:59.644 02:21:27 -- nvmf/common.sh@7 -- # uname -s 00:18:59.644 02:21:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:59.644 02:21:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:59.644 02:21:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:59.644 02:21:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:59.644 02:21:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:59.644 02:21:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:59.644 02:21:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:59.645 02:21:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:59.645 02:21:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:59.645 02:21:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:59.645 02:21:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:59.645 02:21:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:59.645 02:21:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:59.645 02:21:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:59.645 02:21:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:59.645 02:21:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:59.645 02:21:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:59.645 02:21:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:59.645 02:21:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:59.645 02:21:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:59.645 02:21:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:59.645 02:21:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:59.645 02:21:27 -- paths/export.sh@5 -- # export PATH 00:18:59.645 02:21:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:59.645 02:21:27 -- nvmf/common.sh@46 -- # : 0 00:18:59.645 02:21:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:59.645 02:21:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:59.645 02:21:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:59.645 02:21:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:59.645 02:21:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:59.645 02:21:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:59.645 02:21:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:59.645 02:21:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:59.645 02:21:27 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:59.645 02:21:27 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:59.645 02:21:27 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:18:59.645 02:21:27 -- target/multiconnection.sh@16 -- # nvmftestinit 00:18:59.645 02:21:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:59.645 02:21:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:59.645 02:21:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:59.645 02:21:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:59.645 02:21:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:59.645 02:21:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:59.645 02:21:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:59.645 02:21:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:59.645 02:21:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:59.645 02:21:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:59.645 02:21:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:59.645 02:21:27 -- common/autotest_common.sh@10 -- # set +x 00:19:01.544 02:21:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:01.544 02:21:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:01.544 02:21:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:01.544 02:21:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:01.544 02:21:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:01.544 02:21:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:01.544 02:21:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:01.544 02:21:29 -- nvmf/common.sh@294 -- # net_devs=() 00:19:01.544 02:21:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:01.544 02:21:29 -- nvmf/common.sh@295 -- # e810=() 00:19:01.544 02:21:29 -- nvmf/common.sh@295 -- # local -ga e810 00:19:01.544 02:21:29 -- nvmf/common.sh@296 -- # x722=() 00:19:01.544 02:21:29 -- nvmf/common.sh@296 -- # local -ga x722 00:19:01.544 02:21:29 -- nvmf/common.sh@297 -- # mlx=() 00:19:01.544 02:21:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:01.544 02:21:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:01.544 02:21:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:01.544 02:21:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:01.544 02:21:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:01.544 02:21:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:01.544 02:21:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:01.544 02:21:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:01.544 02:21:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:01.544 02:21:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:01.544 02:21:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:01.544 02:21:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:01.544 02:21:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:01.544 02:21:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:01.544 02:21:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:01.544 02:21:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:01.544 02:21:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:01.544 02:21:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:01.544 02:21:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:01.544 02:21:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:01.544 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:01.544 02:21:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:01.544 02:21:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:01.544 02:21:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:01.544 02:21:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:01.544 02:21:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:01.544 02:21:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:01.544 02:21:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:01.544 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:01.544 02:21:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:01.544 02:21:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:01.544 02:21:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:01.544 02:21:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:01.544 02:21:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:01.544 02:21:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:01.544 02:21:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:01.544 02:21:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:01.544 02:21:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:01.544 02:21:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:01.544 02:21:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:01.544 02:21:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:01.544 02:21:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:01.544 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:01.544 02:21:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:01.544 02:21:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:01.544 02:21:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:01.544 02:21:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:01.544 02:21:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:01.544 02:21:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:01.544 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:01.544 02:21:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:01.544 02:21:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:01.544 02:21:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:01.544 02:21:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:01.544 02:21:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:01.544 02:21:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:01.544 02:21:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:01.544 02:21:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:01.544 02:21:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:01.544 02:21:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:01.544 02:21:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:01.544 02:21:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:01.544 02:21:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:01.544 02:21:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:01.544 02:21:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:01.544 02:21:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:01.544 02:21:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:01.544 02:21:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:01.544 02:21:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:01.544 02:21:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:01.545 02:21:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:01.545 02:21:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:01.545 02:21:29 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:01.545 02:21:29 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:01.545 02:21:29 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:01.545 02:21:29 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:01.545 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:01.545 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.230 ms 00:19:01.545 00:19:01.545 --- 10.0.0.2 ping statistics --- 00:19:01.545 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:01.545 rtt min/avg/max/mdev = 0.230/0.230/0.230/0.000 ms 00:19:01.545 02:21:29 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:01.545 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:01.545 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.118 ms 00:19:01.545 00:19:01.545 --- 10.0.0.1 ping statistics --- 00:19:01.545 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:01.545 rtt min/avg/max/mdev = 0.118/0.118/0.118/0.000 ms 00:19:01.545 02:21:29 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:01.545 02:21:29 -- nvmf/common.sh@410 -- # return 0 00:19:01.545 02:21:29 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:01.804 02:21:29 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:01.804 02:21:29 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:01.804 02:21:29 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:01.804 02:21:29 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:01.804 02:21:29 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:01.804 02:21:29 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:01.804 02:21:29 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:19:01.804 02:21:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:01.804 02:21:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:01.804 02:21:29 -- common/autotest_common.sh@10 -- # set +x 00:19:01.804 02:21:29 -- nvmf/common.sh@469 -- # nvmfpid=2143994 00:19:01.804 02:21:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:01.804 02:21:29 -- nvmf/common.sh@470 -- # waitforlisten 2143994 00:19:01.804 02:21:29 -- common/autotest_common.sh@829 -- # '[' -z 2143994 ']' 00:19:01.804 02:21:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:01.804 02:21:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:01.804 02:21:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:01.804 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:01.804 02:21:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:01.804 02:21:29 -- common/autotest_common.sh@10 -- # set +x 00:19:01.804 [2024-12-08 02:21:29.393466] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:01.804 [2024-12-08 02:21:29.393543] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:01.804 EAL: No free 2048 kB hugepages reported on node 1 00:19:01.804 [2024-12-08 02:21:29.461511] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:01.804 [2024-12-08 02:21:29.581836] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:01.804 [2024-12-08 02:21:29.582035] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:01.804 [2024-12-08 02:21:29.582062] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:01.804 [2024-12-08 02:21:29.582082] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:01.804 [2024-12-08 02:21:29.582167] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:01.804 [2024-12-08 02:21:29.582225] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:01.804 [2024-12-08 02:21:29.582281] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:01.804 [2024-12-08 02:21:29.582284] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:02.740 02:21:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:02.740 02:21:30 -- common/autotest_common.sh@862 -- # return 0 00:19:02.740 02:21:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:02.740 02:21:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:02.740 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:02.740 02:21:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:02.740 02:21:30 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:02.740 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.740 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:02.740 [2024-12-08 02:21:30.384105] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:02.740 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.740 02:21:30 -- target/multiconnection.sh@21 -- # seq 1 11 00:19:02.740 02:21:30 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:02.740 02:21:30 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:19:02.740 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.740 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:02.740 Malloc1 00:19:02.740 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.740 02:21:30 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:19:02.740 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.740 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:02.740 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.740 02:21:30 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:02.740 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.740 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:02.740 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.740 02:21:30 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:02.740 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.740 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:02.740 [2024-12-08 02:21:30.439253] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:02.740 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.740 02:21:30 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:02.740 02:21:30 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:19:02.740 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.740 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:02.740 Malloc2 00:19:02.740 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.740 02:21:30 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:19:02.740 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.740 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:02.740 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.740 02:21:30 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:19:02.740 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.740 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:02.740 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.740 02:21:30 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:19:02.740 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.740 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:02.740 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.740 02:21:30 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:02.740 02:21:30 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:19:02.740 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.740 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:02.740 Malloc3 00:19:02.740 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.740 02:21:30 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:19:02.740 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.740 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:02.740 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.740 02:21:30 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:19:02.740 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.740 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:02.999 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.999 02:21:30 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:19:02.999 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.999 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:02.999 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.999 02:21:30 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:02.999 02:21:30 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:19:02.999 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.999 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:02.999 Malloc4 00:19:02.999 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.999 02:21:30 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:19:02.999 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.999 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:02.999 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.999 02:21:30 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:19:02.999 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.999 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:02.999 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.999 02:21:30 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:19:02.999 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.999 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:02.999 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.999 02:21:30 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:02.999 02:21:30 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:19:02.999 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.999 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:02.999 Malloc5 00:19:02.999 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.999 02:21:30 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:19:02.999 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.999 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:02.999 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.999 02:21:30 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:19:02.999 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.999 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:02.999 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.999 02:21:30 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:19:02.999 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.999 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:02.999 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.999 02:21:30 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:02.999 02:21:30 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:19:02.999 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.999 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:02.999 Malloc6 00:19:02.999 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.999 02:21:30 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:19:02.999 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.999 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:02.999 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.999 02:21:30 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:19:02.999 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.999 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:02.999 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.999 02:21:30 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:19:02.999 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.999 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:02.999 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.999 02:21:30 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:02.999 02:21:30 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:19:02.999 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.999 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:02.999 Malloc7 00:19:02.999 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.999 02:21:30 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:19:02.999 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.999 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:02.999 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.999 02:21:30 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:19:02.999 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.999 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:02.999 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.999 02:21:30 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:19:02.999 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.999 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:02.999 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.999 02:21:30 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:02.999 02:21:30 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:19:02.999 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.999 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:02.999 Malloc8 00:19:02.999 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.999 02:21:30 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:19:02.999 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.999 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:02.999 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.999 02:21:30 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:19:02.999 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.999 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:02.999 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.999 02:21:30 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:19:02.999 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.999 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:03.258 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:03.258 02:21:30 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:03.258 02:21:30 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:19:03.258 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:03.258 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:03.258 Malloc9 00:19:03.258 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:03.258 02:21:30 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:19:03.258 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:03.258 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:03.258 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:03.258 02:21:30 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:19:03.258 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:03.258 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:03.258 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:03.258 02:21:30 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:19:03.258 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:03.258 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:03.258 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:03.258 02:21:30 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:03.258 02:21:30 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:19:03.258 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:03.258 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:03.258 Malloc10 00:19:03.258 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:03.258 02:21:30 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:19:03.258 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:03.258 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:03.258 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:03.258 02:21:30 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:19:03.258 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:03.258 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:03.258 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:03.258 02:21:30 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:19:03.258 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:03.258 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:03.258 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:03.258 02:21:30 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:03.258 02:21:30 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:19:03.258 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:03.258 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:03.258 Malloc11 00:19:03.258 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:03.258 02:21:30 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:19:03.258 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:03.258 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:03.258 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:03.258 02:21:30 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:19:03.258 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:03.258 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:03.258 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:03.258 02:21:30 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:19:03.258 02:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:03.258 02:21:30 -- common/autotest_common.sh@10 -- # set +x 00:19:03.258 02:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:03.258 02:21:30 -- target/multiconnection.sh@28 -- # seq 1 11 00:19:03.258 02:21:30 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:03.258 02:21:30 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:03.827 02:21:31 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:19:03.827 02:21:31 -- common/autotest_common.sh@1187 -- # local i=0 00:19:03.827 02:21:31 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:03.827 02:21:31 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:03.827 02:21:31 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:06.358 02:21:33 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:06.358 02:21:33 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:06.358 02:21:33 -- common/autotest_common.sh@1196 -- # grep -c SPDK1 00:19:06.358 02:21:33 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:06.358 02:21:33 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:06.358 02:21:33 -- common/autotest_common.sh@1197 -- # return 0 00:19:06.358 02:21:33 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:06.358 02:21:33 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:19:06.617 02:21:34 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:19:06.617 02:21:34 -- common/autotest_common.sh@1187 -- # local i=0 00:19:06.617 02:21:34 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:06.617 02:21:34 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:06.617 02:21:34 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:08.519 02:21:36 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:08.519 02:21:36 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:08.519 02:21:36 -- common/autotest_common.sh@1196 -- # grep -c SPDK2 00:19:08.519 02:21:36 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:08.519 02:21:36 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:08.519 02:21:36 -- common/autotest_common.sh@1197 -- # return 0 00:19:08.519 02:21:36 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:08.519 02:21:36 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:19:09.452 02:21:36 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:19:09.453 02:21:36 -- common/autotest_common.sh@1187 -- # local i=0 00:19:09.453 02:21:36 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:09.453 02:21:36 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:09.453 02:21:36 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:11.384 02:21:38 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:11.384 02:21:38 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:11.384 02:21:38 -- common/autotest_common.sh@1196 -- # grep -c SPDK3 00:19:11.384 02:21:38 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:11.384 02:21:38 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:11.384 02:21:38 -- common/autotest_common.sh@1197 -- # return 0 00:19:11.384 02:21:38 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:11.384 02:21:38 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:19:11.953 02:21:39 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:19:11.953 02:21:39 -- common/autotest_common.sh@1187 -- # local i=0 00:19:11.953 02:21:39 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:11.953 02:21:39 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:11.953 02:21:39 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:14.491 02:21:41 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:14.491 02:21:41 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:14.491 02:21:41 -- common/autotest_common.sh@1196 -- # grep -c SPDK4 00:19:14.491 02:21:41 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:14.491 02:21:41 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:14.491 02:21:41 -- common/autotest_common.sh@1197 -- # return 0 00:19:14.491 02:21:41 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:14.491 02:21:41 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:19:14.750 02:21:42 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:19:14.751 02:21:42 -- common/autotest_common.sh@1187 -- # local i=0 00:19:14.751 02:21:42 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:14.751 02:21:42 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:14.751 02:21:42 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:16.657 02:21:44 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:16.657 02:21:44 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:16.657 02:21:44 -- common/autotest_common.sh@1196 -- # grep -c SPDK5 00:19:16.917 02:21:44 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:16.917 02:21:44 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:16.917 02:21:44 -- common/autotest_common.sh@1197 -- # return 0 00:19:16.917 02:21:44 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:16.917 02:21:44 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:19:17.853 02:21:45 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:19:17.853 02:21:45 -- common/autotest_common.sh@1187 -- # local i=0 00:19:17.853 02:21:45 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:17.853 02:21:45 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:17.853 02:21:45 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:19.761 02:21:47 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:19.761 02:21:47 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:19.761 02:21:47 -- common/autotest_common.sh@1196 -- # grep -c SPDK6 00:19:19.761 02:21:47 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:19.761 02:21:47 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:19.761 02:21:47 -- common/autotest_common.sh@1197 -- # return 0 00:19:19.761 02:21:47 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:19.761 02:21:47 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:19:20.698 02:21:48 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:19:20.698 02:21:48 -- common/autotest_common.sh@1187 -- # local i=0 00:19:20.698 02:21:48 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:20.698 02:21:48 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:20.698 02:21:48 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:22.603 02:21:50 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:22.603 02:21:50 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:22.603 02:21:50 -- common/autotest_common.sh@1196 -- # grep -c SPDK7 00:19:22.603 02:21:50 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:22.603 02:21:50 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:22.603 02:21:50 -- common/autotest_common.sh@1197 -- # return 0 00:19:22.603 02:21:50 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:22.603 02:21:50 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:19:23.173 02:21:50 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:19:23.173 02:21:50 -- common/autotest_common.sh@1187 -- # local i=0 00:19:23.173 02:21:50 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:23.173 02:21:50 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:23.173 02:21:50 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:25.710 02:21:52 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:25.710 02:21:52 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:25.710 02:21:52 -- common/autotest_common.sh@1196 -- # grep -c SPDK8 00:19:25.710 02:21:52 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:25.710 02:21:52 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:25.710 02:21:52 -- common/autotest_common.sh@1197 -- # return 0 00:19:25.710 02:21:52 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:25.710 02:21:52 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:19:26.280 02:21:53 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:19:26.280 02:21:53 -- common/autotest_common.sh@1187 -- # local i=0 00:19:26.280 02:21:53 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:26.280 02:21:53 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:26.280 02:21:53 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:28.187 02:21:55 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:28.187 02:21:55 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:28.187 02:21:55 -- common/autotest_common.sh@1196 -- # grep -c SPDK9 00:19:28.187 02:21:55 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:28.187 02:21:55 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:28.187 02:21:55 -- common/autotest_common.sh@1197 -- # return 0 00:19:28.187 02:21:55 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:28.187 02:21:55 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:19:29.121 02:21:56 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:19:29.121 02:21:56 -- common/autotest_common.sh@1187 -- # local i=0 00:19:29.121 02:21:56 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:29.121 02:21:56 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:29.121 02:21:56 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:31.030 02:21:58 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:31.030 02:21:58 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:31.030 02:21:58 -- common/autotest_common.sh@1196 -- # grep -c SPDK10 00:19:31.030 02:21:58 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:31.030 02:21:58 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:31.030 02:21:58 -- common/autotest_common.sh@1197 -- # return 0 00:19:31.030 02:21:58 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:31.030 02:21:58 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:19:31.968 02:21:59 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:19:31.968 02:21:59 -- common/autotest_common.sh@1187 -- # local i=0 00:19:31.968 02:21:59 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:31.968 02:21:59 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:31.968 02:21:59 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:33.899 02:22:01 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:33.899 02:22:01 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:33.899 02:22:01 -- common/autotest_common.sh@1196 -- # grep -c SPDK11 00:19:33.899 02:22:01 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:33.899 02:22:01 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:33.899 02:22:01 -- common/autotest_common.sh@1197 -- # return 0 00:19:33.899 02:22:01 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:19:33.899 [global] 00:19:33.899 thread=1 00:19:33.899 invalidate=1 00:19:33.899 rw=read 00:19:33.899 time_based=1 00:19:33.899 runtime=10 00:19:33.899 ioengine=libaio 00:19:33.899 direct=1 00:19:33.899 bs=262144 00:19:33.899 iodepth=64 00:19:33.899 norandommap=1 00:19:33.899 numjobs=1 00:19:33.899 00:19:33.899 [job0] 00:19:33.899 filename=/dev/nvme0n1 00:19:33.899 [job1] 00:19:33.899 filename=/dev/nvme10n1 00:19:33.899 [job2] 00:19:33.899 filename=/dev/nvme1n1 00:19:33.899 [job3] 00:19:33.899 filename=/dev/nvme2n1 00:19:33.899 [job4] 00:19:33.899 filename=/dev/nvme3n1 00:19:33.899 [job5] 00:19:33.899 filename=/dev/nvme4n1 00:19:33.899 [job6] 00:19:33.899 filename=/dev/nvme5n1 00:19:33.899 [job7] 00:19:33.899 filename=/dev/nvme6n1 00:19:33.899 [job8] 00:19:33.899 filename=/dev/nvme7n1 00:19:33.899 [job9] 00:19:33.899 filename=/dev/nvme8n1 00:19:33.899 [job10] 00:19:33.899 filename=/dev/nvme9n1 00:19:33.899 Could not set queue depth (nvme0n1) 00:19:33.899 Could not set queue depth (nvme10n1) 00:19:33.899 Could not set queue depth (nvme1n1) 00:19:33.899 Could not set queue depth (nvme2n1) 00:19:33.899 Could not set queue depth (nvme3n1) 00:19:33.899 Could not set queue depth (nvme4n1) 00:19:33.899 Could not set queue depth (nvme5n1) 00:19:33.899 Could not set queue depth (nvme6n1) 00:19:33.899 Could not set queue depth (nvme7n1) 00:19:33.899 Could not set queue depth (nvme8n1) 00:19:33.899 Could not set queue depth (nvme9n1) 00:19:34.181 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:34.181 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:34.181 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:34.181 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:34.181 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:34.181 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:34.181 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:34.181 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:34.181 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:34.181 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:34.181 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:34.181 fio-3.35 00:19:34.181 Starting 11 threads 00:19:46.389 00:19:46.389 job0: (groupid=0, jobs=1): err= 0: pid=2148383: Sun Dec 8 02:22:12 2024 00:19:46.389 read: IOPS=488, BW=122MiB/s (128MB/s)(1235MiB/10109msec) 00:19:46.389 slat (usec): min=9, max=89778, avg=1800.44, stdev=5518.33 00:19:46.390 clat (msec): min=11, max=268, avg=129.04, stdev=44.96 00:19:46.390 lat (msec): min=11, max=268, avg=130.84, stdev=45.88 00:19:46.390 clat percentiles (msec): 00:19:46.390 | 1.00th=[ 39], 5.00th=[ 58], 10.00th=[ 69], 20.00th=[ 90], 00:19:46.390 | 30.00th=[ 104], 40.00th=[ 115], 50.00th=[ 128], 60.00th=[ 142], 00:19:46.390 | 70.00th=[ 159], 80.00th=[ 169], 90.00th=[ 184], 95.00th=[ 203], 00:19:46.390 | 99.00th=[ 236], 99.50th=[ 245], 99.90th=[ 262], 99.95th=[ 268], 00:19:46.390 | 99.99th=[ 268] 00:19:46.390 bw ( KiB/s): min=77824, max=273408, per=6.18%, avg=124806.40, stdev=44698.47, samples=20 00:19:46.390 iops : min= 304, max= 1068, avg=487.45, stdev=174.54, samples=20 00:19:46.390 lat (msec) : 20=0.43%, 50=2.81%, 100=22.79%, 250=73.53%, 500=0.45% 00:19:46.390 cpu : usr=0.27%, sys=1.64%, ctx=1035, majf=0, minf=4097 00:19:46.390 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:19:46.390 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.390 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:46.390 issued rwts: total=4941,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:46.390 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:46.390 job1: (groupid=0, jobs=1): err= 0: pid=2148403: Sun Dec 8 02:22:12 2024 00:19:46.390 read: IOPS=724, BW=181MiB/s (190MB/s)(1813MiB/10013msec) 00:19:46.390 slat (usec): min=10, max=98992, avg=1098.45, stdev=4575.05 00:19:46.390 clat (usec): min=1423, max=264846, avg=87237.36, stdev=52368.16 00:19:46.390 lat (usec): min=1446, max=333824, avg=88335.81, stdev=53132.04 00:19:46.390 clat percentiles (msec): 00:19:46.390 | 1.00th=[ 8], 5.00th=[ 20], 10.00th=[ 28], 20.00th=[ 37], 00:19:46.390 | 30.00th=[ 55], 40.00th=[ 67], 50.00th=[ 78], 60.00th=[ 91], 00:19:46.390 | 70.00th=[ 108], 80.00th=[ 131], 90.00th=[ 167], 95.00th=[ 184], 00:19:46.390 | 99.00th=[ 234], 99.50th=[ 239], 99.90th=[ 251], 99.95th=[ 251], 00:19:46.390 | 99.99th=[ 266] 00:19:46.390 bw ( KiB/s): min=90112, max=471552, per=9.11%, avg=183939.90, stdev=83159.36, samples=20 00:19:46.390 iops : min= 352, max= 1842, avg=718.40, stdev=324.88, samples=20 00:19:46.390 lat (msec) : 2=0.03%, 4=0.50%, 10=1.37%, 20=3.43%, 50=21.50% 00:19:46.390 lat (msec) : 100=38.98%, 250=34.12%, 500=0.07% 00:19:46.390 cpu : usr=0.40%, sys=2.12%, ctx=1526, majf=0, minf=4097 00:19:46.390 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:19:46.390 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.390 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:46.390 issued rwts: total=7250,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:46.390 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:46.390 job2: (groupid=0, jobs=1): err= 0: pid=2148441: Sun Dec 8 02:22:12 2024 00:19:46.390 read: IOPS=848, BW=212MiB/s (222MB/s)(2129MiB/10032msec) 00:19:46.390 slat (usec): min=12, max=54717, avg=1058.01, stdev=3456.08 00:19:46.390 clat (msec): min=4, max=293, avg=74.30, stdev=46.34 00:19:46.390 lat (msec): min=4, max=293, avg=75.36, stdev=47.02 00:19:46.390 clat percentiles (msec): 00:19:46.390 | 1.00th=[ 13], 5.00th=[ 28], 10.00th=[ 30], 20.00th=[ 33], 00:19:46.390 | 30.00th=[ 44], 40.00th=[ 55], 50.00th=[ 64], 60.00th=[ 73], 00:19:46.390 | 70.00th=[ 85], 80.00th=[ 105], 90.00th=[ 155], 95.00th=[ 169], 00:19:46.390 | 99.00th=[ 222], 99.50th=[ 241], 99.90th=[ 257], 99.95th=[ 257], 00:19:46.390 | 99.99th=[ 292] 00:19:46.390 bw ( KiB/s): min=78336, max=478275, per=10.70%, avg=216234.85, stdev=117373.62, samples=20 00:19:46.390 iops : min= 306, max= 1868, avg=844.55, stdev=458.47, samples=20 00:19:46.390 lat (msec) : 10=0.55%, 20=1.42%, 50=32.69%, 100=43.35%, 250=21.78% 00:19:46.390 lat (msec) : 500=0.21% 00:19:46.390 cpu : usr=0.50%, sys=2.76%, ctx=1583, majf=0, minf=4098 00:19:46.390 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:19:46.390 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.390 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:46.390 issued rwts: total=8514,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:46.390 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:46.390 job3: (groupid=0, jobs=1): err= 0: pid=2148458: Sun Dec 8 02:22:12 2024 00:19:46.390 read: IOPS=678, BW=170MiB/s (178MB/s)(1709MiB/10067msec) 00:19:46.390 slat (usec): min=9, max=126616, avg=1061.29, stdev=5106.57 00:19:46.390 clat (msec): min=2, max=305, avg=93.16, stdev=46.01 00:19:46.390 lat (msec): min=2, max=362, avg=94.22, stdev=46.71 00:19:46.390 clat percentiles (msec): 00:19:46.390 | 1.00th=[ 9], 5.00th=[ 26], 10.00th=[ 43], 20.00th=[ 59], 00:19:46.390 | 30.00th=[ 69], 40.00th=[ 79], 50.00th=[ 88], 60.00th=[ 100], 00:19:46.390 | 70.00th=[ 110], 80.00th=[ 124], 90.00th=[ 146], 95.00th=[ 182], 00:19:46.390 | 99.00th=[ 239], 99.50th=[ 249], 99.90th=[ 266], 99.95th=[ 300], 00:19:46.390 | 99.99th=[ 305] 00:19:46.390 bw ( KiB/s): min=75776, max=267264, per=8.58%, avg=173280.10, stdev=54252.89, samples=20 00:19:46.390 iops : min= 296, max= 1044, avg=676.80, stdev=211.93, samples=20 00:19:46.390 lat (msec) : 4=0.25%, 10=1.42%, 20=2.08%, 50=9.86%, 100=48.10% 00:19:46.390 lat (msec) : 250=37.80%, 500=0.50% 00:19:46.390 cpu : usr=0.40%, sys=2.00%, ctx=1382, majf=0, minf=4097 00:19:46.390 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:19:46.390 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.390 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:46.390 issued rwts: total=6834,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:46.390 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:46.390 job4: (groupid=0, jobs=1): err= 0: pid=2148469: Sun Dec 8 02:22:12 2024 00:19:46.390 read: IOPS=523, BW=131MiB/s (137MB/s)(1322MiB/10106msec) 00:19:46.390 slat (usec): min=9, max=93819, avg=1406.09, stdev=5463.45 00:19:46.390 clat (usec): min=713, max=268420, avg=120851.86, stdev=58589.55 00:19:46.390 lat (usec): min=766, max=286314, avg=122257.94, stdev=59483.10 00:19:46.390 clat percentiles (msec): 00:19:46.390 | 1.00th=[ 4], 5.00th=[ 13], 10.00th=[ 24], 20.00th=[ 62], 00:19:46.390 | 30.00th=[ 100], 40.00th=[ 115], 50.00th=[ 129], 60.00th=[ 146], 00:19:46.390 | 70.00th=[ 159], 80.00th=[ 169], 90.00th=[ 186], 95.00th=[ 209], 00:19:46.390 | 99.00th=[ 241], 99.50th=[ 249], 99.90th=[ 264], 99.95th=[ 266], 00:19:46.390 | 99.99th=[ 268] 00:19:46.390 bw ( KiB/s): min=76288, max=272384, per=6.62%, avg=133648.65, stdev=54260.57, samples=20 00:19:46.390 iops : min= 298, max= 1064, avg=521.95, stdev=211.92, samples=20 00:19:46.390 lat (usec) : 750=0.04%, 1000=0.08% 00:19:46.390 lat (msec) : 2=0.26%, 4=0.78%, 10=3.12%, 20=4.69%, 50=7.15% 00:19:46.390 lat (msec) : 100=14.28%, 250=69.18%, 500=0.42% 00:19:46.390 cpu : usr=0.28%, sys=1.68%, ctx=1249, majf=0, minf=3721 00:19:46.390 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:19:46.390 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.390 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:46.390 issued rwts: total=5286,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:46.390 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:46.390 job5: (groupid=0, jobs=1): err= 0: pid=2148506: Sun Dec 8 02:22:12 2024 00:19:46.390 read: IOPS=645, BW=161MiB/s (169MB/s)(1632MiB/10111msec) 00:19:46.390 slat (usec): min=8, max=97865, avg=914.64, stdev=4451.08 00:19:46.390 clat (msec): min=3, max=287, avg=98.13, stdev=51.94 00:19:46.390 lat (msec): min=3, max=287, avg=99.04, stdev=52.61 00:19:46.390 clat percentiles (msec): 00:19:46.390 | 1.00th=[ 11], 5.00th=[ 23], 10.00th=[ 37], 20.00th=[ 55], 00:19:46.390 | 30.00th=[ 68], 40.00th=[ 80], 50.00th=[ 89], 60.00th=[ 101], 00:19:46.390 | 70.00th=[ 116], 80.00th=[ 155], 90.00th=[ 176], 95.00th=[ 190], 00:19:46.390 | 99.00th=[ 234], 99.50th=[ 245], 99.90th=[ 257], 99.95th=[ 264], 00:19:46.390 | 99.99th=[ 288] 00:19:46.390 bw ( KiB/s): min=67584, max=335872, per=8.19%, avg=165478.00, stdev=71635.91, samples=20 00:19:46.390 iops : min= 264, max= 1312, avg=646.30, stdev=279.82, samples=20 00:19:46.390 lat (msec) : 4=0.14%, 10=0.75%, 20=3.34%, 50=12.70%, 100=43.01% 00:19:46.390 lat (msec) : 250=39.81%, 500=0.26% 00:19:46.390 cpu : usr=0.26%, sys=1.72%, ctx=1456, majf=0, minf=4097 00:19:46.390 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:19:46.390 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.390 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:46.390 issued rwts: total=6529,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:46.390 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:46.390 job6: (groupid=0, jobs=1): err= 0: pid=2148511: Sun Dec 8 02:22:12 2024 00:19:46.390 read: IOPS=713, BW=178MiB/s (187MB/s)(1789MiB/10033msec) 00:19:46.390 slat (usec): min=8, max=130919, avg=1068.59, stdev=4260.66 00:19:46.390 clat (msec): min=2, max=280, avg=88.63, stdev=45.22 00:19:46.390 lat (msec): min=2, max=327, avg=89.70, stdev=45.74 00:19:46.390 clat percentiles (msec): 00:19:46.390 | 1.00th=[ 6], 5.00th=[ 18], 10.00th=[ 42], 20.00th=[ 57], 00:19:46.390 | 30.00th=[ 68], 40.00th=[ 73], 50.00th=[ 81], 60.00th=[ 88], 00:19:46.390 | 70.00th=[ 100], 80.00th=[ 116], 90.00th=[ 161], 95.00th=[ 184], 00:19:46.390 | 99.00th=[ 218], 99.50th=[ 228], 99.90th=[ 245], 99.95th=[ 271], 00:19:46.390 | 99.99th=[ 279] 00:19:46.390 bw ( KiB/s): min=84992, max=254976, per=8.98%, avg=181456.10, stdev=50827.31, samples=20 00:19:46.390 iops : min= 332, max= 996, avg=708.70, stdev=198.58, samples=20 00:19:46.390 lat (msec) : 4=0.46%, 10=2.12%, 20=3.06%, 50=9.34%, 100=55.26% 00:19:46.390 lat (msec) : 250=29.68%, 500=0.08% 00:19:46.390 cpu : usr=0.41%, sys=2.08%, ctx=1435, majf=0, minf=4097 00:19:46.390 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:19:46.390 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.390 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:46.390 issued rwts: total=7154,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:46.390 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:46.390 job7: (groupid=0, jobs=1): err= 0: pid=2148512: Sun Dec 8 02:22:12 2024 00:19:46.390 read: IOPS=789, BW=197MiB/s (207MB/s)(1994MiB/10104msec) 00:19:46.390 slat (usec): min=9, max=80123, avg=1180.38, stdev=3574.27 00:19:46.390 clat (msec): min=4, max=250, avg=79.82, stdev=39.03 00:19:46.390 lat (msec): min=4, max=250, avg=81.00, stdev=39.65 00:19:46.390 clat percentiles (msec): 00:19:46.390 | 1.00th=[ 16], 5.00th=[ 36], 10.00th=[ 43], 20.00th=[ 52], 00:19:46.390 | 30.00th=[ 58], 40.00th=[ 63], 50.00th=[ 69], 60.00th=[ 78], 00:19:46.390 | 70.00th=[ 88], 80.00th=[ 104], 90.00th=[ 144], 95.00th=[ 167], 00:19:46.390 | 99.00th=[ 201], 99.50th=[ 211], 99.90th=[ 222], 99.95th=[ 247], 00:19:46.390 | 99.99th=[ 251] 00:19:46.390 bw ( KiB/s): min=86528, max=336896, per=10.03%, avg=202518.65, stdev=72307.05, samples=20 00:19:46.390 iops : min= 338, max= 1316, avg=791.00, stdev=282.44, samples=20 00:19:46.390 lat (msec) : 10=0.31%, 20=1.38%, 50=15.31%, 100=61.65%, 250=21.34% 00:19:46.390 lat (msec) : 500=0.01% 00:19:46.390 cpu : usr=0.40%, sys=2.51%, ctx=1254, majf=0, minf=4097 00:19:46.390 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:19:46.390 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.390 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:46.390 issued rwts: total=7976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:46.390 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:46.390 job8: (groupid=0, jobs=1): err= 0: pid=2148513: Sun Dec 8 02:22:12 2024 00:19:46.390 read: IOPS=544, BW=136MiB/s (143MB/s)(1377MiB/10105msec) 00:19:46.390 slat (usec): min=8, max=136045, avg=1424.09, stdev=5841.51 00:19:46.390 clat (usec): min=1405, max=344904, avg=115949.53, stdev=54819.27 00:19:46.390 lat (usec): min=1424, max=344953, avg=117373.62, stdev=55812.53 00:19:46.390 clat percentiles (msec): 00:19:46.390 | 1.00th=[ 4], 5.00th=[ 16], 10.00th=[ 48], 20.00th=[ 69], 00:19:46.390 | 30.00th=[ 88], 40.00th=[ 100], 50.00th=[ 114], 60.00th=[ 132], 00:19:46.390 | 70.00th=[ 155], 80.00th=[ 165], 90.00th=[ 182], 95.00th=[ 205], 00:19:46.390 | 99.00th=[ 239], 99.50th=[ 245], 99.90th=[ 300], 99.95th=[ 347], 00:19:46.390 | 99.99th=[ 347] 00:19:46.390 bw ( KiB/s): min=80896, max=226816, per=6.89%, avg=139251.50, stdev=49354.07, samples=20 00:19:46.390 iops : min= 316, max= 886, avg=543.90, stdev=192.74, samples=20 00:19:46.390 lat (msec) : 2=0.29%, 4=1.04%, 10=2.00%, 20=3.03%, 50=4.89% 00:19:46.390 lat (msec) : 100=29.44%, 250=58.88%, 500=0.44% 00:19:46.390 cpu : usr=0.33%, sys=1.66%, ctx=1276, majf=0, minf=4097 00:19:46.390 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:19:46.390 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.390 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:46.390 issued rwts: total=5506,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:46.390 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:46.390 job9: (groupid=0, jobs=1): err= 0: pid=2148514: Sun Dec 8 02:22:12 2024 00:19:46.390 read: IOPS=927, BW=232MiB/s (243MB/s)(2334MiB/10065msec) 00:19:46.390 slat (usec): min=9, max=133575, avg=748.91, stdev=3237.83 00:19:46.390 clat (msec): min=2, max=277, avg=68.22, stdev=46.19 00:19:46.390 lat (msec): min=2, max=277, avg=68.97, stdev=46.61 00:19:46.390 clat percentiles (msec): 00:19:46.390 | 1.00th=[ 5], 5.00th=[ 19], 10.00th=[ 27], 20.00th=[ 29], 00:19:46.391 | 30.00th=[ 31], 40.00th=[ 40], 50.00th=[ 58], 60.00th=[ 72], 00:19:46.391 | 70.00th=[ 87], 80.00th=[ 107], 90.00th=[ 132], 95.00th=[ 163], 00:19:46.391 | 99.00th=[ 205], 99.50th=[ 218], 99.90th=[ 259], 99.95th=[ 262], 00:19:46.391 | 99.99th=[ 279] 00:19:46.391 bw ( KiB/s): min=81408, max=549376, per=11.75%, avg=237284.60, stdev=130426.97, samples=20 00:19:46.391 iops : min= 318, max= 2146, avg=926.85, stdev=509.50, samples=20 00:19:46.391 lat (msec) : 4=0.55%, 10=1.85%, 20=3.15%, 50=39.10%, 100=32.52% 00:19:46.391 lat (msec) : 250=22.69%, 500=0.14% 00:19:46.391 cpu : usr=0.46%, sys=2.49%, ctx=1861, majf=0, minf=4097 00:19:46.391 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:19:46.391 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.391 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:46.391 issued rwts: total=9334,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:46.391 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:46.391 job10: (groupid=0, jobs=1): err= 0: pid=2148515: Sun Dec 8 02:22:12 2024 00:19:46.391 read: IOPS=1038, BW=260MiB/s (272MB/s)(2614MiB/10064msec) 00:19:46.391 slat (usec): min=8, max=166055, avg=850.60, stdev=3844.79 00:19:46.391 clat (msec): min=2, max=367, avg=60.71, stdev=39.99 00:19:46.391 lat (msec): min=2, max=367, avg=61.56, stdev=40.56 00:19:46.391 clat percentiles (msec): 00:19:46.391 | 1.00th=[ 8], 5.00th=[ 21], 10.00th=[ 27], 20.00th=[ 30], 00:19:46.391 | 30.00th=[ 33], 40.00th=[ 36], 50.00th=[ 44], 60.00th=[ 62], 00:19:46.391 | 70.00th=[ 77], 80.00th=[ 95], 90.00th=[ 116], 95.00th=[ 132], 00:19:46.391 | 99.00th=[ 199], 99.50th=[ 213], 99.90th=[ 232], 99.95th=[ 241], 00:19:46.391 | 99.99th=[ 368] 00:19:46.391 bw ( KiB/s): min=79872, max=484352, per=13.17%, avg=265996.85, stdev=121039.74, samples=20 00:19:46.391 iops : min= 312, max= 1892, avg=1038.95, stdev=472.87, samples=20 00:19:46.391 lat (msec) : 4=0.25%, 10=1.43%, 20=3.14%, 50=48.35%, 100=28.97% 00:19:46.391 lat (msec) : 250=17.83%, 500=0.04% 00:19:46.391 cpu : usr=0.69%, sys=2.95%, ctx=1854, majf=0, minf=4097 00:19:46.391 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:19:46.391 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.391 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:46.391 issued rwts: total=10456,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:46.391 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:46.391 00:19:46.391 Run status group 0 (all jobs): 00:19:46.391 READ: bw=1973MiB/s (2068MB/s), 122MiB/s-260MiB/s (128MB/s-272MB/s), io=19.5GiB (20.9GB), run=10013-10111msec 00:19:46.391 00:19:46.391 Disk stats (read/write): 00:19:46.391 nvme0n1: ios=9721/0, merge=0/0, ticks=1232739/0, in_queue=1232739, util=97.17% 00:19:46.391 nvme10n1: ios=14094/0, merge=0/0, ticks=1238947/0, in_queue=1238947, util=97.40% 00:19:46.391 nvme1n1: ios=16755/0, merge=0/0, ticks=1236878/0, in_queue=1236878, util=97.70% 00:19:46.391 nvme2n1: ios=13441/0, merge=0/0, ticks=1242571/0, in_queue=1242571, util=97.85% 00:19:46.391 nvme3n1: ios=10408/0, merge=0/0, ticks=1233564/0, in_queue=1233564, util=97.94% 00:19:46.391 nvme4n1: ios=12866/0, merge=0/0, ticks=1236790/0, in_queue=1236790, util=98.30% 00:19:46.391 nvme5n1: ios=14032/0, merge=0/0, ticks=1240404/0, in_queue=1240404, util=98.47% 00:19:46.391 nvme6n1: ios=15708/0, merge=0/0, ticks=1224884/0, in_queue=1224884, util=98.58% 00:19:46.391 nvme7n1: ios=10884/0, merge=0/0, ticks=1234723/0, in_queue=1234723, util=98.96% 00:19:46.391 nvme8n1: ios=18430/0, merge=0/0, ticks=1240162/0, in_queue=1240162, util=99.12% 00:19:46.391 nvme9n1: ios=20684/0, merge=0/0, ticks=1236747/0, in_queue=1236747, util=99.24% 00:19:46.391 02:22:12 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:19:46.391 [global] 00:19:46.391 thread=1 00:19:46.391 invalidate=1 00:19:46.391 rw=randwrite 00:19:46.391 time_based=1 00:19:46.391 runtime=10 00:19:46.391 ioengine=libaio 00:19:46.391 direct=1 00:19:46.391 bs=262144 00:19:46.391 iodepth=64 00:19:46.391 norandommap=1 00:19:46.391 numjobs=1 00:19:46.391 00:19:46.391 [job0] 00:19:46.391 filename=/dev/nvme0n1 00:19:46.391 [job1] 00:19:46.391 filename=/dev/nvme10n1 00:19:46.391 [job2] 00:19:46.391 filename=/dev/nvme1n1 00:19:46.391 [job3] 00:19:46.391 filename=/dev/nvme2n1 00:19:46.391 [job4] 00:19:46.391 filename=/dev/nvme3n1 00:19:46.391 [job5] 00:19:46.391 filename=/dev/nvme4n1 00:19:46.391 [job6] 00:19:46.391 filename=/dev/nvme5n1 00:19:46.391 [job7] 00:19:46.391 filename=/dev/nvme6n1 00:19:46.391 [job8] 00:19:46.391 filename=/dev/nvme7n1 00:19:46.391 [job9] 00:19:46.391 filename=/dev/nvme8n1 00:19:46.391 [job10] 00:19:46.391 filename=/dev/nvme9n1 00:19:46.391 Could not set queue depth (nvme0n1) 00:19:46.391 Could not set queue depth (nvme10n1) 00:19:46.391 Could not set queue depth (nvme1n1) 00:19:46.391 Could not set queue depth (nvme2n1) 00:19:46.391 Could not set queue depth (nvme3n1) 00:19:46.391 Could not set queue depth (nvme4n1) 00:19:46.391 Could not set queue depth (nvme5n1) 00:19:46.391 Could not set queue depth (nvme6n1) 00:19:46.391 Could not set queue depth (nvme7n1) 00:19:46.391 Could not set queue depth (nvme8n1) 00:19:46.391 Could not set queue depth (nvme9n1) 00:19:46.391 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:46.391 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:46.391 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:46.391 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:46.391 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:46.391 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:46.391 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:46.391 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:46.391 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:46.391 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:46.391 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:46.391 fio-3.35 00:19:46.391 Starting 11 threads 00:19:56.374 00:19:56.374 job0: (groupid=0, jobs=1): err= 0: pid=2149554: Sun Dec 8 02:22:23 2024 00:19:56.374 write: IOPS=457, BW=114MiB/s (120MB/s)(1151MiB/10073msec); 0 zone resets 00:19:56.374 slat (usec): min=15, max=103001, avg=1604.25, stdev=4876.35 00:19:56.374 clat (usec): min=1839, max=387963, avg=138366.48, stdev=77267.31 00:19:56.374 lat (usec): min=1879, max=388007, avg=139970.73, stdev=78424.72 00:19:56.374 clat percentiles (msec): 00:19:56.374 | 1.00th=[ 7], 5.00th=[ 23], 10.00th=[ 42], 20.00th=[ 78], 00:19:56.374 | 30.00th=[ 93], 40.00th=[ 109], 50.00th=[ 129], 60.00th=[ 146], 00:19:56.374 | 70.00th=[ 174], 80.00th=[ 201], 90.00th=[ 245], 95.00th=[ 292], 00:19:56.374 | 99.00th=[ 351], 99.50th=[ 368], 99.90th=[ 384], 99.95th=[ 388], 00:19:56.374 | 99.99th=[ 388] 00:19:56.374 bw ( KiB/s): min=51200, max=218112, per=7.87%, avg=116233.40, stdev=40804.00, samples=20 00:19:56.374 iops : min= 200, max= 852, avg=454.00, stdev=159.35, samples=20 00:19:56.374 lat (msec) : 2=0.02%, 4=0.20%, 10=1.54%, 20=2.45%, 50=7.88% 00:19:56.374 lat (msec) : 100=22.76%, 250=56.30%, 500=8.84% 00:19:56.374 cpu : usr=1.46%, sys=1.43%, ctx=2549, majf=0, minf=1 00:19:56.374 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.6% 00:19:56.374 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:56.374 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:56.374 issued rwts: total=0,4604,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:56.374 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:56.374 job1: (groupid=0, jobs=1): err= 0: pid=2149566: Sun Dec 8 02:22:23 2024 00:19:56.374 write: IOPS=466, BW=117MiB/s (122MB/s)(1175MiB/10079msec); 0 zone resets 00:19:56.375 slat (usec): min=19, max=90735, avg=1352.51, stdev=4387.07 00:19:56.375 clat (usec): min=904, max=382911, avg=135762.03, stdev=78255.65 00:19:56.375 lat (usec): min=935, max=382950, avg=137114.54, stdev=79124.00 00:19:56.375 clat percentiles (msec): 00:19:56.375 | 1.00th=[ 8], 5.00th=[ 23], 10.00th=[ 41], 20.00th=[ 67], 00:19:56.375 | 30.00th=[ 89], 40.00th=[ 103], 50.00th=[ 127], 60.00th=[ 148], 00:19:56.375 | 70.00th=[ 176], 80.00th=[ 203], 90.00th=[ 236], 95.00th=[ 296], 00:19:56.375 | 99.00th=[ 338], 99.50th=[ 355], 99.90th=[ 376], 99.95th=[ 380], 00:19:56.375 | 99.99th=[ 384] 00:19:56.375 bw ( KiB/s): min=52224, max=179712, per=8.04%, avg=118721.75, stdev=38971.82, samples=20 00:19:56.375 iops : min= 204, max= 702, avg=463.75, stdev=152.24, samples=20 00:19:56.375 lat (usec) : 1000=0.04% 00:19:56.375 lat (msec) : 2=0.34%, 4=0.23%, 10=0.81%, 20=2.89%, 50=10.19% 00:19:56.375 lat (msec) : 100=23.80%, 250=54.03%, 500=7.66% 00:19:56.375 cpu : usr=1.25%, sys=1.78%, ctx=2791, majf=0, minf=1 00:19:56.375 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:19:56.375 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:56.375 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:56.375 issued rwts: total=0,4701,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:56.375 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:56.375 job2: (groupid=0, jobs=1): err= 0: pid=2149567: Sun Dec 8 02:22:23 2024 00:19:56.375 write: IOPS=574, BW=144MiB/s (151MB/s)(1451MiB/10103msec); 0 zone resets 00:19:56.375 slat (usec): min=20, max=74439, avg=1108.61, stdev=3426.12 00:19:56.375 clat (usec): min=902, max=391050, avg=110264.33, stdev=71942.62 00:19:56.375 lat (usec): min=962, max=391090, avg=111372.94, stdev=72721.33 00:19:56.375 clat percentiles (msec): 00:19:56.375 | 1.00th=[ 4], 5.00th=[ 9], 10.00th=[ 24], 20.00th=[ 41], 00:19:56.375 | 30.00th=[ 54], 40.00th=[ 83], 50.00th=[ 101], 60.00th=[ 130], 00:19:56.375 | 70.00th=[ 155], 80.00th=[ 178], 90.00th=[ 213], 95.00th=[ 234], 00:19:56.375 | 99.00th=[ 257], 99.50th=[ 279], 99.90th=[ 384], 99.95th=[ 388], 00:19:56.375 | 99.99th=[ 393] 00:19:56.375 bw ( KiB/s): min=82944, max=338944, per=9.95%, avg=146933.80, stdev=64252.51, samples=20 00:19:56.375 iops : min= 324, max= 1324, avg=573.95, stdev=250.99, samples=20 00:19:56.375 lat (usec) : 1000=0.05% 00:19:56.375 lat (msec) : 2=0.33%, 4=1.24%, 10=3.69%, 20=3.74%, 50=19.52% 00:19:56.375 lat (msec) : 100=21.30%, 250=48.25%, 500=1.88% 00:19:56.375 cpu : usr=1.78%, sys=2.27%, ctx=3464, majf=0, minf=1 00:19:56.375 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:19:56.375 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:56.375 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:56.375 issued rwts: total=0,5803,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:56.375 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:56.375 job3: (groupid=0, jobs=1): err= 0: pid=2149568: Sun Dec 8 02:22:23 2024 00:19:56.375 write: IOPS=513, BW=128MiB/s (135MB/s)(1307MiB/10178msec); 0 zone resets 00:19:56.375 slat (usec): min=16, max=162186, avg=1081.72, stdev=4087.25 00:19:56.375 clat (usec): min=828, max=450068, avg=123379.69, stdev=71842.15 00:19:56.375 lat (usec): min=870, max=450108, avg=124461.42, stdev=72632.43 00:19:56.375 clat percentiles (msec): 00:19:56.375 | 1.00th=[ 4], 5.00th=[ 11], 10.00th=[ 30], 20.00th=[ 51], 00:19:56.375 | 30.00th=[ 81], 40.00th=[ 111], 50.00th=[ 130], 60.00th=[ 142], 00:19:56.375 | 70.00th=[ 159], 80.00th=[ 178], 90.00th=[ 209], 95.00th=[ 245], 00:19:56.375 | 99.00th=[ 330], 99.50th=[ 363], 99.90th=[ 380], 99.95th=[ 393], 00:19:56.375 | 99.99th=[ 451] 00:19:56.375 bw ( KiB/s): min=59904, max=251392, per=8.96%, avg=132241.30, stdev=45516.46, samples=20 00:19:56.375 iops : min= 234, max= 982, avg=516.55, stdev=177.82, samples=20 00:19:56.375 lat (usec) : 1000=0.08% 00:19:56.375 lat (msec) : 2=0.27%, 4=0.67%, 10=3.50%, 20=3.60%, 50=11.99% 00:19:56.375 lat (msec) : 100=15.11%, 250=60.34%, 500=4.46% 00:19:56.375 cpu : usr=1.44%, sys=2.00%, ctx=3455, majf=0, minf=1 00:19:56.375 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:19:56.375 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:56.375 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:56.375 issued rwts: total=0,5229,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:56.375 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:56.375 job4: (groupid=0, jobs=1): err= 0: pid=2149569: Sun Dec 8 02:22:23 2024 00:19:56.375 write: IOPS=583, BW=146MiB/s (153MB/s)(1465MiB/10035msec); 0 zone resets 00:19:56.375 slat (usec): min=23, max=139582, avg=1169.43, stdev=4354.36 00:19:56.375 clat (usec): min=1271, max=416139, avg=108338.28, stdev=62516.88 00:19:56.375 lat (usec): min=1969, max=416189, avg=109507.72, stdev=63261.11 00:19:56.375 clat percentiles (msec): 00:19:56.375 | 1.00th=[ 7], 5.00th=[ 15], 10.00th=[ 28], 20.00th=[ 59], 00:19:56.375 | 30.00th=[ 77], 40.00th=[ 90], 50.00th=[ 102], 60.00th=[ 118], 00:19:56.375 | 70.00th=[ 134], 80.00th=[ 153], 90.00th=[ 184], 95.00th=[ 222], 00:19:56.375 | 99.00th=[ 317], 99.50th=[ 321], 99.90th=[ 418], 99.95th=[ 418], 00:19:56.375 | 99.99th=[ 418] 00:19:56.375 bw ( KiB/s): min=76288, max=232448, per=10.05%, avg=148384.25, stdev=41686.39, samples=20 00:19:56.375 iops : min= 298, max= 908, avg=579.60, stdev=162.83, samples=20 00:19:56.375 lat (msec) : 2=0.03%, 4=0.38%, 10=2.12%, 20=4.51%, 50=9.97% 00:19:56.375 lat (msec) : 100=32.17%, 250=48.39%, 500=2.44% 00:19:56.375 cpu : usr=2.08%, sys=1.95%, ctx=3193, majf=0, minf=1 00:19:56.375 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:19:56.375 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:56.375 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:56.375 issued rwts: total=0,5859,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:56.375 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:56.375 job5: (groupid=0, jobs=1): err= 0: pid=2149570: Sun Dec 8 02:22:23 2024 00:19:56.375 write: IOPS=473, BW=118MiB/s (124MB/s)(1205MiB/10177msec); 0 zone resets 00:19:56.375 slat (usec): min=19, max=103692, avg=1672.09, stdev=4779.10 00:19:56.375 clat (usec): min=1240, max=424152, avg=133307.27, stdev=76862.12 00:19:56.375 lat (usec): min=1723, max=445766, avg=134979.36, stdev=77949.62 00:19:56.375 clat percentiles (msec): 00:19:56.375 | 1.00th=[ 9], 5.00th=[ 19], 10.00th=[ 39], 20.00th=[ 71], 00:19:56.375 | 30.00th=[ 91], 40.00th=[ 104], 50.00th=[ 118], 60.00th=[ 138], 00:19:56.375 | 70.00th=[ 167], 80.00th=[ 199], 90.00th=[ 236], 95.00th=[ 279], 00:19:56.375 | 99.00th=[ 342], 99.50th=[ 351], 99.90th=[ 388], 99.95th=[ 397], 00:19:56.375 | 99.99th=[ 426] 00:19:56.375 bw ( KiB/s): min=51200, max=243712, per=8.25%, avg=121768.30, stdev=45880.14, samples=20 00:19:56.375 iops : min= 200, max= 952, avg=475.65, stdev=179.22, samples=20 00:19:56.375 lat (msec) : 2=0.04%, 4=0.21%, 10=1.33%, 20=3.73%, 50=8.13% 00:19:56.375 lat (msec) : 100=25.02%, 250=53.65%, 500=7.88% 00:19:56.375 cpu : usr=1.40%, sys=1.72%, ctx=2310, majf=0, minf=1 00:19:56.375 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:19:56.375 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:56.375 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:56.375 issued rwts: total=0,4820,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:56.375 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:56.375 job6: (groupid=0, jobs=1): err= 0: pid=2149571: Sun Dec 8 02:22:23 2024 00:19:56.375 write: IOPS=572, BW=143MiB/s (150MB/s)(1456MiB/10175msec); 0 zone resets 00:19:56.375 slat (usec): min=20, max=153327, avg=1054.01, stdev=3843.25 00:19:56.375 clat (usec): min=1634, max=461307, avg=110659.03, stdev=71263.29 00:19:56.375 lat (usec): min=1701, max=461392, avg=111713.04, stdev=72022.28 00:19:56.375 clat percentiles (msec): 00:19:56.375 | 1.00th=[ 10], 5.00th=[ 31], 10.00th=[ 41], 20.00th=[ 46], 00:19:56.375 | 30.00th=[ 62], 40.00th=[ 82], 50.00th=[ 94], 60.00th=[ 110], 00:19:56.375 | 70.00th=[ 132], 80.00th=[ 171], 90.00th=[ 218], 95.00th=[ 236], 00:19:56.375 | 99.00th=[ 321], 99.50th=[ 351], 99.90th=[ 393], 99.95th=[ 460], 00:19:56.375 | 99.99th=[ 460] 00:19:56.375 bw ( KiB/s): min=71680, max=280576, per=9.99%, avg=147461.85, stdev=62129.84, samples=20 00:19:56.375 iops : min= 280, max= 1096, avg=576.00, stdev=242.68, samples=20 00:19:56.375 lat (msec) : 2=0.05%, 4=0.17%, 10=0.94%, 20=1.46%, 50=22.84% 00:19:56.375 lat (msec) : 100=29.22%, 250=40.97%, 500=4.34% 00:19:56.375 cpu : usr=1.86%, sys=2.10%, ctx=3319, majf=0, minf=1 00:19:56.375 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:19:56.375 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:56.375 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:56.375 issued rwts: total=0,5824,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:56.375 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:56.375 job7: (groupid=0, jobs=1): err= 0: pid=2149572: Sun Dec 8 02:22:23 2024 00:19:56.375 write: IOPS=563, BW=141MiB/s (148MB/s)(1423MiB/10107msec); 0 zone resets 00:19:56.375 slat (usec): min=20, max=106558, avg=1220.93, stdev=3599.77 00:19:56.375 clat (msec): min=2, max=311, avg=112.35, stdev=56.86 00:19:56.375 lat (msec): min=4, max=313, avg=113.57, stdev=57.48 00:19:56.375 clat percentiles (msec): 00:19:56.375 | 1.00th=[ 12], 5.00th=[ 30], 10.00th=[ 42], 20.00th=[ 55], 00:19:56.375 | 30.00th=[ 80], 40.00th=[ 96], 50.00th=[ 111], 60.00th=[ 125], 00:19:56.375 | 70.00th=[ 142], 80.00th=[ 157], 90.00th=[ 186], 95.00th=[ 218], 00:19:56.375 | 99.00th=[ 253], 99.50th=[ 259], 99.90th=[ 305], 99.95th=[ 309], 00:19:56.375 | 99.99th=[ 313] 00:19:56.375 bw ( KiB/s): min=79872, max=235008, per=9.76%, avg=144061.30, stdev=42533.97, samples=20 00:19:56.375 iops : min= 312, max= 918, avg=562.70, stdev=166.14, samples=20 00:19:56.375 lat (msec) : 4=0.04%, 10=0.74%, 20=1.46%, 50=16.11%, 100=23.62% 00:19:56.375 lat (msec) : 250=56.63%, 500=1.41% 00:19:56.375 cpu : usr=1.85%, sys=2.00%, ctx=3041, majf=0, minf=1 00:19:56.375 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:19:56.375 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:56.375 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:56.375 issued rwts: total=0,5691,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:56.375 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:56.375 job8: (groupid=0, jobs=1): err= 0: pid=2149573: Sun Dec 8 02:22:23 2024 00:19:56.376 write: IOPS=429, BW=107MiB/s (113MB/s)(1093MiB/10177msec); 0 zone resets 00:19:56.376 slat (usec): min=17, max=92434, avg=1955.85, stdev=5057.29 00:19:56.376 clat (usec): min=906, max=384306, avg=146940.54, stdev=79202.37 00:19:56.376 lat (usec): min=950, max=384336, avg=148896.39, stdev=80264.43 00:19:56.376 clat percentiles (msec): 00:19:56.376 | 1.00th=[ 5], 5.00th=[ 18], 10.00th=[ 45], 20.00th=[ 81], 00:19:56.376 | 30.00th=[ 103], 40.00th=[ 127], 50.00th=[ 148], 60.00th=[ 161], 00:19:56.376 | 70.00th=[ 178], 80.00th=[ 207], 90.00th=[ 251], 95.00th=[ 313], 00:19:56.376 | 99.00th=[ 359], 99.50th=[ 368], 99.90th=[ 384], 99.95th=[ 384], 00:19:56.376 | 99.99th=[ 384] 00:19:56.376 bw ( KiB/s): min=51200, max=208384, per=7.47%, avg=110302.80, stdev=43327.47, samples=20 00:19:56.376 iops : min= 200, max= 814, avg=430.85, stdev=169.27, samples=20 00:19:56.376 lat (usec) : 1000=0.02% 00:19:56.376 lat (msec) : 2=0.25%, 4=0.53%, 10=1.76%, 20=2.88%, 50=6.13% 00:19:56.376 lat (msec) : 100=16.88%, 250=61.60%, 500=9.95% 00:19:56.376 cpu : usr=1.43%, sys=1.45%, ctx=1917, majf=0, minf=1 00:19:56.376 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:19:56.376 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:56.376 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:56.376 issued rwts: total=0,4372,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:56.376 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:56.376 job9: (groupid=0, jobs=1): err= 0: pid=2149574: Sun Dec 8 02:22:23 2024 00:19:56.376 write: IOPS=607, BW=152MiB/s (159MB/s)(1544MiB/10165msec); 0 zone resets 00:19:56.376 slat (usec): min=15, max=69207, avg=897.03, stdev=2693.49 00:19:56.376 clat (usec): min=981, max=382495, avg=104389.03, stdev=61794.25 00:19:56.376 lat (usec): min=1022, max=382554, avg=105286.06, stdev=62238.04 00:19:56.376 clat percentiles (msec): 00:19:56.376 | 1.00th=[ 5], 5.00th=[ 18], 10.00th=[ 33], 20.00th=[ 43], 00:19:56.376 | 30.00th=[ 65], 40.00th=[ 82], 50.00th=[ 99], 60.00th=[ 122], 00:19:56.376 | 70.00th=[ 136], 80.00th=[ 148], 90.00th=[ 188], 95.00th=[ 213], 00:19:56.376 | 99.00th=[ 292], 99.50th=[ 300], 99.90th=[ 359], 99.95th=[ 372], 00:19:56.376 | 99.99th=[ 384] 00:19:56.376 bw ( KiB/s): min=94720, max=377344, per=10.60%, avg=156472.90, stdev=70083.25, samples=20 00:19:56.376 iops : min= 370, max= 1474, avg=611.20, stdev=273.75, samples=20 00:19:56.376 lat (usec) : 1000=0.02% 00:19:56.376 lat (msec) : 2=0.18%, 4=0.68%, 10=1.34%, 20=3.50%, 50=19.46% 00:19:56.376 lat (msec) : 100=25.58%, 250=47.33%, 500=1.91% 00:19:56.376 cpu : usr=2.10%, sys=1.95%, ctx=3617, majf=0, minf=1 00:19:56.376 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:19:56.376 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:56.376 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:56.376 issued rwts: total=0,6176,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:56.376 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:56.376 job10: (groupid=0, jobs=1): err= 0: pid=2149575: Sun Dec 8 02:22:23 2024 00:19:56.376 write: IOPS=554, BW=139MiB/s (145MB/s)(1402MiB/10105msec); 0 zone resets 00:19:56.376 slat (usec): min=15, max=171823, avg=1058.17, stdev=4480.41 00:19:56.376 clat (usec): min=916, max=378583, avg=113927.12, stdev=73355.63 00:19:56.376 lat (usec): min=946, max=387147, avg=114985.29, stdev=73874.17 00:19:56.376 clat percentiles (msec): 00:19:56.376 | 1.00th=[ 5], 5.00th=[ 13], 10.00th=[ 22], 20.00th=[ 50], 00:19:56.376 | 30.00th=[ 70], 40.00th=[ 87], 50.00th=[ 110], 60.00th=[ 126], 00:19:56.376 | 70.00th=[ 142], 80.00th=[ 171], 90.00th=[ 209], 95.00th=[ 255], 00:19:56.376 | 99.00th=[ 326], 99.50th=[ 342], 99.90th=[ 376], 99.95th=[ 376], 00:19:56.376 | 99.99th=[ 380] 00:19:56.376 bw ( KiB/s): min=74388, max=235008, per=9.61%, avg=141920.30, stdev=38714.19, samples=20 00:19:56.376 iops : min= 290, max= 918, avg=554.30, stdev=151.29, samples=20 00:19:56.376 lat (usec) : 1000=0.02% 00:19:56.376 lat (msec) : 2=0.23%, 4=0.43%, 10=2.89%, 20=5.90%, 50=11.13% 00:19:56.376 lat (msec) : 100=25.34%, 250=48.67%, 500=5.39% 00:19:56.376 cpu : usr=1.48%, sys=2.23%, ctx=3344, majf=0, minf=1 00:19:56.376 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:19:56.376 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:56.376 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:56.376 issued rwts: total=0,5607,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:56.376 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:56.376 00:19:56.376 Run status group 0 (all jobs): 00:19:56.376 WRITE: bw=1441MiB/s (1512MB/s), 107MiB/s-152MiB/s (113MB/s-159MB/s), io=14.3GiB (15.4GB), run=10035-10178msec 00:19:56.376 00:19:56.376 Disk stats (read/write): 00:19:56.376 nvme0n1: ios=49/9024, merge=0/0, ticks=31/1214166, in_queue=1214197, util=97.26% 00:19:56.376 nvme10n1: ios=49/9228, merge=0/0, ticks=536/1211104, in_queue=1211640, util=100.00% 00:19:56.376 nvme1n1: ios=0/11415, merge=0/0, ticks=0/1224575, in_queue=1224575, util=97.61% 00:19:56.376 nvme2n1: ios=43/10300, merge=0/0, ticks=707/1224306, in_queue=1225013, util=100.00% 00:19:56.376 nvme3n1: ios=47/11343, merge=0/0, ticks=2493/1178515, in_queue=1181008, util=100.00% 00:19:56.376 nvme4n1: ios=42/9486, merge=0/0, ticks=1797/1199264, in_queue=1201061, util=100.00% 00:19:56.376 nvme5n1: ios=42/11496, merge=0/0, ticks=1047/1220027, in_queue=1221074, util=100.00% 00:19:56.376 nvme6n1: ios=45/11188, merge=0/0, ticks=1266/1222176, in_queue=1223442, util=100.00% 00:19:56.376 nvme7n1: ios=43/8573, merge=0/0, ticks=2493/1210749, in_queue=1213242, util=100.00% 00:19:56.376 nvme8n1: ios=0/12163, merge=0/0, ticks=0/1224714, in_queue=1224714, util=98.97% 00:19:56.376 nvme9n1: ios=42/11030, merge=0/0, ticks=3450/1203504, in_queue=1206954, util=100.00% 00:19:56.376 02:22:23 -- target/multiconnection.sh@36 -- # sync 00:19:56.376 02:22:23 -- target/multiconnection.sh@37 -- # seq 1 11 00:19:56.376 02:22:23 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:56.376 02:22:23 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:56.376 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:19:56.376 02:22:23 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:19:56.376 02:22:23 -- common/autotest_common.sh@1208 -- # local i=0 00:19:56.376 02:22:23 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:56.376 02:22:23 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK1 00:19:56.376 02:22:23 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:56.376 02:22:23 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK1 00:19:56.376 02:22:23 -- common/autotest_common.sh@1220 -- # return 0 00:19:56.376 02:22:23 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:56.376 02:22:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:56.376 02:22:23 -- common/autotest_common.sh@10 -- # set +x 00:19:56.376 02:22:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:56.376 02:22:23 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:56.376 02:22:23 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:19:56.376 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:19:56.376 02:22:23 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:19:56.376 02:22:23 -- common/autotest_common.sh@1208 -- # local i=0 00:19:56.376 02:22:23 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:56.376 02:22:23 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK2 00:19:56.376 02:22:23 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:56.376 02:22:23 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK2 00:19:56.376 02:22:23 -- common/autotest_common.sh@1220 -- # return 0 00:19:56.376 02:22:23 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:19:56.376 02:22:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:56.376 02:22:23 -- common/autotest_common.sh@10 -- # set +x 00:19:56.376 02:22:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:56.376 02:22:23 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:56.376 02:22:23 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:19:56.637 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:19:56.637 02:22:24 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:19:56.637 02:22:24 -- common/autotest_common.sh@1208 -- # local i=0 00:19:56.637 02:22:24 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:56.637 02:22:24 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK3 00:19:56.637 02:22:24 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:56.637 02:22:24 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK3 00:19:56.637 02:22:24 -- common/autotest_common.sh@1220 -- # return 0 00:19:56.637 02:22:24 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:19:56.637 02:22:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:56.637 02:22:24 -- common/autotest_common.sh@10 -- # set +x 00:19:56.637 02:22:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:56.637 02:22:24 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:56.637 02:22:24 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:19:56.897 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:19:56.897 02:22:24 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:19:56.897 02:22:24 -- common/autotest_common.sh@1208 -- # local i=0 00:19:56.897 02:22:24 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:56.897 02:22:24 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK4 00:19:56.897 02:22:24 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:56.897 02:22:24 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK4 00:19:56.897 02:22:24 -- common/autotest_common.sh@1220 -- # return 0 00:19:56.897 02:22:24 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:19:56.897 02:22:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:56.897 02:22:24 -- common/autotest_common.sh@10 -- # set +x 00:19:56.897 02:22:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:56.897 02:22:24 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:56.897 02:22:24 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:19:57.155 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:19:57.155 02:22:24 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:19:57.155 02:22:24 -- common/autotest_common.sh@1208 -- # local i=0 00:19:57.155 02:22:24 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:57.155 02:22:24 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK5 00:19:57.413 02:22:24 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:57.413 02:22:24 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK5 00:19:57.413 02:22:24 -- common/autotest_common.sh@1220 -- # return 0 00:19:57.413 02:22:24 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:19:57.413 02:22:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:57.413 02:22:24 -- common/autotest_common.sh@10 -- # set +x 00:19:57.413 02:22:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:57.413 02:22:24 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:57.413 02:22:24 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:19:57.671 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:19:57.671 02:22:25 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:19:57.671 02:22:25 -- common/autotest_common.sh@1208 -- # local i=0 00:19:57.671 02:22:25 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:57.671 02:22:25 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK6 00:19:57.671 02:22:25 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:57.671 02:22:25 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK6 00:19:57.671 02:22:25 -- common/autotest_common.sh@1220 -- # return 0 00:19:57.671 02:22:25 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:19:57.671 02:22:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:57.671 02:22:25 -- common/autotest_common.sh@10 -- # set +x 00:19:57.671 02:22:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:57.671 02:22:25 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:57.671 02:22:25 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:19:57.929 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:19:57.929 02:22:25 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:19:57.929 02:22:25 -- common/autotest_common.sh@1208 -- # local i=0 00:19:57.929 02:22:25 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:57.929 02:22:25 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK7 00:19:57.929 02:22:25 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:57.929 02:22:25 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK7 00:19:57.929 02:22:25 -- common/autotest_common.sh@1220 -- # return 0 00:19:57.929 02:22:25 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:19:57.929 02:22:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:57.929 02:22:25 -- common/autotest_common.sh@10 -- # set +x 00:19:57.929 02:22:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:57.929 02:22:25 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:57.929 02:22:25 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:19:57.929 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:19:57.929 02:22:25 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:19:57.929 02:22:25 -- common/autotest_common.sh@1208 -- # local i=0 00:19:57.929 02:22:25 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:57.929 02:22:25 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK8 00:19:57.929 02:22:25 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:57.929 02:22:25 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK8 00:19:57.929 02:22:25 -- common/autotest_common.sh@1220 -- # return 0 00:19:57.929 02:22:25 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:19:57.929 02:22:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:57.929 02:22:25 -- common/autotest_common.sh@10 -- # set +x 00:19:57.929 02:22:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:57.929 02:22:25 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:57.929 02:22:25 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:19:58.189 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:19:58.189 02:22:25 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:19:58.189 02:22:25 -- common/autotest_common.sh@1208 -- # local i=0 00:19:58.189 02:22:25 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:58.189 02:22:25 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK9 00:19:58.189 02:22:25 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:58.189 02:22:25 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK9 00:19:58.189 02:22:25 -- common/autotest_common.sh@1220 -- # return 0 00:19:58.189 02:22:25 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:19:58.189 02:22:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:58.189 02:22:25 -- common/autotest_common.sh@10 -- # set +x 00:19:58.189 02:22:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:58.189 02:22:25 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:58.189 02:22:25 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:19:58.448 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:19:58.448 02:22:25 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:19:58.448 02:22:25 -- common/autotest_common.sh@1208 -- # local i=0 00:19:58.448 02:22:25 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:58.448 02:22:25 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK10 00:19:58.448 02:22:25 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:58.448 02:22:25 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK10 00:19:58.448 02:22:26 -- common/autotest_common.sh@1220 -- # return 0 00:19:58.448 02:22:26 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:19:58.448 02:22:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:58.448 02:22:26 -- common/autotest_common.sh@10 -- # set +x 00:19:58.448 02:22:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:58.448 02:22:26 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:58.448 02:22:26 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:19:58.448 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:19:58.448 02:22:26 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:19:58.448 02:22:26 -- common/autotest_common.sh@1208 -- # local i=0 00:19:58.448 02:22:26 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:58.448 02:22:26 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK11 00:19:58.448 02:22:26 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:58.448 02:22:26 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK11 00:19:58.448 02:22:26 -- common/autotest_common.sh@1220 -- # return 0 00:19:58.448 02:22:26 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:19:58.448 02:22:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:58.448 02:22:26 -- common/autotest_common.sh@10 -- # set +x 00:19:58.448 02:22:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:58.448 02:22:26 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:19:58.448 02:22:26 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:19:58.448 02:22:26 -- target/multiconnection.sh@47 -- # nvmftestfini 00:19:58.448 02:22:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:58.448 02:22:26 -- nvmf/common.sh@116 -- # sync 00:19:58.448 02:22:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:58.448 02:22:26 -- nvmf/common.sh@119 -- # set +e 00:19:58.448 02:22:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:58.448 02:22:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:58.448 rmmod nvme_tcp 00:19:58.448 rmmod nvme_fabrics 00:19:58.448 rmmod nvme_keyring 00:19:58.448 02:22:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:58.448 02:22:26 -- nvmf/common.sh@123 -- # set -e 00:19:58.448 02:22:26 -- nvmf/common.sh@124 -- # return 0 00:19:58.448 02:22:26 -- nvmf/common.sh@477 -- # '[' -n 2143994 ']' 00:19:58.448 02:22:26 -- nvmf/common.sh@478 -- # killprocess 2143994 00:19:58.448 02:22:26 -- common/autotest_common.sh@936 -- # '[' -z 2143994 ']' 00:19:58.448 02:22:26 -- common/autotest_common.sh@940 -- # kill -0 2143994 00:19:58.448 02:22:26 -- common/autotest_common.sh@941 -- # uname 00:19:58.448 02:22:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:58.448 02:22:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2143994 00:19:58.708 02:22:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:58.708 02:22:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:58.708 02:22:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2143994' 00:19:58.708 killing process with pid 2143994 00:19:58.708 02:22:26 -- common/autotest_common.sh@955 -- # kill 2143994 00:19:58.708 02:22:26 -- common/autotest_common.sh@960 -- # wait 2143994 00:19:59.275 02:22:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:59.275 02:22:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:59.275 02:22:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:59.275 02:22:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:59.275 02:22:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:59.275 02:22:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:59.275 02:22:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:59.275 02:22:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:01.179 02:22:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:01.179 00:20:01.179 real 1m1.913s 00:20:01.179 user 3m26.101s 00:20:01.179 sys 0m26.594s 00:20:01.179 02:22:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:01.179 02:22:28 -- common/autotest_common.sh@10 -- # set +x 00:20:01.179 ************************************ 00:20:01.179 END TEST nvmf_multiconnection 00:20:01.179 ************************************ 00:20:01.179 02:22:28 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:20:01.179 02:22:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:01.179 02:22:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:01.179 02:22:28 -- common/autotest_common.sh@10 -- # set +x 00:20:01.179 ************************************ 00:20:01.179 START TEST nvmf_initiator_timeout 00:20:01.179 ************************************ 00:20:01.179 02:22:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:20:01.179 * Looking for test storage... 00:20:01.179 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:01.179 02:22:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:01.179 02:22:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:01.179 02:22:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:01.437 02:22:29 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:01.437 02:22:29 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:01.437 02:22:29 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:01.437 02:22:29 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:01.437 02:22:29 -- scripts/common.sh@335 -- # IFS=.-: 00:20:01.437 02:22:29 -- scripts/common.sh@335 -- # read -ra ver1 00:20:01.437 02:22:29 -- scripts/common.sh@336 -- # IFS=.-: 00:20:01.437 02:22:29 -- scripts/common.sh@336 -- # read -ra ver2 00:20:01.437 02:22:29 -- scripts/common.sh@337 -- # local 'op=<' 00:20:01.437 02:22:29 -- scripts/common.sh@339 -- # ver1_l=2 00:20:01.437 02:22:29 -- scripts/common.sh@340 -- # ver2_l=1 00:20:01.437 02:22:29 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:01.437 02:22:29 -- scripts/common.sh@343 -- # case "$op" in 00:20:01.437 02:22:29 -- scripts/common.sh@344 -- # : 1 00:20:01.437 02:22:29 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:01.437 02:22:29 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:01.437 02:22:29 -- scripts/common.sh@364 -- # decimal 1 00:20:01.437 02:22:29 -- scripts/common.sh@352 -- # local d=1 00:20:01.437 02:22:29 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:01.437 02:22:29 -- scripts/common.sh@354 -- # echo 1 00:20:01.437 02:22:29 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:01.437 02:22:29 -- scripts/common.sh@365 -- # decimal 2 00:20:01.437 02:22:29 -- scripts/common.sh@352 -- # local d=2 00:20:01.437 02:22:29 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:01.437 02:22:29 -- scripts/common.sh@354 -- # echo 2 00:20:01.437 02:22:29 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:01.437 02:22:29 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:01.437 02:22:29 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:01.437 02:22:29 -- scripts/common.sh@367 -- # return 0 00:20:01.437 02:22:29 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:01.437 02:22:29 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:01.437 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:01.437 --rc genhtml_branch_coverage=1 00:20:01.437 --rc genhtml_function_coverage=1 00:20:01.437 --rc genhtml_legend=1 00:20:01.437 --rc geninfo_all_blocks=1 00:20:01.437 --rc geninfo_unexecuted_blocks=1 00:20:01.437 00:20:01.437 ' 00:20:01.437 02:22:29 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:01.437 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:01.437 --rc genhtml_branch_coverage=1 00:20:01.437 --rc genhtml_function_coverage=1 00:20:01.437 --rc genhtml_legend=1 00:20:01.437 --rc geninfo_all_blocks=1 00:20:01.437 --rc geninfo_unexecuted_blocks=1 00:20:01.437 00:20:01.437 ' 00:20:01.437 02:22:29 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:01.437 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:01.437 --rc genhtml_branch_coverage=1 00:20:01.437 --rc genhtml_function_coverage=1 00:20:01.437 --rc genhtml_legend=1 00:20:01.437 --rc geninfo_all_blocks=1 00:20:01.437 --rc geninfo_unexecuted_blocks=1 00:20:01.437 00:20:01.437 ' 00:20:01.437 02:22:29 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:01.437 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:01.437 --rc genhtml_branch_coverage=1 00:20:01.437 --rc genhtml_function_coverage=1 00:20:01.437 --rc genhtml_legend=1 00:20:01.437 --rc geninfo_all_blocks=1 00:20:01.437 --rc geninfo_unexecuted_blocks=1 00:20:01.437 00:20:01.437 ' 00:20:01.437 02:22:29 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:01.437 02:22:29 -- nvmf/common.sh@7 -- # uname -s 00:20:01.437 02:22:29 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:01.437 02:22:29 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:01.438 02:22:29 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:01.438 02:22:29 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:01.438 02:22:29 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:01.438 02:22:29 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:01.438 02:22:29 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:01.438 02:22:29 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:01.438 02:22:29 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:01.438 02:22:29 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:01.438 02:22:29 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:01.438 02:22:29 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:01.438 02:22:29 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:01.438 02:22:29 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:01.438 02:22:29 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:01.438 02:22:29 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:01.438 02:22:29 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:01.438 02:22:29 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:01.438 02:22:29 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:01.438 02:22:29 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:01.438 02:22:29 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:01.438 02:22:29 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:01.438 02:22:29 -- paths/export.sh@5 -- # export PATH 00:20:01.438 02:22:29 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:01.438 02:22:29 -- nvmf/common.sh@46 -- # : 0 00:20:01.438 02:22:29 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:01.438 02:22:29 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:01.438 02:22:29 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:01.438 02:22:29 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:01.438 02:22:29 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:01.438 02:22:29 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:01.438 02:22:29 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:01.438 02:22:29 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:01.438 02:22:29 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:01.438 02:22:29 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:01.438 02:22:29 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:20:01.438 02:22:29 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:01.438 02:22:29 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:01.438 02:22:29 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:01.438 02:22:29 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:01.438 02:22:29 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:01.438 02:22:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:01.438 02:22:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:01.438 02:22:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:01.438 02:22:29 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:01.438 02:22:29 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:01.438 02:22:29 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:01.438 02:22:29 -- common/autotest_common.sh@10 -- # set +x 00:20:03.972 02:22:31 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:03.972 02:22:31 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:03.972 02:22:31 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:03.972 02:22:31 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:03.972 02:22:31 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:03.972 02:22:31 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:03.972 02:22:31 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:03.972 02:22:31 -- nvmf/common.sh@294 -- # net_devs=() 00:20:03.972 02:22:31 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:03.972 02:22:31 -- nvmf/common.sh@295 -- # e810=() 00:20:03.972 02:22:31 -- nvmf/common.sh@295 -- # local -ga e810 00:20:03.972 02:22:31 -- nvmf/common.sh@296 -- # x722=() 00:20:03.972 02:22:31 -- nvmf/common.sh@296 -- # local -ga x722 00:20:03.972 02:22:31 -- nvmf/common.sh@297 -- # mlx=() 00:20:03.972 02:22:31 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:03.972 02:22:31 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:03.972 02:22:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:03.972 02:22:31 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:03.972 02:22:31 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:03.972 02:22:31 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:03.972 02:22:31 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:03.972 02:22:31 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:03.972 02:22:31 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:03.972 02:22:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:03.972 02:22:31 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:03.972 02:22:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:03.972 02:22:31 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:03.972 02:22:31 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:03.972 02:22:31 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:03.972 02:22:31 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:03.972 02:22:31 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:03.972 02:22:31 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:03.972 02:22:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:03.972 02:22:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:03.972 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:03.972 02:22:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:03.972 02:22:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:03.972 02:22:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:03.972 02:22:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:03.972 02:22:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:03.972 02:22:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:03.972 02:22:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:03.972 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:03.972 02:22:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:03.972 02:22:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:03.972 02:22:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:03.972 02:22:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:03.972 02:22:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:03.972 02:22:31 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:03.972 02:22:31 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:03.972 02:22:31 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:03.972 02:22:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:03.972 02:22:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:03.972 02:22:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:03.972 02:22:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:03.972 02:22:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:03.972 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:03.972 02:22:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:03.972 02:22:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:03.972 02:22:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:03.972 02:22:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:03.972 02:22:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:03.972 02:22:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:03.972 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:03.972 02:22:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:03.972 02:22:31 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:03.972 02:22:31 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:03.972 02:22:31 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:03.972 02:22:31 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:03.972 02:22:31 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:03.972 02:22:31 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:03.972 02:22:31 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:03.972 02:22:31 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:03.972 02:22:31 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:03.972 02:22:31 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:03.972 02:22:31 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:03.972 02:22:31 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:03.972 02:22:31 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:03.972 02:22:31 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:03.972 02:22:31 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:03.972 02:22:31 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:03.972 02:22:31 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:03.972 02:22:31 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:03.972 02:22:31 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:03.972 02:22:31 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:03.972 02:22:31 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:03.972 02:22:31 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:03.972 02:22:31 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:03.972 02:22:31 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:03.973 02:22:31 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:03.973 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:03.973 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.383 ms 00:20:03.973 00:20:03.973 --- 10.0.0.2 ping statistics --- 00:20:03.973 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:03.973 rtt min/avg/max/mdev = 0.383/0.383/0.383/0.000 ms 00:20:03.973 02:22:31 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:03.973 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:03.973 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.167 ms 00:20:03.973 00:20:03.973 --- 10.0.0.1 ping statistics --- 00:20:03.973 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:03.973 rtt min/avg/max/mdev = 0.167/0.167/0.167/0.000 ms 00:20:03.973 02:22:31 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:03.973 02:22:31 -- nvmf/common.sh@410 -- # return 0 00:20:03.973 02:22:31 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:03.973 02:22:31 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:03.973 02:22:31 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:03.973 02:22:31 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:03.973 02:22:31 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:03.973 02:22:31 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:03.973 02:22:31 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:03.973 02:22:31 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:20:03.973 02:22:31 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:03.973 02:22:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:03.973 02:22:31 -- common/autotest_common.sh@10 -- # set +x 00:20:03.973 02:22:31 -- nvmf/common.sh@469 -- # nvmfpid=2153108 00:20:03.973 02:22:31 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:20:03.973 02:22:31 -- nvmf/common.sh@470 -- # waitforlisten 2153108 00:20:03.973 02:22:31 -- common/autotest_common.sh@829 -- # '[' -z 2153108 ']' 00:20:03.973 02:22:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:03.973 02:22:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:03.973 02:22:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:03.973 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:03.973 02:22:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:03.973 02:22:31 -- common/autotest_common.sh@10 -- # set +x 00:20:03.973 [2024-12-08 02:22:31.455176] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:03.973 [2024-12-08 02:22:31.455252] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:03.973 EAL: No free 2048 kB hugepages reported on node 1 00:20:03.973 [2024-12-08 02:22:31.520479] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:03.973 [2024-12-08 02:22:31.630548] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:03.973 [2024-12-08 02:22:31.630700] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:03.973 [2024-12-08 02:22:31.630717] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:03.973 [2024-12-08 02:22:31.630729] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:03.973 [2024-12-08 02:22:31.630787] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:03.973 [2024-12-08 02:22:31.630847] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:03.973 [2024-12-08 02:22:31.630914] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:03.973 [2024-12-08 02:22:31.630917] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:04.906 02:22:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:04.906 02:22:32 -- common/autotest_common.sh@862 -- # return 0 00:20:04.906 02:22:32 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:04.906 02:22:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:04.906 02:22:32 -- common/autotest_common.sh@10 -- # set +x 00:20:04.906 02:22:32 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:04.906 02:22:32 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:20:04.906 02:22:32 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:20:04.906 02:22:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:04.906 02:22:32 -- common/autotest_common.sh@10 -- # set +x 00:20:04.906 Malloc0 00:20:04.906 02:22:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:04.906 02:22:32 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:20:04.906 02:22:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:04.906 02:22:32 -- common/autotest_common.sh@10 -- # set +x 00:20:04.906 Delay0 00:20:04.906 02:22:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:04.906 02:22:32 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:20:04.906 02:22:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:04.906 02:22:32 -- common/autotest_common.sh@10 -- # set +x 00:20:04.906 [2024-12-08 02:22:32.489090] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:04.906 02:22:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:04.906 02:22:32 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:20:04.906 02:22:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:04.906 02:22:32 -- common/autotest_common.sh@10 -- # set +x 00:20:04.906 02:22:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:04.906 02:22:32 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:20:04.906 02:22:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:04.906 02:22:32 -- common/autotest_common.sh@10 -- # set +x 00:20:04.906 02:22:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:04.906 02:22:32 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:04.906 02:22:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:04.906 02:22:32 -- common/autotest_common.sh@10 -- # set +x 00:20:04.906 [2024-12-08 02:22:32.517365] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:04.906 02:22:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:04.906 02:22:32 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:20:05.477 02:22:33 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:20:05.477 02:22:33 -- common/autotest_common.sh@1187 -- # local i=0 00:20:05.477 02:22:33 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:05.477 02:22:33 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:05.477 02:22:33 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:08.017 02:22:35 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:08.017 02:22:35 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:08.017 02:22:35 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:20:08.017 02:22:35 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:08.017 02:22:35 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:08.017 02:22:35 -- common/autotest_common.sh@1197 -- # return 0 00:20:08.017 02:22:35 -- target/initiator_timeout.sh@35 -- # fio_pid=2153581 00:20:08.017 02:22:35 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:20:08.017 02:22:35 -- target/initiator_timeout.sh@37 -- # sleep 3 00:20:08.017 [global] 00:20:08.017 thread=1 00:20:08.017 invalidate=1 00:20:08.017 rw=write 00:20:08.017 time_based=1 00:20:08.017 runtime=60 00:20:08.017 ioengine=libaio 00:20:08.017 direct=1 00:20:08.017 bs=4096 00:20:08.017 iodepth=1 00:20:08.017 norandommap=0 00:20:08.017 numjobs=1 00:20:08.017 00:20:08.017 verify_dump=1 00:20:08.017 verify_backlog=512 00:20:08.017 verify_state_save=0 00:20:08.017 do_verify=1 00:20:08.017 verify=crc32c-intel 00:20:08.017 [job0] 00:20:08.017 filename=/dev/nvme0n1 00:20:08.017 Could not set queue depth (nvme0n1) 00:20:08.017 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:08.017 fio-3.35 00:20:08.017 Starting 1 thread 00:20:10.548 02:22:38 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:20:10.548 02:22:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:10.548 02:22:38 -- common/autotest_common.sh@10 -- # set +x 00:20:10.548 true 00:20:10.548 02:22:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:10.548 02:22:38 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:20:10.548 02:22:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:10.548 02:22:38 -- common/autotest_common.sh@10 -- # set +x 00:20:10.548 true 00:20:10.548 02:22:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:10.548 02:22:38 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:20:10.548 02:22:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:10.548 02:22:38 -- common/autotest_common.sh@10 -- # set +x 00:20:10.548 true 00:20:10.548 02:22:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:10.548 02:22:38 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:20:10.548 02:22:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:10.548 02:22:38 -- common/autotest_common.sh@10 -- # set +x 00:20:10.548 true 00:20:10.548 02:22:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:10.548 02:22:38 -- target/initiator_timeout.sh@45 -- # sleep 3 00:20:13.838 02:22:41 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:20:13.838 02:22:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:13.838 02:22:41 -- common/autotest_common.sh@10 -- # set +x 00:20:13.838 true 00:20:13.838 02:22:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:13.838 02:22:41 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:20:13.838 02:22:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:13.838 02:22:41 -- common/autotest_common.sh@10 -- # set +x 00:20:13.838 true 00:20:13.838 02:22:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:13.838 02:22:41 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:20:13.838 02:22:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:13.838 02:22:41 -- common/autotest_common.sh@10 -- # set +x 00:20:13.838 true 00:20:13.838 02:22:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:13.838 02:22:41 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:20:13.838 02:22:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:13.838 02:22:41 -- common/autotest_common.sh@10 -- # set +x 00:20:13.838 true 00:20:13.838 02:22:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:13.838 02:22:41 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:20:13.838 02:22:41 -- target/initiator_timeout.sh@54 -- # wait 2153581 00:21:10.076 00:21:10.076 job0: (groupid=0, jobs=1): err= 0: pid=2153772: Sun Dec 8 02:23:35 2024 00:21:10.076 read: IOPS=27, BW=111KiB/s (114kB/s)(6672KiB/60036msec) 00:21:10.076 slat (nsec): min=6874, max=51032, avg=16631.72, stdev=8668.47 00:21:10.076 clat (usec): min=217, max=41147k, avg=35661.41, stdev=1007388.43 00:21:10.076 lat (usec): min=224, max=41147k, avg=35678.05, stdev=1007388.43 00:21:10.076 clat percentiles (usec): 00:21:10.076 | 1.00th=[ 229], 5.00th=[ 239], 10.00th=[ 243], 00:21:10.076 | 20.00th=[ 255], 30.00th=[ 265], 40.00th=[ 273], 00:21:10.076 | 50.00th=[ 281], 60.00th=[ 306], 70.00th=[ 478], 00:21:10.076 | 80.00th=[ 41157], 90.00th=[ 41157], 95.00th=[ 41157], 00:21:10.076 | 99.00th=[ 41157], 99.50th=[ 41157], 99.90th=[ 41157], 00:21:10.076 | 99.95th=[17112761], 99.99th=[17112761] 00:21:10.076 write: IOPS=34, BW=136KiB/s (140kB/s)(8192KiB/60036msec); 0 zone resets 00:21:10.076 slat (usec): min=6, max=27872, avg=29.72, stdev=615.61 00:21:10.076 clat (usec): min=167, max=958, avg=218.23, stdev=57.21 00:21:10.076 lat (usec): min=174, max=28131, avg=247.95, stdev=619.53 00:21:10.076 clat percentiles (usec): 00:21:10.076 | 1.00th=[ 174], 5.00th=[ 180], 10.00th=[ 182], 20.00th=[ 188], 00:21:10.076 | 30.00th=[ 194], 40.00th=[ 200], 50.00th=[ 206], 60.00th=[ 215], 00:21:10.076 | 70.00th=[ 221], 80.00th=[ 229], 90.00th=[ 247], 95.00th=[ 322], 00:21:10.076 | 99.00th=[ 424], 99.50th=[ 578], 99.90th=[ 791], 99.95th=[ 857], 00:21:10.076 | 99.99th=[ 963] 00:21:10.076 bw ( KiB/s): min= 352, max= 7840, per=100.00%, avg=3276.80, stdev=2976.40, samples=5 00:21:10.076 iops : min= 88, max= 1960, avg=819.20, stdev=744.10, samples=5 00:21:10.076 lat (usec) : 250=57.75%, 500=29.31%, 750=0.97%, 1000=0.08% 00:21:10.076 lat (msec) : 2=0.05%, 50=11.81%, >=2000=0.03% 00:21:10.076 cpu : usr=0.05%, sys=0.15%, ctx=3719, majf=0, minf=1 00:21:10.076 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:21:10.076 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:10.076 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:10.076 issued rwts: total=1668,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:10.076 latency : target=0, window=0, percentile=100.00%, depth=1 00:21:10.076 00:21:10.076 Run status group 0 (all jobs): 00:21:10.076 READ: bw=111KiB/s (114kB/s), 111KiB/s-111KiB/s (114kB/s-114kB/s), io=6672KiB (6832kB), run=60036-60036msec 00:21:10.076 WRITE: bw=136KiB/s (140kB/s), 136KiB/s-136KiB/s (140kB/s-140kB/s), io=8192KiB (8389kB), run=60036-60036msec 00:21:10.076 00:21:10.076 Disk stats (read/write): 00:21:10.076 nvme0n1: ios=1716/2048, merge=0/0, ticks=19461/435, in_queue=19896, util=99.66% 00:21:10.076 02:23:35 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:21:10.076 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:21:10.076 02:23:35 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:21:10.076 02:23:35 -- common/autotest_common.sh@1208 -- # local i=0 00:21:10.076 02:23:35 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:21:10.076 02:23:35 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:10.077 02:23:35 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:21:10.077 02:23:35 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:10.077 02:23:35 -- common/autotest_common.sh@1220 -- # return 0 00:21:10.077 02:23:35 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:21:10.077 02:23:35 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:21:10.077 nvmf hotplug test: fio successful as expected 00:21:10.077 02:23:35 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:10.077 02:23:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:10.077 02:23:35 -- common/autotest_common.sh@10 -- # set +x 00:21:10.077 02:23:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:10.077 02:23:35 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:21:10.077 02:23:35 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:21:10.077 02:23:35 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:21:10.077 02:23:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:10.077 02:23:35 -- nvmf/common.sh@116 -- # sync 00:21:10.077 02:23:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:10.077 02:23:35 -- nvmf/common.sh@119 -- # set +e 00:21:10.077 02:23:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:10.077 02:23:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:10.077 rmmod nvme_tcp 00:21:10.077 rmmod nvme_fabrics 00:21:10.077 rmmod nvme_keyring 00:21:10.077 02:23:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:10.077 02:23:35 -- nvmf/common.sh@123 -- # set -e 00:21:10.077 02:23:35 -- nvmf/common.sh@124 -- # return 0 00:21:10.077 02:23:35 -- nvmf/common.sh@477 -- # '[' -n 2153108 ']' 00:21:10.077 02:23:35 -- nvmf/common.sh@478 -- # killprocess 2153108 00:21:10.077 02:23:35 -- common/autotest_common.sh@936 -- # '[' -z 2153108 ']' 00:21:10.077 02:23:35 -- common/autotest_common.sh@940 -- # kill -0 2153108 00:21:10.077 02:23:35 -- common/autotest_common.sh@941 -- # uname 00:21:10.077 02:23:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:10.077 02:23:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2153108 00:21:10.077 02:23:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:10.077 02:23:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:10.077 02:23:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2153108' 00:21:10.077 killing process with pid 2153108 00:21:10.077 02:23:35 -- common/autotest_common.sh@955 -- # kill 2153108 00:21:10.077 02:23:35 -- common/autotest_common.sh@960 -- # wait 2153108 00:21:10.077 02:23:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:10.077 02:23:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:10.077 02:23:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:10.077 02:23:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:10.077 02:23:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:10.077 02:23:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:10.077 02:23:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:10.077 02:23:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:10.644 02:23:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:10.644 00:21:10.644 real 1m9.285s 00:21:10.644 user 4m14.524s 00:21:10.644 sys 0m6.517s 00:21:10.644 02:23:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:10.644 02:23:38 -- common/autotest_common.sh@10 -- # set +x 00:21:10.644 ************************************ 00:21:10.644 END TEST nvmf_initiator_timeout 00:21:10.644 ************************************ 00:21:10.644 02:23:38 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:21:10.644 02:23:38 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:21:10.644 02:23:38 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:21:10.644 02:23:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:10.644 02:23:38 -- common/autotest_common.sh@10 -- # set +x 00:21:12.548 02:23:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:12.548 02:23:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:12.548 02:23:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:12.548 02:23:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:12.548 02:23:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:12.548 02:23:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:12.548 02:23:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:12.548 02:23:40 -- nvmf/common.sh@294 -- # net_devs=() 00:21:12.548 02:23:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:12.548 02:23:40 -- nvmf/common.sh@295 -- # e810=() 00:21:12.548 02:23:40 -- nvmf/common.sh@295 -- # local -ga e810 00:21:12.548 02:23:40 -- nvmf/common.sh@296 -- # x722=() 00:21:12.548 02:23:40 -- nvmf/common.sh@296 -- # local -ga x722 00:21:12.548 02:23:40 -- nvmf/common.sh@297 -- # mlx=() 00:21:12.548 02:23:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:12.548 02:23:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:12.548 02:23:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:12.548 02:23:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:12.548 02:23:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:12.548 02:23:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:12.548 02:23:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:12.548 02:23:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:12.548 02:23:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:12.548 02:23:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:12.548 02:23:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:12.548 02:23:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:12.548 02:23:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:12.548 02:23:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:12.548 02:23:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:12.548 02:23:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:12.548 02:23:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:12.548 02:23:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:12.548 02:23:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:12.548 02:23:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:12.548 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:12.548 02:23:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:12.548 02:23:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:12.548 02:23:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:12.548 02:23:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:12.548 02:23:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:12.548 02:23:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:12.548 02:23:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:12.548 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:12.548 02:23:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:12.548 02:23:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:12.548 02:23:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:12.548 02:23:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:12.548 02:23:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:12.548 02:23:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:12.548 02:23:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:12.548 02:23:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:12.548 02:23:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:12.548 02:23:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:12.548 02:23:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:12.548 02:23:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:12.548 02:23:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:12.549 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:12.549 02:23:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:12.549 02:23:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:12.549 02:23:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:12.549 02:23:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:12.549 02:23:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:12.549 02:23:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:12.549 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:12.549 02:23:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:12.549 02:23:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:12.549 02:23:40 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:12.549 02:23:40 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:21:12.549 02:23:40 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:12.549 02:23:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:12.549 02:23:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:12.549 02:23:40 -- common/autotest_common.sh@10 -- # set +x 00:21:12.549 ************************************ 00:21:12.549 START TEST nvmf_perf_adq 00:21:12.549 ************************************ 00:21:12.549 02:23:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:12.549 * Looking for test storage... 00:21:12.549 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:12.549 02:23:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:12.549 02:23:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:12.549 02:23:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:12.549 02:23:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:12.549 02:23:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:12.549 02:23:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:12.549 02:23:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:12.549 02:23:40 -- scripts/common.sh@335 -- # IFS=.-: 00:21:12.549 02:23:40 -- scripts/common.sh@335 -- # read -ra ver1 00:21:12.549 02:23:40 -- scripts/common.sh@336 -- # IFS=.-: 00:21:12.549 02:23:40 -- scripts/common.sh@336 -- # read -ra ver2 00:21:12.549 02:23:40 -- scripts/common.sh@337 -- # local 'op=<' 00:21:12.549 02:23:40 -- scripts/common.sh@339 -- # ver1_l=2 00:21:12.549 02:23:40 -- scripts/common.sh@340 -- # ver2_l=1 00:21:12.549 02:23:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:12.549 02:23:40 -- scripts/common.sh@343 -- # case "$op" in 00:21:12.549 02:23:40 -- scripts/common.sh@344 -- # : 1 00:21:12.549 02:23:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:12.549 02:23:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:12.549 02:23:40 -- scripts/common.sh@364 -- # decimal 1 00:21:12.549 02:23:40 -- scripts/common.sh@352 -- # local d=1 00:21:12.549 02:23:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:12.549 02:23:40 -- scripts/common.sh@354 -- # echo 1 00:21:12.549 02:23:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:12.549 02:23:40 -- scripts/common.sh@365 -- # decimal 2 00:21:12.549 02:23:40 -- scripts/common.sh@352 -- # local d=2 00:21:12.549 02:23:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:12.549 02:23:40 -- scripts/common.sh@354 -- # echo 2 00:21:12.549 02:23:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:12.549 02:23:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:12.549 02:23:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:12.549 02:23:40 -- scripts/common.sh@367 -- # return 0 00:21:12.549 02:23:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:12.549 02:23:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:12.549 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:12.549 --rc genhtml_branch_coverage=1 00:21:12.549 --rc genhtml_function_coverage=1 00:21:12.549 --rc genhtml_legend=1 00:21:12.549 --rc geninfo_all_blocks=1 00:21:12.549 --rc geninfo_unexecuted_blocks=1 00:21:12.549 00:21:12.549 ' 00:21:12.549 02:23:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:12.549 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:12.549 --rc genhtml_branch_coverage=1 00:21:12.549 --rc genhtml_function_coverage=1 00:21:12.549 --rc genhtml_legend=1 00:21:12.549 --rc geninfo_all_blocks=1 00:21:12.549 --rc geninfo_unexecuted_blocks=1 00:21:12.549 00:21:12.549 ' 00:21:12.549 02:23:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:12.549 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:12.549 --rc genhtml_branch_coverage=1 00:21:12.549 --rc genhtml_function_coverage=1 00:21:12.549 --rc genhtml_legend=1 00:21:12.549 --rc geninfo_all_blocks=1 00:21:12.549 --rc geninfo_unexecuted_blocks=1 00:21:12.549 00:21:12.549 ' 00:21:12.549 02:23:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:12.549 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:12.549 --rc genhtml_branch_coverage=1 00:21:12.549 --rc genhtml_function_coverage=1 00:21:12.549 --rc genhtml_legend=1 00:21:12.549 --rc geninfo_all_blocks=1 00:21:12.549 --rc geninfo_unexecuted_blocks=1 00:21:12.549 00:21:12.549 ' 00:21:12.549 02:23:40 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:12.549 02:23:40 -- nvmf/common.sh@7 -- # uname -s 00:21:12.549 02:23:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:12.549 02:23:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:12.549 02:23:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:12.549 02:23:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:12.549 02:23:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:12.549 02:23:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:12.549 02:23:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:12.549 02:23:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:12.549 02:23:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:12.549 02:23:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:12.549 02:23:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:12.549 02:23:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:12.549 02:23:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:12.549 02:23:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:12.549 02:23:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:12.549 02:23:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:12.549 02:23:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:12.549 02:23:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:12.549 02:23:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:12.549 02:23:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:12.549 02:23:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:12.549 02:23:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:12.549 02:23:40 -- paths/export.sh@5 -- # export PATH 00:21:12.549 02:23:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:12.549 02:23:40 -- nvmf/common.sh@46 -- # : 0 00:21:12.549 02:23:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:12.549 02:23:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:12.549 02:23:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:12.549 02:23:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:12.549 02:23:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:12.549 02:23:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:12.549 02:23:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:12.549 02:23:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:12.549 02:23:40 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:21:12.549 02:23:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:12.549 02:23:40 -- common/autotest_common.sh@10 -- # set +x 00:21:15.129 02:23:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:15.129 02:23:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:15.129 02:23:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:15.129 02:23:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:15.129 02:23:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:15.129 02:23:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:15.129 02:23:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:15.129 02:23:42 -- nvmf/common.sh@294 -- # net_devs=() 00:21:15.129 02:23:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:15.129 02:23:42 -- nvmf/common.sh@295 -- # e810=() 00:21:15.129 02:23:42 -- nvmf/common.sh@295 -- # local -ga e810 00:21:15.129 02:23:42 -- nvmf/common.sh@296 -- # x722=() 00:21:15.129 02:23:42 -- nvmf/common.sh@296 -- # local -ga x722 00:21:15.129 02:23:42 -- nvmf/common.sh@297 -- # mlx=() 00:21:15.129 02:23:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:15.129 02:23:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:15.129 02:23:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:15.129 02:23:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:15.129 02:23:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:15.129 02:23:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:15.129 02:23:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:15.129 02:23:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:15.129 02:23:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:15.129 02:23:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:15.129 02:23:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:15.129 02:23:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:15.129 02:23:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:15.129 02:23:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:15.129 02:23:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:15.129 02:23:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:15.129 02:23:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:15.129 02:23:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:15.129 02:23:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:15.129 02:23:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:15.129 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:15.129 02:23:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:15.129 02:23:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:15.129 02:23:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:15.129 02:23:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:15.129 02:23:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:15.129 02:23:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:15.129 02:23:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:15.129 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:15.129 02:23:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:15.129 02:23:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:15.129 02:23:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:15.129 02:23:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:15.129 02:23:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:15.129 02:23:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:15.129 02:23:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:15.129 02:23:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:15.129 02:23:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:15.129 02:23:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:15.129 02:23:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:15.129 02:23:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:15.129 02:23:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:15.129 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:15.129 02:23:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:15.129 02:23:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:15.129 02:23:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:15.129 02:23:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:15.129 02:23:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:15.129 02:23:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:15.129 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:15.129 02:23:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:15.129 02:23:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:15.129 02:23:42 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:15.129 02:23:42 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:21:15.129 02:23:42 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:21:15.129 02:23:42 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:21:15.129 02:23:42 -- target/perf_adq.sh@52 -- # rmmod ice 00:21:15.393 02:23:43 -- target/perf_adq.sh@53 -- # modprobe ice 00:21:17.929 02:23:45 -- target/perf_adq.sh@54 -- # sleep 5 00:21:23.206 02:23:50 -- target/perf_adq.sh@67 -- # nvmftestinit 00:21:23.206 02:23:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:23.206 02:23:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:23.206 02:23:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:23.206 02:23:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:23.206 02:23:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:23.206 02:23:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:23.206 02:23:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:23.206 02:23:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:23.206 02:23:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:23.206 02:23:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:23.206 02:23:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:23.206 02:23:50 -- common/autotest_common.sh@10 -- # set +x 00:21:23.206 02:23:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:23.206 02:23:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:23.206 02:23:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:23.206 02:23:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:23.206 02:23:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:23.206 02:23:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:23.206 02:23:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:23.206 02:23:50 -- nvmf/common.sh@294 -- # net_devs=() 00:21:23.206 02:23:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:23.206 02:23:50 -- nvmf/common.sh@295 -- # e810=() 00:21:23.206 02:23:50 -- nvmf/common.sh@295 -- # local -ga e810 00:21:23.206 02:23:50 -- nvmf/common.sh@296 -- # x722=() 00:21:23.206 02:23:50 -- nvmf/common.sh@296 -- # local -ga x722 00:21:23.206 02:23:50 -- nvmf/common.sh@297 -- # mlx=() 00:21:23.206 02:23:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:23.206 02:23:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:23.206 02:23:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:23.206 02:23:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:23.206 02:23:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:23.206 02:23:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:23.206 02:23:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:23.206 02:23:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:23.206 02:23:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:23.206 02:23:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:23.206 02:23:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:23.206 02:23:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:23.206 02:23:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:23.206 02:23:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:23.206 02:23:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:23.206 02:23:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:23.206 02:23:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:23.206 02:23:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:23.206 02:23:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:23.206 02:23:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:23.206 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:23.206 02:23:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:23.206 02:23:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:23.206 02:23:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:23.206 02:23:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:23.206 02:23:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:23.206 02:23:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:23.206 02:23:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:23.206 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:23.206 02:23:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:23.206 02:23:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:23.206 02:23:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:23.206 02:23:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:23.206 02:23:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:23.206 02:23:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:23.206 02:23:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:23.206 02:23:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:23.206 02:23:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:23.206 02:23:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:23.206 02:23:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:23.206 02:23:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:23.207 02:23:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:23.207 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:23.207 02:23:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:23.207 02:23:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:23.207 02:23:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:23.207 02:23:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:23.207 02:23:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:23.207 02:23:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:23.207 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:23.207 02:23:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:23.207 02:23:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:23.207 02:23:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:23.207 02:23:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:23.207 02:23:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:23.207 02:23:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:23.207 02:23:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:23.207 02:23:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:23.207 02:23:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:23.207 02:23:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:23.207 02:23:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:23.207 02:23:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:23.207 02:23:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:23.207 02:23:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:23.207 02:23:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:23.207 02:23:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:23.207 02:23:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:23.207 02:23:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:23.207 02:23:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:23.207 02:23:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:23.207 02:23:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:23.207 02:23:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:23.207 02:23:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:23.207 02:23:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:23.207 02:23:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:23.207 02:23:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:23.207 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:23.207 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.244 ms 00:21:23.207 00:21:23.207 --- 10.0.0.2 ping statistics --- 00:21:23.207 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:23.207 rtt min/avg/max/mdev = 0.244/0.244/0.244/0.000 ms 00:21:23.207 02:23:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:23.207 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:23.207 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:21:23.207 00:21:23.207 --- 10.0.0.1 ping statistics --- 00:21:23.207 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:23.207 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:21:23.207 02:23:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:23.207 02:23:50 -- nvmf/common.sh@410 -- # return 0 00:21:23.207 02:23:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:23.207 02:23:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:23.207 02:23:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:23.207 02:23:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:23.207 02:23:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:23.207 02:23:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:23.207 02:23:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:23.207 02:23:50 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:21:23.207 02:23:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:23.207 02:23:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:23.207 02:23:50 -- common/autotest_common.sh@10 -- # set +x 00:21:23.207 02:23:50 -- nvmf/common.sh@469 -- # nvmfpid=2165637 00:21:23.207 02:23:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:21:23.207 02:23:50 -- nvmf/common.sh@470 -- # waitforlisten 2165637 00:21:23.207 02:23:50 -- common/autotest_common.sh@829 -- # '[' -z 2165637 ']' 00:21:23.207 02:23:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:23.207 02:23:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:23.207 02:23:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:23.207 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:23.207 02:23:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:23.207 02:23:50 -- common/autotest_common.sh@10 -- # set +x 00:21:23.207 [2024-12-08 02:23:50.637946] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:23.207 [2024-12-08 02:23:50.638039] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:23.207 EAL: No free 2048 kB hugepages reported on node 1 00:21:23.207 [2024-12-08 02:23:50.708344] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:23.207 [2024-12-08 02:23:50.821867] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:23.207 [2024-12-08 02:23:50.822024] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:23.207 [2024-12-08 02:23:50.822042] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:23.207 [2024-12-08 02:23:50.822055] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:23.207 [2024-12-08 02:23:50.822108] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:23.207 [2024-12-08 02:23:50.822135] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:23.207 [2024-12-08 02:23:50.822194] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:23.207 [2024-12-08 02:23:50.822197] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:23.207 02:23:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:23.207 02:23:50 -- common/autotest_common.sh@862 -- # return 0 00:21:23.207 02:23:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:23.207 02:23:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:23.207 02:23:50 -- common/autotest_common.sh@10 -- # set +x 00:21:23.207 02:23:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:23.207 02:23:50 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:21:23.207 02:23:50 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:21:23.207 02:23:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:23.207 02:23:50 -- common/autotest_common.sh@10 -- # set +x 00:21:23.207 02:23:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:23.207 02:23:50 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:21:23.207 02:23:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:23.207 02:23:50 -- common/autotest_common.sh@10 -- # set +x 00:21:23.467 02:23:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:23.467 02:23:51 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:21:23.467 02:23:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:23.467 02:23:51 -- common/autotest_common.sh@10 -- # set +x 00:21:23.467 [2024-12-08 02:23:51.018563] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:23.467 02:23:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:23.467 02:23:51 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:23.467 02:23:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:23.467 02:23:51 -- common/autotest_common.sh@10 -- # set +x 00:21:23.467 Malloc1 00:21:23.467 02:23:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:23.467 02:23:51 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:23.467 02:23:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:23.467 02:23:51 -- common/autotest_common.sh@10 -- # set +x 00:21:23.467 02:23:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:23.467 02:23:51 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:23.467 02:23:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:23.467 02:23:51 -- common/autotest_common.sh@10 -- # set +x 00:21:23.467 02:23:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:23.467 02:23:51 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:23.468 02:23:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:23.468 02:23:51 -- common/autotest_common.sh@10 -- # set +x 00:21:23.468 [2024-12-08 02:23:51.071730] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:23.468 02:23:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:23.468 02:23:51 -- target/perf_adq.sh@73 -- # perfpid=2165729 00:21:23.468 02:23:51 -- target/perf_adq.sh@74 -- # sleep 2 00:21:23.468 02:23:51 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:21:23.468 EAL: No free 2048 kB hugepages reported on node 1 00:21:25.373 02:23:53 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:21:25.373 02:23:53 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:21:25.373 02:23:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:25.373 02:23:53 -- target/perf_adq.sh@76 -- # wc -l 00:21:25.373 02:23:53 -- common/autotest_common.sh@10 -- # set +x 00:21:25.373 02:23:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:25.373 02:23:53 -- target/perf_adq.sh@76 -- # count=4 00:21:25.373 02:23:53 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:21:25.373 02:23:53 -- target/perf_adq.sh@81 -- # wait 2165729 00:21:33.491 Initializing NVMe Controllers 00:21:33.491 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:21:33.491 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:21:33.491 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:21:33.491 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:21:33.491 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:21:33.491 Initialization complete. Launching workers. 00:21:33.491 ======================================================== 00:21:33.491 Latency(us) 00:21:33.492 Device Information : IOPS MiB/s Average min max 00:21:33.492 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 10745.50 41.97 5955.83 1809.38 10166.78 00:21:33.492 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 10933.50 42.71 5854.66 1770.95 9332.37 00:21:33.492 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 11157.30 43.58 5737.63 1530.47 9869.73 00:21:33.492 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 11085.00 43.30 5773.56 1767.59 9955.05 00:21:33.492 ======================================================== 00:21:33.492 Total : 43921.30 171.57 5829.21 1530.47 10166.78 00:21:33.492 00:21:33.492 02:24:01 -- target/perf_adq.sh@82 -- # nvmftestfini 00:21:33.492 02:24:01 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:33.492 02:24:01 -- nvmf/common.sh@116 -- # sync 00:21:33.492 02:24:01 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:33.492 02:24:01 -- nvmf/common.sh@119 -- # set +e 00:21:33.492 02:24:01 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:33.492 02:24:01 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:33.492 rmmod nvme_tcp 00:21:33.492 rmmod nvme_fabrics 00:21:33.492 rmmod nvme_keyring 00:21:33.492 02:24:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:33.751 02:24:01 -- nvmf/common.sh@123 -- # set -e 00:21:33.751 02:24:01 -- nvmf/common.sh@124 -- # return 0 00:21:33.751 02:24:01 -- nvmf/common.sh@477 -- # '[' -n 2165637 ']' 00:21:33.751 02:24:01 -- nvmf/common.sh@478 -- # killprocess 2165637 00:21:33.751 02:24:01 -- common/autotest_common.sh@936 -- # '[' -z 2165637 ']' 00:21:33.751 02:24:01 -- common/autotest_common.sh@940 -- # kill -0 2165637 00:21:33.751 02:24:01 -- common/autotest_common.sh@941 -- # uname 00:21:33.751 02:24:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:33.751 02:24:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2165637 00:21:33.751 02:24:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:33.751 02:24:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:33.751 02:24:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2165637' 00:21:33.751 killing process with pid 2165637 00:21:33.751 02:24:01 -- common/autotest_common.sh@955 -- # kill 2165637 00:21:33.751 02:24:01 -- common/autotest_common.sh@960 -- # wait 2165637 00:21:34.009 02:24:01 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:34.009 02:24:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:34.009 02:24:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:34.009 02:24:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:34.009 02:24:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:34.009 02:24:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:34.009 02:24:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:34.009 02:24:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:35.914 02:24:03 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:35.914 02:24:03 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:21:35.914 02:24:03 -- target/perf_adq.sh@52 -- # rmmod ice 00:21:36.851 02:24:04 -- target/perf_adq.sh@53 -- # modprobe ice 00:21:39.381 02:24:06 -- target/perf_adq.sh@54 -- # sleep 5 00:21:44.655 02:24:11 -- target/perf_adq.sh@87 -- # nvmftestinit 00:21:44.655 02:24:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:44.655 02:24:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:44.655 02:24:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:44.655 02:24:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:44.655 02:24:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:44.655 02:24:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:44.655 02:24:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:44.655 02:24:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:44.655 02:24:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:44.655 02:24:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:44.655 02:24:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:44.655 02:24:11 -- common/autotest_common.sh@10 -- # set +x 00:21:44.655 02:24:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:44.655 02:24:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:44.655 02:24:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:44.655 02:24:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:44.655 02:24:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:44.655 02:24:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:44.655 02:24:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:44.655 02:24:11 -- nvmf/common.sh@294 -- # net_devs=() 00:21:44.655 02:24:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:44.655 02:24:11 -- nvmf/common.sh@295 -- # e810=() 00:21:44.655 02:24:11 -- nvmf/common.sh@295 -- # local -ga e810 00:21:44.655 02:24:11 -- nvmf/common.sh@296 -- # x722=() 00:21:44.655 02:24:11 -- nvmf/common.sh@296 -- # local -ga x722 00:21:44.655 02:24:11 -- nvmf/common.sh@297 -- # mlx=() 00:21:44.655 02:24:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:44.655 02:24:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:44.655 02:24:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:44.655 02:24:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:44.655 02:24:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:44.655 02:24:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:44.655 02:24:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:44.655 02:24:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:44.655 02:24:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:44.655 02:24:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:44.655 02:24:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:44.655 02:24:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:44.655 02:24:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:44.655 02:24:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:44.655 02:24:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:44.655 02:24:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:44.655 02:24:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:44.655 02:24:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:44.655 02:24:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:44.655 02:24:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:44.655 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:44.655 02:24:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:44.655 02:24:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:44.655 02:24:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:44.655 02:24:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:44.655 02:24:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:44.655 02:24:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:44.655 02:24:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:44.655 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:44.655 02:24:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:44.655 02:24:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:44.655 02:24:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:44.655 02:24:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:44.655 02:24:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:44.655 02:24:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:44.655 02:24:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:44.655 02:24:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:44.655 02:24:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:44.655 02:24:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:44.655 02:24:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:44.656 02:24:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:44.656 02:24:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:44.656 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:44.656 02:24:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:44.656 02:24:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:44.656 02:24:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:44.656 02:24:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:44.656 02:24:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:44.656 02:24:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:44.656 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:44.656 02:24:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:44.656 02:24:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:44.656 02:24:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:44.656 02:24:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:44.656 02:24:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:44.656 02:24:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:44.656 02:24:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:44.656 02:24:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:44.656 02:24:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:44.656 02:24:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:44.656 02:24:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:44.656 02:24:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:44.656 02:24:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:44.656 02:24:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:44.656 02:24:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:44.656 02:24:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:44.656 02:24:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:44.656 02:24:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:44.656 02:24:11 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:44.656 02:24:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:44.656 02:24:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:44.656 02:24:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:44.656 02:24:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:44.656 02:24:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:44.656 02:24:11 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:44.656 02:24:11 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:44.656 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:44.656 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.268 ms 00:21:44.656 00:21:44.656 --- 10.0.0.2 ping statistics --- 00:21:44.656 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:44.656 rtt min/avg/max/mdev = 0.268/0.268/0.268/0.000 ms 00:21:44.656 02:24:11 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:44.656 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:44.656 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.115 ms 00:21:44.656 00:21:44.656 --- 10.0.0.1 ping statistics --- 00:21:44.656 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:44.656 rtt min/avg/max/mdev = 0.115/0.115/0.115/0.000 ms 00:21:44.656 02:24:11 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:44.656 02:24:11 -- nvmf/common.sh@410 -- # return 0 00:21:44.656 02:24:11 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:44.656 02:24:11 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:44.656 02:24:11 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:44.656 02:24:11 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:44.656 02:24:11 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:44.656 02:24:11 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:44.656 02:24:11 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:44.656 02:24:11 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:21:44.656 02:24:11 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:21:44.656 02:24:11 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:21:44.656 02:24:11 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:21:44.656 net.core.busy_poll = 1 00:21:44.656 02:24:11 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:21:44.656 net.core.busy_read = 1 00:21:44.656 02:24:11 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:21:44.656 02:24:11 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:21:44.656 02:24:11 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:21:44.656 02:24:11 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:21:44.656 02:24:11 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:21:44.656 02:24:12 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:21:44.656 02:24:12 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:44.656 02:24:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:44.656 02:24:12 -- common/autotest_common.sh@10 -- # set +x 00:21:44.656 02:24:12 -- nvmf/common.sh@469 -- # nvmfpid=2169046 00:21:44.656 02:24:12 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:21:44.656 02:24:12 -- nvmf/common.sh@470 -- # waitforlisten 2169046 00:21:44.656 02:24:12 -- common/autotest_common.sh@829 -- # '[' -z 2169046 ']' 00:21:44.656 02:24:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:44.656 02:24:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:44.656 02:24:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:44.656 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:44.656 02:24:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:44.656 02:24:12 -- common/autotest_common.sh@10 -- # set +x 00:21:44.656 [2024-12-08 02:24:12.054318] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:44.656 [2024-12-08 02:24:12.054417] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:44.656 EAL: No free 2048 kB hugepages reported on node 1 00:21:44.656 [2024-12-08 02:24:12.120422] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:44.656 [2024-12-08 02:24:12.228805] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:44.656 [2024-12-08 02:24:12.228984] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:44.656 [2024-12-08 02:24:12.229002] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:44.656 [2024-12-08 02:24:12.229022] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:44.656 [2024-12-08 02:24:12.229087] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:44.656 [2024-12-08 02:24:12.229149] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:44.656 [2024-12-08 02:24:12.229214] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:44.656 [2024-12-08 02:24:12.229217] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:44.656 02:24:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:44.656 02:24:12 -- common/autotest_common.sh@862 -- # return 0 00:21:44.656 02:24:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:44.656 02:24:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:44.656 02:24:12 -- common/autotest_common.sh@10 -- # set +x 00:21:44.656 02:24:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:44.656 02:24:12 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:21:44.656 02:24:12 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:21:44.656 02:24:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:44.656 02:24:12 -- common/autotest_common.sh@10 -- # set +x 00:21:44.656 02:24:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:44.656 02:24:12 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:21:44.656 02:24:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:44.656 02:24:12 -- common/autotest_common.sh@10 -- # set +x 00:21:44.656 02:24:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:44.656 02:24:12 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:21:44.656 02:24:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:44.656 02:24:12 -- common/autotest_common.sh@10 -- # set +x 00:21:44.656 [2024-12-08 02:24:12.423478] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:44.656 02:24:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:44.656 02:24:12 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:44.656 02:24:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:44.656 02:24:12 -- common/autotest_common.sh@10 -- # set +x 00:21:44.915 Malloc1 00:21:44.915 02:24:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:44.915 02:24:12 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:44.915 02:24:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:44.915 02:24:12 -- common/autotest_common.sh@10 -- # set +x 00:21:44.915 02:24:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:44.915 02:24:12 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:44.915 02:24:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:44.915 02:24:12 -- common/autotest_common.sh@10 -- # set +x 00:21:44.915 02:24:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:44.915 02:24:12 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:44.915 02:24:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:44.915 02:24:12 -- common/autotest_common.sh@10 -- # set +x 00:21:44.915 [2024-12-08 02:24:12.477194] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:44.915 02:24:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:44.915 02:24:12 -- target/perf_adq.sh@94 -- # perfpid=2169194 00:21:44.915 02:24:12 -- target/perf_adq.sh@95 -- # sleep 2 00:21:44.915 02:24:12 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:21:44.915 EAL: No free 2048 kB hugepages reported on node 1 00:21:46.819 02:24:14 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:21:46.819 02:24:14 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:21:46.819 02:24:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:46.819 02:24:14 -- target/perf_adq.sh@97 -- # wc -l 00:21:46.819 02:24:14 -- common/autotest_common.sh@10 -- # set +x 00:21:46.819 02:24:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:46.819 02:24:14 -- target/perf_adq.sh@97 -- # count=2 00:21:46.819 02:24:14 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:21:46.819 02:24:14 -- target/perf_adq.sh@103 -- # wait 2169194 00:21:54.928 Initializing NVMe Controllers 00:21:54.928 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:21:54.928 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:21:54.928 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:21:54.928 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:21:54.928 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:21:54.928 Initialization complete. Launching workers. 00:21:54.928 ======================================================== 00:21:54.928 Latency(us) 00:21:54.928 Device Information : IOPS MiB/s Average min max 00:21:54.928 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 5084.40 19.86 12588.12 2134.54 59259.98 00:21:54.928 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 4907.20 19.17 13042.07 2064.01 61032.72 00:21:54.928 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 15179.50 59.29 4216.02 2028.70 6519.57 00:21:54.928 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 5056.60 19.75 12672.14 2109.55 58753.64 00:21:54.928 ======================================================== 00:21:54.928 Total : 30227.70 118.08 8471.64 2028.70 61032.72 00:21:54.928 00:21:54.928 02:24:22 -- target/perf_adq.sh@104 -- # nvmftestfini 00:21:54.928 02:24:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:54.928 02:24:22 -- nvmf/common.sh@116 -- # sync 00:21:54.928 02:24:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:54.928 02:24:22 -- nvmf/common.sh@119 -- # set +e 00:21:54.928 02:24:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:54.928 02:24:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:54.928 rmmod nvme_tcp 00:21:54.928 rmmod nvme_fabrics 00:21:54.928 rmmod nvme_keyring 00:21:54.928 02:24:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:54.928 02:24:22 -- nvmf/common.sh@123 -- # set -e 00:21:54.928 02:24:22 -- nvmf/common.sh@124 -- # return 0 00:21:54.928 02:24:22 -- nvmf/common.sh@477 -- # '[' -n 2169046 ']' 00:21:54.928 02:24:22 -- nvmf/common.sh@478 -- # killprocess 2169046 00:21:54.928 02:24:22 -- common/autotest_common.sh@936 -- # '[' -z 2169046 ']' 00:21:54.928 02:24:22 -- common/autotest_common.sh@940 -- # kill -0 2169046 00:21:54.928 02:24:22 -- common/autotest_common.sh@941 -- # uname 00:21:54.928 02:24:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:54.928 02:24:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2169046 00:21:55.186 02:24:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:55.186 02:24:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:55.186 02:24:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2169046' 00:21:55.186 killing process with pid 2169046 00:21:55.186 02:24:22 -- common/autotest_common.sh@955 -- # kill 2169046 00:21:55.186 02:24:22 -- common/autotest_common.sh@960 -- # wait 2169046 00:21:55.444 02:24:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:55.444 02:24:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:55.444 02:24:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:55.444 02:24:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:55.444 02:24:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:55.444 02:24:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:55.444 02:24:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:55.444 02:24:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:58.735 02:24:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:58.735 02:24:26 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:21:58.735 00:21:58.735 real 0m45.890s 00:21:58.735 user 2m39.254s 00:21:58.735 sys 0m9.472s 00:21:58.735 02:24:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:58.735 02:24:26 -- common/autotest_common.sh@10 -- # set +x 00:21:58.736 ************************************ 00:21:58.736 END TEST nvmf_perf_adq 00:21:58.736 ************************************ 00:21:58.736 02:24:26 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:21:58.736 02:24:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:58.736 02:24:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:58.736 02:24:26 -- common/autotest_common.sh@10 -- # set +x 00:21:58.736 ************************************ 00:21:58.736 START TEST nvmf_shutdown 00:21:58.736 ************************************ 00:21:58.736 02:24:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:21:58.736 * Looking for test storage... 00:21:58.736 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:58.736 02:24:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:58.736 02:24:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:58.736 02:24:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:58.736 02:24:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:58.736 02:24:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:58.736 02:24:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:58.736 02:24:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:58.736 02:24:26 -- scripts/common.sh@335 -- # IFS=.-: 00:21:58.736 02:24:26 -- scripts/common.sh@335 -- # read -ra ver1 00:21:58.736 02:24:26 -- scripts/common.sh@336 -- # IFS=.-: 00:21:58.736 02:24:26 -- scripts/common.sh@336 -- # read -ra ver2 00:21:58.736 02:24:26 -- scripts/common.sh@337 -- # local 'op=<' 00:21:58.736 02:24:26 -- scripts/common.sh@339 -- # ver1_l=2 00:21:58.736 02:24:26 -- scripts/common.sh@340 -- # ver2_l=1 00:21:58.736 02:24:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:58.736 02:24:26 -- scripts/common.sh@343 -- # case "$op" in 00:21:58.736 02:24:26 -- scripts/common.sh@344 -- # : 1 00:21:58.736 02:24:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:58.736 02:24:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:58.736 02:24:26 -- scripts/common.sh@364 -- # decimal 1 00:21:58.736 02:24:26 -- scripts/common.sh@352 -- # local d=1 00:21:58.736 02:24:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:58.736 02:24:26 -- scripts/common.sh@354 -- # echo 1 00:21:58.736 02:24:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:58.736 02:24:26 -- scripts/common.sh@365 -- # decimal 2 00:21:58.736 02:24:26 -- scripts/common.sh@352 -- # local d=2 00:21:58.736 02:24:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:58.736 02:24:26 -- scripts/common.sh@354 -- # echo 2 00:21:58.736 02:24:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:58.736 02:24:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:58.736 02:24:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:58.736 02:24:26 -- scripts/common.sh@367 -- # return 0 00:21:58.736 02:24:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:58.736 02:24:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:58.736 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:58.736 --rc genhtml_branch_coverage=1 00:21:58.736 --rc genhtml_function_coverage=1 00:21:58.736 --rc genhtml_legend=1 00:21:58.736 --rc geninfo_all_blocks=1 00:21:58.736 --rc geninfo_unexecuted_blocks=1 00:21:58.736 00:21:58.736 ' 00:21:58.736 02:24:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:58.736 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:58.736 --rc genhtml_branch_coverage=1 00:21:58.736 --rc genhtml_function_coverage=1 00:21:58.736 --rc genhtml_legend=1 00:21:58.736 --rc geninfo_all_blocks=1 00:21:58.736 --rc geninfo_unexecuted_blocks=1 00:21:58.736 00:21:58.736 ' 00:21:58.736 02:24:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:58.736 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:58.736 --rc genhtml_branch_coverage=1 00:21:58.736 --rc genhtml_function_coverage=1 00:21:58.736 --rc genhtml_legend=1 00:21:58.736 --rc geninfo_all_blocks=1 00:21:58.736 --rc geninfo_unexecuted_blocks=1 00:21:58.736 00:21:58.736 ' 00:21:58.736 02:24:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:58.736 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:58.736 --rc genhtml_branch_coverage=1 00:21:58.736 --rc genhtml_function_coverage=1 00:21:58.736 --rc genhtml_legend=1 00:21:58.736 --rc geninfo_all_blocks=1 00:21:58.736 --rc geninfo_unexecuted_blocks=1 00:21:58.736 00:21:58.736 ' 00:21:58.736 02:24:26 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:58.736 02:24:26 -- nvmf/common.sh@7 -- # uname -s 00:21:58.736 02:24:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:58.736 02:24:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:58.736 02:24:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:58.736 02:24:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:58.736 02:24:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:58.736 02:24:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:58.736 02:24:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:58.736 02:24:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:58.736 02:24:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:58.736 02:24:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:58.736 02:24:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:58.736 02:24:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:58.736 02:24:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:58.736 02:24:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:58.736 02:24:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:58.736 02:24:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:58.736 02:24:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:58.736 02:24:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:58.736 02:24:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:58.736 02:24:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:58.736 02:24:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:58.736 02:24:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:58.736 02:24:26 -- paths/export.sh@5 -- # export PATH 00:21:58.736 02:24:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:58.736 02:24:26 -- nvmf/common.sh@46 -- # : 0 00:21:58.736 02:24:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:58.736 02:24:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:58.736 02:24:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:58.736 02:24:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:58.736 02:24:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:58.736 02:24:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:58.736 02:24:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:58.736 02:24:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:58.736 02:24:26 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:21:58.736 02:24:26 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:21:58.736 02:24:26 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:21:58.736 02:24:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:21:58.736 02:24:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:58.736 02:24:26 -- common/autotest_common.sh@10 -- # set +x 00:21:58.736 ************************************ 00:21:58.736 START TEST nvmf_shutdown_tc1 00:21:58.736 ************************************ 00:21:58.736 02:24:26 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc1 00:21:58.736 02:24:26 -- target/shutdown.sh@74 -- # starttarget 00:21:58.736 02:24:26 -- target/shutdown.sh@15 -- # nvmftestinit 00:21:58.736 02:24:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:58.736 02:24:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:58.736 02:24:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:58.736 02:24:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:58.736 02:24:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:58.736 02:24:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:58.736 02:24:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:58.736 02:24:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:58.736 02:24:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:58.736 02:24:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:58.736 02:24:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:58.736 02:24:26 -- common/autotest_common.sh@10 -- # set +x 00:22:00.643 02:24:28 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:00.643 02:24:28 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:00.643 02:24:28 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:00.643 02:24:28 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:00.643 02:24:28 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:00.643 02:24:28 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:00.643 02:24:28 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:00.643 02:24:28 -- nvmf/common.sh@294 -- # net_devs=() 00:22:00.643 02:24:28 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:00.643 02:24:28 -- nvmf/common.sh@295 -- # e810=() 00:22:00.643 02:24:28 -- nvmf/common.sh@295 -- # local -ga e810 00:22:00.643 02:24:28 -- nvmf/common.sh@296 -- # x722=() 00:22:00.643 02:24:28 -- nvmf/common.sh@296 -- # local -ga x722 00:22:00.643 02:24:28 -- nvmf/common.sh@297 -- # mlx=() 00:22:00.643 02:24:28 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:00.643 02:24:28 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:00.643 02:24:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:00.643 02:24:28 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:00.643 02:24:28 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:00.643 02:24:28 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:00.643 02:24:28 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:00.643 02:24:28 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:00.643 02:24:28 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:00.643 02:24:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:00.643 02:24:28 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:00.643 02:24:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:00.643 02:24:28 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:00.643 02:24:28 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:00.643 02:24:28 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:00.643 02:24:28 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:00.643 02:24:28 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:00.643 02:24:28 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:00.643 02:24:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:00.643 02:24:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:00.643 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:00.643 02:24:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:00.643 02:24:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:00.643 02:24:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:00.643 02:24:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:00.643 02:24:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:00.643 02:24:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:00.643 02:24:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:00.643 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:00.643 02:24:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:00.643 02:24:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:00.643 02:24:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:00.643 02:24:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:00.643 02:24:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:00.643 02:24:28 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:00.643 02:24:28 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:00.643 02:24:28 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:00.643 02:24:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:00.643 02:24:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:00.643 02:24:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:00.643 02:24:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:00.643 02:24:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:00.643 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:00.643 02:24:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:00.643 02:24:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:00.643 02:24:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:00.643 02:24:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:00.643 02:24:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:00.643 02:24:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:00.643 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:00.643 02:24:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:00.643 02:24:28 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:00.643 02:24:28 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:00.643 02:24:28 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:00.643 02:24:28 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:00.643 02:24:28 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:00.643 02:24:28 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:00.643 02:24:28 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:00.643 02:24:28 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:00.643 02:24:28 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:00.643 02:24:28 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:00.643 02:24:28 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:00.643 02:24:28 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:00.643 02:24:28 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:00.643 02:24:28 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:00.643 02:24:28 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:00.643 02:24:28 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:00.643 02:24:28 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:00.643 02:24:28 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:00.643 02:24:28 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:00.643 02:24:28 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:00.643 02:24:28 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:00.643 02:24:28 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:00.643 02:24:28 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:00.643 02:24:28 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:00.643 02:24:28 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:00.643 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:00.643 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.220 ms 00:22:00.643 00:22:00.643 --- 10.0.0.2 ping statistics --- 00:22:00.643 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:00.643 rtt min/avg/max/mdev = 0.220/0.220/0.220/0.000 ms 00:22:00.643 02:24:28 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:00.643 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:00.643 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.087 ms 00:22:00.643 00:22:00.643 --- 10.0.0.1 ping statistics --- 00:22:00.643 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:00.643 rtt min/avg/max/mdev = 0.087/0.087/0.087/0.000 ms 00:22:00.643 02:24:28 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:00.643 02:24:28 -- nvmf/common.sh@410 -- # return 0 00:22:00.643 02:24:28 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:00.643 02:24:28 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:00.643 02:24:28 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:00.643 02:24:28 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:00.643 02:24:28 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:00.643 02:24:28 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:00.643 02:24:28 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:00.643 02:24:28 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:00.643 02:24:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:00.643 02:24:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:00.643 02:24:28 -- common/autotest_common.sh@10 -- # set +x 00:22:00.644 02:24:28 -- nvmf/common.sh@469 -- # nvmfpid=2172542 00:22:00.644 02:24:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:00.644 02:24:28 -- nvmf/common.sh@470 -- # waitforlisten 2172542 00:22:00.644 02:24:28 -- common/autotest_common.sh@829 -- # '[' -z 2172542 ']' 00:22:00.644 02:24:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:00.644 02:24:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:00.644 02:24:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:00.644 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:00.644 02:24:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:00.644 02:24:28 -- common/autotest_common.sh@10 -- # set +x 00:22:00.904 [2024-12-08 02:24:28.449068] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:00.904 [2024-12-08 02:24:28.449148] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:00.904 EAL: No free 2048 kB hugepages reported on node 1 00:22:00.904 [2024-12-08 02:24:28.519138] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:00.904 [2024-12-08 02:24:28.635919] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:00.904 [2024-12-08 02:24:28.636075] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:00.904 [2024-12-08 02:24:28.636095] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:00.904 [2024-12-08 02:24:28.636111] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:00.904 [2024-12-08 02:24:28.636215] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:00.904 [2024-12-08 02:24:28.636325] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:00.904 [2024-12-08 02:24:28.636378] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:00.904 [2024-12-08 02:24:28.636381] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:01.842 02:24:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:01.842 02:24:29 -- common/autotest_common.sh@862 -- # return 0 00:22:01.842 02:24:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:01.842 02:24:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:01.842 02:24:29 -- common/autotest_common.sh@10 -- # set +x 00:22:01.842 02:24:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:01.842 02:24:29 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:01.842 02:24:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:01.842 02:24:29 -- common/autotest_common.sh@10 -- # set +x 00:22:01.842 [2024-12-08 02:24:29.442069] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:01.842 02:24:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:01.842 02:24:29 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:01.842 02:24:29 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:01.842 02:24:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:01.842 02:24:29 -- common/autotest_common.sh@10 -- # set +x 00:22:01.842 02:24:29 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:01.842 02:24:29 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:01.842 02:24:29 -- target/shutdown.sh@28 -- # cat 00:22:01.842 02:24:29 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:01.842 02:24:29 -- target/shutdown.sh@28 -- # cat 00:22:01.842 02:24:29 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:01.842 02:24:29 -- target/shutdown.sh@28 -- # cat 00:22:01.842 02:24:29 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:01.842 02:24:29 -- target/shutdown.sh@28 -- # cat 00:22:01.842 02:24:29 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:01.842 02:24:29 -- target/shutdown.sh@28 -- # cat 00:22:01.842 02:24:29 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:01.842 02:24:29 -- target/shutdown.sh@28 -- # cat 00:22:01.842 02:24:29 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:01.842 02:24:29 -- target/shutdown.sh@28 -- # cat 00:22:01.842 02:24:29 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:01.842 02:24:29 -- target/shutdown.sh@28 -- # cat 00:22:01.842 02:24:29 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:01.842 02:24:29 -- target/shutdown.sh@28 -- # cat 00:22:01.842 02:24:29 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:01.842 02:24:29 -- target/shutdown.sh@28 -- # cat 00:22:01.842 02:24:29 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:01.842 02:24:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:01.842 02:24:29 -- common/autotest_common.sh@10 -- # set +x 00:22:01.842 Malloc1 00:22:01.842 [2024-12-08 02:24:29.531503] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:01.842 Malloc2 00:22:01.842 Malloc3 00:22:02.101 Malloc4 00:22:02.101 Malloc5 00:22:02.101 Malloc6 00:22:02.101 Malloc7 00:22:02.101 Malloc8 00:22:02.360 Malloc9 00:22:02.360 Malloc10 00:22:02.360 02:24:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:02.360 02:24:29 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:02.360 02:24:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:02.360 02:24:29 -- common/autotest_common.sh@10 -- # set +x 00:22:02.360 02:24:29 -- target/shutdown.sh@78 -- # perfpid=2172741 00:22:02.360 02:24:29 -- target/shutdown.sh@79 -- # waitforlisten 2172741 /var/tmp/bdevperf.sock 00:22:02.360 02:24:29 -- common/autotest_common.sh@829 -- # '[' -z 2172741 ']' 00:22:02.360 02:24:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:02.360 02:24:29 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:22:02.360 02:24:29 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:02.360 02:24:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:02.360 02:24:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:02.360 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:02.360 02:24:29 -- nvmf/common.sh@520 -- # config=() 00:22:02.360 02:24:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:02.360 02:24:29 -- nvmf/common.sh@520 -- # local subsystem config 00:22:02.360 02:24:29 -- common/autotest_common.sh@10 -- # set +x 00:22:02.360 02:24:29 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:02.360 02:24:29 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:02.360 { 00:22:02.360 "params": { 00:22:02.360 "name": "Nvme$subsystem", 00:22:02.360 "trtype": "$TEST_TRANSPORT", 00:22:02.360 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:02.360 "adrfam": "ipv4", 00:22:02.360 "trsvcid": "$NVMF_PORT", 00:22:02.360 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:02.360 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:02.360 "hdgst": ${hdgst:-false}, 00:22:02.360 "ddgst": ${ddgst:-false} 00:22:02.360 }, 00:22:02.360 "method": "bdev_nvme_attach_controller" 00:22:02.360 } 00:22:02.360 EOF 00:22:02.360 )") 00:22:02.360 02:24:29 -- nvmf/common.sh@542 -- # cat 00:22:02.360 02:24:29 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:02.360 02:24:29 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:02.360 { 00:22:02.360 "params": { 00:22:02.360 "name": "Nvme$subsystem", 00:22:02.360 "trtype": "$TEST_TRANSPORT", 00:22:02.360 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:02.360 "adrfam": "ipv4", 00:22:02.360 "trsvcid": "$NVMF_PORT", 00:22:02.360 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:02.360 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:02.360 "hdgst": ${hdgst:-false}, 00:22:02.360 "ddgst": ${ddgst:-false} 00:22:02.360 }, 00:22:02.360 "method": "bdev_nvme_attach_controller" 00:22:02.360 } 00:22:02.360 EOF 00:22:02.360 )") 00:22:02.360 02:24:29 -- nvmf/common.sh@542 -- # cat 00:22:02.360 02:24:29 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:02.360 02:24:29 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:02.360 { 00:22:02.360 "params": { 00:22:02.360 "name": "Nvme$subsystem", 00:22:02.360 "trtype": "$TEST_TRANSPORT", 00:22:02.360 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:02.360 "adrfam": "ipv4", 00:22:02.360 "trsvcid": "$NVMF_PORT", 00:22:02.360 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:02.360 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:02.360 "hdgst": ${hdgst:-false}, 00:22:02.360 "ddgst": ${ddgst:-false} 00:22:02.360 }, 00:22:02.360 "method": "bdev_nvme_attach_controller" 00:22:02.360 } 00:22:02.360 EOF 00:22:02.360 )") 00:22:02.360 02:24:29 -- nvmf/common.sh@542 -- # cat 00:22:02.360 02:24:29 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:02.360 02:24:29 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:02.360 { 00:22:02.360 "params": { 00:22:02.360 "name": "Nvme$subsystem", 00:22:02.360 "trtype": "$TEST_TRANSPORT", 00:22:02.360 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:02.360 "adrfam": "ipv4", 00:22:02.360 "trsvcid": "$NVMF_PORT", 00:22:02.360 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:02.360 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:02.360 "hdgst": ${hdgst:-false}, 00:22:02.360 "ddgst": ${ddgst:-false} 00:22:02.360 }, 00:22:02.360 "method": "bdev_nvme_attach_controller" 00:22:02.360 } 00:22:02.360 EOF 00:22:02.360 )") 00:22:02.360 02:24:29 -- nvmf/common.sh@542 -- # cat 00:22:02.361 02:24:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:02.361 02:24:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:02.361 { 00:22:02.361 "params": { 00:22:02.361 "name": "Nvme$subsystem", 00:22:02.361 "trtype": "$TEST_TRANSPORT", 00:22:02.361 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:02.361 "adrfam": "ipv4", 00:22:02.361 "trsvcid": "$NVMF_PORT", 00:22:02.361 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:02.361 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:02.361 "hdgst": ${hdgst:-false}, 00:22:02.361 "ddgst": ${ddgst:-false} 00:22:02.361 }, 00:22:02.361 "method": "bdev_nvme_attach_controller" 00:22:02.361 } 00:22:02.361 EOF 00:22:02.361 )") 00:22:02.361 02:24:30 -- nvmf/common.sh@542 -- # cat 00:22:02.361 02:24:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:02.361 02:24:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:02.361 { 00:22:02.361 "params": { 00:22:02.361 "name": "Nvme$subsystem", 00:22:02.361 "trtype": "$TEST_TRANSPORT", 00:22:02.361 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:02.361 "adrfam": "ipv4", 00:22:02.361 "trsvcid": "$NVMF_PORT", 00:22:02.361 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:02.361 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:02.361 "hdgst": ${hdgst:-false}, 00:22:02.361 "ddgst": ${ddgst:-false} 00:22:02.361 }, 00:22:02.361 "method": "bdev_nvme_attach_controller" 00:22:02.361 } 00:22:02.361 EOF 00:22:02.361 )") 00:22:02.361 02:24:30 -- nvmf/common.sh@542 -- # cat 00:22:02.361 02:24:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:02.361 02:24:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:02.361 { 00:22:02.361 "params": { 00:22:02.361 "name": "Nvme$subsystem", 00:22:02.361 "trtype": "$TEST_TRANSPORT", 00:22:02.361 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:02.361 "adrfam": "ipv4", 00:22:02.361 "trsvcid": "$NVMF_PORT", 00:22:02.361 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:02.361 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:02.361 "hdgst": ${hdgst:-false}, 00:22:02.361 "ddgst": ${ddgst:-false} 00:22:02.361 }, 00:22:02.361 "method": "bdev_nvme_attach_controller" 00:22:02.361 } 00:22:02.361 EOF 00:22:02.361 )") 00:22:02.361 02:24:30 -- nvmf/common.sh@542 -- # cat 00:22:02.361 02:24:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:02.361 02:24:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:02.361 { 00:22:02.361 "params": { 00:22:02.361 "name": "Nvme$subsystem", 00:22:02.361 "trtype": "$TEST_TRANSPORT", 00:22:02.361 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:02.361 "adrfam": "ipv4", 00:22:02.361 "trsvcid": "$NVMF_PORT", 00:22:02.361 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:02.361 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:02.361 "hdgst": ${hdgst:-false}, 00:22:02.361 "ddgst": ${ddgst:-false} 00:22:02.361 }, 00:22:02.361 "method": "bdev_nvme_attach_controller" 00:22:02.361 } 00:22:02.361 EOF 00:22:02.361 )") 00:22:02.361 02:24:30 -- nvmf/common.sh@542 -- # cat 00:22:02.361 02:24:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:02.361 02:24:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:02.361 { 00:22:02.361 "params": { 00:22:02.361 "name": "Nvme$subsystem", 00:22:02.361 "trtype": "$TEST_TRANSPORT", 00:22:02.361 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:02.361 "adrfam": "ipv4", 00:22:02.361 "trsvcid": "$NVMF_PORT", 00:22:02.361 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:02.361 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:02.361 "hdgst": ${hdgst:-false}, 00:22:02.361 "ddgst": ${ddgst:-false} 00:22:02.361 }, 00:22:02.361 "method": "bdev_nvme_attach_controller" 00:22:02.361 } 00:22:02.361 EOF 00:22:02.361 )") 00:22:02.361 02:24:30 -- nvmf/common.sh@542 -- # cat 00:22:02.361 02:24:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:02.361 02:24:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:02.361 { 00:22:02.361 "params": { 00:22:02.361 "name": "Nvme$subsystem", 00:22:02.361 "trtype": "$TEST_TRANSPORT", 00:22:02.361 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:02.361 "adrfam": "ipv4", 00:22:02.361 "trsvcid": "$NVMF_PORT", 00:22:02.361 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:02.361 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:02.361 "hdgst": ${hdgst:-false}, 00:22:02.361 "ddgst": ${ddgst:-false} 00:22:02.361 }, 00:22:02.361 "method": "bdev_nvme_attach_controller" 00:22:02.361 } 00:22:02.361 EOF 00:22:02.361 )") 00:22:02.361 02:24:30 -- nvmf/common.sh@542 -- # cat 00:22:02.361 02:24:30 -- nvmf/common.sh@544 -- # jq . 00:22:02.361 02:24:30 -- nvmf/common.sh@545 -- # IFS=, 00:22:02.361 02:24:30 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:02.361 "params": { 00:22:02.361 "name": "Nvme1", 00:22:02.361 "trtype": "tcp", 00:22:02.361 "traddr": "10.0.0.2", 00:22:02.361 "adrfam": "ipv4", 00:22:02.361 "trsvcid": "4420", 00:22:02.361 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:02.361 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:02.361 "hdgst": false, 00:22:02.361 "ddgst": false 00:22:02.361 }, 00:22:02.361 "method": "bdev_nvme_attach_controller" 00:22:02.361 },{ 00:22:02.361 "params": { 00:22:02.361 "name": "Nvme2", 00:22:02.361 "trtype": "tcp", 00:22:02.361 "traddr": "10.0.0.2", 00:22:02.361 "adrfam": "ipv4", 00:22:02.361 "trsvcid": "4420", 00:22:02.361 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:02.361 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:02.361 "hdgst": false, 00:22:02.361 "ddgst": false 00:22:02.361 }, 00:22:02.361 "method": "bdev_nvme_attach_controller" 00:22:02.361 },{ 00:22:02.361 "params": { 00:22:02.361 "name": "Nvme3", 00:22:02.361 "trtype": "tcp", 00:22:02.361 "traddr": "10.0.0.2", 00:22:02.361 "adrfam": "ipv4", 00:22:02.361 "trsvcid": "4420", 00:22:02.361 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:02.361 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:02.361 "hdgst": false, 00:22:02.361 "ddgst": false 00:22:02.361 }, 00:22:02.361 "method": "bdev_nvme_attach_controller" 00:22:02.361 },{ 00:22:02.361 "params": { 00:22:02.361 "name": "Nvme4", 00:22:02.361 "trtype": "tcp", 00:22:02.361 "traddr": "10.0.0.2", 00:22:02.361 "adrfam": "ipv4", 00:22:02.361 "trsvcid": "4420", 00:22:02.361 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:02.361 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:02.361 "hdgst": false, 00:22:02.361 "ddgst": false 00:22:02.361 }, 00:22:02.361 "method": "bdev_nvme_attach_controller" 00:22:02.361 },{ 00:22:02.361 "params": { 00:22:02.361 "name": "Nvme5", 00:22:02.361 "trtype": "tcp", 00:22:02.361 "traddr": "10.0.0.2", 00:22:02.361 "adrfam": "ipv4", 00:22:02.361 "trsvcid": "4420", 00:22:02.361 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:02.361 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:02.361 "hdgst": false, 00:22:02.361 "ddgst": false 00:22:02.361 }, 00:22:02.361 "method": "bdev_nvme_attach_controller" 00:22:02.361 },{ 00:22:02.361 "params": { 00:22:02.361 "name": "Nvme6", 00:22:02.361 "trtype": "tcp", 00:22:02.361 "traddr": "10.0.0.2", 00:22:02.361 "adrfam": "ipv4", 00:22:02.361 "trsvcid": "4420", 00:22:02.361 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:02.361 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:02.361 "hdgst": false, 00:22:02.361 "ddgst": false 00:22:02.361 }, 00:22:02.361 "method": "bdev_nvme_attach_controller" 00:22:02.361 },{ 00:22:02.361 "params": { 00:22:02.361 "name": "Nvme7", 00:22:02.361 "trtype": "tcp", 00:22:02.361 "traddr": "10.0.0.2", 00:22:02.361 "adrfam": "ipv4", 00:22:02.361 "trsvcid": "4420", 00:22:02.361 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:02.361 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:02.361 "hdgst": false, 00:22:02.361 "ddgst": false 00:22:02.361 }, 00:22:02.361 "method": "bdev_nvme_attach_controller" 00:22:02.361 },{ 00:22:02.361 "params": { 00:22:02.361 "name": "Nvme8", 00:22:02.361 "trtype": "tcp", 00:22:02.361 "traddr": "10.0.0.2", 00:22:02.361 "adrfam": "ipv4", 00:22:02.361 "trsvcid": "4420", 00:22:02.361 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:02.361 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:02.361 "hdgst": false, 00:22:02.361 "ddgst": false 00:22:02.361 }, 00:22:02.361 "method": "bdev_nvme_attach_controller" 00:22:02.361 },{ 00:22:02.361 "params": { 00:22:02.361 "name": "Nvme9", 00:22:02.361 "trtype": "tcp", 00:22:02.361 "traddr": "10.0.0.2", 00:22:02.361 "adrfam": "ipv4", 00:22:02.361 "trsvcid": "4420", 00:22:02.361 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:02.361 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:02.361 "hdgst": false, 00:22:02.361 "ddgst": false 00:22:02.361 }, 00:22:02.361 "method": "bdev_nvme_attach_controller" 00:22:02.361 },{ 00:22:02.361 "params": { 00:22:02.361 "name": "Nvme10", 00:22:02.361 "trtype": "tcp", 00:22:02.361 "traddr": "10.0.0.2", 00:22:02.361 "adrfam": "ipv4", 00:22:02.361 "trsvcid": "4420", 00:22:02.361 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:02.362 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:02.362 "hdgst": false, 00:22:02.362 "ddgst": false 00:22:02.362 }, 00:22:02.362 "method": "bdev_nvme_attach_controller" 00:22:02.362 }' 00:22:02.362 [2024-12-08 02:24:30.026782] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:02.362 [2024-12-08 02:24:30.026869] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:22:02.362 EAL: No free 2048 kB hugepages reported on node 1 00:22:02.362 [2024-12-08 02:24:30.107446] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:02.620 [2024-12-08 02:24:30.217381] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:04.524 02:24:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:04.524 02:24:31 -- common/autotest_common.sh@862 -- # return 0 00:22:04.524 02:24:31 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:04.524 02:24:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:04.524 02:24:31 -- common/autotest_common.sh@10 -- # set +x 00:22:04.524 02:24:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:04.524 02:24:31 -- target/shutdown.sh@83 -- # kill -9 2172741 00:22:04.524 02:24:31 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:22:04.524 02:24:31 -- target/shutdown.sh@87 -- # sleep 1 00:22:05.092 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 2172741 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:22:05.092 02:24:32 -- target/shutdown.sh@88 -- # kill -0 2172542 00:22:05.092 02:24:32 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:22:05.092 02:24:32 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:05.092 02:24:32 -- nvmf/common.sh@520 -- # config=() 00:22:05.092 02:24:32 -- nvmf/common.sh@520 -- # local subsystem config 00:22:05.092 02:24:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:05.092 02:24:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:05.092 { 00:22:05.092 "params": { 00:22:05.092 "name": "Nvme$subsystem", 00:22:05.092 "trtype": "$TEST_TRANSPORT", 00:22:05.092 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:05.092 "adrfam": "ipv4", 00:22:05.092 "trsvcid": "$NVMF_PORT", 00:22:05.092 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:05.092 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:05.092 "hdgst": ${hdgst:-false}, 00:22:05.092 "ddgst": ${ddgst:-false} 00:22:05.092 }, 00:22:05.092 "method": "bdev_nvme_attach_controller" 00:22:05.092 } 00:22:05.092 EOF 00:22:05.092 )") 00:22:05.092 02:24:32 -- nvmf/common.sh@542 -- # cat 00:22:05.092 02:24:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:05.092 02:24:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:05.092 { 00:22:05.092 "params": { 00:22:05.092 "name": "Nvme$subsystem", 00:22:05.092 "trtype": "$TEST_TRANSPORT", 00:22:05.092 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:05.092 "adrfam": "ipv4", 00:22:05.092 "trsvcid": "$NVMF_PORT", 00:22:05.092 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:05.092 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:05.092 "hdgst": ${hdgst:-false}, 00:22:05.092 "ddgst": ${ddgst:-false} 00:22:05.092 }, 00:22:05.092 "method": "bdev_nvme_attach_controller" 00:22:05.092 } 00:22:05.092 EOF 00:22:05.092 )") 00:22:05.092 02:24:32 -- nvmf/common.sh@542 -- # cat 00:22:05.092 02:24:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:05.092 02:24:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:05.092 { 00:22:05.092 "params": { 00:22:05.092 "name": "Nvme$subsystem", 00:22:05.092 "trtype": "$TEST_TRANSPORT", 00:22:05.092 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:05.092 "adrfam": "ipv4", 00:22:05.092 "trsvcid": "$NVMF_PORT", 00:22:05.092 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:05.092 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:05.092 "hdgst": ${hdgst:-false}, 00:22:05.092 "ddgst": ${ddgst:-false} 00:22:05.092 }, 00:22:05.092 "method": "bdev_nvme_attach_controller" 00:22:05.092 } 00:22:05.092 EOF 00:22:05.092 )") 00:22:05.092 02:24:32 -- nvmf/common.sh@542 -- # cat 00:22:05.092 02:24:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:05.092 02:24:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:05.092 { 00:22:05.092 "params": { 00:22:05.092 "name": "Nvme$subsystem", 00:22:05.092 "trtype": "$TEST_TRANSPORT", 00:22:05.092 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:05.092 "adrfam": "ipv4", 00:22:05.092 "trsvcid": "$NVMF_PORT", 00:22:05.092 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:05.092 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:05.092 "hdgst": ${hdgst:-false}, 00:22:05.092 "ddgst": ${ddgst:-false} 00:22:05.092 }, 00:22:05.092 "method": "bdev_nvme_attach_controller" 00:22:05.092 } 00:22:05.092 EOF 00:22:05.092 )") 00:22:05.092 02:24:32 -- nvmf/common.sh@542 -- # cat 00:22:05.092 02:24:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:05.092 02:24:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:05.092 { 00:22:05.092 "params": { 00:22:05.092 "name": "Nvme$subsystem", 00:22:05.092 "trtype": "$TEST_TRANSPORT", 00:22:05.092 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:05.092 "adrfam": "ipv4", 00:22:05.092 "trsvcid": "$NVMF_PORT", 00:22:05.092 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:05.092 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:05.092 "hdgst": ${hdgst:-false}, 00:22:05.092 "ddgst": ${ddgst:-false} 00:22:05.092 }, 00:22:05.093 "method": "bdev_nvme_attach_controller" 00:22:05.093 } 00:22:05.093 EOF 00:22:05.093 )") 00:22:05.093 02:24:32 -- nvmf/common.sh@542 -- # cat 00:22:05.093 02:24:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:05.093 02:24:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:05.093 { 00:22:05.093 "params": { 00:22:05.093 "name": "Nvme$subsystem", 00:22:05.093 "trtype": "$TEST_TRANSPORT", 00:22:05.093 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:05.093 "adrfam": "ipv4", 00:22:05.093 "trsvcid": "$NVMF_PORT", 00:22:05.093 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:05.093 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:05.093 "hdgst": ${hdgst:-false}, 00:22:05.093 "ddgst": ${ddgst:-false} 00:22:05.093 }, 00:22:05.093 "method": "bdev_nvme_attach_controller" 00:22:05.093 } 00:22:05.093 EOF 00:22:05.093 )") 00:22:05.093 02:24:32 -- nvmf/common.sh@542 -- # cat 00:22:05.093 02:24:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:05.093 02:24:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:05.093 { 00:22:05.093 "params": { 00:22:05.093 "name": "Nvme$subsystem", 00:22:05.093 "trtype": "$TEST_TRANSPORT", 00:22:05.093 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:05.093 "adrfam": "ipv4", 00:22:05.093 "trsvcid": "$NVMF_PORT", 00:22:05.093 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:05.093 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:05.093 "hdgst": ${hdgst:-false}, 00:22:05.093 "ddgst": ${ddgst:-false} 00:22:05.093 }, 00:22:05.093 "method": "bdev_nvme_attach_controller" 00:22:05.093 } 00:22:05.093 EOF 00:22:05.093 )") 00:22:05.093 02:24:32 -- nvmf/common.sh@542 -- # cat 00:22:05.093 02:24:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:05.093 02:24:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:05.093 { 00:22:05.093 "params": { 00:22:05.093 "name": "Nvme$subsystem", 00:22:05.093 "trtype": "$TEST_TRANSPORT", 00:22:05.093 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:05.093 "adrfam": "ipv4", 00:22:05.093 "trsvcid": "$NVMF_PORT", 00:22:05.093 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:05.093 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:05.093 "hdgst": ${hdgst:-false}, 00:22:05.093 "ddgst": ${ddgst:-false} 00:22:05.093 }, 00:22:05.093 "method": "bdev_nvme_attach_controller" 00:22:05.093 } 00:22:05.093 EOF 00:22:05.093 )") 00:22:05.093 02:24:32 -- nvmf/common.sh@542 -- # cat 00:22:05.093 02:24:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:05.093 02:24:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:05.093 { 00:22:05.093 "params": { 00:22:05.093 "name": "Nvme$subsystem", 00:22:05.093 "trtype": "$TEST_TRANSPORT", 00:22:05.093 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:05.093 "adrfam": "ipv4", 00:22:05.093 "trsvcid": "$NVMF_PORT", 00:22:05.093 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:05.093 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:05.093 "hdgst": ${hdgst:-false}, 00:22:05.093 "ddgst": ${ddgst:-false} 00:22:05.093 }, 00:22:05.093 "method": "bdev_nvme_attach_controller" 00:22:05.093 } 00:22:05.093 EOF 00:22:05.093 )") 00:22:05.093 02:24:32 -- nvmf/common.sh@542 -- # cat 00:22:05.093 02:24:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:05.093 02:24:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:05.093 { 00:22:05.093 "params": { 00:22:05.093 "name": "Nvme$subsystem", 00:22:05.093 "trtype": "$TEST_TRANSPORT", 00:22:05.093 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:05.093 "adrfam": "ipv4", 00:22:05.093 "trsvcid": "$NVMF_PORT", 00:22:05.093 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:05.093 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:05.093 "hdgst": ${hdgst:-false}, 00:22:05.093 "ddgst": ${ddgst:-false} 00:22:05.093 }, 00:22:05.093 "method": "bdev_nvme_attach_controller" 00:22:05.093 } 00:22:05.093 EOF 00:22:05.093 )") 00:22:05.093 02:24:32 -- nvmf/common.sh@542 -- # cat 00:22:05.093 02:24:32 -- nvmf/common.sh@544 -- # jq . 00:22:05.093 02:24:32 -- nvmf/common.sh@545 -- # IFS=, 00:22:05.093 02:24:32 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:05.093 "params": { 00:22:05.093 "name": "Nvme1", 00:22:05.093 "trtype": "tcp", 00:22:05.093 "traddr": "10.0.0.2", 00:22:05.093 "adrfam": "ipv4", 00:22:05.093 "trsvcid": "4420", 00:22:05.093 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:05.093 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:05.093 "hdgst": false, 00:22:05.093 "ddgst": false 00:22:05.093 }, 00:22:05.093 "method": "bdev_nvme_attach_controller" 00:22:05.093 },{ 00:22:05.093 "params": { 00:22:05.093 "name": "Nvme2", 00:22:05.093 "trtype": "tcp", 00:22:05.093 "traddr": "10.0.0.2", 00:22:05.093 "adrfam": "ipv4", 00:22:05.093 "trsvcid": "4420", 00:22:05.093 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:05.093 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:05.093 "hdgst": false, 00:22:05.093 "ddgst": false 00:22:05.093 }, 00:22:05.093 "method": "bdev_nvme_attach_controller" 00:22:05.093 },{ 00:22:05.093 "params": { 00:22:05.093 "name": "Nvme3", 00:22:05.093 "trtype": "tcp", 00:22:05.093 "traddr": "10.0.0.2", 00:22:05.093 "adrfam": "ipv4", 00:22:05.093 "trsvcid": "4420", 00:22:05.093 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:05.093 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:05.093 "hdgst": false, 00:22:05.093 "ddgst": false 00:22:05.093 }, 00:22:05.093 "method": "bdev_nvme_attach_controller" 00:22:05.093 },{ 00:22:05.093 "params": { 00:22:05.093 "name": "Nvme4", 00:22:05.093 "trtype": "tcp", 00:22:05.093 "traddr": "10.0.0.2", 00:22:05.093 "adrfam": "ipv4", 00:22:05.093 "trsvcid": "4420", 00:22:05.093 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:05.093 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:05.093 "hdgst": false, 00:22:05.093 "ddgst": false 00:22:05.093 }, 00:22:05.093 "method": "bdev_nvme_attach_controller" 00:22:05.093 },{ 00:22:05.093 "params": { 00:22:05.093 "name": "Nvme5", 00:22:05.093 "trtype": "tcp", 00:22:05.093 "traddr": "10.0.0.2", 00:22:05.093 "adrfam": "ipv4", 00:22:05.093 "trsvcid": "4420", 00:22:05.093 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:05.093 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:05.093 "hdgst": false, 00:22:05.093 "ddgst": false 00:22:05.093 }, 00:22:05.093 "method": "bdev_nvme_attach_controller" 00:22:05.093 },{ 00:22:05.093 "params": { 00:22:05.093 "name": "Nvme6", 00:22:05.093 "trtype": "tcp", 00:22:05.093 "traddr": "10.0.0.2", 00:22:05.093 "adrfam": "ipv4", 00:22:05.093 "trsvcid": "4420", 00:22:05.093 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:05.093 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:05.093 "hdgst": false, 00:22:05.093 "ddgst": false 00:22:05.093 }, 00:22:05.093 "method": "bdev_nvme_attach_controller" 00:22:05.093 },{ 00:22:05.093 "params": { 00:22:05.093 "name": "Nvme7", 00:22:05.093 "trtype": "tcp", 00:22:05.093 "traddr": "10.0.0.2", 00:22:05.093 "adrfam": "ipv4", 00:22:05.093 "trsvcid": "4420", 00:22:05.093 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:05.093 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:05.093 "hdgst": false, 00:22:05.093 "ddgst": false 00:22:05.093 }, 00:22:05.093 "method": "bdev_nvme_attach_controller" 00:22:05.093 },{ 00:22:05.093 "params": { 00:22:05.093 "name": "Nvme8", 00:22:05.093 "trtype": "tcp", 00:22:05.093 "traddr": "10.0.0.2", 00:22:05.093 "adrfam": "ipv4", 00:22:05.093 "trsvcid": "4420", 00:22:05.093 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:05.093 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:05.093 "hdgst": false, 00:22:05.093 "ddgst": false 00:22:05.093 }, 00:22:05.093 "method": "bdev_nvme_attach_controller" 00:22:05.093 },{ 00:22:05.093 "params": { 00:22:05.093 "name": "Nvme9", 00:22:05.093 "trtype": "tcp", 00:22:05.093 "traddr": "10.0.0.2", 00:22:05.093 "adrfam": "ipv4", 00:22:05.093 "trsvcid": "4420", 00:22:05.093 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:05.093 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:05.093 "hdgst": false, 00:22:05.093 "ddgst": false 00:22:05.093 }, 00:22:05.093 "method": "bdev_nvme_attach_controller" 00:22:05.093 },{ 00:22:05.093 "params": { 00:22:05.093 "name": "Nvme10", 00:22:05.093 "trtype": "tcp", 00:22:05.093 "traddr": "10.0.0.2", 00:22:05.093 "adrfam": "ipv4", 00:22:05.093 "trsvcid": "4420", 00:22:05.093 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:05.093 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:05.093 "hdgst": false, 00:22:05.093 "ddgst": false 00:22:05.093 }, 00:22:05.093 "method": "bdev_nvme_attach_controller" 00:22:05.093 }' 00:22:05.093 [2024-12-08 02:24:32.866628] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:05.094 [2024-12-08 02:24:32.866714] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2173169 ] 00:22:05.352 EAL: No free 2048 kB hugepages reported on node 1 00:22:05.352 [2024-12-08 02:24:32.931667] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:05.352 [2024-12-08 02:24:33.042053] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:06.809 Running I/O for 1 seconds... 00:22:08.184 00:22:08.184 Latency(us) 00:22:08.184 [2024-12-08T01:24:35.965Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:08.184 [2024-12-08T01:24:35.965Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:08.184 Verification LBA range: start 0x0 length 0x400 00:22:08.184 Nvme1n1 : 1.07 372.88 23.30 0.00 0.00 165801.81 43108.12 146800.64 00:22:08.184 [2024-12-08T01:24:35.965Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:08.184 Verification LBA range: start 0x0 length 0x400 00:22:08.184 Nvme2n1 : 1.10 393.80 24.61 0.00 0.00 158552.49 18544.26 131266.18 00:22:08.184 [2024-12-08T01:24:35.965Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:08.184 Verification LBA range: start 0x0 length 0x400 00:22:08.184 Nvme3n1 : 1.09 396.81 24.80 0.00 0.00 156459.23 16796.63 125829.12 00:22:08.184 [2024-12-08T01:24:35.965Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:08.184 Verification LBA range: start 0x0 length 0x400 00:22:08.184 Nvme4n1 : 1.10 395.95 24.75 0.00 0.00 155864.61 15243.19 121168.78 00:22:08.184 [2024-12-08T01:24:35.965Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:08.184 Verification LBA range: start 0x0 length 0x400 00:22:08.184 Nvme5n1 : 1.10 395.54 24.72 0.00 0.00 154560.15 18350.08 118061.89 00:22:08.184 [2024-12-08T01:24:35.965Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:08.184 Verification LBA range: start 0x0 length 0x400 00:22:08.184 Nvme6n1 : 1.11 392.66 24.54 0.00 0.00 154694.38 17476.27 121168.78 00:22:08.184 [2024-12-08T01:24:35.965Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:08.184 Verification LBA range: start 0x0 length 0x400 00:22:08.184 Nvme7n1 : 1.11 391.87 24.49 0.00 0.00 154191.70 15631.55 121945.51 00:22:08.184 [2024-12-08T01:24:35.965Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:08.184 Verification LBA range: start 0x0 length 0x400 00:22:08.184 Nvme8n1 : 1.11 390.48 24.41 0.00 0.00 154073.53 12039.21 126605.84 00:22:08.184 [2024-12-08T01:24:35.965Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:08.184 Verification LBA range: start 0x0 length 0x400 00:22:08.184 Nvme9n1 : 1.12 389.02 24.31 0.00 0.00 154364.71 5534.15 128936.01 00:22:08.184 [2024-12-08T01:24:35.965Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:08.184 Verification LBA range: start 0x0 length 0x400 00:22:08.184 Nvme10n1 : 1.12 388.05 24.25 0.00 0.00 153703.87 5267.15 132042.90 00:22:08.184 [2024-12-08T01:24:35.965Z] =================================================================================================================== 00:22:08.184 [2024-12-08T01:24:35.965Z] Total : 3907.07 244.19 0.00 0.00 156146.56 5267.15 146800.64 00:22:08.184 02:24:35 -- target/shutdown.sh@93 -- # stoptarget 00:22:08.184 02:24:35 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:08.185 02:24:35 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:08.185 02:24:35 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:08.185 02:24:35 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:08.185 02:24:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:08.185 02:24:35 -- nvmf/common.sh@116 -- # sync 00:22:08.185 02:24:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:08.185 02:24:35 -- nvmf/common.sh@119 -- # set +e 00:22:08.185 02:24:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:08.185 02:24:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:08.185 rmmod nvme_tcp 00:22:08.185 rmmod nvme_fabrics 00:22:08.185 rmmod nvme_keyring 00:22:08.185 02:24:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:08.185 02:24:35 -- nvmf/common.sh@123 -- # set -e 00:22:08.185 02:24:35 -- nvmf/common.sh@124 -- # return 0 00:22:08.185 02:24:35 -- nvmf/common.sh@477 -- # '[' -n 2172542 ']' 00:22:08.185 02:24:35 -- nvmf/common.sh@478 -- # killprocess 2172542 00:22:08.185 02:24:35 -- common/autotest_common.sh@936 -- # '[' -z 2172542 ']' 00:22:08.185 02:24:35 -- common/autotest_common.sh@940 -- # kill -0 2172542 00:22:08.185 02:24:35 -- common/autotest_common.sh@941 -- # uname 00:22:08.185 02:24:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:08.185 02:24:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2172542 00:22:08.185 02:24:35 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:08.185 02:24:35 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:08.185 02:24:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2172542' 00:22:08.185 killing process with pid 2172542 00:22:08.185 02:24:35 -- common/autotest_common.sh@955 -- # kill 2172542 00:22:08.185 02:24:35 -- common/autotest_common.sh@960 -- # wait 2172542 00:22:08.751 02:24:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:08.751 02:24:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:08.751 02:24:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:08.751 02:24:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:08.751 02:24:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:08.751 02:24:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:08.751 02:24:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:08.751 02:24:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:11.295 02:24:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:11.295 00:22:11.295 real 0m12.297s 00:22:11.295 user 0m36.182s 00:22:11.295 sys 0m3.252s 00:22:11.295 02:24:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:11.295 02:24:38 -- common/autotest_common.sh@10 -- # set +x 00:22:11.295 ************************************ 00:22:11.295 END TEST nvmf_shutdown_tc1 00:22:11.295 ************************************ 00:22:11.295 02:24:38 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:22:11.295 02:24:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:11.295 02:24:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:11.295 02:24:38 -- common/autotest_common.sh@10 -- # set +x 00:22:11.295 ************************************ 00:22:11.295 START TEST nvmf_shutdown_tc2 00:22:11.295 ************************************ 00:22:11.295 02:24:38 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc2 00:22:11.295 02:24:38 -- target/shutdown.sh@98 -- # starttarget 00:22:11.295 02:24:38 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:11.295 02:24:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:11.295 02:24:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:11.295 02:24:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:11.295 02:24:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:11.295 02:24:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:11.295 02:24:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:11.295 02:24:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:11.295 02:24:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:11.295 02:24:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:11.295 02:24:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:11.295 02:24:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:11.295 02:24:38 -- common/autotest_common.sh@10 -- # set +x 00:22:11.295 02:24:38 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:11.295 02:24:38 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:11.295 02:24:38 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:11.295 02:24:38 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:11.295 02:24:38 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:11.295 02:24:38 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:11.295 02:24:38 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:11.295 02:24:38 -- nvmf/common.sh@294 -- # net_devs=() 00:22:11.295 02:24:38 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:11.295 02:24:38 -- nvmf/common.sh@295 -- # e810=() 00:22:11.295 02:24:38 -- nvmf/common.sh@295 -- # local -ga e810 00:22:11.295 02:24:38 -- nvmf/common.sh@296 -- # x722=() 00:22:11.295 02:24:38 -- nvmf/common.sh@296 -- # local -ga x722 00:22:11.295 02:24:38 -- nvmf/common.sh@297 -- # mlx=() 00:22:11.295 02:24:38 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:11.295 02:24:38 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:11.295 02:24:38 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:11.295 02:24:38 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:11.295 02:24:38 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:11.295 02:24:38 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:11.295 02:24:38 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:11.295 02:24:38 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:11.295 02:24:38 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:11.295 02:24:38 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:11.295 02:24:38 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:11.296 02:24:38 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:11.296 02:24:38 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:11.296 02:24:38 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:11.296 02:24:38 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:11.296 02:24:38 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:11.296 02:24:38 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:11.296 02:24:38 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:11.296 02:24:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:11.296 02:24:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:11.296 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:11.296 02:24:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:11.296 02:24:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:11.296 02:24:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:11.296 02:24:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:11.296 02:24:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:11.296 02:24:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:11.296 02:24:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:11.296 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:11.296 02:24:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:11.296 02:24:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:11.296 02:24:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:11.296 02:24:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:11.296 02:24:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:11.296 02:24:38 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:11.296 02:24:38 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:11.296 02:24:38 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:11.296 02:24:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:11.296 02:24:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:11.296 02:24:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:11.296 02:24:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:11.296 02:24:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:11.296 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:11.296 02:24:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:11.296 02:24:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:11.296 02:24:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:11.296 02:24:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:11.296 02:24:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:11.296 02:24:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:11.296 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:11.296 02:24:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:11.296 02:24:38 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:11.296 02:24:38 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:11.296 02:24:38 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:11.296 02:24:38 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:11.296 02:24:38 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:11.296 02:24:38 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:11.296 02:24:38 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:11.296 02:24:38 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:11.296 02:24:38 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:11.296 02:24:38 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:11.296 02:24:38 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:11.296 02:24:38 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:11.296 02:24:38 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:11.296 02:24:38 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:11.296 02:24:38 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:11.296 02:24:38 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:11.296 02:24:38 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:11.296 02:24:38 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:11.296 02:24:38 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:11.296 02:24:38 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:11.296 02:24:38 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:11.296 02:24:38 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:11.296 02:24:38 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:11.296 02:24:38 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:11.296 02:24:38 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:11.296 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:11.296 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.283 ms 00:22:11.296 00:22:11.296 --- 10.0.0.2 ping statistics --- 00:22:11.296 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:11.296 rtt min/avg/max/mdev = 0.283/0.283/0.283/0.000 ms 00:22:11.296 02:24:38 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:11.296 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:11.296 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.189 ms 00:22:11.296 00:22:11.296 --- 10.0.0.1 ping statistics --- 00:22:11.296 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:11.296 rtt min/avg/max/mdev = 0.189/0.189/0.189/0.000 ms 00:22:11.296 02:24:38 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:11.296 02:24:38 -- nvmf/common.sh@410 -- # return 0 00:22:11.296 02:24:38 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:11.296 02:24:38 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:11.296 02:24:38 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:11.296 02:24:38 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:11.296 02:24:38 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:11.296 02:24:38 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:11.296 02:24:38 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:11.296 02:24:38 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:11.296 02:24:38 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:11.296 02:24:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:11.296 02:24:38 -- common/autotest_common.sh@10 -- # set +x 00:22:11.296 02:24:38 -- nvmf/common.sh@469 -- # nvmfpid=2173951 00:22:11.296 02:24:38 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:11.296 02:24:38 -- nvmf/common.sh@470 -- # waitforlisten 2173951 00:22:11.296 02:24:38 -- common/autotest_common.sh@829 -- # '[' -z 2173951 ']' 00:22:11.296 02:24:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:11.296 02:24:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:11.296 02:24:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:11.296 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:11.296 02:24:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:11.296 02:24:38 -- common/autotest_common.sh@10 -- # set +x 00:22:11.296 [2024-12-08 02:24:38.779749] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:11.296 [2024-12-08 02:24:38.779844] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:11.296 EAL: No free 2048 kB hugepages reported on node 1 00:22:11.296 [2024-12-08 02:24:38.844252] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:11.296 [2024-12-08 02:24:38.955444] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:11.296 [2024-12-08 02:24:38.955614] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:11.296 [2024-12-08 02:24:38.955633] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:11.296 [2024-12-08 02:24:38.955646] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:11.296 [2024-12-08 02:24:38.955739] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:11.296 [2024-12-08 02:24:38.955804] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:11.296 [2024-12-08 02:24:38.955851] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:11.296 [2024-12-08 02:24:38.955853] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:12.232 02:24:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:12.232 02:24:39 -- common/autotest_common.sh@862 -- # return 0 00:22:12.232 02:24:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:12.232 02:24:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:12.232 02:24:39 -- common/autotest_common.sh@10 -- # set +x 00:22:12.232 02:24:39 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:12.232 02:24:39 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:12.232 02:24:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:12.232 02:24:39 -- common/autotest_common.sh@10 -- # set +x 00:22:12.232 [2024-12-08 02:24:39.810222] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:12.232 02:24:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:12.232 02:24:39 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:12.232 02:24:39 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:12.232 02:24:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:12.232 02:24:39 -- common/autotest_common.sh@10 -- # set +x 00:22:12.232 02:24:39 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:12.232 02:24:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:12.232 02:24:39 -- target/shutdown.sh@28 -- # cat 00:22:12.232 02:24:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:12.232 02:24:39 -- target/shutdown.sh@28 -- # cat 00:22:12.232 02:24:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:12.232 02:24:39 -- target/shutdown.sh@28 -- # cat 00:22:12.232 02:24:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:12.232 02:24:39 -- target/shutdown.sh@28 -- # cat 00:22:12.232 02:24:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:12.232 02:24:39 -- target/shutdown.sh@28 -- # cat 00:22:12.232 02:24:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:12.232 02:24:39 -- target/shutdown.sh@28 -- # cat 00:22:12.232 02:24:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:12.232 02:24:39 -- target/shutdown.sh@28 -- # cat 00:22:12.232 02:24:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:12.232 02:24:39 -- target/shutdown.sh@28 -- # cat 00:22:12.232 02:24:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:12.232 02:24:39 -- target/shutdown.sh@28 -- # cat 00:22:12.232 02:24:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:12.232 02:24:39 -- target/shutdown.sh@28 -- # cat 00:22:12.232 02:24:39 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:12.232 02:24:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:12.232 02:24:39 -- common/autotest_common.sh@10 -- # set +x 00:22:12.232 Malloc1 00:22:12.232 [2024-12-08 02:24:39.885434] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:12.232 Malloc2 00:22:12.232 Malloc3 00:22:12.232 Malloc4 00:22:12.490 Malloc5 00:22:12.490 Malloc6 00:22:12.490 Malloc7 00:22:12.490 Malloc8 00:22:12.490 Malloc9 00:22:12.748 Malloc10 00:22:12.748 02:24:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:12.748 02:24:40 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:12.748 02:24:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:12.748 02:24:40 -- common/autotest_common.sh@10 -- # set +x 00:22:12.748 02:24:40 -- target/shutdown.sh@102 -- # perfpid=2174148 00:22:12.748 02:24:40 -- target/shutdown.sh@103 -- # waitforlisten 2174148 /var/tmp/bdevperf.sock 00:22:12.748 02:24:40 -- common/autotest_common.sh@829 -- # '[' -z 2174148 ']' 00:22:12.748 02:24:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:12.748 02:24:40 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:12.748 02:24:40 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:12.748 02:24:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:12.748 02:24:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:12.748 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:12.748 02:24:40 -- nvmf/common.sh@520 -- # config=() 00:22:12.748 02:24:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:12.748 02:24:40 -- nvmf/common.sh@520 -- # local subsystem config 00:22:12.748 02:24:40 -- common/autotest_common.sh@10 -- # set +x 00:22:12.748 02:24:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:12.748 02:24:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:12.748 { 00:22:12.748 "params": { 00:22:12.748 "name": "Nvme$subsystem", 00:22:12.748 "trtype": "$TEST_TRANSPORT", 00:22:12.748 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:12.748 "adrfam": "ipv4", 00:22:12.748 "trsvcid": "$NVMF_PORT", 00:22:12.748 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:12.748 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:12.748 "hdgst": ${hdgst:-false}, 00:22:12.748 "ddgst": ${ddgst:-false} 00:22:12.748 }, 00:22:12.748 "method": "bdev_nvme_attach_controller" 00:22:12.748 } 00:22:12.748 EOF 00:22:12.748 )") 00:22:12.748 02:24:40 -- nvmf/common.sh@542 -- # cat 00:22:12.748 02:24:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:12.748 02:24:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:12.748 { 00:22:12.748 "params": { 00:22:12.748 "name": "Nvme$subsystem", 00:22:12.748 "trtype": "$TEST_TRANSPORT", 00:22:12.748 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:12.748 "adrfam": "ipv4", 00:22:12.748 "trsvcid": "$NVMF_PORT", 00:22:12.748 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:12.748 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:12.748 "hdgst": ${hdgst:-false}, 00:22:12.748 "ddgst": ${ddgst:-false} 00:22:12.748 }, 00:22:12.748 "method": "bdev_nvme_attach_controller" 00:22:12.748 } 00:22:12.748 EOF 00:22:12.748 )") 00:22:12.748 02:24:40 -- nvmf/common.sh@542 -- # cat 00:22:12.748 02:24:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:12.748 02:24:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:12.748 { 00:22:12.748 "params": { 00:22:12.748 "name": "Nvme$subsystem", 00:22:12.748 "trtype": "$TEST_TRANSPORT", 00:22:12.748 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:12.748 "adrfam": "ipv4", 00:22:12.748 "trsvcid": "$NVMF_PORT", 00:22:12.748 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:12.748 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:12.748 "hdgst": ${hdgst:-false}, 00:22:12.748 "ddgst": ${ddgst:-false} 00:22:12.748 }, 00:22:12.748 "method": "bdev_nvme_attach_controller" 00:22:12.748 } 00:22:12.749 EOF 00:22:12.749 )") 00:22:12.749 02:24:40 -- nvmf/common.sh@542 -- # cat 00:22:12.749 02:24:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:12.749 02:24:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:12.749 { 00:22:12.749 "params": { 00:22:12.749 "name": "Nvme$subsystem", 00:22:12.749 "trtype": "$TEST_TRANSPORT", 00:22:12.749 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:12.749 "adrfam": "ipv4", 00:22:12.749 "trsvcid": "$NVMF_PORT", 00:22:12.749 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:12.749 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:12.749 "hdgst": ${hdgst:-false}, 00:22:12.749 "ddgst": ${ddgst:-false} 00:22:12.749 }, 00:22:12.749 "method": "bdev_nvme_attach_controller" 00:22:12.749 } 00:22:12.749 EOF 00:22:12.749 )") 00:22:12.749 02:24:40 -- nvmf/common.sh@542 -- # cat 00:22:12.749 02:24:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:12.749 02:24:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:12.749 { 00:22:12.749 "params": { 00:22:12.749 "name": "Nvme$subsystem", 00:22:12.749 "trtype": "$TEST_TRANSPORT", 00:22:12.749 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:12.749 "adrfam": "ipv4", 00:22:12.749 "trsvcid": "$NVMF_PORT", 00:22:12.749 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:12.749 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:12.749 "hdgst": ${hdgst:-false}, 00:22:12.749 "ddgst": ${ddgst:-false} 00:22:12.749 }, 00:22:12.749 "method": "bdev_nvme_attach_controller" 00:22:12.749 } 00:22:12.749 EOF 00:22:12.749 )") 00:22:12.749 02:24:40 -- nvmf/common.sh@542 -- # cat 00:22:12.749 02:24:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:12.749 02:24:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:12.749 { 00:22:12.749 "params": { 00:22:12.749 "name": "Nvme$subsystem", 00:22:12.749 "trtype": "$TEST_TRANSPORT", 00:22:12.749 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:12.749 "adrfam": "ipv4", 00:22:12.749 "trsvcid": "$NVMF_PORT", 00:22:12.749 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:12.749 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:12.749 "hdgst": ${hdgst:-false}, 00:22:12.749 "ddgst": ${ddgst:-false} 00:22:12.749 }, 00:22:12.749 "method": "bdev_nvme_attach_controller" 00:22:12.749 } 00:22:12.749 EOF 00:22:12.749 )") 00:22:12.749 02:24:40 -- nvmf/common.sh@542 -- # cat 00:22:12.749 02:24:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:12.749 02:24:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:12.749 { 00:22:12.749 "params": { 00:22:12.749 "name": "Nvme$subsystem", 00:22:12.749 "trtype": "$TEST_TRANSPORT", 00:22:12.749 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:12.749 "adrfam": "ipv4", 00:22:12.749 "trsvcid": "$NVMF_PORT", 00:22:12.749 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:12.749 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:12.749 "hdgst": ${hdgst:-false}, 00:22:12.749 "ddgst": ${ddgst:-false} 00:22:12.749 }, 00:22:12.749 "method": "bdev_nvme_attach_controller" 00:22:12.749 } 00:22:12.749 EOF 00:22:12.749 )") 00:22:12.749 02:24:40 -- nvmf/common.sh@542 -- # cat 00:22:12.749 02:24:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:12.749 02:24:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:12.749 { 00:22:12.749 "params": { 00:22:12.749 "name": "Nvme$subsystem", 00:22:12.749 "trtype": "$TEST_TRANSPORT", 00:22:12.749 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:12.749 "adrfam": "ipv4", 00:22:12.749 "trsvcid": "$NVMF_PORT", 00:22:12.749 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:12.749 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:12.749 "hdgst": ${hdgst:-false}, 00:22:12.749 "ddgst": ${ddgst:-false} 00:22:12.749 }, 00:22:12.749 "method": "bdev_nvme_attach_controller" 00:22:12.749 } 00:22:12.749 EOF 00:22:12.749 )") 00:22:12.749 02:24:40 -- nvmf/common.sh@542 -- # cat 00:22:12.749 02:24:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:12.749 02:24:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:12.749 { 00:22:12.749 "params": { 00:22:12.749 "name": "Nvme$subsystem", 00:22:12.749 "trtype": "$TEST_TRANSPORT", 00:22:12.749 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:12.749 "adrfam": "ipv4", 00:22:12.749 "trsvcid": "$NVMF_PORT", 00:22:12.749 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:12.749 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:12.749 "hdgst": ${hdgst:-false}, 00:22:12.749 "ddgst": ${ddgst:-false} 00:22:12.749 }, 00:22:12.749 "method": "bdev_nvme_attach_controller" 00:22:12.749 } 00:22:12.749 EOF 00:22:12.749 )") 00:22:12.749 02:24:40 -- nvmf/common.sh@542 -- # cat 00:22:12.749 02:24:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:12.749 02:24:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:12.749 { 00:22:12.749 "params": { 00:22:12.749 "name": "Nvme$subsystem", 00:22:12.749 "trtype": "$TEST_TRANSPORT", 00:22:12.749 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:12.749 "adrfam": "ipv4", 00:22:12.749 "trsvcid": "$NVMF_PORT", 00:22:12.749 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:12.749 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:12.749 "hdgst": ${hdgst:-false}, 00:22:12.749 "ddgst": ${ddgst:-false} 00:22:12.749 }, 00:22:12.749 "method": "bdev_nvme_attach_controller" 00:22:12.749 } 00:22:12.749 EOF 00:22:12.749 )") 00:22:12.749 02:24:40 -- nvmf/common.sh@542 -- # cat 00:22:12.749 02:24:40 -- nvmf/common.sh@544 -- # jq . 00:22:12.749 02:24:40 -- nvmf/common.sh@545 -- # IFS=, 00:22:12.749 02:24:40 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:12.749 "params": { 00:22:12.749 "name": "Nvme1", 00:22:12.749 "trtype": "tcp", 00:22:12.749 "traddr": "10.0.0.2", 00:22:12.749 "adrfam": "ipv4", 00:22:12.749 "trsvcid": "4420", 00:22:12.749 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:12.749 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:12.749 "hdgst": false, 00:22:12.749 "ddgst": false 00:22:12.749 }, 00:22:12.749 "method": "bdev_nvme_attach_controller" 00:22:12.749 },{ 00:22:12.749 "params": { 00:22:12.749 "name": "Nvme2", 00:22:12.749 "trtype": "tcp", 00:22:12.749 "traddr": "10.0.0.2", 00:22:12.749 "adrfam": "ipv4", 00:22:12.749 "trsvcid": "4420", 00:22:12.749 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:12.749 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:12.749 "hdgst": false, 00:22:12.749 "ddgst": false 00:22:12.749 }, 00:22:12.749 "method": "bdev_nvme_attach_controller" 00:22:12.749 },{ 00:22:12.749 "params": { 00:22:12.749 "name": "Nvme3", 00:22:12.749 "trtype": "tcp", 00:22:12.749 "traddr": "10.0.0.2", 00:22:12.749 "adrfam": "ipv4", 00:22:12.749 "trsvcid": "4420", 00:22:12.749 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:12.749 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:12.749 "hdgst": false, 00:22:12.749 "ddgst": false 00:22:12.749 }, 00:22:12.749 "method": "bdev_nvme_attach_controller" 00:22:12.749 },{ 00:22:12.749 "params": { 00:22:12.749 "name": "Nvme4", 00:22:12.749 "trtype": "tcp", 00:22:12.749 "traddr": "10.0.0.2", 00:22:12.749 "adrfam": "ipv4", 00:22:12.749 "trsvcid": "4420", 00:22:12.749 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:12.749 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:12.749 "hdgst": false, 00:22:12.749 "ddgst": false 00:22:12.749 }, 00:22:12.749 "method": "bdev_nvme_attach_controller" 00:22:12.749 },{ 00:22:12.749 "params": { 00:22:12.749 "name": "Nvme5", 00:22:12.749 "trtype": "tcp", 00:22:12.749 "traddr": "10.0.0.2", 00:22:12.749 "adrfam": "ipv4", 00:22:12.749 "trsvcid": "4420", 00:22:12.749 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:12.749 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:12.749 "hdgst": false, 00:22:12.749 "ddgst": false 00:22:12.749 }, 00:22:12.749 "method": "bdev_nvme_attach_controller" 00:22:12.749 },{ 00:22:12.749 "params": { 00:22:12.749 "name": "Nvme6", 00:22:12.749 "trtype": "tcp", 00:22:12.749 "traddr": "10.0.0.2", 00:22:12.749 "adrfam": "ipv4", 00:22:12.749 "trsvcid": "4420", 00:22:12.749 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:12.749 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:12.749 "hdgst": false, 00:22:12.749 "ddgst": false 00:22:12.749 }, 00:22:12.749 "method": "bdev_nvme_attach_controller" 00:22:12.749 },{ 00:22:12.749 "params": { 00:22:12.749 "name": "Nvme7", 00:22:12.749 "trtype": "tcp", 00:22:12.749 "traddr": "10.0.0.2", 00:22:12.749 "adrfam": "ipv4", 00:22:12.749 "trsvcid": "4420", 00:22:12.749 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:12.749 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:12.749 "hdgst": false, 00:22:12.749 "ddgst": false 00:22:12.749 }, 00:22:12.749 "method": "bdev_nvme_attach_controller" 00:22:12.749 },{ 00:22:12.749 "params": { 00:22:12.749 "name": "Nvme8", 00:22:12.749 "trtype": "tcp", 00:22:12.749 "traddr": "10.0.0.2", 00:22:12.749 "adrfam": "ipv4", 00:22:12.749 "trsvcid": "4420", 00:22:12.749 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:12.749 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:12.749 "hdgst": false, 00:22:12.749 "ddgst": false 00:22:12.749 }, 00:22:12.749 "method": "bdev_nvme_attach_controller" 00:22:12.749 },{ 00:22:12.749 "params": { 00:22:12.749 "name": "Nvme9", 00:22:12.749 "trtype": "tcp", 00:22:12.749 "traddr": "10.0.0.2", 00:22:12.749 "adrfam": "ipv4", 00:22:12.749 "trsvcid": "4420", 00:22:12.749 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:12.749 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:12.749 "hdgst": false, 00:22:12.749 "ddgst": false 00:22:12.749 }, 00:22:12.749 "method": "bdev_nvme_attach_controller" 00:22:12.749 },{ 00:22:12.749 "params": { 00:22:12.749 "name": "Nvme10", 00:22:12.749 "trtype": "tcp", 00:22:12.749 "traddr": "10.0.0.2", 00:22:12.749 "adrfam": "ipv4", 00:22:12.749 "trsvcid": "4420", 00:22:12.749 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:12.749 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:12.749 "hdgst": false, 00:22:12.749 "ddgst": false 00:22:12.749 }, 00:22:12.749 "method": "bdev_nvme_attach_controller" 00:22:12.749 }' 00:22:12.749 [2024-12-08 02:24:40.381195] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:12.749 [2024-12-08 02:24:40.381269] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2174148 ] 00:22:12.749 EAL: No free 2048 kB hugepages reported on node 1 00:22:12.749 [2024-12-08 02:24:40.445061] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:13.006 [2024-12-08 02:24:40.554760] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:14.383 Running I/O for 10 seconds... 00:22:14.383 02:24:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:14.383 02:24:42 -- common/autotest_common.sh@862 -- # return 0 00:22:14.383 02:24:42 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:14.383 02:24:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.383 02:24:42 -- common/autotest_common.sh@10 -- # set +x 00:22:14.645 02:24:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.645 02:24:42 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:14.645 02:24:42 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:14.645 02:24:42 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:14.645 02:24:42 -- target/shutdown.sh@57 -- # local ret=1 00:22:14.645 02:24:42 -- target/shutdown.sh@58 -- # local i 00:22:14.645 02:24:42 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:14.645 02:24:42 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:14.645 02:24:42 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:14.645 02:24:42 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:14.645 02:24:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.645 02:24:42 -- common/autotest_common.sh@10 -- # set +x 00:22:14.645 02:24:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.645 02:24:42 -- target/shutdown.sh@60 -- # read_io_count=3 00:22:14.645 02:24:42 -- target/shutdown.sh@63 -- # '[' 3 -ge 100 ']' 00:22:14.645 02:24:42 -- target/shutdown.sh@67 -- # sleep 0.25 00:22:14.906 02:24:42 -- target/shutdown.sh@59 -- # (( i-- )) 00:22:14.906 02:24:42 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:14.906 02:24:42 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:14.906 02:24:42 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:14.906 02:24:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.906 02:24:42 -- common/autotest_common.sh@10 -- # set +x 00:22:14.906 02:24:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.906 02:24:42 -- target/shutdown.sh@60 -- # read_io_count=129 00:22:14.906 02:24:42 -- target/shutdown.sh@63 -- # '[' 129 -ge 100 ']' 00:22:14.906 02:24:42 -- target/shutdown.sh@64 -- # ret=0 00:22:14.906 02:24:42 -- target/shutdown.sh@65 -- # break 00:22:14.906 02:24:42 -- target/shutdown.sh@69 -- # return 0 00:22:14.906 02:24:42 -- target/shutdown.sh@109 -- # killprocess 2174148 00:22:14.906 02:24:42 -- common/autotest_common.sh@936 -- # '[' -z 2174148 ']' 00:22:14.906 02:24:42 -- common/autotest_common.sh@940 -- # kill -0 2174148 00:22:14.906 02:24:42 -- common/autotest_common.sh@941 -- # uname 00:22:14.906 02:24:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:14.906 02:24:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2174148 00:22:14.906 02:24:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:14.906 02:24:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:14.906 02:24:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2174148' 00:22:14.906 killing process with pid 2174148 00:22:14.906 02:24:42 -- common/autotest_common.sh@955 -- # kill 2174148 00:22:14.906 02:24:42 -- common/autotest_common.sh@960 -- # wait 2174148 00:22:14.906 Received shutdown signal, test time was about 0.526485 seconds 00:22:14.906 00:22:14.906 Latency(us) 00:22:14.906 [2024-12-08T01:24:42.687Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:14.906 [2024-12-08T01:24:42.687Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:14.906 Verification LBA range: start 0x0 length 0x400 00:22:14.906 Nvme1n1 : 0.52 437.03 27.31 0.00 0.00 142548.68 13495.56 119615.34 00:22:14.906 [2024-12-08T01:24:42.687Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:14.906 Verification LBA range: start 0x0 length 0x400 00:22:14.906 Nvme2n1 : 0.49 383.99 24.00 0.00 0.00 157082.00 27379.48 139033.41 00:22:14.906 [2024-12-08T01:24:42.687Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:14.906 Verification LBA range: start 0x0 length 0x400 00:22:14.906 Nvme3n1 : 0.52 438.25 27.39 0.00 0.00 138415.31 10825.58 116508.44 00:22:14.906 [2024-12-08T01:24:42.687Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:14.906 Verification LBA range: start 0x0 length 0x400 00:22:14.906 Nvme4n1 : 0.49 385.47 24.09 0.00 0.00 152054.76 23981.32 145247.19 00:22:14.906 [2024-12-08T01:24:42.687Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:14.906 Verification LBA range: start 0x0 length 0x400 00:22:14.906 Nvme5n1 : 0.52 434.85 27.18 0.00 0.00 134756.75 13204.29 108741.21 00:22:14.906 [2024-12-08T01:24:42.687Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:14.906 Verification LBA range: start 0x0 length 0x400 00:22:14.906 Nvme6n1 : 0.50 379.86 23.74 0.00 0.00 148214.07 29515.47 115731.72 00:22:14.906 [2024-12-08T01:24:42.687Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:14.906 Verification LBA range: start 0x0 length 0x400 00:22:14.906 Nvme7n1 : 0.53 433.72 27.11 0.00 0.00 130919.98 13301.38 111848.11 00:22:14.906 [2024-12-08T01:24:42.687Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:14.906 Verification LBA range: start 0x0 length 0x400 00:22:14.906 Nvme8n1 : 0.50 381.41 23.84 0.00 0.00 143484.24 24758.04 122722.23 00:22:14.906 [2024-12-08T01:24:42.687Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:14.906 Verification LBA range: start 0x0 length 0x400 00:22:14.906 Nvme9n1 : 0.50 376.76 23.55 0.00 0.00 142562.39 26408.58 125052.40 00:22:14.906 [2024-12-08T01:24:42.687Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:14.906 Verification LBA range: start 0x0 length 0x400 00:22:14.906 Nvme10n1 : 0.51 369.58 23.10 0.00 0.00 142750.44 29903.83 125052.40 00:22:14.906 [2024-12-08T01:24:42.687Z] =================================================================================================================== 00:22:14.906 [2024-12-08T01:24:42.687Z] Total : 4020.93 251.31 0.00 0.00 142788.59 10825.58 145247.19 00:22:15.473 02:24:42 -- target/shutdown.sh@112 -- # sleep 1 00:22:16.410 02:24:43 -- target/shutdown.sh@113 -- # kill -0 2173951 00:22:16.410 02:24:43 -- target/shutdown.sh@115 -- # stoptarget 00:22:16.410 02:24:43 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:16.410 02:24:43 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:16.410 02:24:43 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:16.410 02:24:43 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:16.410 02:24:43 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:16.410 02:24:43 -- nvmf/common.sh@116 -- # sync 00:22:16.410 02:24:43 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:16.410 02:24:43 -- nvmf/common.sh@119 -- # set +e 00:22:16.410 02:24:43 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:16.410 02:24:43 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:16.410 rmmod nvme_tcp 00:22:16.410 rmmod nvme_fabrics 00:22:16.410 rmmod nvme_keyring 00:22:16.410 02:24:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:16.410 02:24:44 -- nvmf/common.sh@123 -- # set -e 00:22:16.410 02:24:44 -- nvmf/common.sh@124 -- # return 0 00:22:16.410 02:24:44 -- nvmf/common.sh@477 -- # '[' -n 2173951 ']' 00:22:16.410 02:24:44 -- nvmf/common.sh@478 -- # killprocess 2173951 00:22:16.410 02:24:44 -- common/autotest_common.sh@936 -- # '[' -z 2173951 ']' 00:22:16.410 02:24:44 -- common/autotest_common.sh@940 -- # kill -0 2173951 00:22:16.410 02:24:44 -- common/autotest_common.sh@941 -- # uname 00:22:16.410 02:24:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:16.410 02:24:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2173951 00:22:16.410 02:24:44 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:16.410 02:24:44 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:16.410 02:24:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2173951' 00:22:16.410 killing process with pid 2173951 00:22:16.410 02:24:44 -- common/autotest_common.sh@955 -- # kill 2173951 00:22:16.410 02:24:44 -- common/autotest_common.sh@960 -- # wait 2173951 00:22:16.980 02:24:44 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:16.980 02:24:44 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:16.980 02:24:44 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:16.980 02:24:44 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:16.980 02:24:44 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:16.980 02:24:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:16.980 02:24:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:16.980 02:24:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:19.512 02:24:46 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:19.512 00:22:19.512 real 0m8.121s 00:22:19.512 user 0m25.238s 00:22:19.512 sys 0m1.339s 00:22:19.512 02:24:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:19.512 02:24:46 -- common/autotest_common.sh@10 -- # set +x 00:22:19.512 ************************************ 00:22:19.512 END TEST nvmf_shutdown_tc2 00:22:19.512 ************************************ 00:22:19.512 02:24:46 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:22:19.512 02:24:46 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:19.512 02:24:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:19.512 02:24:46 -- common/autotest_common.sh@10 -- # set +x 00:22:19.512 ************************************ 00:22:19.512 START TEST nvmf_shutdown_tc3 00:22:19.512 ************************************ 00:22:19.512 02:24:46 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc3 00:22:19.512 02:24:46 -- target/shutdown.sh@120 -- # starttarget 00:22:19.512 02:24:46 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:19.512 02:24:46 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:19.512 02:24:46 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:19.512 02:24:46 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:19.512 02:24:46 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:19.512 02:24:46 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:19.512 02:24:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:19.512 02:24:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:19.512 02:24:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:19.512 02:24:46 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:19.512 02:24:46 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:19.512 02:24:46 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:19.512 02:24:46 -- common/autotest_common.sh@10 -- # set +x 00:22:19.512 02:24:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:19.512 02:24:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:19.513 02:24:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:19.513 02:24:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:19.513 02:24:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:19.513 02:24:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:19.513 02:24:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:19.513 02:24:46 -- nvmf/common.sh@294 -- # net_devs=() 00:22:19.513 02:24:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:19.513 02:24:46 -- nvmf/common.sh@295 -- # e810=() 00:22:19.513 02:24:46 -- nvmf/common.sh@295 -- # local -ga e810 00:22:19.513 02:24:46 -- nvmf/common.sh@296 -- # x722=() 00:22:19.513 02:24:46 -- nvmf/common.sh@296 -- # local -ga x722 00:22:19.513 02:24:46 -- nvmf/common.sh@297 -- # mlx=() 00:22:19.513 02:24:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:19.513 02:24:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:19.513 02:24:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:19.513 02:24:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:19.513 02:24:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:19.513 02:24:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:19.513 02:24:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:19.513 02:24:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:19.513 02:24:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:19.513 02:24:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:19.513 02:24:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:19.513 02:24:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:19.513 02:24:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:19.513 02:24:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:19.513 02:24:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:19.513 02:24:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:19.513 02:24:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:19.513 02:24:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:19.513 02:24:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:19.513 02:24:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:19.513 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:19.513 02:24:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:19.513 02:24:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:19.513 02:24:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:19.513 02:24:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:19.513 02:24:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:19.513 02:24:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:19.513 02:24:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:19.513 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:19.513 02:24:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:19.513 02:24:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:19.513 02:24:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:19.513 02:24:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:19.513 02:24:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:19.513 02:24:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:19.513 02:24:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:19.513 02:24:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:19.513 02:24:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:19.513 02:24:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:19.513 02:24:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:19.513 02:24:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:19.513 02:24:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:19.513 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:19.513 02:24:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:19.513 02:24:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:19.513 02:24:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:19.513 02:24:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:19.513 02:24:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:19.513 02:24:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:19.513 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:19.513 02:24:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:19.513 02:24:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:19.513 02:24:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:19.513 02:24:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:19.513 02:24:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:19.513 02:24:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:19.513 02:24:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:19.513 02:24:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:19.513 02:24:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:19.513 02:24:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:19.513 02:24:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:19.513 02:24:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:19.513 02:24:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:19.513 02:24:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:19.513 02:24:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:19.513 02:24:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:19.513 02:24:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:19.513 02:24:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:19.513 02:24:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:19.513 02:24:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:19.513 02:24:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:19.513 02:24:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:19.513 02:24:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:19.513 02:24:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:19.513 02:24:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:19.513 02:24:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:19.513 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:19.513 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.241 ms 00:22:19.513 00:22:19.513 --- 10.0.0.2 ping statistics --- 00:22:19.513 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:19.513 rtt min/avg/max/mdev = 0.241/0.241/0.241/0.000 ms 00:22:19.513 02:24:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:19.513 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:19.513 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.122 ms 00:22:19.513 00:22:19.513 --- 10.0.0.1 ping statistics --- 00:22:19.513 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:19.513 rtt min/avg/max/mdev = 0.122/0.122/0.122/0.000 ms 00:22:19.513 02:24:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:19.513 02:24:46 -- nvmf/common.sh@410 -- # return 0 00:22:19.513 02:24:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:19.513 02:24:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:19.513 02:24:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:19.513 02:24:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:19.513 02:24:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:19.513 02:24:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:19.513 02:24:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:19.513 02:24:46 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:19.513 02:24:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:19.513 02:24:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:19.513 02:24:46 -- common/autotest_common.sh@10 -- # set +x 00:22:19.513 02:24:46 -- nvmf/common.sh@469 -- # nvmfpid=2175076 00:22:19.513 02:24:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:19.513 02:24:46 -- nvmf/common.sh@470 -- # waitforlisten 2175076 00:22:19.513 02:24:46 -- common/autotest_common.sh@829 -- # '[' -z 2175076 ']' 00:22:19.513 02:24:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:19.513 02:24:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:19.513 02:24:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:19.513 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:19.513 02:24:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:19.513 02:24:46 -- common/autotest_common.sh@10 -- # set +x 00:22:19.513 [2024-12-08 02:24:46.916492] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:19.513 [2024-12-08 02:24:46.916567] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:19.513 EAL: No free 2048 kB hugepages reported on node 1 00:22:19.513 [2024-12-08 02:24:46.981581] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:19.513 [2024-12-08 02:24:47.100832] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:19.513 [2024-12-08 02:24:47.100992] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:19.513 [2024-12-08 02:24:47.101013] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:19.513 [2024-12-08 02:24:47.101027] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:19.513 [2024-12-08 02:24:47.101083] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:19.513 [2024-12-08 02:24:47.101204] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:19.513 [2024-12-08 02:24:47.101283] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:19.513 [2024-12-08 02:24:47.101286] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:20.448 02:24:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:20.448 02:24:47 -- common/autotest_common.sh@862 -- # return 0 00:22:20.448 02:24:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:20.448 02:24:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:20.448 02:24:47 -- common/autotest_common.sh@10 -- # set +x 00:22:20.448 02:24:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:20.448 02:24:47 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:20.448 02:24:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.448 02:24:47 -- common/autotest_common.sh@10 -- # set +x 00:22:20.448 [2024-12-08 02:24:47.955222] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:20.448 02:24:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.448 02:24:47 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:20.448 02:24:47 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:20.448 02:24:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:20.448 02:24:47 -- common/autotest_common.sh@10 -- # set +x 00:22:20.448 02:24:47 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:20.448 02:24:47 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.448 02:24:47 -- target/shutdown.sh@28 -- # cat 00:22:20.448 02:24:47 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.448 02:24:47 -- target/shutdown.sh@28 -- # cat 00:22:20.448 02:24:47 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.448 02:24:47 -- target/shutdown.sh@28 -- # cat 00:22:20.448 02:24:47 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.448 02:24:47 -- target/shutdown.sh@28 -- # cat 00:22:20.448 02:24:47 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.448 02:24:47 -- target/shutdown.sh@28 -- # cat 00:22:20.448 02:24:47 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.448 02:24:47 -- target/shutdown.sh@28 -- # cat 00:22:20.448 02:24:47 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.448 02:24:47 -- target/shutdown.sh@28 -- # cat 00:22:20.448 02:24:47 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.448 02:24:47 -- target/shutdown.sh@28 -- # cat 00:22:20.448 02:24:47 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.448 02:24:47 -- target/shutdown.sh@28 -- # cat 00:22:20.448 02:24:47 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.448 02:24:47 -- target/shutdown.sh@28 -- # cat 00:22:20.448 02:24:47 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:20.448 02:24:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.448 02:24:47 -- common/autotest_common.sh@10 -- # set +x 00:22:20.448 Malloc1 00:22:20.448 [2024-12-08 02:24:48.044806] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:20.448 Malloc2 00:22:20.448 Malloc3 00:22:20.448 Malloc4 00:22:20.448 Malloc5 00:22:20.705 Malloc6 00:22:20.705 Malloc7 00:22:20.705 Malloc8 00:22:20.705 Malloc9 00:22:20.705 Malloc10 00:22:20.705 02:24:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.705 02:24:48 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:20.705 02:24:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:20.964 02:24:48 -- common/autotest_common.sh@10 -- # set +x 00:22:20.964 02:24:48 -- target/shutdown.sh@124 -- # perfpid=2175276 00:22:20.964 02:24:48 -- target/shutdown.sh@125 -- # waitforlisten 2175276 /var/tmp/bdevperf.sock 00:22:20.964 02:24:48 -- common/autotest_common.sh@829 -- # '[' -z 2175276 ']' 00:22:20.964 02:24:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:20.964 02:24:48 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:20.964 02:24:48 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:20.964 02:24:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:20.964 02:24:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:20.964 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:20.964 02:24:48 -- nvmf/common.sh@520 -- # config=() 00:22:20.964 02:24:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:20.964 02:24:48 -- nvmf/common.sh@520 -- # local subsystem config 00:22:20.964 02:24:48 -- common/autotest_common.sh@10 -- # set +x 00:22:20.964 02:24:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:20.964 02:24:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:20.964 { 00:22:20.964 "params": { 00:22:20.964 "name": "Nvme$subsystem", 00:22:20.964 "trtype": "$TEST_TRANSPORT", 00:22:20.964 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:20.964 "adrfam": "ipv4", 00:22:20.964 "trsvcid": "$NVMF_PORT", 00:22:20.964 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:20.964 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:20.964 "hdgst": ${hdgst:-false}, 00:22:20.964 "ddgst": ${ddgst:-false} 00:22:20.964 }, 00:22:20.964 "method": "bdev_nvme_attach_controller" 00:22:20.964 } 00:22:20.964 EOF 00:22:20.964 )") 00:22:20.964 02:24:48 -- nvmf/common.sh@542 -- # cat 00:22:20.964 02:24:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:20.964 02:24:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:20.964 { 00:22:20.964 "params": { 00:22:20.964 "name": "Nvme$subsystem", 00:22:20.964 "trtype": "$TEST_TRANSPORT", 00:22:20.964 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:20.964 "adrfam": "ipv4", 00:22:20.964 "trsvcid": "$NVMF_PORT", 00:22:20.964 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:20.964 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:20.964 "hdgst": ${hdgst:-false}, 00:22:20.964 "ddgst": ${ddgst:-false} 00:22:20.964 }, 00:22:20.964 "method": "bdev_nvme_attach_controller" 00:22:20.964 } 00:22:20.964 EOF 00:22:20.964 )") 00:22:20.964 02:24:48 -- nvmf/common.sh@542 -- # cat 00:22:20.964 02:24:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:20.964 02:24:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:20.964 { 00:22:20.964 "params": { 00:22:20.964 "name": "Nvme$subsystem", 00:22:20.964 "trtype": "$TEST_TRANSPORT", 00:22:20.964 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:20.964 "adrfam": "ipv4", 00:22:20.964 "trsvcid": "$NVMF_PORT", 00:22:20.964 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:20.964 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:20.964 "hdgst": ${hdgst:-false}, 00:22:20.964 "ddgst": ${ddgst:-false} 00:22:20.964 }, 00:22:20.964 "method": "bdev_nvme_attach_controller" 00:22:20.964 } 00:22:20.964 EOF 00:22:20.964 )") 00:22:20.964 02:24:48 -- nvmf/common.sh@542 -- # cat 00:22:20.964 02:24:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:20.964 02:24:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:20.964 { 00:22:20.964 "params": { 00:22:20.964 "name": "Nvme$subsystem", 00:22:20.964 "trtype": "$TEST_TRANSPORT", 00:22:20.964 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:20.964 "adrfam": "ipv4", 00:22:20.964 "trsvcid": "$NVMF_PORT", 00:22:20.964 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:20.964 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:20.964 "hdgst": ${hdgst:-false}, 00:22:20.964 "ddgst": ${ddgst:-false} 00:22:20.964 }, 00:22:20.965 "method": "bdev_nvme_attach_controller" 00:22:20.965 } 00:22:20.965 EOF 00:22:20.965 )") 00:22:20.965 02:24:48 -- nvmf/common.sh@542 -- # cat 00:22:20.965 02:24:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:20.965 02:24:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:20.965 { 00:22:20.965 "params": { 00:22:20.965 "name": "Nvme$subsystem", 00:22:20.965 "trtype": "$TEST_TRANSPORT", 00:22:20.965 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:20.965 "adrfam": "ipv4", 00:22:20.965 "trsvcid": "$NVMF_PORT", 00:22:20.965 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:20.965 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:20.965 "hdgst": ${hdgst:-false}, 00:22:20.965 "ddgst": ${ddgst:-false} 00:22:20.965 }, 00:22:20.965 "method": "bdev_nvme_attach_controller" 00:22:20.965 } 00:22:20.965 EOF 00:22:20.965 )") 00:22:20.965 02:24:48 -- nvmf/common.sh@542 -- # cat 00:22:20.965 02:24:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:20.965 02:24:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:20.965 { 00:22:20.965 "params": { 00:22:20.965 "name": "Nvme$subsystem", 00:22:20.965 "trtype": "$TEST_TRANSPORT", 00:22:20.965 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:20.965 "adrfam": "ipv4", 00:22:20.965 "trsvcid": "$NVMF_PORT", 00:22:20.965 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:20.965 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:20.965 "hdgst": ${hdgst:-false}, 00:22:20.965 "ddgst": ${ddgst:-false} 00:22:20.965 }, 00:22:20.965 "method": "bdev_nvme_attach_controller" 00:22:20.965 } 00:22:20.965 EOF 00:22:20.965 )") 00:22:20.965 02:24:48 -- nvmf/common.sh@542 -- # cat 00:22:20.965 02:24:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:20.965 02:24:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:20.965 { 00:22:20.965 "params": { 00:22:20.965 "name": "Nvme$subsystem", 00:22:20.965 "trtype": "$TEST_TRANSPORT", 00:22:20.965 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:20.965 "adrfam": "ipv4", 00:22:20.965 "trsvcid": "$NVMF_PORT", 00:22:20.965 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:20.965 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:20.965 "hdgst": ${hdgst:-false}, 00:22:20.965 "ddgst": ${ddgst:-false} 00:22:20.965 }, 00:22:20.965 "method": "bdev_nvme_attach_controller" 00:22:20.965 } 00:22:20.965 EOF 00:22:20.965 )") 00:22:20.965 02:24:48 -- nvmf/common.sh@542 -- # cat 00:22:20.965 02:24:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:20.965 02:24:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:20.965 { 00:22:20.965 "params": { 00:22:20.965 "name": "Nvme$subsystem", 00:22:20.965 "trtype": "$TEST_TRANSPORT", 00:22:20.965 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:20.965 "adrfam": "ipv4", 00:22:20.965 "trsvcid": "$NVMF_PORT", 00:22:20.965 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:20.965 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:20.965 "hdgst": ${hdgst:-false}, 00:22:20.965 "ddgst": ${ddgst:-false} 00:22:20.965 }, 00:22:20.965 "method": "bdev_nvme_attach_controller" 00:22:20.965 } 00:22:20.965 EOF 00:22:20.965 )") 00:22:20.965 02:24:48 -- nvmf/common.sh@542 -- # cat 00:22:20.965 02:24:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:20.965 02:24:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:20.965 { 00:22:20.965 "params": { 00:22:20.965 "name": "Nvme$subsystem", 00:22:20.965 "trtype": "$TEST_TRANSPORT", 00:22:20.965 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:20.965 "adrfam": "ipv4", 00:22:20.965 "trsvcid": "$NVMF_PORT", 00:22:20.965 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:20.965 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:20.965 "hdgst": ${hdgst:-false}, 00:22:20.965 "ddgst": ${ddgst:-false} 00:22:20.965 }, 00:22:20.965 "method": "bdev_nvme_attach_controller" 00:22:20.965 } 00:22:20.965 EOF 00:22:20.965 )") 00:22:20.965 02:24:48 -- nvmf/common.sh@542 -- # cat 00:22:20.965 02:24:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:20.965 02:24:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:20.965 { 00:22:20.965 "params": { 00:22:20.965 "name": "Nvme$subsystem", 00:22:20.965 "trtype": "$TEST_TRANSPORT", 00:22:20.965 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:20.965 "adrfam": "ipv4", 00:22:20.965 "trsvcid": "$NVMF_PORT", 00:22:20.965 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:20.965 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:20.965 "hdgst": ${hdgst:-false}, 00:22:20.965 "ddgst": ${ddgst:-false} 00:22:20.965 }, 00:22:20.965 "method": "bdev_nvme_attach_controller" 00:22:20.965 } 00:22:20.965 EOF 00:22:20.965 )") 00:22:20.965 02:24:48 -- nvmf/common.sh@542 -- # cat 00:22:20.965 02:24:48 -- nvmf/common.sh@544 -- # jq . 00:22:20.965 02:24:48 -- nvmf/common.sh@545 -- # IFS=, 00:22:20.965 02:24:48 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:20.965 "params": { 00:22:20.965 "name": "Nvme1", 00:22:20.965 "trtype": "tcp", 00:22:20.965 "traddr": "10.0.0.2", 00:22:20.965 "adrfam": "ipv4", 00:22:20.965 "trsvcid": "4420", 00:22:20.965 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:20.965 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:20.965 "hdgst": false, 00:22:20.965 "ddgst": false 00:22:20.965 }, 00:22:20.965 "method": "bdev_nvme_attach_controller" 00:22:20.965 },{ 00:22:20.965 "params": { 00:22:20.965 "name": "Nvme2", 00:22:20.965 "trtype": "tcp", 00:22:20.965 "traddr": "10.0.0.2", 00:22:20.965 "adrfam": "ipv4", 00:22:20.965 "trsvcid": "4420", 00:22:20.965 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:20.965 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:20.965 "hdgst": false, 00:22:20.965 "ddgst": false 00:22:20.965 }, 00:22:20.965 "method": "bdev_nvme_attach_controller" 00:22:20.965 },{ 00:22:20.965 "params": { 00:22:20.965 "name": "Nvme3", 00:22:20.965 "trtype": "tcp", 00:22:20.965 "traddr": "10.0.0.2", 00:22:20.965 "adrfam": "ipv4", 00:22:20.965 "trsvcid": "4420", 00:22:20.965 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:20.965 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:20.965 "hdgst": false, 00:22:20.965 "ddgst": false 00:22:20.965 }, 00:22:20.965 "method": "bdev_nvme_attach_controller" 00:22:20.965 },{ 00:22:20.965 "params": { 00:22:20.965 "name": "Nvme4", 00:22:20.965 "trtype": "tcp", 00:22:20.965 "traddr": "10.0.0.2", 00:22:20.965 "adrfam": "ipv4", 00:22:20.965 "trsvcid": "4420", 00:22:20.965 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:20.965 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:20.965 "hdgst": false, 00:22:20.965 "ddgst": false 00:22:20.965 }, 00:22:20.965 "method": "bdev_nvme_attach_controller" 00:22:20.965 },{ 00:22:20.965 "params": { 00:22:20.965 "name": "Nvme5", 00:22:20.965 "trtype": "tcp", 00:22:20.965 "traddr": "10.0.0.2", 00:22:20.965 "adrfam": "ipv4", 00:22:20.965 "trsvcid": "4420", 00:22:20.965 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:20.965 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:20.965 "hdgst": false, 00:22:20.965 "ddgst": false 00:22:20.965 }, 00:22:20.965 "method": "bdev_nvme_attach_controller" 00:22:20.965 },{ 00:22:20.965 "params": { 00:22:20.965 "name": "Nvme6", 00:22:20.965 "trtype": "tcp", 00:22:20.965 "traddr": "10.0.0.2", 00:22:20.965 "adrfam": "ipv4", 00:22:20.965 "trsvcid": "4420", 00:22:20.965 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:20.965 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:20.965 "hdgst": false, 00:22:20.965 "ddgst": false 00:22:20.965 }, 00:22:20.965 "method": "bdev_nvme_attach_controller" 00:22:20.965 },{ 00:22:20.965 "params": { 00:22:20.965 "name": "Nvme7", 00:22:20.965 "trtype": "tcp", 00:22:20.965 "traddr": "10.0.0.2", 00:22:20.965 "adrfam": "ipv4", 00:22:20.965 "trsvcid": "4420", 00:22:20.965 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:20.965 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:20.965 "hdgst": false, 00:22:20.965 "ddgst": false 00:22:20.965 }, 00:22:20.965 "method": "bdev_nvme_attach_controller" 00:22:20.965 },{ 00:22:20.965 "params": { 00:22:20.965 "name": "Nvme8", 00:22:20.965 "trtype": "tcp", 00:22:20.965 "traddr": "10.0.0.2", 00:22:20.965 "adrfam": "ipv4", 00:22:20.965 "trsvcid": "4420", 00:22:20.965 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:20.965 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:20.965 "hdgst": false, 00:22:20.965 "ddgst": false 00:22:20.965 }, 00:22:20.965 "method": "bdev_nvme_attach_controller" 00:22:20.965 },{ 00:22:20.965 "params": { 00:22:20.965 "name": "Nvme9", 00:22:20.965 "trtype": "tcp", 00:22:20.965 "traddr": "10.0.0.2", 00:22:20.965 "adrfam": "ipv4", 00:22:20.965 "trsvcid": "4420", 00:22:20.965 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:20.965 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:20.965 "hdgst": false, 00:22:20.965 "ddgst": false 00:22:20.965 }, 00:22:20.965 "method": "bdev_nvme_attach_controller" 00:22:20.965 },{ 00:22:20.965 "params": { 00:22:20.965 "name": "Nvme10", 00:22:20.965 "trtype": "tcp", 00:22:20.966 "traddr": "10.0.0.2", 00:22:20.966 "adrfam": "ipv4", 00:22:20.966 "trsvcid": "4420", 00:22:20.966 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:20.966 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:20.966 "hdgst": false, 00:22:20.966 "ddgst": false 00:22:20.966 }, 00:22:20.966 "method": "bdev_nvme_attach_controller" 00:22:20.966 }' 00:22:20.966 [2024-12-08 02:24:48.542620] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:20.966 [2024-12-08 02:24:48.542693] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2175276 ] 00:22:20.966 EAL: No free 2048 kB hugepages reported on node 1 00:22:20.966 [2024-12-08 02:24:48.609827] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:20.966 [2024-12-08 02:24:48.718318] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:22.341 Running I/O for 10 seconds... 00:22:22.599 02:24:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:22.599 02:24:50 -- common/autotest_common.sh@862 -- # return 0 00:22:22.599 02:24:50 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:22.599 02:24:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:22.599 02:24:50 -- common/autotest_common.sh@10 -- # set +x 00:22:22.599 02:24:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:22.599 02:24:50 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:22.599 02:24:50 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:22.599 02:24:50 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:22.599 02:24:50 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:22.599 02:24:50 -- target/shutdown.sh@57 -- # local ret=1 00:22:22.599 02:24:50 -- target/shutdown.sh@58 -- # local i 00:22:22.599 02:24:50 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:22.599 02:24:50 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:22.599 02:24:50 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:22.599 02:24:50 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:22.599 02:24:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:22.599 02:24:50 -- common/autotest_common.sh@10 -- # set +x 00:22:22.871 02:24:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:22.871 02:24:50 -- target/shutdown.sh@60 -- # read_io_count=129 00:22:22.871 02:24:50 -- target/shutdown.sh@63 -- # '[' 129 -ge 100 ']' 00:22:22.871 02:24:50 -- target/shutdown.sh@64 -- # ret=0 00:22:22.871 02:24:50 -- target/shutdown.sh@65 -- # break 00:22:22.871 02:24:50 -- target/shutdown.sh@69 -- # return 0 00:22:22.871 02:24:50 -- target/shutdown.sh@134 -- # killprocess 2175076 00:22:22.871 02:24:50 -- common/autotest_common.sh@936 -- # '[' -z 2175076 ']' 00:22:22.871 02:24:50 -- common/autotest_common.sh@940 -- # kill -0 2175076 00:22:22.871 02:24:50 -- common/autotest_common.sh@941 -- # uname 00:22:22.871 02:24:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:22.871 02:24:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2175076 00:22:22.871 02:24:50 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:22.871 02:24:50 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:22.871 02:24:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2175076' 00:22:22.871 killing process with pid 2175076 00:22:22.871 02:24:50 -- common/autotest_common.sh@955 -- # kill 2175076 00:22:22.871 02:24:50 -- common/autotest_common.sh@960 -- # wait 2175076 00:22:22.871 [2024-12-08 02:24:50.433097] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa372e0 is same with the state(5) to be set 00:22:22.871 [2024-12-08 02:24:50.433177] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa372e0 is same with the state(5) to be set 00:22:22.871 [2024-12-08 02:24:50.433776] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.871 [2024-12-08 02:24:50.433811] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.871 [2024-12-08 02:24:50.433838] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.871 [2024-12-08 02:24:50.433850] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.871 [2024-12-08 02:24:50.433863] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.871 [2024-12-08 02:24:50.433875] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.871 [2024-12-08 02:24:50.433888] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.871 [2024-12-08 02:24:50.433900] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.871 [2024-12-08 02:24:50.433913] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.871 [2024-12-08 02:24:50.433925] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.871 [2024-12-08 02:24:50.433936] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.871 [2024-12-08 02:24:50.433948] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.871 [2024-12-08 02:24:50.433959] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.871 [2024-12-08 02:24:50.433971] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.871 [2024-12-08 02:24:50.433983] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.871 [2024-12-08 02:24:50.433995] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.871 [2024-12-08 02:24:50.434006] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.871 [2024-12-08 02:24:50.434017] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.871 [2024-12-08 02:24:50.434029] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.871 [2024-12-08 02:24:50.434057] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.871 [2024-12-08 02:24:50.434070] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.871 [2024-12-08 02:24:50.434081] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.871 [2024-12-08 02:24:50.434092] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.871 [2024-12-08 02:24:50.434104] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.871 [2024-12-08 02:24:50.434116] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.871 [2024-12-08 02:24:50.434127] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434139] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434150] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434162] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434173] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434185] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434196] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434207] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434219] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434231] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434242] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434254] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434265] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434276] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434287] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434299] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434310] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434322] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434333] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434344] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434355] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434370] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434382] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434393] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434405] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434416] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434427] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434438] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434449] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434460] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434472] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434484] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434495] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434507] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434518] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434530] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434552] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.434566] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39cd0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.435512] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa37790 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.436695] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa37c40 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.437252] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa380d0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.437286] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa380d0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.437598] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa38580 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.437626] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa38580 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.438843] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa38ec0 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.439378] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39370 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.439675] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.439701] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.439727] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.439740] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.439751] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.439763] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.439774] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.439786] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.439797] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.439808] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.439820] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.439837] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.439849] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.439861] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.439872] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.439883] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.439894] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.439906] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.439917] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.439929] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.439940] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.439951] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.439963] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.439974] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.439985] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.439996] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.440007] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.440019] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.440030] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.440041] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.440056] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.440068] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.440080] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.440091] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.440103] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.440114] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.440125] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.440136] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.872 [2024-12-08 02:24:50.440148] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.873 [2024-12-08 02:24:50.440159] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.873 [2024-12-08 02:24:50.440170] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.873 [2024-12-08 02:24:50.440181] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.873 [2024-12-08 02:24:50.440192] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.873 [2024-12-08 02:24:50.440203] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.873 [2024-12-08 02:24:50.440215] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.873 [2024-12-08 02:24:50.440226] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.873 [2024-12-08 02:24:50.440237] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.873 [2024-12-08 02:24:50.440248] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.873 [2024-12-08 02:24:50.440259] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.873 [2024-12-08 02:24:50.440271] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.873 [2024-12-08 02:24:50.440282] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.873 [2024-12-08 02:24:50.440294] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.873 [2024-12-08 02:24:50.440305] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.873 [2024-12-08 02:24:50.440316] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.873 [2024-12-08 02:24:50.440328] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.873 [2024-12-08 02:24:50.440340] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.873 [2024-12-08 02:24:50.440352] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.873 [2024-12-08 02:24:50.440367] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.873 [2024-12-08 02:24:50.440379] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.873 [2024-12-08 02:24:50.440391] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.873 [2024-12-08 02:24:50.440402] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.873 [2024-12-08 02:24:50.440413] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.873 [2024-12-08 02:24:50.440424] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa39820 is same with the state(5) to be set 00:22:22.873 [2024-12-08 02:24:50.483444] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.873 [2024-12-08 02:24:50.483516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.873 [2024-12-08 02:24:50.483552] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.873 [2024-12-08 02:24:50.483567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.873 [2024-12-08 02:24:50.483581] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.873 [2024-12-08 02:24:50.483595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.873 [2024-12-08 02:24:50.483609] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.873 [2024-12-08 02:24:50.483621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.873 [2024-12-08 02:24:50.483634] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6a3490 is same with the state(5) to be set 00:22:22.873 [2024-12-08 02:24:50.483707] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.873 [2024-12-08 02:24:50.483728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.873 [2024-12-08 02:24:50.483743] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.873 [2024-12-08 02:24:50.483756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.873 [2024-12-08 02:24:50.483770] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.873 [2024-12-08 02:24:50.483783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.873 [2024-12-08 02:24:50.483796] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.873 [2024-12-08 02:24:50.483809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.873 [2024-12-08 02:24:50.483821] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x681690 is same with the state(5) to be set 00:22:22.873 [2024-12-08 02:24:50.483882] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.873 [2024-12-08 02:24:50.483904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.873 [2024-12-08 02:24:50.483930] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.873 [2024-12-08 02:24:50.483944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.873 [2024-12-08 02:24:50.483958] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.873 [2024-12-08 02:24:50.483970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.873 [2024-12-08 02:24:50.483984] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.873 [2024-12-08 02:24:50.483998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.873 [2024-12-08 02:24:50.484011] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x80c150 is same with the state(5) to be set 00:22:22.873 [2024-12-08 02:24:50.484059] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.873 [2024-12-08 02:24:50.484080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.873 [2024-12-08 02:24:50.484095] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.873 [2024-12-08 02:24:50.484108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.873 [2024-12-08 02:24:50.484122] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.873 [2024-12-08 02:24:50.484135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.873 [2024-12-08 02:24:50.484148] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.873 [2024-12-08 02:24:50.484161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.873 [2024-12-08 02:24:50.484173] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x81c600 is same with the state(5) to be set 00:22:22.873 [2024-12-08 02:24:50.484218] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.873 [2024-12-08 02:24:50.484238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.873 [2024-12-08 02:24:50.484253] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.873 [2024-12-08 02:24:50.484266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.873 [2024-12-08 02:24:50.484280] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.873 [2024-12-08 02:24:50.484292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.873 [2024-12-08 02:24:50.484306] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.873 [2024-12-08 02:24:50.484318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.873 [2024-12-08 02:24:50.484330] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6781b0 is same with the state(5) to be set 00:22:22.873 [2024-12-08 02:24:50.484380] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.873 [2024-12-08 02:24:50.484401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.873 [2024-12-08 02:24:50.484415] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.873 [2024-12-08 02:24:50.484428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.873 [2024-12-08 02:24:50.484441] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.873 [2024-12-08 02:24:50.484454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.873 [2024-12-08 02:24:50.484468] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.873 [2024-12-08 02:24:50.484480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.873 [2024-12-08 02:24:50.484493] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x655f70 is same with the state(5) to be set 00:22:22.873 [2024-12-08 02:24:50.484558] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.873 [2024-12-08 02:24:50.484580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.873 [2024-12-08 02:24:50.484595] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.873 [2024-12-08 02:24:50.484608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.484621] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.874 [2024-12-08 02:24:50.484636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.484650] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.874 [2024-12-08 02:24:50.484663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.484675] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x80bc70 is same with the state(5) to be set 00:22:22.874 [2024-12-08 02:24:50.484722] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.874 [2024-12-08 02:24:50.484742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.484756] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.874 [2024-12-08 02:24:50.484769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.484783] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.874 [2024-12-08 02:24:50.484796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.484810] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.874 [2024-12-08 02:24:50.484828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.484846] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ae590 is same with the state(5) to be set 00:22:22.874 [2024-12-08 02:24:50.484894] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.874 [2024-12-08 02:24:50.484915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.484929] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.874 [2024-12-08 02:24:50.484942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.484956] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.874 [2024-12-08 02:24:50.484968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.484982] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.874 [2024-12-08 02:24:50.484995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.485008] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f70a0 is same with the state(5) to be set 00:22:22.874 [2024-12-08 02:24:50.485053] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.874 [2024-12-08 02:24:50.485074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.485088] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.874 [2024-12-08 02:24:50.485101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.485115] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.874 [2024-12-08 02:24:50.485128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.485141] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:22.874 [2024-12-08 02:24:50.485154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.485167] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x806a60 is same with the state(5) to be set 00:22:22.874 [2024-12-08 02:24:50.485263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.874 [2024-12-08 02:24:50.485286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.485313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.874 [2024-12-08 02:24:50.485328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.485345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.874 [2024-12-08 02:24:50.485359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.485379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.874 [2024-12-08 02:24:50.485393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.485409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.874 [2024-12-08 02:24:50.485422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.485444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.874 [2024-12-08 02:24:50.485457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.485473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.874 [2024-12-08 02:24:50.485486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.485502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.874 [2024-12-08 02:24:50.485515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.485531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.874 [2024-12-08 02:24:50.485554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.485570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.874 [2024-12-08 02:24:50.485584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.485599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.874 [2024-12-08 02:24:50.485612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.485627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.874 [2024-12-08 02:24:50.485641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.485657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.874 [2024-12-08 02:24:50.485670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.485685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.874 [2024-12-08 02:24:50.485698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.485714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.874 [2024-12-08 02:24:50.485728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.485742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.874 [2024-12-08 02:24:50.485760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.485777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.874 [2024-12-08 02:24:50.485791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.485806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.874 [2024-12-08 02:24:50.485822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.485838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.874 [2024-12-08 02:24:50.485851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.485867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.874 [2024-12-08 02:24:50.485884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.485899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.874 [2024-12-08 02:24:50.485913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.485928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.874 [2024-12-08 02:24:50.485949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.485965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.874 [2024-12-08 02:24:50.485979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.874 [2024-12-08 02:24:50.485994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.874 [2024-12-08 02:24:50.486007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.486023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.875 [2024-12-08 02:24:50.486036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.486051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.875 [2024-12-08 02:24:50.486064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.486079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.875 [2024-12-08 02:24:50.486093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.486109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.875 [2024-12-08 02:24:50.486122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.486141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.875 [2024-12-08 02:24:50.486155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.486170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.875 [2024-12-08 02:24:50.486184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.486199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.875 [2024-12-08 02:24:50.486221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.486238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.875 [2024-12-08 02:24:50.486251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.486276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.875 [2024-12-08 02:24:50.486290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.486306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.875 [2024-12-08 02:24:50.486319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.486335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.875 [2024-12-08 02:24:50.486349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.486364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.875 [2024-12-08 02:24:50.486377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.486393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.875 [2024-12-08 02:24:50.486406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.486422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.875 [2024-12-08 02:24:50.486435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.486451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.875 [2024-12-08 02:24:50.486465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.486480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.875 [2024-12-08 02:24:50.486494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.486510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.875 [2024-12-08 02:24:50.486528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.486554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.875 [2024-12-08 02:24:50.486569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.486595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.875 [2024-12-08 02:24:50.486608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.486624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.875 [2024-12-08 02:24:50.486637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.486653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.875 [2024-12-08 02:24:50.486666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.486682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.875 [2024-12-08 02:24:50.486695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.486710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.875 [2024-12-08 02:24:50.486723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.486739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.875 [2024-12-08 02:24:50.486753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.486768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.875 [2024-12-08 02:24:50.486783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.486799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.875 [2024-12-08 02:24:50.486811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.486831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.875 [2024-12-08 02:24:50.486845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.486860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.875 [2024-12-08 02:24:50.486874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.486888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.875 [2024-12-08 02:24:50.486901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.486917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.875 [2024-12-08 02:24:50.486939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.486955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.875 [2024-12-08 02:24:50.486969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.486984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.875 [2024-12-08 02:24:50.486998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.487013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.875 [2024-12-08 02:24:50.487026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.487041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.875 [2024-12-08 02:24:50.487054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.487070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.875 [2024-12-08 02:24:50.487083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.487098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.875 [2024-12-08 02:24:50.487110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.875 [2024-12-08 02:24:50.487125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.876 [2024-12-08 02:24:50.487138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.876 [2024-12-08 02:24:50.487154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.876 [2024-12-08 02:24:50.487167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.876 [2024-12-08 02:24:50.487183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.876 [2024-12-08 02:24:50.487196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.876 [2024-12-08 02:24:50.487211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.876 [2024-12-08 02:24:50.487224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.876 [2024-12-08 02:24:50.487238] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x89a260 is same with the state(5) to be set 00:22:22.876 [2024-12-08 02:24:50.487318] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x89a260 was disconnected and freed. reset controller. 00:22:22.876 [2024-12-08 02:24:50.487388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.876 [2024-12-08 02:24:50.487410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.876 [2024-12-08 02:24:50.487435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.876 [2024-12-08 02:24:50.487451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.876 [2024-12-08 02:24:50.487466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.876 [2024-12-08 02:24:50.487479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.876 [2024-12-08 02:24:50.487495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.876 [2024-12-08 02:24:50.487508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.876 [2024-12-08 02:24:50.487531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.876 [2024-12-08 02:24:50.487553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.876 [2024-12-08 02:24:50.487569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.876 [2024-12-08 02:24:50.487582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.876 [2024-12-08 02:24:50.487598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.876 [2024-12-08 02:24:50.487612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.876 [2024-12-08 02:24:50.487627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.876 [2024-12-08 02:24:50.487640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.876 [2024-12-08 02:24:50.487655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.876 [2024-12-08 02:24:50.487669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.876 [2024-12-08 02:24:50.487683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.876 [2024-12-08 02:24:50.487697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.876 [2024-12-08 02:24:50.487712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.876 [2024-12-08 02:24:50.487725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.876 [2024-12-08 02:24:50.487741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.876 [2024-12-08 02:24:50.487754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.876 [2024-12-08 02:24:50.487769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.876 [2024-12-08 02:24:50.487783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.876 [2024-12-08 02:24:50.487798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.876 [2024-12-08 02:24:50.487816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.876 [2024-12-08 02:24:50.487841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.876 [2024-12-08 02:24:50.487854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.876 [2024-12-08 02:24:50.487869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.876 [2024-12-08 02:24:50.487883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.876 [2024-12-08 02:24:50.487899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.876 [2024-12-08 02:24:50.487912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.876 [2024-12-08 02:24:50.487927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.876 [2024-12-08 02:24:50.487940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.876 [2024-12-08 02:24:50.487955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.876 [2024-12-08 02:24:50.487968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.876 [2024-12-08 02:24:50.487983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.876 [2024-12-08 02:24:50.487997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.876 [2024-12-08 02:24:50.488012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.876 [2024-12-08 02:24:50.488025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.876 [2024-12-08 02:24:50.488040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.876 [2024-12-08 02:24:50.488053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.876 [2024-12-08 02:24:50.488068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.876 [2024-12-08 02:24:50.488082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.876 [2024-12-08 02:24:50.488096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.876 [2024-12-08 02:24:50.488109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.876 [2024-12-08 02:24:50.488124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.876 [2024-12-08 02:24:50.488138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.876 [2024-12-08 02:24:50.488153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.876 [2024-12-08 02:24:50.488165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.876 [2024-12-08 02:24:50.488184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.876 [2024-12-08 02:24:50.488198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.876 [2024-12-08 02:24:50.488213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.876 [2024-12-08 02:24:50.488227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.876 [2024-12-08 02:24:50.488243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.876 [2024-12-08 02:24:50.488256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.876 [2024-12-08 02:24:50.488271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.876 [2024-12-08 02:24:50.488284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.876 [2024-12-08 02:24:50.488299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.876 [2024-12-08 02:24:50.488312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.876 [2024-12-08 02:24:50.488327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.876 [2024-12-08 02:24:50.488341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.488356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.488369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.488383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.488397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.488412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.488425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.488441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.488454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.488469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.488482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.488497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.488510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.488534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.488558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.488574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.488588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.488604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.488617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.488632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.488645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.488661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.488674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.488689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.488702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.488718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.488732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.488747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.488760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.488776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.488789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.488804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.488831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.488847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.488861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.488876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.488890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.488906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.488919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.488938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.488952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.488968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.488982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.488998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.489011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.489027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.489040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.489056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.489069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.489086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.489100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.489115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.489129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.489145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.489158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.489174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.489188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.489212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.489227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.489242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.489255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.489271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.489284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.489300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.489318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.489334] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x646550 is same with the state(5) to be set 00:22:22.877 [2024-12-08 02:24:50.489405] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x646550 was disconnected and freed. reset controller. 00:22:22.877 [2024-12-08 02:24:50.489461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.489482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.489503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.489518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.489534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.489557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.489574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.489589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.489605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.489619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.877 [2024-12-08 02:24:50.489635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.877 [2024-12-08 02:24:50.489648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.489664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.489677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.489693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.489707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.489722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.489736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.489752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.489766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.489782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.489795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.489830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.489845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.489860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.489874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.489890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.489903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.489918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.489931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.489947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.489960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.489976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.489989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.490004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.490017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.490033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.490046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.490061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.490074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.490089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.490113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.490128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.490141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.490156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.490169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.490185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.490202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.490218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.490232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.490247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.490260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.490276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.490289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.490305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.490318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.490334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.490347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.490362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.490375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.490390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.490404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.490421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.490434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.490449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.490462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.490477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.490490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.490505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.490528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.490550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.490565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.490584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.490598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.490614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.490627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.490642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.490655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.490670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.490683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.490698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.490711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.490726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.490739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.490754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.490767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.490782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.490795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.490810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.878 [2024-12-08 02:24:50.490823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.878 [2024-12-08 02:24:50.490838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.490850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.490865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.490878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.490893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.490907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.490922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.490939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.490955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.490968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.490984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.490996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.491011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.491024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.491039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.491052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.491068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.491081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.491096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.491109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.491124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.491138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.491153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.491166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.491181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.491194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.491209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.491222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.491238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.491251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.491266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.491279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.491298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.491312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.491328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.491341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.491356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.491369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.491383] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7e21a0 is same with the state(5) to be set 00:22:22.879 [2024-12-08 02:24:50.491453] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x7e21a0 was disconnected and freed. reset controller. 00:22:22.879 [2024-12-08 02:24:50.491503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.491531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.491558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.491574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.491589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.491602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.491618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.491631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.491646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.491661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.491677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.491691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.491706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.491719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.491735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.491748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.491764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.491782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.491799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.491823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.491839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.491853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.491869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.491882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.491897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.491910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.491926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.491939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.491955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.491968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.491983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.491996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.492012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.492033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.492049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.492063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.492078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.492092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.492107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.879 [2024-12-08 02:24:50.492120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.879 [2024-12-08 02:24:50.492135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.880 [2024-12-08 02:24:50.492149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.880 [2024-12-08 02:24:50.492170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.880 [2024-12-08 02:24:50.492184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.880 [2024-12-08 02:24:50.492200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.880 [2024-12-08 02:24:50.492213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.880 [2024-12-08 02:24:50.492230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.880 [2024-12-08 02:24:50.492243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.880 [2024-12-08 02:24:50.492258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.880 [2024-12-08 02:24:50.492272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.880 [2024-12-08 02:24:50.492288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.880 [2024-12-08 02:24:50.492301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.880 [2024-12-08 02:24:50.492322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.880 [2024-12-08 02:24:50.492337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.880 [2024-12-08 02:24:50.492353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.880 [2024-12-08 02:24:50.492367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.880 [2024-12-08 02:24:50.492391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.880 [2024-12-08 02:24:50.492404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.880 [2024-12-08 02:24:50.492420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.880 [2024-12-08 02:24:50.492433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.880 [2024-12-08 02:24:50.492461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.880 [2024-12-08 02:24:50.492474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.880 [2024-12-08 02:24:50.492489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.880 [2024-12-08 02:24:50.492504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.880 [2024-12-08 02:24:50.492519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.880 [2024-12-08 02:24:50.492532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.880 [2024-12-08 02:24:50.492556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.880 [2024-12-08 02:24:50.492600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.880 [2024-12-08 02:24:50.492620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.880 [2024-12-08 02:24:50.492634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.880 [2024-12-08 02:24:50.492650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.880 [2024-12-08 02:24:50.492663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.880 [2024-12-08 02:24:50.492679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.880 [2024-12-08 02:24:50.492692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.880 [2024-12-08 02:24:50.492708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.880 [2024-12-08 02:24:50.492722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.880 [2024-12-08 02:24:50.492737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.880 [2024-12-08 02:24:50.492750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.880 [2024-12-08 02:24:50.492772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.880 [2024-12-08 02:24:50.492786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.880 [2024-12-08 02:24:50.492802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.880 [2024-12-08 02:24:50.492815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.880 [2024-12-08 02:24:50.492831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.880 [2024-12-08 02:24:50.492844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.880 [2024-12-08 02:24:50.492865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.880 [2024-12-08 02:24:50.492879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.880 [2024-12-08 02:24:50.492895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.880 [2024-12-08 02:24:50.492908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.880 [2024-12-08 02:24:50.492923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.880 [2024-12-08 02:24:50.492937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.880 [2024-12-08 02:24:50.492953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.880 [2024-12-08 02:24:50.492966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.880 [2024-12-08 02:24:50.492981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.880 [2024-12-08 02:24:50.492998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.880 [2024-12-08 02:24:50.493014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.880 [2024-12-08 02:24:50.493028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.880 [2024-12-08 02:24:50.493043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.880 [2024-12-08 02:24:50.493056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.880 [2024-12-08 02:24:50.493071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.880 [2024-12-08 02:24:50.493085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.880 [2024-12-08 02:24:50.493100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.880 [2024-12-08 02:24:50.493113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.880 [2024-12-08 02:24:50.493129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.880 [2024-12-08 02:24:50.493142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.880 [2024-12-08 02:24:50.493157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.880 [2024-12-08 02:24:50.493171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.880 [2024-12-08 02:24:50.493186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.880 [2024-12-08 02:24:50.493199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.880 [2024-12-08 02:24:50.493214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.880 [2024-12-08 02:24:50.493227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.880 [2024-12-08 02:24:50.493243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.880 [2024-12-08 02:24:50.493257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.493272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.493285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.493300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.493314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.493335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.493349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.493367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.493381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.493397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.493410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.493426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.493439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.493453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.493467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.493484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.493498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.493596] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x7e36f0 was disconnected and freed. reset controller. 00:22:22.881 [2024-12-08 02:24:50.493660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.493681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.493702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.493717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.493734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.493747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.493763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.493777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.493792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.493806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.493823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.493836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.493852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.493865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.493886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.493901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.493917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.493930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.493947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.499980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.500047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.500063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.500080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.500094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.500110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.500124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.500140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.500154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.500169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.500183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.500199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.500213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.500230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.500243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.500259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.500272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.500288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.500302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.500318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.500339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.500356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.500369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.500386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.500399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.500415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.500429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.500445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.500459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.500475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.500488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.500504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.500517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.500533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.500559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.500586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.500600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.500615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.500628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.500644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.500658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.500674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.881 [2024-12-08 02:24:50.500687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.881 [2024-12-08 02:24:50.500702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.500716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.500735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.500750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.500765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.500779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.500795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.500809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.500824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.500837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.500853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.500866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.500882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.500896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.500912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.500925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.500941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.500955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.500970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.500984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.500999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.501012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.501028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.501042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.501058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.501071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.501086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.501103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.501120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.501133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.501149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.501162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.501177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.501191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.501207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.501220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.501235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.501248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.501264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.501277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.501292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.501306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.501321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.501335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.501350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.501364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.501380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.501394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.501410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.501423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.501439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.501453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.501472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.501486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.501501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.501515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.501530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.501560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.501577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.501591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.501607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.501620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.501635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.501649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.501664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.501678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.501693] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8a5950 is same with the state(5) to be set 00:22:22.882 [2024-12-08 02:24:50.501788] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x8a5950 was disconnected and freed. reset controller. 00:22:22.882 [2024-12-08 02:24:50.501905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.501926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.501951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.501967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.501983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.501997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.502012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.502026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.502042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.502060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.882 [2024-12-08 02:24:50.502077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.882 [2024-12-08 02:24:50.502091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.502107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.502120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.502136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.502150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.502165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.502178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.502194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.502209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.502225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.502238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.502254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.502268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.502283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.502298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.502313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.502326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.502342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.502356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.502372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.502385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.502400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.502414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.502433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.502448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.502464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.502477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.502493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.502506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.502523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.502545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.502563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.502577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.502593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.502607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.502622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.502635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.502650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.502663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.502679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.502692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.502707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.502720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.502735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.502748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.502764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.502777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.502792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.502809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.502825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.502838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.502854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.502867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.502882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.502895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.502910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.502924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.502939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.502952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.502967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.502980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.502996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.503009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.503025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.503037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.503053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.503066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.503081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.503094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.503109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.503122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.503138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.503151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.503171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.503185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.503200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.883 [2024-12-08 02:24:50.503214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.883 [2024-12-08 02:24:50.503229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.884 [2024-12-08 02:24:50.503242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.884 [2024-12-08 02:24:50.503257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.884 [2024-12-08 02:24:50.503270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.884 [2024-12-08 02:24:50.503285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.884 [2024-12-08 02:24:50.503299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.884 [2024-12-08 02:24:50.503314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.884 [2024-12-08 02:24:50.503327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.884 [2024-12-08 02:24:50.503342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.884 [2024-12-08 02:24:50.503355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.884 [2024-12-08 02:24:50.503370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.884 [2024-12-08 02:24:50.503383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.884 [2024-12-08 02:24:50.503398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.884 [2024-12-08 02:24:50.503411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.884 [2024-12-08 02:24:50.503426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.884 [2024-12-08 02:24:50.503439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.884 [2024-12-08 02:24:50.503454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.884 [2024-12-08 02:24:50.503467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.884 [2024-12-08 02:24:50.503483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.884 [2024-12-08 02:24:50.503496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.884 [2024-12-08 02:24:50.503511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.884 [2024-12-08 02:24:50.503528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.884 [2024-12-08 02:24:50.503553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.884 [2024-12-08 02:24:50.503567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.884 [2024-12-08 02:24:50.503582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.884 [2024-12-08 02:24:50.503596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.884 [2024-12-08 02:24:50.503611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.884 [2024-12-08 02:24:50.503624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.884 [2024-12-08 02:24:50.503639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.884 [2024-12-08 02:24:50.503652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.884 [2024-12-08 02:24:50.503667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.884 [2024-12-08 02:24:50.503681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.884 [2024-12-08 02:24:50.503695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.884 [2024-12-08 02:24:50.503708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.884 [2024-12-08 02:24:50.503723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.884 [2024-12-08 02:24:50.503737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.884 [2024-12-08 02:24:50.503752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.884 [2024-12-08 02:24:50.503765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.884 [2024-12-08 02:24:50.503780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.884 [2024-12-08 02:24:50.503793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.884 [2024-12-08 02:24:50.503807] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8a6e00 is same with the state(5) to be set 00:22:22.884 [2024-12-08 02:24:50.503879] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x8a6e00 was disconnected and freed. reset controller. 00:22:22.884 [2024-12-08 02:24:50.504020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.884 [2024-12-08 02:24:50.504042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.884 [2024-12-08 02:24:50.504063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.884 [2024-12-08 02:24:50.504079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.884 [2024-12-08 02:24:50.504099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.884 [2024-12-08 02:24:50.504113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.884 [2024-12-08 02:24:50.504129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.884 [2024-12-08 02:24:50.504145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.884 [2024-12-08 02:24:50.504161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.884 [2024-12-08 02:24:50.504175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.884 [2024-12-08 02:24:50.504191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.884 [2024-12-08 02:24:50.504206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.884 [2024-12-08 02:24:50.504222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.884 [2024-12-08 02:24:50.504236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.884 [2024-12-08 02:24:50.504252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.884 [2024-12-08 02:24:50.504265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.884 [2024-12-08 02:24:50.504281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.884 [2024-12-08 02:24:50.504295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.884 [2024-12-08 02:24:50.504311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.884 [2024-12-08 02:24:50.504324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.884 [2024-12-08 02:24:50.504340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.884 [2024-12-08 02:24:50.504354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.884 [2024-12-08 02:24:50.504370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.884 [2024-12-08 02:24:50.504383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.884 [2024-12-08 02:24:50.504400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.884 [2024-12-08 02:24:50.504413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.884 [2024-12-08 02:24:50.504429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.884 [2024-12-08 02:24:50.504442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.884 [2024-12-08 02:24:50.504458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.884 [2024-12-08 02:24:50.504475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.504492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.504506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.504521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.504543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.504562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.504576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.504592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.504606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.504621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.504635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.504651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.504664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.504680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.504693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.504709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.504722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.504738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.504751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.504767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.504780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.504796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.504810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.504825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.504838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.504861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.504875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.504890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.504903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.504919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.504932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.504947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.504960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.504975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.504988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.505004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.505017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.505032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.505045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.505060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.505073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.505088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.505101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.505117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.505129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.505144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.505158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.505173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.505186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.505201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.505217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.505233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.505247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.505262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.505275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.505290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.505303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.505318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.505331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.505346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.505359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.505374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.505387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.505402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.505415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.505431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.505444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.505459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.505473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.505488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.505501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.505516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.505530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.505557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.505571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.885 [2024-12-08 02:24:50.505587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.885 [2024-12-08 02:24:50.505605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.886 [2024-12-08 02:24:50.505620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.886 [2024-12-08 02:24:50.505634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.886 [2024-12-08 02:24:50.505649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.886 [2024-12-08 02:24:50.505663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.886 [2024-12-08 02:24:50.505678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.886 [2024-12-08 02:24:50.505691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.886 [2024-12-08 02:24:50.505705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.886 [2024-12-08 02:24:50.505719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.886 [2024-12-08 02:24:50.505734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.886 [2024-12-08 02:24:50.505747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.886 [2024-12-08 02:24:50.505763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.886 [2024-12-08 02:24:50.505776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.886 [2024-12-08 02:24:50.505793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.886 [2024-12-08 02:24:50.505807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.886 [2024-12-08 02:24:50.505823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.886 [2024-12-08 02:24:50.505837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.886 [2024-12-08 02:24:50.505852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.886 [2024-12-08 02:24:50.505865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.886 [2024-12-08 02:24:50.505880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.886 [2024-12-08 02:24:50.505894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.886 [2024-12-08 02:24:50.505909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.886 [2024-12-08 02:24:50.505922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.886 [2024-12-08 02:24:50.505937] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8a99c0 is same with the state(5) to be set 00:22:22.886 [2024-12-08 02:24:50.506009] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x8a99c0 was disconnected and freed. reset controller. 00:22:22.886 [2024-12-08 02:24:50.506279] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6a3490 (9): Bad file descriptor 00:22:22.886 [2024-12-08 02:24:50.506315] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x681690 (9): Bad file descriptor 00:22:22.886 [2024-12-08 02:24:50.506339] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x80c150 (9): Bad file descriptor 00:22:22.886 [2024-12-08 02:24:50.506365] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x81c600 (9): Bad file descriptor 00:22:22.886 [2024-12-08 02:24:50.506388] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6781b0 (9): Bad file descriptor 00:22:22.886 [2024-12-08 02:24:50.506411] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x655f70 (9): Bad file descriptor 00:22:22.886 [2024-12-08 02:24:50.506433] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x80bc70 (9): Bad file descriptor 00:22:22.886 [2024-12-08 02:24:50.506456] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ae590 (9): Bad file descriptor 00:22:22.886 [2024-12-08 02:24:50.506478] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7f70a0 (9): Bad file descriptor 00:22:22.886 [2024-12-08 02:24:50.506500] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x806a60 (9): Bad file descriptor 00:22:22.886 [2024-12-08 02:24:50.515657] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:22.886 [2024-12-08 02:24:50.515731] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:22.886 [2024-12-08 02:24:50.515754] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:22.886 [2024-12-08 02:24:50.515773] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:22.886 [2024-12-08 02:24:50.517504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.886 [2024-12-08 02:24:50.517533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.886 [2024-12-08 02:24:50.517570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.886 [2024-12-08 02:24:50.517587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.886 [2024-12-08 02:24:50.517604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.886 [2024-12-08 02:24:50.517619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.886 [2024-12-08 02:24:50.517634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.886 [2024-12-08 02:24:50.517648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.886 [2024-12-08 02:24:50.517664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.886 [2024-12-08 02:24:50.517678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.886 [2024-12-08 02:24:50.517693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.886 [2024-12-08 02:24:50.517707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.886 [2024-12-08 02:24:50.517723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.886 [2024-12-08 02:24:50.517748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.886 [2024-12-08 02:24:50.517765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.886 [2024-12-08 02:24:50.517779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.886 [2024-12-08 02:24:50.517794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.886 [2024-12-08 02:24:50.517808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.886 [2024-12-08 02:24:50.517823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.886 [2024-12-08 02:24:50.517837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.886 [2024-12-08 02:24:50.517852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.886 [2024-12-08 02:24:50.517865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.886 [2024-12-08 02:24:50.517881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.886 [2024-12-08 02:24:50.517895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.886 [2024-12-08 02:24:50.517910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.886 [2024-12-08 02:24:50.517924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.886 [2024-12-08 02:24:50.517939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.886 [2024-12-08 02:24:50.517953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.886 [2024-12-08 02:24:50.517969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.886 [2024-12-08 02:24:50.517983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.886 [2024-12-08 02:24:50.517998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.886 [2024-12-08 02:24:50.518012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.886 [2024-12-08 02:24:50.518028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.886 [2024-12-08 02:24:50.518043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.886 [2024-12-08 02:24:50.518059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.886 [2024-12-08 02:24:50.518073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.886 [2024-12-08 02:24:50.518088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.886 [2024-12-08 02:24:50.518101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.886 [2024-12-08 02:24:50.518121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.886 [2024-12-08 02:24:50.518136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.886 [2024-12-08 02:24:50.518152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.887 [2024-12-08 02:24:50.518166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.887 [2024-12-08 02:24:50.518181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.887 [2024-12-08 02:24:50.518194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.887 [2024-12-08 02:24:50.518210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.887 [2024-12-08 02:24:50.518224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.887 [2024-12-08 02:24:50.518239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.887 [2024-12-08 02:24:50.518253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.887 [2024-12-08 02:24:50.518269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.887 [2024-12-08 02:24:50.518283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.887 [2024-12-08 02:24:50.518299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.887 [2024-12-08 02:24:50.518313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.887 [2024-12-08 02:24:50.518327] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8a83e0 is same with the state(5) to be set 00:22:22.887 [2024-12-08 02:24:50.518402] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x8a83e0 was disconnected and freed. reset controller. 00:22:22.887 [2024-12-08 02:24:50.518752] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:22.887 [2024-12-08 02:24:50.518828] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:22.887 [2024-12-08 02:24:50.518859] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:22.887 [2024-12-08 02:24:50.518883] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:22:22.887 [2024-12-08 02:24:50.518901] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:22:22.887 [2024-12-08 02:24:50.519070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.887 [2024-12-08 02:24:50.519164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.887 [2024-12-08 02:24:50.519190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x655f70 with addr=10.0.0.2, port=4420 00:22:22.887 [2024-12-08 02:24:50.519206] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x655f70 is same with the state(5) to be set 00:22:22.887 [2024-12-08 02:24:50.519292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.887 [2024-12-08 02:24:50.519393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.887 [2024-12-08 02:24:50.519418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x81c600 with addr=10.0.0.2, port=4420 00:22:22.887 [2024-12-08 02:24:50.519438] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x81c600 is same with the state(5) to be set 00:22:22.887 [2024-12-08 02:24:50.519524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.887 [2024-12-08 02:24:50.519625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.887 [2024-12-08 02:24:50.519652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6781b0 with addr=10.0.0.2, port=4420 00:22:22.887 [2024-12-08 02:24:50.519667] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6781b0 is same with the state(5) to be set 00:22:22.887 [2024-12-08 02:24:50.519744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.887 [2024-12-08 02:24:50.519834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.887 [2024-12-08 02:24:50.519858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x681690 with addr=10.0.0.2, port=4420 00:22:22.887 [2024-12-08 02:24:50.519873] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x681690 is same with the state(5) to be set 00:22:22.887 [2024-12-08 02:24:50.519918] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:22.887 [2024-12-08 02:24:50.521046] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:22:22.887 [2024-12-08 02:24:50.521167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.887 [2024-12-08 02:24:50.521256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.887 [2024-12-08 02:24:50.521281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x80c150 with addr=10.0.0.2, port=4420 00:22:22.887 [2024-12-08 02:24:50.521297] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x80c150 is same with the state(5) to be set 00:22:22.887 [2024-12-08 02:24:50.521371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.887 [2024-12-08 02:24:50.521473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.887 [2024-12-08 02:24:50.521498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f70a0 with addr=10.0.0.2, port=4420 00:22:22.887 [2024-12-08 02:24:50.521514] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f70a0 is same with the state(5) to be set 00:22:22.887 [2024-12-08 02:24:50.521612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.887 [2024-12-08 02:24:50.521700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.887 [2024-12-08 02:24:50.521727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x80bc70 with addr=10.0.0.2, port=4420 00:22:22.887 [2024-12-08 02:24:50.521743] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x80bc70 is same with the state(5) to be set 00:22:22.887 [2024-12-08 02:24:50.521764] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x655f70 (9): Bad file descriptor 00:22:22.887 [2024-12-08 02:24:50.521783] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x81c600 (9): Bad file descriptor 00:22:22.887 [2024-12-08 02:24:50.521801] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6781b0 (9): Bad file descriptor 00:22:22.887 [2024-12-08 02:24:50.521817] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x681690 (9): Bad file descriptor 00:22:22.887 [2024-12-08 02:24:50.521952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.887 [2024-12-08 02:24:50.521977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.887 [2024-12-08 02:24:50.522012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.887 [2024-12-08 02:24:50.522033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.887 [2024-12-08 02:24:50.522051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.887 [2024-12-08 02:24:50.522071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.887 [2024-12-08 02:24:50.522087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.887 [2024-12-08 02:24:50.522100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.887 [2024-12-08 02:24:50.522115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.887 [2024-12-08 02:24:50.522128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.887 [2024-12-08 02:24:50.522143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:13952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.887 [2024-12-08 02:24:50.522156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.887 [2024-12-08 02:24:50.522171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.887 [2024-12-08 02:24:50.522184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.887 [2024-12-08 02:24:50.522199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.887 [2024-12-08 02:24:50.522213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.887 [2024-12-08 02:24:50.522229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.887 [2024-12-08 02:24:50.522242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.887 [2024-12-08 02:24:50.522256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.887 [2024-12-08 02:24:50.522270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.887 [2024-12-08 02:24:50.522284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.887 [2024-12-08 02:24:50.522297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.887 [2024-12-08 02:24:50.522312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.887 [2024-12-08 02:24:50.522326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.887 [2024-12-08 02:24:50.522340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.887 [2024-12-08 02:24:50.522354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.887 [2024-12-08 02:24:50.522369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.887 [2024-12-08 02:24:50.522382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.887 [2024-12-08 02:24:50.522402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.887 [2024-12-08 02:24:50.522416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.887 [2024-12-08 02:24:50.522432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:14848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.887 [2024-12-08 02:24:50.522446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.887 [2024-12-08 02:24:50.522461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.522475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.522498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.522511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.522526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:14976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.522549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.522568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:15104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.522587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.522602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.522616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.522631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:15232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.522644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.522659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.522672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.522687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.522700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.522715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.522728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.522743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:15360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.522758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.522774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:15744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.522792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.522809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:16000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.522822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.522848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.522861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.522876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.522889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.522904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:16256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.522918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.522933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.522947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.522962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.522976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.523001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.523014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.523029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.523043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.523067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.523081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.523096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.523110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.523125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.523139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.523154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.523167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.523186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.523200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.523219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.523232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.523248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.523263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.523284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.523297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.523313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.523326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.523341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.523355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.523370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.523383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.523398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.523411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.523432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.523445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.523460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.523473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.523496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.523510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.523525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.523544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.523561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.523588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.523604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.523618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.523633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.523646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.888 [2024-12-08 02:24:50.523661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.888 [2024-12-08 02:24:50.523674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.889 [2024-12-08 02:24:50.523690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.889 [2024-12-08 02:24:50.523703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.889 [2024-12-08 02:24:50.523718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.889 [2024-12-08 02:24:50.523731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.889 [2024-12-08 02:24:50.523746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.889 [2024-12-08 02:24:50.523760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.889 [2024-12-08 02:24:50.523776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.889 [2024-12-08 02:24:50.523789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.889 [2024-12-08 02:24:50.523804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.889 [2024-12-08 02:24:50.523817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.889 [2024-12-08 02:24:50.523838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.889 [2024-12-08 02:24:50.523852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.889 [2024-12-08 02:24:50.523867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.889 [2024-12-08 02:24:50.523880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.889 [2024-12-08 02:24:50.523903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.889 [2024-12-08 02:24:50.523917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.889 [2024-12-08 02:24:50.523932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.889 [2024-12-08 02:24:50.523945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.889 [2024-12-08 02:24:50.523962] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8aafa0 is same with the state(5) to be set 00:22:22.889 [2024-12-08 02:24:50.525785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.889 [2024-12-08 02:24:50.525812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.889 [2024-12-08 02:24:50.525834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.889 [2024-12-08 02:24:50.525849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.889 [2024-12-08 02:24:50.525865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.889 [2024-12-08 02:24:50.525878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.889 [2024-12-08 02:24:50.525894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.889 [2024-12-08 02:24:50.525908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.889 [2024-12-08 02:24:50.525923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:13824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.889 [2024-12-08 02:24:50.525936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.889 [2024-12-08 02:24:50.525952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:13952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.889 [2024-12-08 02:24:50.525965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.889 [2024-12-08 02:24:50.525983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.889 [2024-12-08 02:24:50.525996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.889 [2024-12-08 02:24:50.526011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.889 [2024-12-08 02:24:50.526024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.889 [2024-12-08 02:24:50.526048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.889 [2024-12-08 02:24:50.526061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.889 [2024-12-08 02:24:50.526076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.889 [2024-12-08 02:24:50.526089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.889 [2024-12-08 02:24:50.526104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.889 [2024-12-08 02:24:50.526117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.889 [2024-12-08 02:24:50.526132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.889 [2024-12-08 02:24:50.526145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.889 [2024-12-08 02:24:50.526165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.889 [2024-12-08 02:24:50.526179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.889 [2024-12-08 02:24:50.526195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.889 [2024-12-08 02:24:50.526208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.889 [2024-12-08 02:24:50.526223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:14848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.889 [2024-12-08 02:24:50.526236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.889 [2024-12-08 02:24:50.526258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.889 [2024-12-08 02:24:50.526271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.889 [2024-12-08 02:24:50.526286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:14976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.889 [2024-12-08 02:24:50.526300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.889 [2024-12-08 02:24:50.526314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.889 [2024-12-08 02:24:50.526327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.889 [2024-12-08 02:24:50.526342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:15104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.889 [2024-12-08 02:24:50.526355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.889 [2024-12-08 02:24:50.526370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.889 [2024-12-08 02:24:50.526383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.889 [2024-12-08 02:24:50.526398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.889 [2024-12-08 02:24:50.526411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.889 [2024-12-08 02:24:50.526426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:15232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.889 [2024-12-08 02:24:50.526439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.889 [2024-12-08 02:24:50.526454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:15360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.889 [2024-12-08 02:24:50.526467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.889 [2024-12-08 02:24:50.526481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.889 [2024-12-08 02:24:50.526494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.889 [2024-12-08 02:24:50.526509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:15744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.889 [2024-12-08 02:24:50.526525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.889 [2024-12-08 02:24:50.526550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.526565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.526586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:16000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.526599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.526614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:16256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.526627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.526641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.526654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.526670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.526683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.526698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.526711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.526726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.526740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.526754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.526768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.526783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.526796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.526811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.526832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.526847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.526861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.526876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.526889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.526904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.526921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.526937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.526951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.526966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.526979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.526994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.527007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.527022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.527035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.527051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.527065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.527081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.527094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.527110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.527123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.527139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.527152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.527167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.527180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.527195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.527209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.527224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.527238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.527253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.527266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.527285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.527299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.527315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.527328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.527343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.527356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.527372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.527385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.527400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.527413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.527429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.527442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.527458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.527471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.527486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.527499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.527515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.527528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.527550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.527564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.527591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.527604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.527619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.527632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.527647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.527664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.890 [2024-12-08 02:24:50.527680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:22.890 [2024-12-08 02:24:50.527693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:22.891 [2024-12-08 02:24:50.527707] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ac580 is same with the state(5) to be set 00:22:22.891 [2024-12-08 02:24:50.529661] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:22:22.891 task offset: 24320 on job bdev=Nvme1n1 fails 00:22:22.891 00:22:22.891 Latency(us) 00:22:22.891 [2024-12-08T01:24:50.672Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:22.891 [2024-12-08T01:24:50.672Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:22.891 [2024-12-08T01:24:50.672Z] Job: Nvme1n1 ended in about 0.53 seconds with error 00:22:22.891 Verification LBA range: start 0x0 length 0x400 00:22:22.891 Nvme1n1 : 0.53 310.94 19.43 121.34 0.00 146400.36 67186.54 127382.57 00:22:22.891 [2024-12-08T01:24:50.672Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:22.891 [2024-12-08T01:24:50.672Z] Job: Nvme2n1 ended in about 0.53 seconds with error 00:22:22.891 Verification LBA range: start 0x0 length 0x400 00:22:22.891 Nvme2n1 : 0.53 310.30 19.39 121.09 0.00 144008.87 60972.75 125052.40 00:22:22.891 [2024-12-08T01:24:50.672Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:22.891 [2024-12-08T01:24:50.672Z] Job: Nvme3n1 ended in about 0.53 seconds with error 00:22:22.891 Verification LBA range: start 0x0 length 0x400 00:22:22.891 Nvme3n1 : 0.53 309.66 19.35 120.84 0.00 141590.12 54758.97 121945.51 00:22:22.891 [2024-12-08T01:24:50.672Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:22.891 [2024-12-08T01:24:50.672Z] Job: Nvme4n1 ended in about 0.53 seconds with error 00:22:22.891 Verification LBA range: start 0x0 length 0x400 00:22:22.891 Nvme4n1 : 0.53 309.03 19.31 120.60 0.00 139162.86 48545.19 160781.65 00:22:22.891 [2024-12-08T01:24:50.672Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:22.891 [2024-12-08T01:24:50.672Z] Job: Nvme5n1 ended in about 0.53 seconds with error 00:22:22.891 Verification LBA range: start 0x0 length 0x400 00:22:22.891 Nvme5n1 : 0.53 308.40 19.27 120.35 0.00 136742.42 42525.58 116508.44 00:22:22.891 [2024-12-08T01:24:50.672Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:22.891 [2024-12-08T01:24:50.672Z] Job: Nvme6n1 ended in about 0.53 seconds with error 00:22:22.891 Verification LBA range: start 0x0 length 0x400 00:22:22.891 Nvme6n1 : 0.53 307.78 19.24 120.11 0.00 134274.28 36311.80 116508.44 00:22:22.891 [2024-12-08T01:24:50.672Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:22.891 [2024-12-08T01:24:50.672Z] Job: Nvme7n1 ended in about 0.54 seconds with error 00:22:22.891 Verification LBA range: start 0x0 length 0x400 00:22:22.891 Nvme7n1 : 0.54 303.30 18.96 48.08 0.00 159661.41 4854.52 135926.52 00:22:22.891 [2024-12-08T01:24:50.672Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:22.891 [2024-12-08T01:24:50.672Z] Job: Nvme8n1 ended in about 0.53 seconds with error 00:22:22.891 Verification LBA range: start 0x0 length 0x400 00:22:22.891 Nvme8n1 : 0.53 307.10 19.19 119.84 0.00 129249.43 30292.20 111848.11 00:22:22.891 [2024-12-08T01:24:50.672Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:22.891 [2024-12-08T01:24:50.672Z] Job: Nvme9n1 ended in about 0.54 seconds with error 00:22:22.891 Verification LBA range: start 0x0 length 0x400 00:22:22.891 Nvme9n1 : 0.54 231.26 14.45 117.47 0.00 155524.47 100197.26 132819.63 00:22:22.891 [2024-12-08T01:24:50.672Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:22.891 [2024-12-08T01:24:50.672Z] Job: Nvme10n1 ended in about 0.55 seconds with error 00:22:22.891 Verification LBA range: start 0x0 length 0x400 00:22:22.891 Nvme10n1 : 0.55 229.70 14.36 116.67 0.00 153492.72 99420.54 124275.67 00:22:22.891 [2024-12-08T01:24:50.672Z] =================================================================================================================== 00:22:22.891 [2024-12-08T01:24:50.672Z] Total : 2927.47 182.97 1126.40 0.00 143367.77 4854.52 160781.65 00:22:22.891 [2024-12-08 02:24:50.556177] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:22:22.891 [2024-12-08 02:24:50.556263] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:22.891 [2024-12-08 02:24:50.556507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.891 [2024-12-08 02:24:50.556638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.891 [2024-12-08 02:24:50.556665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x806a60 with addr=10.0.0.2, port=4420 00:22:22.891 [2024-12-08 02:24:50.556685] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x806a60 is same with the state(5) to be set 00:22:22.891 [2024-12-08 02:24:50.556713] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x80c150 (9): Bad file descriptor 00:22:22.891 [2024-12-08 02:24:50.556736] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7f70a0 (9): Bad file descriptor 00:22:22.891 [2024-12-08 02:24:50.556755] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x80bc70 (9): Bad file descriptor 00:22:22.891 [2024-12-08 02:24:50.556771] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:22.891 [2024-12-08 02:24:50.556784] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:22.891 [2024-12-08 02:24:50.556801] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:22.891 [2024-12-08 02:24:50.556836] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:22.891 [2024-12-08 02:24:50.556850] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:22.891 [2024-12-08 02:24:50.556864] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:22.891 [2024-12-08 02:24:50.556882] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:22.891 [2024-12-08 02:24:50.556895] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:22.891 [2024-12-08 02:24:50.556909] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:22.891 [2024-12-08 02:24:50.556925] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:22.891 [2024-12-08 02:24:50.556939] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:22.891 [2024-12-08 02:24:50.556953] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:22.891 [2024-12-08 02:24:50.557002] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:22.891 [2024-12-08 02:24:50.557028] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:22.891 [2024-12-08 02:24:50.557048] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:22.891 [2024-12-08 02:24:50.557070] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:22.891 [2024-12-08 02:24:50.557093] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:22.891 [2024-12-08 02:24:50.557112] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:22.891 [2024-12-08 02:24:50.557131] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:22.891 [2024-12-08 02:24:50.557521] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:22.891 [2024-12-08 02:24:50.557570] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:22.891 [2024-12-08 02:24:50.557585] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:22.891 [2024-12-08 02:24:50.557597] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:22.891 [2024-12-08 02:24:50.557720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.891 [2024-12-08 02:24:50.557819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.891 [2024-12-08 02:24:50.557845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6a3490 with addr=10.0.0.2, port=4420 00:22:22.891 [2024-12-08 02:24:50.557861] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6a3490 is same with the state(5) to be set 00:22:22.891 [2024-12-08 02:24:50.557938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.891 [2024-12-08 02:24:50.558029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.891 [2024-12-08 02:24:50.558054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6ae590 with addr=10.0.0.2, port=4420 00:22:22.891 [2024-12-08 02:24:50.558069] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6ae590 is same with the state(5) to be set 00:22:22.891 [2024-12-08 02:24:50.558087] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x806a60 (9): Bad file descriptor 00:22:22.891 [2024-12-08 02:24:50.558105] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:22.891 [2024-12-08 02:24:50.558119] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:22.891 [2024-12-08 02:24:50.558131] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:22.891 [2024-12-08 02:24:50.558150] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:22:22.891 [2024-12-08 02:24:50.558164] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:22:22.891 [2024-12-08 02:24:50.558177] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:22:22.891 [2024-12-08 02:24:50.558193] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:22:22.891 [2024-12-08 02:24:50.558206] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:22:22.891 [2024-12-08 02:24:50.558218] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:22:22.891 [2024-12-08 02:24:50.558240] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:22.891 [2024-12-08 02:24:50.558293] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:22.891 [2024-12-08 02:24:50.558315] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:22.891 [2024-12-08 02:24:50.558333] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:22.891 [2024-12-08 02:24:50.558933] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:22.892 [2024-12-08 02:24:50.558957] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:22.892 [2024-12-08 02:24:50.558970] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:22.892 [2024-12-08 02:24:50.559001] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6a3490 (9): Bad file descriptor 00:22:22.892 [2024-12-08 02:24:50.559022] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6ae590 (9): Bad file descriptor 00:22:22.892 [2024-12-08 02:24:50.559038] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:22:22.892 [2024-12-08 02:24:50.559056] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:22:22.892 [2024-12-08 02:24:50.559069] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:22:22.892 [2024-12-08 02:24:50.559146] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:22.892 [2024-12-08 02:24:50.559171] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:22.892 [2024-12-08 02:24:50.559187] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:22.892 [2024-12-08 02:24:50.559203] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:22.892 [2024-12-08 02:24:50.559218] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:22.892 [2024-12-08 02:24:50.559256] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:22:22.892 [2024-12-08 02:24:50.559272] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:22:22.892 [2024-12-08 02:24:50.559285] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:22:22.892 [2024-12-08 02:24:50.559300] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:22.892 [2024-12-08 02:24:50.559313] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:22.892 [2024-12-08 02:24:50.559326] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:22.892 [2024-12-08 02:24:50.559380] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:22.892 [2024-12-08 02:24:50.559399] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:22.892 [2024-12-08 02:24:50.559489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.892 [2024-12-08 02:24:50.559589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.892 [2024-12-08 02:24:50.559615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x681690 with addr=10.0.0.2, port=4420 00:22:22.892 [2024-12-08 02:24:50.559631] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x681690 is same with the state(5) to be set 00:22:22.892 [2024-12-08 02:24:50.559705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.892 [2024-12-08 02:24:50.559793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.892 [2024-12-08 02:24:50.559818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x6781b0 with addr=10.0.0.2, port=4420 00:22:22.892 [2024-12-08 02:24:50.559833] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6781b0 is same with the state(5) to be set 00:22:22.892 [2024-12-08 02:24:50.559931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.892 [2024-12-08 02:24:50.560013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.892 [2024-12-08 02:24:50.560038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x81c600 with addr=10.0.0.2, port=4420 00:22:22.892 [2024-12-08 02:24:50.560052] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x81c600 is same with the state(5) to be set 00:22:22.892 [2024-12-08 02:24:50.560131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.892 [2024-12-08 02:24:50.560226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:22.892 [2024-12-08 02:24:50.560251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x655f70 with addr=10.0.0.2, port=4420 00:22:22.892 [2024-12-08 02:24:50.560266] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x655f70 is same with the state(5) to be set 00:22:22.892 [2024-12-08 02:24:50.560308] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x681690 (9): Bad file descriptor 00:22:22.892 [2024-12-08 02:24:50.560338] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6781b0 (9): Bad file descriptor 00:22:22.892 [2024-12-08 02:24:50.560357] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x81c600 (9): Bad file descriptor 00:22:22.892 [2024-12-08 02:24:50.560374] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x655f70 (9): Bad file descriptor 00:22:22.892 [2024-12-08 02:24:50.560417] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:22.892 [2024-12-08 02:24:50.560437] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:22.892 [2024-12-08 02:24:50.560450] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:22.892 [2024-12-08 02:24:50.560466] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:22.892 [2024-12-08 02:24:50.560480] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:22.892 [2024-12-08 02:24:50.560492] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:22.892 [2024-12-08 02:24:50.560506] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:22.892 [2024-12-08 02:24:50.560519] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:22.892 [2024-12-08 02:24:50.560531] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:22.892 [2024-12-08 02:24:50.560557] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:22.892 [2024-12-08 02:24:50.560571] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:22.892 [2024-12-08 02:24:50.560583] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:22.892 [2024-12-08 02:24:50.560620] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:22.892 [2024-12-08 02:24:50.560637] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:22.892 [2024-12-08 02:24:50.560649] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:22.892 [2024-12-08 02:24:50.560660] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:23.461 02:24:51 -- target/shutdown.sh@135 -- # nvmfpid= 00:22:23.461 02:24:51 -- target/shutdown.sh@138 -- # sleep 1 00:22:24.394 02:24:52 -- target/shutdown.sh@141 -- # kill -9 2175276 00:22:24.394 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (2175276) - No such process 00:22:24.394 02:24:52 -- target/shutdown.sh@141 -- # true 00:22:24.394 02:24:52 -- target/shutdown.sh@143 -- # stoptarget 00:22:24.394 02:24:52 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:24.394 02:24:52 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:24.394 02:24:52 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:24.394 02:24:52 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:24.394 02:24:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:24.394 02:24:52 -- nvmf/common.sh@116 -- # sync 00:22:24.394 02:24:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:24.394 02:24:52 -- nvmf/common.sh@119 -- # set +e 00:22:24.394 02:24:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:24.394 02:24:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:24.394 rmmod nvme_tcp 00:22:24.394 rmmod nvme_fabrics 00:22:24.394 rmmod nvme_keyring 00:22:24.394 02:24:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:24.394 02:24:52 -- nvmf/common.sh@123 -- # set -e 00:22:24.394 02:24:52 -- nvmf/common.sh@124 -- # return 0 00:22:24.394 02:24:52 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:22:24.394 02:24:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:24.394 02:24:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:24.394 02:24:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:24.394 02:24:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:24.394 02:24:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:24.394 02:24:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:24.394 02:24:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:24.394 02:24:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:26.929 02:24:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:26.929 00:22:26.929 real 0m7.413s 00:22:26.929 user 0m17.833s 00:22:26.929 sys 0m1.290s 00:22:26.929 02:24:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:26.929 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:22:26.929 ************************************ 00:22:26.929 END TEST nvmf_shutdown_tc3 00:22:26.929 ************************************ 00:22:26.929 02:24:54 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:22:26.929 00:22:26.929 real 0m28.057s 00:22:26.929 user 1m19.390s 00:22:26.929 sys 0m5.991s 00:22:26.929 02:24:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:26.929 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:22:26.929 ************************************ 00:22:26.929 END TEST nvmf_shutdown 00:22:26.929 ************************************ 00:22:26.929 02:24:54 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:22:26.929 02:24:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:26.929 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:22:26.929 02:24:54 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:22:26.929 02:24:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:26.929 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:22:26.929 02:24:54 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:22:26.929 02:24:54 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:22:26.929 02:24:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:26.929 02:24:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:26.929 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:22:26.929 ************************************ 00:22:26.929 START TEST nvmf_multicontroller 00:22:26.929 ************************************ 00:22:26.929 02:24:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:22:26.929 * Looking for test storage... 00:22:26.929 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:26.929 02:24:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:26.929 02:24:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:26.929 02:24:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:26.929 02:24:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:26.929 02:24:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:26.929 02:24:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:26.929 02:24:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:26.929 02:24:54 -- scripts/common.sh@335 -- # IFS=.-: 00:22:26.929 02:24:54 -- scripts/common.sh@335 -- # read -ra ver1 00:22:26.929 02:24:54 -- scripts/common.sh@336 -- # IFS=.-: 00:22:26.929 02:24:54 -- scripts/common.sh@336 -- # read -ra ver2 00:22:26.929 02:24:54 -- scripts/common.sh@337 -- # local 'op=<' 00:22:26.929 02:24:54 -- scripts/common.sh@339 -- # ver1_l=2 00:22:26.929 02:24:54 -- scripts/common.sh@340 -- # ver2_l=1 00:22:26.929 02:24:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:26.929 02:24:54 -- scripts/common.sh@343 -- # case "$op" in 00:22:26.929 02:24:54 -- scripts/common.sh@344 -- # : 1 00:22:26.929 02:24:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:26.929 02:24:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:26.929 02:24:54 -- scripts/common.sh@364 -- # decimal 1 00:22:26.930 02:24:54 -- scripts/common.sh@352 -- # local d=1 00:22:26.930 02:24:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:26.930 02:24:54 -- scripts/common.sh@354 -- # echo 1 00:22:26.930 02:24:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:26.930 02:24:54 -- scripts/common.sh@365 -- # decimal 2 00:22:26.930 02:24:54 -- scripts/common.sh@352 -- # local d=2 00:22:26.930 02:24:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:26.930 02:24:54 -- scripts/common.sh@354 -- # echo 2 00:22:26.930 02:24:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:26.930 02:24:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:26.930 02:24:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:26.930 02:24:54 -- scripts/common.sh@367 -- # return 0 00:22:26.930 02:24:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:26.930 02:24:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:26.930 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:26.930 --rc genhtml_branch_coverage=1 00:22:26.930 --rc genhtml_function_coverage=1 00:22:26.930 --rc genhtml_legend=1 00:22:26.930 --rc geninfo_all_blocks=1 00:22:26.930 --rc geninfo_unexecuted_blocks=1 00:22:26.930 00:22:26.930 ' 00:22:26.930 02:24:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:26.930 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:26.930 --rc genhtml_branch_coverage=1 00:22:26.930 --rc genhtml_function_coverage=1 00:22:26.930 --rc genhtml_legend=1 00:22:26.930 --rc geninfo_all_blocks=1 00:22:26.930 --rc geninfo_unexecuted_blocks=1 00:22:26.930 00:22:26.930 ' 00:22:26.930 02:24:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:26.930 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:26.930 --rc genhtml_branch_coverage=1 00:22:26.930 --rc genhtml_function_coverage=1 00:22:26.930 --rc genhtml_legend=1 00:22:26.930 --rc geninfo_all_blocks=1 00:22:26.930 --rc geninfo_unexecuted_blocks=1 00:22:26.930 00:22:26.930 ' 00:22:26.930 02:24:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:26.930 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:26.930 --rc genhtml_branch_coverage=1 00:22:26.930 --rc genhtml_function_coverage=1 00:22:26.930 --rc genhtml_legend=1 00:22:26.930 --rc geninfo_all_blocks=1 00:22:26.930 --rc geninfo_unexecuted_blocks=1 00:22:26.930 00:22:26.930 ' 00:22:26.930 02:24:54 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:26.930 02:24:54 -- nvmf/common.sh@7 -- # uname -s 00:22:26.930 02:24:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:26.930 02:24:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:26.930 02:24:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:26.930 02:24:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:26.930 02:24:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:26.930 02:24:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:26.930 02:24:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:26.930 02:24:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:26.930 02:24:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:26.930 02:24:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:26.930 02:24:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:26.930 02:24:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:26.930 02:24:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:26.930 02:24:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:26.930 02:24:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:26.930 02:24:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:26.930 02:24:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:26.930 02:24:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:26.930 02:24:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:26.930 02:24:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:26.930 02:24:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:26.930 02:24:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:26.930 02:24:54 -- paths/export.sh@5 -- # export PATH 00:22:26.930 02:24:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:26.930 02:24:54 -- nvmf/common.sh@46 -- # : 0 00:22:26.930 02:24:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:26.930 02:24:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:26.930 02:24:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:26.930 02:24:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:26.930 02:24:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:26.930 02:24:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:26.930 02:24:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:26.930 02:24:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:26.930 02:24:54 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:26.930 02:24:54 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:26.930 02:24:54 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:22:26.930 02:24:54 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:22:26.930 02:24:54 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:22:26.930 02:24:54 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:22:26.930 02:24:54 -- host/multicontroller.sh@23 -- # nvmftestinit 00:22:26.930 02:24:54 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:26.930 02:24:54 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:26.930 02:24:54 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:26.930 02:24:54 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:26.930 02:24:54 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:26.930 02:24:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:26.930 02:24:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:26.930 02:24:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:26.930 02:24:54 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:26.930 02:24:54 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:26.930 02:24:54 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:26.930 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:22:28.837 02:24:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:28.837 02:24:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:28.837 02:24:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:28.837 02:24:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:28.837 02:24:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:28.837 02:24:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:28.837 02:24:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:28.837 02:24:56 -- nvmf/common.sh@294 -- # net_devs=() 00:22:28.837 02:24:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:28.837 02:24:56 -- nvmf/common.sh@295 -- # e810=() 00:22:28.837 02:24:56 -- nvmf/common.sh@295 -- # local -ga e810 00:22:28.837 02:24:56 -- nvmf/common.sh@296 -- # x722=() 00:22:28.838 02:24:56 -- nvmf/common.sh@296 -- # local -ga x722 00:22:28.838 02:24:56 -- nvmf/common.sh@297 -- # mlx=() 00:22:28.838 02:24:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:28.838 02:24:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:28.838 02:24:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:28.838 02:24:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:28.838 02:24:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:28.838 02:24:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:28.838 02:24:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:28.838 02:24:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:28.838 02:24:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:28.838 02:24:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:28.838 02:24:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:28.838 02:24:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:28.838 02:24:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:28.838 02:24:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:28.838 02:24:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:28.838 02:24:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:28.838 02:24:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:28.838 02:24:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:28.838 02:24:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:28.838 02:24:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:28.838 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:28.838 02:24:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:28.838 02:24:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:28.838 02:24:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:28.838 02:24:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:28.838 02:24:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:28.838 02:24:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:28.838 02:24:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:28.838 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:28.838 02:24:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:28.838 02:24:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:28.838 02:24:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:28.838 02:24:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:28.838 02:24:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:28.838 02:24:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:28.838 02:24:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:28.838 02:24:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:28.838 02:24:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:28.838 02:24:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:28.838 02:24:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:28.838 02:24:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:28.838 02:24:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:28.838 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:28.838 02:24:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:28.838 02:24:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:28.838 02:24:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:28.838 02:24:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:28.838 02:24:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:28.838 02:24:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:28.838 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:28.838 02:24:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:28.838 02:24:56 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:28.838 02:24:56 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:28.838 02:24:56 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:28.838 02:24:56 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:28.838 02:24:56 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:28.838 02:24:56 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:28.838 02:24:56 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:28.838 02:24:56 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:28.838 02:24:56 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:28.838 02:24:56 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:28.838 02:24:56 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:28.838 02:24:56 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:28.838 02:24:56 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:28.838 02:24:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:28.838 02:24:56 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:28.838 02:24:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:28.838 02:24:56 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:28.838 02:24:56 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:28.838 02:24:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:28.838 02:24:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:28.838 02:24:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:28.838 02:24:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:29.097 02:24:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:29.097 02:24:56 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:29.097 02:24:56 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:29.097 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:29.097 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.275 ms 00:22:29.097 00:22:29.097 --- 10.0.0.2 ping statistics --- 00:22:29.097 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:29.097 rtt min/avg/max/mdev = 0.275/0.275/0.275/0.000 ms 00:22:29.097 02:24:56 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:29.097 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:29.097 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.114 ms 00:22:29.097 00:22:29.097 --- 10.0.0.1 ping statistics --- 00:22:29.097 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:29.097 rtt min/avg/max/mdev = 0.114/0.114/0.114/0.000 ms 00:22:29.097 02:24:56 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:29.097 02:24:56 -- nvmf/common.sh@410 -- # return 0 00:22:29.097 02:24:56 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:29.097 02:24:56 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:29.097 02:24:56 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:29.097 02:24:56 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:29.097 02:24:56 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:29.097 02:24:56 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:29.097 02:24:56 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:29.097 02:24:56 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:22:29.097 02:24:56 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:29.097 02:24:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:29.097 02:24:56 -- common/autotest_common.sh@10 -- # set +x 00:22:29.097 02:24:56 -- nvmf/common.sh@469 -- # nvmfpid=2177809 00:22:29.097 02:24:56 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:22:29.097 02:24:56 -- nvmf/common.sh@470 -- # waitforlisten 2177809 00:22:29.097 02:24:56 -- common/autotest_common.sh@829 -- # '[' -z 2177809 ']' 00:22:29.097 02:24:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:29.097 02:24:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:29.097 02:24:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:29.097 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:29.097 02:24:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:29.097 02:24:56 -- common/autotest_common.sh@10 -- # set +x 00:22:29.097 [2024-12-08 02:24:56.702105] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:29.097 [2024-12-08 02:24:56.702174] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:29.097 EAL: No free 2048 kB hugepages reported on node 1 00:22:29.097 [2024-12-08 02:24:56.767985] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:22:29.355 [2024-12-08 02:24:56.884697] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:29.355 [2024-12-08 02:24:56.884856] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:29.355 [2024-12-08 02:24:56.884887] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:29.355 [2024-12-08 02:24:56.884900] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:29.355 [2024-12-08 02:24:56.884970] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:29.355 [2024-12-08 02:24:56.885034] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:29.355 [2024-12-08 02:24:56.885038] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:30.288 02:24:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:30.288 02:24:57 -- common/autotest_common.sh@862 -- # return 0 00:22:30.288 02:24:57 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:30.288 02:24:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:30.288 02:24:57 -- common/autotest_common.sh@10 -- # set +x 00:22:30.288 02:24:57 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:30.288 02:24:57 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:30.288 02:24:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:30.288 02:24:57 -- common/autotest_common.sh@10 -- # set +x 00:22:30.288 [2024-12-08 02:24:57.786411] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:30.288 02:24:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:30.288 02:24:57 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:30.288 02:24:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:30.288 02:24:57 -- common/autotest_common.sh@10 -- # set +x 00:22:30.288 Malloc0 00:22:30.288 02:24:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:30.288 02:24:57 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:30.288 02:24:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:30.288 02:24:57 -- common/autotest_common.sh@10 -- # set +x 00:22:30.288 02:24:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:30.288 02:24:57 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:30.288 02:24:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:30.288 02:24:57 -- common/autotest_common.sh@10 -- # set +x 00:22:30.288 02:24:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:30.288 02:24:57 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:30.288 02:24:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:30.288 02:24:57 -- common/autotest_common.sh@10 -- # set +x 00:22:30.288 [2024-12-08 02:24:57.855976] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:30.288 02:24:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:30.288 02:24:57 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:22:30.288 02:24:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:30.288 02:24:57 -- common/autotest_common.sh@10 -- # set +x 00:22:30.288 [2024-12-08 02:24:57.863852] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:22:30.288 02:24:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:30.288 02:24:57 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:30.288 02:24:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:30.288 02:24:57 -- common/autotest_common.sh@10 -- # set +x 00:22:30.288 Malloc1 00:22:30.288 02:24:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:30.288 02:24:57 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:22:30.288 02:24:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:30.288 02:24:57 -- common/autotest_common.sh@10 -- # set +x 00:22:30.288 02:24:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:30.288 02:24:57 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:22:30.288 02:24:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:30.288 02:24:57 -- common/autotest_common.sh@10 -- # set +x 00:22:30.288 02:24:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:30.288 02:24:57 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:22:30.288 02:24:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:30.288 02:24:57 -- common/autotest_common.sh@10 -- # set +x 00:22:30.288 02:24:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:30.288 02:24:57 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:22:30.288 02:24:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:30.288 02:24:57 -- common/autotest_common.sh@10 -- # set +x 00:22:30.288 02:24:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:30.288 02:24:57 -- host/multicontroller.sh@44 -- # bdevperf_pid=2177964 00:22:30.288 02:24:57 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:30.288 02:24:57 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:22:30.288 02:24:57 -- host/multicontroller.sh@47 -- # waitforlisten 2177964 /var/tmp/bdevperf.sock 00:22:30.288 02:24:57 -- common/autotest_common.sh@829 -- # '[' -z 2177964 ']' 00:22:30.288 02:24:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:30.288 02:24:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:30.288 02:24:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:30.288 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:30.288 02:24:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:30.288 02:24:57 -- common/autotest_common.sh@10 -- # set +x 00:22:31.225 02:24:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:31.225 02:24:58 -- common/autotest_common.sh@862 -- # return 0 00:22:31.225 02:24:58 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:22:31.225 02:24:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:31.225 02:24:58 -- common/autotest_common.sh@10 -- # set +x 00:22:31.486 NVMe0n1 00:22:31.486 02:24:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:31.486 02:24:59 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:22:31.486 02:24:59 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:22:31.486 02:24:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:31.486 02:24:59 -- common/autotest_common.sh@10 -- # set +x 00:22:31.486 02:24:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:31.486 1 00:22:31.486 02:24:59 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:31.486 02:24:59 -- common/autotest_common.sh@650 -- # local es=0 00:22:31.487 02:24:59 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:31.487 02:24:59 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:31.487 02:24:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:31.487 02:24:59 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:31.487 02:24:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:31.487 02:24:59 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:31.487 02:24:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:31.487 02:24:59 -- common/autotest_common.sh@10 -- # set +x 00:22:31.487 request: 00:22:31.487 { 00:22:31.487 "name": "NVMe0", 00:22:31.487 "trtype": "tcp", 00:22:31.487 "traddr": "10.0.0.2", 00:22:31.487 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:22:31.487 "hostaddr": "10.0.0.2", 00:22:31.487 "hostsvcid": "60000", 00:22:31.487 "adrfam": "ipv4", 00:22:31.487 "trsvcid": "4420", 00:22:31.487 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:31.487 "method": "bdev_nvme_attach_controller", 00:22:31.487 "req_id": 1 00:22:31.487 } 00:22:31.487 Got JSON-RPC error response 00:22:31.487 response: 00:22:31.487 { 00:22:31.487 "code": -114, 00:22:31.487 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:31.487 } 00:22:31.487 02:24:59 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:31.487 02:24:59 -- common/autotest_common.sh@653 -- # es=1 00:22:31.487 02:24:59 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:31.487 02:24:59 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:31.487 02:24:59 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:31.487 02:24:59 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:31.487 02:24:59 -- common/autotest_common.sh@650 -- # local es=0 00:22:31.487 02:24:59 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:31.487 02:24:59 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:31.487 02:24:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:31.487 02:24:59 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:31.487 02:24:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:31.487 02:24:59 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:31.487 02:24:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:31.487 02:24:59 -- common/autotest_common.sh@10 -- # set +x 00:22:31.487 request: 00:22:31.487 { 00:22:31.487 "name": "NVMe0", 00:22:31.487 "trtype": "tcp", 00:22:31.487 "traddr": "10.0.0.2", 00:22:31.487 "hostaddr": "10.0.0.2", 00:22:31.487 "hostsvcid": "60000", 00:22:31.487 "adrfam": "ipv4", 00:22:31.487 "trsvcid": "4420", 00:22:31.487 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:31.487 "method": "bdev_nvme_attach_controller", 00:22:31.487 "req_id": 1 00:22:31.487 } 00:22:31.487 Got JSON-RPC error response 00:22:31.487 response: 00:22:31.487 { 00:22:31.487 "code": -114, 00:22:31.487 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:31.487 } 00:22:31.487 02:24:59 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:31.487 02:24:59 -- common/autotest_common.sh@653 -- # es=1 00:22:31.487 02:24:59 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:31.487 02:24:59 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:31.487 02:24:59 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:31.487 02:24:59 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:31.487 02:24:59 -- common/autotest_common.sh@650 -- # local es=0 00:22:31.487 02:24:59 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:31.487 02:24:59 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:31.487 02:24:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:31.487 02:24:59 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:31.487 02:24:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:31.487 02:24:59 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:31.487 02:24:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:31.487 02:24:59 -- common/autotest_common.sh@10 -- # set +x 00:22:31.487 request: 00:22:31.487 { 00:22:31.487 "name": "NVMe0", 00:22:31.487 "trtype": "tcp", 00:22:31.487 "traddr": "10.0.0.2", 00:22:31.487 "hostaddr": "10.0.0.2", 00:22:31.487 "hostsvcid": "60000", 00:22:31.487 "adrfam": "ipv4", 00:22:31.487 "trsvcid": "4420", 00:22:31.487 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:31.487 "multipath": "disable", 00:22:31.487 "method": "bdev_nvme_attach_controller", 00:22:31.487 "req_id": 1 00:22:31.487 } 00:22:31.487 Got JSON-RPC error response 00:22:31.487 response: 00:22:31.487 { 00:22:31.487 "code": -114, 00:22:31.487 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:22:31.487 } 00:22:31.487 02:24:59 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:31.487 02:24:59 -- common/autotest_common.sh@653 -- # es=1 00:22:31.487 02:24:59 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:31.487 02:24:59 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:31.487 02:24:59 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:31.487 02:24:59 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:31.487 02:24:59 -- common/autotest_common.sh@650 -- # local es=0 00:22:31.487 02:24:59 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:31.487 02:24:59 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:31.487 02:24:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:31.487 02:24:59 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:31.487 02:24:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:31.487 02:24:59 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:31.487 02:24:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:31.487 02:24:59 -- common/autotest_common.sh@10 -- # set +x 00:22:31.487 request: 00:22:31.487 { 00:22:31.487 "name": "NVMe0", 00:22:31.487 "trtype": "tcp", 00:22:31.487 "traddr": "10.0.0.2", 00:22:31.487 "hostaddr": "10.0.0.2", 00:22:31.487 "hostsvcid": "60000", 00:22:31.487 "adrfam": "ipv4", 00:22:31.487 "trsvcid": "4420", 00:22:31.487 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:31.487 "multipath": "failover", 00:22:31.487 "method": "bdev_nvme_attach_controller", 00:22:31.487 "req_id": 1 00:22:31.487 } 00:22:31.487 Got JSON-RPC error response 00:22:31.487 response: 00:22:31.487 { 00:22:31.487 "code": -114, 00:22:31.487 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:31.487 } 00:22:31.487 02:24:59 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:31.487 02:24:59 -- common/autotest_common.sh@653 -- # es=1 00:22:31.487 02:24:59 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:31.487 02:24:59 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:31.487 02:24:59 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:31.487 02:24:59 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:31.487 02:24:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:31.487 02:24:59 -- common/autotest_common.sh@10 -- # set +x 00:22:31.746 00:22:31.746 02:24:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:31.746 02:24:59 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:31.746 02:24:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:31.746 02:24:59 -- common/autotest_common.sh@10 -- # set +x 00:22:31.746 02:24:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:31.746 02:24:59 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:22:31.746 02:24:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:31.746 02:24:59 -- common/autotest_common.sh@10 -- # set +x 00:22:31.746 00:22:31.746 02:24:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:31.746 02:24:59 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:22:31.746 02:24:59 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:22:31.746 02:24:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:31.746 02:24:59 -- common/autotest_common.sh@10 -- # set +x 00:22:31.746 02:24:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:31.746 02:24:59 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:22:31.746 02:24:59 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:22:33.125 0 00:22:33.125 02:25:00 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:22:33.125 02:25:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:33.125 02:25:00 -- common/autotest_common.sh@10 -- # set +x 00:22:33.125 02:25:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:33.125 02:25:00 -- host/multicontroller.sh@100 -- # killprocess 2177964 00:22:33.125 02:25:00 -- common/autotest_common.sh@936 -- # '[' -z 2177964 ']' 00:22:33.125 02:25:00 -- common/autotest_common.sh@940 -- # kill -0 2177964 00:22:33.125 02:25:00 -- common/autotest_common.sh@941 -- # uname 00:22:33.125 02:25:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:33.125 02:25:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2177964 00:22:33.125 02:25:00 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:33.125 02:25:00 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:33.125 02:25:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2177964' 00:22:33.125 killing process with pid 2177964 00:22:33.125 02:25:00 -- common/autotest_common.sh@955 -- # kill 2177964 00:22:33.125 02:25:00 -- common/autotest_common.sh@960 -- # wait 2177964 00:22:33.410 02:25:00 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:33.410 02:25:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:33.410 02:25:00 -- common/autotest_common.sh@10 -- # set +x 00:22:33.410 02:25:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:33.410 02:25:00 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:22:33.410 02:25:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:33.410 02:25:00 -- common/autotest_common.sh@10 -- # set +x 00:22:33.410 02:25:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:33.410 02:25:00 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:22:33.410 02:25:00 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:22:33.410 02:25:00 -- common/autotest_common.sh@1607 -- # read -r file 00:22:33.410 02:25:00 -- common/autotest_common.sh@1606 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:22:33.410 02:25:00 -- common/autotest_common.sh@1606 -- # sort -u 00:22:33.410 02:25:00 -- common/autotest_common.sh@1608 -- # cat 00:22:33.410 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:22:33.410 [2024-12-08 02:24:57.963043] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:33.410 [2024-12-08 02:24:57.963124] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2177964 ] 00:22:33.410 EAL: No free 2048 kB hugepages reported on node 1 00:22:33.410 [2024-12-08 02:24:58.022719] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:33.410 [2024-12-08 02:24:58.130566] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:33.410 [2024-12-08 02:24:59.458214] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name e7679f23-866b-42ce-b6b3-cb13037a2946 already exists 00:22:33.410 [2024-12-08 02:24:59.458257] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:e7679f23-866b-42ce-b6b3-cb13037a2946 alias for bdev NVMe1n1 00:22:33.410 [2024-12-08 02:24:59.458290] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:22:33.410 Running I/O for 1 seconds... 00:22:33.410 00:22:33.410 Latency(us) 00:22:33.410 [2024-12-08T01:25:01.191Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:33.410 [2024-12-08T01:25:01.191Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:22:33.410 NVMe0n1 : 1.00 19291.01 75.36 0.00 0.00 6625.63 3301.07 14854.83 00:22:33.410 [2024-12-08T01:25:01.191Z] =================================================================================================================== 00:22:33.410 [2024-12-08T01:25:01.191Z] Total : 19291.01 75.36 0.00 0.00 6625.63 3301.07 14854.83 00:22:33.410 Received shutdown signal, test time was about 1.000000 seconds 00:22:33.410 00:22:33.410 Latency(us) 00:22:33.410 [2024-12-08T01:25:01.191Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:33.410 [2024-12-08T01:25:01.191Z] =================================================================================================================== 00:22:33.410 [2024-12-08T01:25:01.191Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:22:33.410 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:22:33.410 02:25:00 -- common/autotest_common.sh@1613 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:22:33.410 02:25:00 -- common/autotest_common.sh@1607 -- # read -r file 00:22:33.410 02:25:00 -- host/multicontroller.sh@108 -- # nvmftestfini 00:22:33.410 02:25:00 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:33.410 02:25:00 -- nvmf/common.sh@116 -- # sync 00:22:33.410 02:25:00 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:33.410 02:25:00 -- nvmf/common.sh@119 -- # set +e 00:22:33.410 02:25:00 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:33.410 02:25:00 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:33.410 rmmod nvme_tcp 00:22:33.410 rmmod nvme_fabrics 00:22:33.410 rmmod nvme_keyring 00:22:33.410 02:25:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:33.410 02:25:01 -- nvmf/common.sh@123 -- # set -e 00:22:33.410 02:25:01 -- nvmf/common.sh@124 -- # return 0 00:22:33.410 02:25:01 -- nvmf/common.sh@477 -- # '[' -n 2177809 ']' 00:22:33.410 02:25:01 -- nvmf/common.sh@478 -- # killprocess 2177809 00:22:33.410 02:25:01 -- common/autotest_common.sh@936 -- # '[' -z 2177809 ']' 00:22:33.410 02:25:01 -- common/autotest_common.sh@940 -- # kill -0 2177809 00:22:33.410 02:25:01 -- common/autotest_common.sh@941 -- # uname 00:22:33.410 02:25:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:33.410 02:25:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2177809 00:22:33.410 02:25:01 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:33.411 02:25:01 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:33.411 02:25:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2177809' 00:22:33.411 killing process with pid 2177809 00:22:33.411 02:25:01 -- common/autotest_common.sh@955 -- # kill 2177809 00:22:33.411 02:25:01 -- common/autotest_common.sh@960 -- # wait 2177809 00:22:33.671 02:25:01 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:33.671 02:25:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:33.671 02:25:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:33.671 02:25:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:33.671 02:25:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:33.671 02:25:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:33.671 02:25:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:33.671 02:25:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:36.209 02:25:03 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:36.209 00:22:36.209 real 0m9.232s 00:22:36.209 user 0m17.780s 00:22:36.209 sys 0m2.440s 00:22:36.209 02:25:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:36.209 02:25:03 -- common/autotest_common.sh@10 -- # set +x 00:22:36.209 ************************************ 00:22:36.209 END TEST nvmf_multicontroller 00:22:36.209 ************************************ 00:22:36.209 02:25:03 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:22:36.209 02:25:03 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:36.209 02:25:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:36.209 02:25:03 -- common/autotest_common.sh@10 -- # set +x 00:22:36.209 ************************************ 00:22:36.209 START TEST nvmf_aer 00:22:36.209 ************************************ 00:22:36.209 02:25:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:22:36.209 * Looking for test storage... 00:22:36.209 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:36.209 02:25:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:36.209 02:25:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:36.209 02:25:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:36.209 02:25:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:36.209 02:25:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:36.209 02:25:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:36.209 02:25:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:36.209 02:25:03 -- scripts/common.sh@335 -- # IFS=.-: 00:22:36.209 02:25:03 -- scripts/common.sh@335 -- # read -ra ver1 00:22:36.209 02:25:03 -- scripts/common.sh@336 -- # IFS=.-: 00:22:36.209 02:25:03 -- scripts/common.sh@336 -- # read -ra ver2 00:22:36.209 02:25:03 -- scripts/common.sh@337 -- # local 'op=<' 00:22:36.209 02:25:03 -- scripts/common.sh@339 -- # ver1_l=2 00:22:36.209 02:25:03 -- scripts/common.sh@340 -- # ver2_l=1 00:22:36.209 02:25:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:36.209 02:25:03 -- scripts/common.sh@343 -- # case "$op" in 00:22:36.209 02:25:03 -- scripts/common.sh@344 -- # : 1 00:22:36.209 02:25:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:36.209 02:25:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:36.209 02:25:03 -- scripts/common.sh@364 -- # decimal 1 00:22:36.209 02:25:03 -- scripts/common.sh@352 -- # local d=1 00:22:36.209 02:25:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:36.209 02:25:03 -- scripts/common.sh@354 -- # echo 1 00:22:36.209 02:25:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:36.209 02:25:03 -- scripts/common.sh@365 -- # decimal 2 00:22:36.209 02:25:03 -- scripts/common.sh@352 -- # local d=2 00:22:36.210 02:25:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:36.210 02:25:03 -- scripts/common.sh@354 -- # echo 2 00:22:36.210 02:25:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:36.210 02:25:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:36.210 02:25:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:36.210 02:25:03 -- scripts/common.sh@367 -- # return 0 00:22:36.210 02:25:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:36.210 02:25:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:36.210 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:36.210 --rc genhtml_branch_coverage=1 00:22:36.210 --rc genhtml_function_coverage=1 00:22:36.210 --rc genhtml_legend=1 00:22:36.210 --rc geninfo_all_blocks=1 00:22:36.210 --rc geninfo_unexecuted_blocks=1 00:22:36.210 00:22:36.210 ' 00:22:36.210 02:25:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:36.210 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:36.210 --rc genhtml_branch_coverage=1 00:22:36.210 --rc genhtml_function_coverage=1 00:22:36.210 --rc genhtml_legend=1 00:22:36.210 --rc geninfo_all_blocks=1 00:22:36.210 --rc geninfo_unexecuted_blocks=1 00:22:36.210 00:22:36.210 ' 00:22:36.210 02:25:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:36.210 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:36.210 --rc genhtml_branch_coverage=1 00:22:36.210 --rc genhtml_function_coverage=1 00:22:36.210 --rc genhtml_legend=1 00:22:36.210 --rc geninfo_all_blocks=1 00:22:36.210 --rc geninfo_unexecuted_blocks=1 00:22:36.210 00:22:36.210 ' 00:22:36.210 02:25:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:36.210 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:36.210 --rc genhtml_branch_coverage=1 00:22:36.210 --rc genhtml_function_coverage=1 00:22:36.210 --rc genhtml_legend=1 00:22:36.210 --rc geninfo_all_blocks=1 00:22:36.210 --rc geninfo_unexecuted_blocks=1 00:22:36.210 00:22:36.210 ' 00:22:36.210 02:25:03 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:36.210 02:25:03 -- nvmf/common.sh@7 -- # uname -s 00:22:36.210 02:25:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:36.210 02:25:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:36.210 02:25:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:36.210 02:25:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:36.210 02:25:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:36.210 02:25:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:36.210 02:25:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:36.210 02:25:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:36.210 02:25:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:36.210 02:25:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:36.210 02:25:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:36.210 02:25:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:36.210 02:25:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:36.210 02:25:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:36.210 02:25:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:36.210 02:25:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:36.210 02:25:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:36.210 02:25:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:36.210 02:25:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:36.210 02:25:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:36.210 02:25:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:36.210 02:25:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:36.210 02:25:03 -- paths/export.sh@5 -- # export PATH 00:22:36.210 02:25:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:36.210 02:25:03 -- nvmf/common.sh@46 -- # : 0 00:22:36.210 02:25:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:36.210 02:25:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:36.210 02:25:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:36.210 02:25:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:36.210 02:25:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:36.210 02:25:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:36.210 02:25:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:36.210 02:25:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:36.210 02:25:03 -- host/aer.sh@11 -- # nvmftestinit 00:22:36.210 02:25:03 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:36.210 02:25:03 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:36.210 02:25:03 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:36.210 02:25:03 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:36.210 02:25:03 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:36.210 02:25:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:36.210 02:25:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:36.210 02:25:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:36.210 02:25:03 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:36.210 02:25:03 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:36.210 02:25:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:36.210 02:25:03 -- common/autotest_common.sh@10 -- # set +x 00:22:38.115 02:25:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:38.115 02:25:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:38.115 02:25:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:38.115 02:25:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:38.115 02:25:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:38.115 02:25:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:38.115 02:25:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:38.115 02:25:05 -- nvmf/common.sh@294 -- # net_devs=() 00:22:38.115 02:25:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:38.115 02:25:05 -- nvmf/common.sh@295 -- # e810=() 00:22:38.115 02:25:05 -- nvmf/common.sh@295 -- # local -ga e810 00:22:38.115 02:25:05 -- nvmf/common.sh@296 -- # x722=() 00:22:38.115 02:25:05 -- nvmf/common.sh@296 -- # local -ga x722 00:22:38.115 02:25:05 -- nvmf/common.sh@297 -- # mlx=() 00:22:38.115 02:25:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:38.115 02:25:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:38.115 02:25:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:38.115 02:25:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:38.115 02:25:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:38.115 02:25:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:38.115 02:25:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:38.115 02:25:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:38.115 02:25:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:38.115 02:25:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:38.115 02:25:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:38.115 02:25:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:38.115 02:25:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:38.115 02:25:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:38.115 02:25:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:38.115 02:25:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:38.115 02:25:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:38.115 02:25:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:38.115 02:25:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:38.115 02:25:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:38.115 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:38.115 02:25:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:38.115 02:25:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:38.115 02:25:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:38.115 02:25:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:38.115 02:25:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:38.115 02:25:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:38.115 02:25:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:38.115 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:38.115 02:25:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:38.115 02:25:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:38.115 02:25:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:38.115 02:25:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:38.115 02:25:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:38.115 02:25:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:38.115 02:25:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:38.115 02:25:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:38.115 02:25:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:38.115 02:25:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:38.115 02:25:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:38.115 02:25:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:38.115 02:25:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:38.115 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:38.115 02:25:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:38.115 02:25:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:38.115 02:25:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:38.115 02:25:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:38.115 02:25:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:38.115 02:25:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:38.115 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:38.115 02:25:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:38.115 02:25:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:38.115 02:25:05 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:38.115 02:25:05 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:38.115 02:25:05 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:38.115 02:25:05 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:38.115 02:25:05 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:38.115 02:25:05 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:38.115 02:25:05 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:38.115 02:25:05 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:38.115 02:25:05 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:38.115 02:25:05 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:38.115 02:25:05 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:38.115 02:25:05 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:38.115 02:25:05 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:38.115 02:25:05 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:38.115 02:25:05 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:38.115 02:25:05 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:38.115 02:25:05 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:38.115 02:25:05 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:38.115 02:25:05 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:38.115 02:25:05 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:38.115 02:25:05 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:38.115 02:25:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:38.116 02:25:05 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:38.116 02:25:05 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:38.116 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:38.116 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.209 ms 00:22:38.116 00:22:38.116 --- 10.0.0.2 ping statistics --- 00:22:38.116 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:38.116 rtt min/avg/max/mdev = 0.209/0.209/0.209/0.000 ms 00:22:38.116 02:25:05 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:38.116 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:38.116 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.064 ms 00:22:38.116 00:22:38.116 --- 10.0.0.1 ping statistics --- 00:22:38.116 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:38.116 rtt min/avg/max/mdev = 0.064/0.064/0.064/0.000 ms 00:22:38.116 02:25:05 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:38.116 02:25:05 -- nvmf/common.sh@410 -- # return 0 00:22:38.116 02:25:05 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:38.116 02:25:05 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:38.116 02:25:05 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:38.116 02:25:05 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:38.116 02:25:05 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:38.116 02:25:05 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:38.116 02:25:05 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:38.116 02:25:05 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:22:38.116 02:25:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:38.116 02:25:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:38.116 02:25:05 -- common/autotest_common.sh@10 -- # set +x 00:22:38.116 02:25:05 -- nvmf/common.sh@469 -- # nvmfpid=2180338 00:22:38.116 02:25:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:38.116 02:25:05 -- nvmf/common.sh@470 -- # waitforlisten 2180338 00:22:38.116 02:25:05 -- common/autotest_common.sh@829 -- # '[' -z 2180338 ']' 00:22:38.116 02:25:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:38.116 02:25:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:38.116 02:25:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:38.116 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:38.116 02:25:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:38.116 02:25:05 -- common/autotest_common.sh@10 -- # set +x 00:22:38.116 [2024-12-08 02:25:05.752839] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:38.116 [2024-12-08 02:25:05.752907] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:38.116 EAL: No free 2048 kB hugepages reported on node 1 00:22:38.116 [2024-12-08 02:25:05.820126] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:38.374 [2024-12-08 02:25:05.939656] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:38.374 [2024-12-08 02:25:05.939828] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:38.374 [2024-12-08 02:25:05.939860] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:38.375 [2024-12-08 02:25:05.939873] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:38.375 [2024-12-08 02:25:05.939930] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:38.375 [2024-12-08 02:25:05.939959] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:38.375 [2024-12-08 02:25:05.940022] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:38.375 [2024-12-08 02:25:05.940025] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:39.311 02:25:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:39.311 02:25:06 -- common/autotest_common.sh@862 -- # return 0 00:22:39.311 02:25:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:39.311 02:25:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:39.311 02:25:06 -- common/autotest_common.sh@10 -- # set +x 00:22:39.311 02:25:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:39.311 02:25:06 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:39.311 02:25:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:39.311 02:25:06 -- common/autotest_common.sh@10 -- # set +x 00:22:39.311 [2024-12-08 02:25:06.809298] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:39.311 02:25:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:39.311 02:25:06 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:22:39.311 02:25:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:39.311 02:25:06 -- common/autotest_common.sh@10 -- # set +x 00:22:39.311 Malloc0 00:22:39.311 02:25:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:39.311 02:25:06 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:22:39.311 02:25:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:39.311 02:25:06 -- common/autotest_common.sh@10 -- # set +x 00:22:39.311 02:25:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:39.311 02:25:06 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:39.311 02:25:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:39.311 02:25:06 -- common/autotest_common.sh@10 -- # set +x 00:22:39.311 02:25:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:39.311 02:25:06 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:39.311 02:25:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:39.311 02:25:06 -- common/autotest_common.sh@10 -- # set +x 00:22:39.311 [2024-12-08 02:25:06.862555] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:39.311 02:25:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:39.311 02:25:06 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:22:39.311 02:25:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:39.311 02:25:06 -- common/autotest_common.sh@10 -- # set +x 00:22:39.311 [2024-12-08 02:25:06.870282] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:22:39.311 [ 00:22:39.311 { 00:22:39.311 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:22:39.311 "subtype": "Discovery", 00:22:39.311 "listen_addresses": [], 00:22:39.311 "allow_any_host": true, 00:22:39.311 "hosts": [] 00:22:39.311 }, 00:22:39.311 { 00:22:39.311 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:22:39.311 "subtype": "NVMe", 00:22:39.311 "listen_addresses": [ 00:22:39.311 { 00:22:39.311 "transport": "TCP", 00:22:39.311 "trtype": "TCP", 00:22:39.311 "adrfam": "IPv4", 00:22:39.311 "traddr": "10.0.0.2", 00:22:39.311 "trsvcid": "4420" 00:22:39.311 } 00:22:39.311 ], 00:22:39.311 "allow_any_host": true, 00:22:39.311 "hosts": [], 00:22:39.311 "serial_number": "SPDK00000000000001", 00:22:39.311 "model_number": "SPDK bdev Controller", 00:22:39.311 "max_namespaces": 2, 00:22:39.311 "min_cntlid": 1, 00:22:39.311 "max_cntlid": 65519, 00:22:39.311 "namespaces": [ 00:22:39.311 { 00:22:39.311 "nsid": 1, 00:22:39.311 "bdev_name": "Malloc0", 00:22:39.311 "name": "Malloc0", 00:22:39.311 "nguid": "2BABD5E12899489A9023558C8487A598", 00:22:39.312 "uuid": "2babd5e1-2899-489a-9023-558c8487a598" 00:22:39.312 } 00:22:39.312 ] 00:22:39.312 } 00:22:39.312 ] 00:22:39.312 02:25:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:39.312 02:25:06 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:22:39.312 02:25:06 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:22:39.312 02:25:06 -- host/aer.sh@33 -- # aerpid=2180497 00:22:39.312 02:25:06 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:22:39.312 02:25:06 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:22:39.312 02:25:06 -- common/autotest_common.sh@1254 -- # local i=0 00:22:39.312 02:25:06 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:39.312 02:25:06 -- common/autotest_common.sh@1256 -- # '[' 0 -lt 200 ']' 00:22:39.312 02:25:06 -- common/autotest_common.sh@1257 -- # i=1 00:22:39.312 02:25:06 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:22:39.312 EAL: No free 2048 kB hugepages reported on node 1 00:22:39.312 02:25:06 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:39.312 02:25:06 -- common/autotest_common.sh@1256 -- # '[' 1 -lt 200 ']' 00:22:39.312 02:25:06 -- common/autotest_common.sh@1257 -- # i=2 00:22:39.312 02:25:06 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:22:39.312 02:25:07 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:39.312 02:25:07 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:39.312 02:25:07 -- common/autotest_common.sh@1265 -- # return 0 00:22:39.312 02:25:07 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:22:39.312 02:25:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:39.312 02:25:07 -- common/autotest_common.sh@10 -- # set +x 00:22:39.570 Malloc1 00:22:39.570 02:25:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:39.570 02:25:07 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:22:39.570 02:25:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:39.570 02:25:07 -- common/autotest_common.sh@10 -- # set +x 00:22:39.570 02:25:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:39.570 02:25:07 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:22:39.570 02:25:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:39.570 02:25:07 -- common/autotest_common.sh@10 -- # set +x 00:22:39.570 Asynchronous Event Request test 00:22:39.570 Attaching to 10.0.0.2 00:22:39.570 Attached to 10.0.0.2 00:22:39.570 Registering asynchronous event callbacks... 00:22:39.570 Starting namespace attribute notice tests for all controllers... 00:22:39.570 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:22:39.570 aer_cb - Changed Namespace 00:22:39.570 Cleaning up... 00:22:39.570 [ 00:22:39.570 { 00:22:39.570 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:22:39.570 "subtype": "Discovery", 00:22:39.570 "listen_addresses": [], 00:22:39.570 "allow_any_host": true, 00:22:39.570 "hosts": [] 00:22:39.570 }, 00:22:39.570 { 00:22:39.570 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:22:39.570 "subtype": "NVMe", 00:22:39.570 "listen_addresses": [ 00:22:39.570 { 00:22:39.570 "transport": "TCP", 00:22:39.570 "trtype": "TCP", 00:22:39.570 "adrfam": "IPv4", 00:22:39.570 "traddr": "10.0.0.2", 00:22:39.570 "trsvcid": "4420" 00:22:39.570 } 00:22:39.570 ], 00:22:39.570 "allow_any_host": true, 00:22:39.570 "hosts": [], 00:22:39.570 "serial_number": "SPDK00000000000001", 00:22:39.570 "model_number": "SPDK bdev Controller", 00:22:39.570 "max_namespaces": 2, 00:22:39.570 "min_cntlid": 1, 00:22:39.570 "max_cntlid": 65519, 00:22:39.570 "namespaces": [ 00:22:39.570 { 00:22:39.570 "nsid": 1, 00:22:39.570 "bdev_name": "Malloc0", 00:22:39.570 "name": "Malloc0", 00:22:39.570 "nguid": "2BABD5E12899489A9023558C8487A598", 00:22:39.570 "uuid": "2babd5e1-2899-489a-9023-558c8487a598" 00:22:39.570 }, 00:22:39.570 { 00:22:39.570 "nsid": 2, 00:22:39.570 "bdev_name": "Malloc1", 00:22:39.570 "name": "Malloc1", 00:22:39.570 "nguid": "5A31D6997E8A4334B35D51BFDE6A3FC2", 00:22:39.570 "uuid": "5a31d699-7e8a-4334-b35d-51bfde6a3fc2" 00:22:39.570 } 00:22:39.570 ] 00:22:39.570 } 00:22:39.570 ] 00:22:39.570 02:25:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:39.570 02:25:07 -- host/aer.sh@43 -- # wait 2180497 00:22:39.570 02:25:07 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:22:39.570 02:25:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:39.570 02:25:07 -- common/autotest_common.sh@10 -- # set +x 00:22:39.570 02:25:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:39.570 02:25:07 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:22:39.570 02:25:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:39.570 02:25:07 -- common/autotest_common.sh@10 -- # set +x 00:22:39.570 02:25:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:39.570 02:25:07 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:39.570 02:25:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:39.570 02:25:07 -- common/autotest_common.sh@10 -- # set +x 00:22:39.570 02:25:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:39.570 02:25:07 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:22:39.570 02:25:07 -- host/aer.sh@51 -- # nvmftestfini 00:22:39.570 02:25:07 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:39.570 02:25:07 -- nvmf/common.sh@116 -- # sync 00:22:39.570 02:25:07 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:39.570 02:25:07 -- nvmf/common.sh@119 -- # set +e 00:22:39.570 02:25:07 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:39.570 02:25:07 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:39.570 rmmod nvme_tcp 00:22:39.570 rmmod nvme_fabrics 00:22:39.570 rmmod nvme_keyring 00:22:39.570 02:25:07 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:39.570 02:25:07 -- nvmf/common.sh@123 -- # set -e 00:22:39.570 02:25:07 -- nvmf/common.sh@124 -- # return 0 00:22:39.570 02:25:07 -- nvmf/common.sh@477 -- # '[' -n 2180338 ']' 00:22:39.570 02:25:07 -- nvmf/common.sh@478 -- # killprocess 2180338 00:22:39.570 02:25:07 -- common/autotest_common.sh@936 -- # '[' -z 2180338 ']' 00:22:39.570 02:25:07 -- common/autotest_common.sh@940 -- # kill -0 2180338 00:22:39.570 02:25:07 -- common/autotest_common.sh@941 -- # uname 00:22:39.570 02:25:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:39.570 02:25:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2180338 00:22:39.570 02:25:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:39.570 02:25:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:39.570 02:25:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2180338' 00:22:39.570 killing process with pid 2180338 00:22:39.570 02:25:07 -- common/autotest_common.sh@955 -- # kill 2180338 00:22:39.570 [2024-12-08 02:25:07.326873] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:22:39.570 02:25:07 -- common/autotest_common.sh@960 -- # wait 2180338 00:22:39.829 02:25:07 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:39.829 02:25:07 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:39.829 02:25:07 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:39.829 02:25:07 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:39.829 02:25:07 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:39.829 02:25:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:39.829 02:25:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:39.829 02:25:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:42.440 02:25:09 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:42.440 00:22:42.440 real 0m6.171s 00:22:42.440 user 0m7.379s 00:22:42.440 sys 0m1.953s 00:22:42.440 02:25:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:42.440 02:25:09 -- common/autotest_common.sh@10 -- # set +x 00:22:42.440 ************************************ 00:22:42.440 END TEST nvmf_aer 00:22:42.440 ************************************ 00:22:42.440 02:25:09 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:22:42.440 02:25:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:42.440 02:25:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:42.440 02:25:09 -- common/autotest_common.sh@10 -- # set +x 00:22:42.440 ************************************ 00:22:42.440 START TEST nvmf_async_init 00:22:42.440 ************************************ 00:22:42.440 02:25:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:22:42.440 * Looking for test storage... 00:22:42.440 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:42.440 02:25:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:42.440 02:25:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:42.440 02:25:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:42.440 02:25:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:42.440 02:25:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:42.440 02:25:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:42.440 02:25:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:42.440 02:25:09 -- scripts/common.sh@335 -- # IFS=.-: 00:22:42.440 02:25:09 -- scripts/common.sh@335 -- # read -ra ver1 00:22:42.440 02:25:09 -- scripts/common.sh@336 -- # IFS=.-: 00:22:42.440 02:25:09 -- scripts/common.sh@336 -- # read -ra ver2 00:22:42.440 02:25:09 -- scripts/common.sh@337 -- # local 'op=<' 00:22:42.440 02:25:09 -- scripts/common.sh@339 -- # ver1_l=2 00:22:42.440 02:25:09 -- scripts/common.sh@340 -- # ver2_l=1 00:22:42.440 02:25:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:42.440 02:25:09 -- scripts/common.sh@343 -- # case "$op" in 00:22:42.440 02:25:09 -- scripts/common.sh@344 -- # : 1 00:22:42.440 02:25:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:42.440 02:25:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:42.440 02:25:09 -- scripts/common.sh@364 -- # decimal 1 00:22:42.440 02:25:09 -- scripts/common.sh@352 -- # local d=1 00:22:42.440 02:25:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:42.440 02:25:09 -- scripts/common.sh@354 -- # echo 1 00:22:42.440 02:25:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:42.440 02:25:09 -- scripts/common.sh@365 -- # decimal 2 00:22:42.440 02:25:09 -- scripts/common.sh@352 -- # local d=2 00:22:42.440 02:25:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:42.440 02:25:09 -- scripts/common.sh@354 -- # echo 2 00:22:42.440 02:25:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:42.440 02:25:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:42.440 02:25:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:42.440 02:25:09 -- scripts/common.sh@367 -- # return 0 00:22:42.440 02:25:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:42.440 02:25:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:42.440 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:42.440 --rc genhtml_branch_coverage=1 00:22:42.440 --rc genhtml_function_coverage=1 00:22:42.440 --rc genhtml_legend=1 00:22:42.440 --rc geninfo_all_blocks=1 00:22:42.440 --rc geninfo_unexecuted_blocks=1 00:22:42.440 00:22:42.440 ' 00:22:42.440 02:25:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:42.440 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:42.440 --rc genhtml_branch_coverage=1 00:22:42.440 --rc genhtml_function_coverage=1 00:22:42.440 --rc genhtml_legend=1 00:22:42.440 --rc geninfo_all_blocks=1 00:22:42.440 --rc geninfo_unexecuted_blocks=1 00:22:42.440 00:22:42.440 ' 00:22:42.440 02:25:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:42.440 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:42.440 --rc genhtml_branch_coverage=1 00:22:42.440 --rc genhtml_function_coverage=1 00:22:42.440 --rc genhtml_legend=1 00:22:42.440 --rc geninfo_all_blocks=1 00:22:42.440 --rc geninfo_unexecuted_blocks=1 00:22:42.440 00:22:42.440 ' 00:22:42.440 02:25:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:42.440 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:42.440 --rc genhtml_branch_coverage=1 00:22:42.440 --rc genhtml_function_coverage=1 00:22:42.440 --rc genhtml_legend=1 00:22:42.440 --rc geninfo_all_blocks=1 00:22:42.440 --rc geninfo_unexecuted_blocks=1 00:22:42.441 00:22:42.441 ' 00:22:42.441 02:25:09 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:42.441 02:25:09 -- nvmf/common.sh@7 -- # uname -s 00:22:42.441 02:25:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:42.441 02:25:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:42.441 02:25:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:42.441 02:25:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:42.441 02:25:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:42.441 02:25:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:42.441 02:25:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:42.441 02:25:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:42.441 02:25:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:42.441 02:25:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:42.441 02:25:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:42.441 02:25:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:42.441 02:25:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:42.441 02:25:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:42.441 02:25:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:42.441 02:25:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:42.441 02:25:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:42.441 02:25:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:42.441 02:25:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:42.441 02:25:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:42.441 02:25:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:42.441 02:25:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:42.441 02:25:09 -- paths/export.sh@5 -- # export PATH 00:22:42.441 02:25:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:42.441 02:25:09 -- nvmf/common.sh@46 -- # : 0 00:22:42.441 02:25:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:42.441 02:25:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:42.441 02:25:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:42.441 02:25:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:42.441 02:25:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:42.441 02:25:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:42.441 02:25:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:42.441 02:25:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:42.441 02:25:09 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:22:42.441 02:25:09 -- host/async_init.sh@14 -- # null_block_size=512 00:22:42.441 02:25:09 -- host/async_init.sh@15 -- # null_bdev=null0 00:22:42.441 02:25:09 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:22:42.441 02:25:09 -- host/async_init.sh@20 -- # uuidgen 00:22:42.441 02:25:09 -- host/async_init.sh@20 -- # tr -d - 00:22:42.441 02:25:09 -- host/async_init.sh@20 -- # nguid=bee0fe6cc6b54d38a2e6fa6d1b8298ba 00:22:42.441 02:25:09 -- host/async_init.sh@22 -- # nvmftestinit 00:22:42.441 02:25:09 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:42.441 02:25:09 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:42.441 02:25:09 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:42.441 02:25:09 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:42.441 02:25:09 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:42.441 02:25:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:42.441 02:25:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:42.441 02:25:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:42.441 02:25:09 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:42.441 02:25:09 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:42.441 02:25:09 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:42.441 02:25:09 -- common/autotest_common.sh@10 -- # set +x 00:22:44.347 02:25:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:44.347 02:25:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:44.347 02:25:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:44.347 02:25:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:44.347 02:25:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:44.347 02:25:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:44.347 02:25:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:44.347 02:25:11 -- nvmf/common.sh@294 -- # net_devs=() 00:22:44.347 02:25:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:44.347 02:25:11 -- nvmf/common.sh@295 -- # e810=() 00:22:44.347 02:25:11 -- nvmf/common.sh@295 -- # local -ga e810 00:22:44.347 02:25:11 -- nvmf/common.sh@296 -- # x722=() 00:22:44.347 02:25:11 -- nvmf/common.sh@296 -- # local -ga x722 00:22:44.347 02:25:11 -- nvmf/common.sh@297 -- # mlx=() 00:22:44.347 02:25:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:44.347 02:25:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:44.347 02:25:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:44.347 02:25:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:44.347 02:25:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:44.347 02:25:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:44.347 02:25:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:44.347 02:25:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:44.347 02:25:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:44.347 02:25:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:44.347 02:25:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:44.347 02:25:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:44.347 02:25:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:44.347 02:25:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:44.347 02:25:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:44.347 02:25:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:44.347 02:25:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:44.347 02:25:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:44.347 02:25:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:44.347 02:25:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:44.347 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:44.347 02:25:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:44.347 02:25:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:44.347 02:25:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:44.347 02:25:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:44.347 02:25:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:44.347 02:25:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:44.347 02:25:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:44.347 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:44.347 02:25:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:44.347 02:25:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:44.347 02:25:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:44.347 02:25:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:44.347 02:25:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:44.347 02:25:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:44.347 02:25:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:44.347 02:25:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:44.347 02:25:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:44.347 02:25:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:44.347 02:25:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:44.347 02:25:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:44.347 02:25:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:44.347 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:44.347 02:25:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:44.347 02:25:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:44.347 02:25:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:44.347 02:25:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:44.347 02:25:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:44.347 02:25:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:44.347 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:44.348 02:25:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:44.348 02:25:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:44.348 02:25:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:44.348 02:25:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:44.348 02:25:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:44.348 02:25:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:44.348 02:25:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:44.348 02:25:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:44.348 02:25:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:44.348 02:25:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:44.348 02:25:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:44.348 02:25:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:44.348 02:25:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:44.348 02:25:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:44.348 02:25:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:44.348 02:25:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:44.348 02:25:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:44.348 02:25:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:44.348 02:25:11 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:44.348 02:25:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:44.348 02:25:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:44.348 02:25:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:44.348 02:25:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:44.348 02:25:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:44.348 02:25:11 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:44.348 02:25:11 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:44.348 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:44.348 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.174 ms 00:22:44.348 00:22:44.348 --- 10.0.0.2 ping statistics --- 00:22:44.348 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:44.348 rtt min/avg/max/mdev = 0.174/0.174/0.174/0.000 ms 00:22:44.348 02:25:11 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:44.348 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:44.348 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.164 ms 00:22:44.348 00:22:44.348 --- 10.0.0.1 ping statistics --- 00:22:44.348 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:44.348 rtt min/avg/max/mdev = 0.164/0.164/0.164/0.000 ms 00:22:44.348 02:25:11 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:44.348 02:25:11 -- nvmf/common.sh@410 -- # return 0 00:22:44.348 02:25:11 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:44.348 02:25:11 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:44.348 02:25:11 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:44.348 02:25:11 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:44.348 02:25:11 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:44.348 02:25:11 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:44.348 02:25:11 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:44.348 02:25:11 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:22:44.348 02:25:11 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:44.348 02:25:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:44.348 02:25:11 -- common/autotest_common.sh@10 -- # set +x 00:22:44.348 02:25:11 -- nvmf/common.sh@469 -- # nvmfpid=2182458 00:22:44.348 02:25:11 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:22:44.348 02:25:11 -- nvmf/common.sh@470 -- # waitforlisten 2182458 00:22:44.348 02:25:11 -- common/autotest_common.sh@829 -- # '[' -z 2182458 ']' 00:22:44.348 02:25:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:44.348 02:25:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:44.348 02:25:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:44.348 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:44.348 02:25:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:44.348 02:25:11 -- common/autotest_common.sh@10 -- # set +x 00:22:44.348 [2024-12-08 02:25:11.974563] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:44.348 [2024-12-08 02:25:11.974632] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:44.348 EAL: No free 2048 kB hugepages reported on node 1 00:22:44.348 [2024-12-08 02:25:12.040410] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:44.605 [2024-12-08 02:25:12.156580] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:44.605 [2024-12-08 02:25:12.156758] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:44.605 [2024-12-08 02:25:12.156791] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:44.605 [2024-12-08 02:25:12.156804] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:44.605 [2024-12-08 02:25:12.156859] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:45.541 02:25:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:45.541 02:25:13 -- common/autotest_common.sh@862 -- # return 0 00:22:45.541 02:25:13 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:45.541 02:25:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:45.541 02:25:13 -- common/autotest_common.sh@10 -- # set +x 00:22:45.541 02:25:13 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:45.541 02:25:13 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:22:45.541 02:25:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:45.541 02:25:13 -- common/autotest_common.sh@10 -- # set +x 00:22:45.541 [2024-12-08 02:25:13.059049] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:45.541 02:25:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:45.541 02:25:13 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:22:45.541 02:25:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:45.541 02:25:13 -- common/autotest_common.sh@10 -- # set +x 00:22:45.541 null0 00:22:45.541 02:25:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:45.541 02:25:13 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:22:45.541 02:25:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:45.541 02:25:13 -- common/autotest_common.sh@10 -- # set +x 00:22:45.541 02:25:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:45.541 02:25:13 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:22:45.541 02:25:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:45.541 02:25:13 -- common/autotest_common.sh@10 -- # set +x 00:22:45.541 02:25:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:45.541 02:25:13 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g bee0fe6cc6b54d38a2e6fa6d1b8298ba 00:22:45.541 02:25:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:45.541 02:25:13 -- common/autotest_common.sh@10 -- # set +x 00:22:45.541 02:25:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:45.541 02:25:13 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:22:45.541 02:25:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:45.541 02:25:13 -- common/autotest_common.sh@10 -- # set +x 00:22:45.541 [2024-12-08 02:25:13.099277] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:45.541 02:25:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:45.541 02:25:13 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:22:45.541 02:25:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:45.541 02:25:13 -- common/autotest_common.sh@10 -- # set +x 00:22:45.800 nvme0n1 00:22:45.800 02:25:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:45.800 02:25:13 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:22:45.800 02:25:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:45.800 02:25:13 -- common/autotest_common.sh@10 -- # set +x 00:22:45.800 [ 00:22:45.800 { 00:22:45.800 "name": "nvme0n1", 00:22:45.800 "aliases": [ 00:22:45.800 "bee0fe6c-c6b5-4d38-a2e6-fa6d1b8298ba" 00:22:45.800 ], 00:22:45.800 "product_name": "NVMe disk", 00:22:45.800 "block_size": 512, 00:22:45.800 "num_blocks": 2097152, 00:22:45.800 "uuid": "bee0fe6c-c6b5-4d38-a2e6-fa6d1b8298ba", 00:22:45.800 "assigned_rate_limits": { 00:22:45.800 "rw_ios_per_sec": 0, 00:22:45.800 "rw_mbytes_per_sec": 0, 00:22:45.800 "r_mbytes_per_sec": 0, 00:22:45.800 "w_mbytes_per_sec": 0 00:22:45.800 }, 00:22:45.800 "claimed": false, 00:22:45.800 "zoned": false, 00:22:45.800 "supported_io_types": { 00:22:45.800 "read": true, 00:22:45.800 "write": true, 00:22:45.800 "unmap": false, 00:22:45.800 "write_zeroes": true, 00:22:45.800 "flush": true, 00:22:45.800 "reset": true, 00:22:45.800 "compare": true, 00:22:45.800 "compare_and_write": true, 00:22:45.800 "abort": true, 00:22:45.800 "nvme_admin": true, 00:22:45.800 "nvme_io": true 00:22:45.800 }, 00:22:45.800 "driver_specific": { 00:22:45.800 "nvme": [ 00:22:45.800 { 00:22:45.800 "trid": { 00:22:45.800 "trtype": "TCP", 00:22:45.800 "adrfam": "IPv4", 00:22:45.800 "traddr": "10.0.0.2", 00:22:45.800 "trsvcid": "4420", 00:22:45.800 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:22:45.800 }, 00:22:45.800 "ctrlr_data": { 00:22:45.800 "cntlid": 1, 00:22:45.800 "vendor_id": "0x8086", 00:22:45.800 "model_number": "SPDK bdev Controller", 00:22:45.800 "serial_number": "00000000000000000000", 00:22:45.800 "firmware_revision": "24.01.1", 00:22:45.800 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:22:45.800 "oacs": { 00:22:45.800 "security": 0, 00:22:45.800 "format": 0, 00:22:45.800 "firmware": 0, 00:22:45.800 "ns_manage": 0 00:22:45.800 }, 00:22:45.800 "multi_ctrlr": true, 00:22:45.800 "ana_reporting": false 00:22:45.800 }, 00:22:45.800 "vs": { 00:22:45.800 "nvme_version": "1.3" 00:22:45.800 }, 00:22:45.800 "ns_data": { 00:22:45.800 "id": 1, 00:22:45.800 "can_share": true 00:22:45.800 } 00:22:45.800 } 00:22:45.800 ], 00:22:45.800 "mp_policy": "active_passive" 00:22:45.800 } 00:22:45.800 } 00:22:45.800 ] 00:22:45.800 02:25:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:45.800 02:25:13 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:22:45.800 02:25:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:45.800 02:25:13 -- common/autotest_common.sh@10 -- # set +x 00:22:45.800 [2024-12-08 02:25:13.347928] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:22:45.800 [2024-12-08 02:25:13.348016] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x235fba0 (9): Bad file descriptor 00:22:45.800 [2024-12-08 02:25:13.479696] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:22:45.800 02:25:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:45.800 02:25:13 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:22:45.800 02:25:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:45.800 02:25:13 -- common/autotest_common.sh@10 -- # set +x 00:22:45.800 [ 00:22:45.800 { 00:22:45.800 "name": "nvme0n1", 00:22:45.800 "aliases": [ 00:22:45.800 "bee0fe6c-c6b5-4d38-a2e6-fa6d1b8298ba" 00:22:45.800 ], 00:22:45.800 "product_name": "NVMe disk", 00:22:45.800 "block_size": 512, 00:22:45.800 "num_blocks": 2097152, 00:22:45.800 "uuid": "bee0fe6c-c6b5-4d38-a2e6-fa6d1b8298ba", 00:22:45.800 "assigned_rate_limits": { 00:22:45.800 "rw_ios_per_sec": 0, 00:22:45.800 "rw_mbytes_per_sec": 0, 00:22:45.800 "r_mbytes_per_sec": 0, 00:22:45.800 "w_mbytes_per_sec": 0 00:22:45.800 }, 00:22:45.800 "claimed": false, 00:22:45.800 "zoned": false, 00:22:45.800 "supported_io_types": { 00:22:45.800 "read": true, 00:22:45.800 "write": true, 00:22:45.800 "unmap": false, 00:22:45.800 "write_zeroes": true, 00:22:45.800 "flush": true, 00:22:45.800 "reset": true, 00:22:45.800 "compare": true, 00:22:45.800 "compare_and_write": true, 00:22:45.800 "abort": true, 00:22:45.800 "nvme_admin": true, 00:22:45.800 "nvme_io": true 00:22:45.800 }, 00:22:45.800 "driver_specific": { 00:22:45.800 "nvme": [ 00:22:45.800 { 00:22:45.800 "trid": { 00:22:45.800 "trtype": "TCP", 00:22:45.800 "adrfam": "IPv4", 00:22:45.800 "traddr": "10.0.0.2", 00:22:45.800 "trsvcid": "4420", 00:22:45.800 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:22:45.800 }, 00:22:45.800 "ctrlr_data": { 00:22:45.800 "cntlid": 2, 00:22:45.800 "vendor_id": "0x8086", 00:22:45.800 "model_number": "SPDK bdev Controller", 00:22:45.800 "serial_number": "00000000000000000000", 00:22:45.800 "firmware_revision": "24.01.1", 00:22:45.800 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:22:45.800 "oacs": { 00:22:45.800 "security": 0, 00:22:45.800 "format": 0, 00:22:45.800 "firmware": 0, 00:22:45.801 "ns_manage": 0 00:22:45.801 }, 00:22:45.801 "multi_ctrlr": true, 00:22:45.801 "ana_reporting": false 00:22:45.801 }, 00:22:45.801 "vs": { 00:22:45.801 "nvme_version": "1.3" 00:22:45.801 }, 00:22:45.801 "ns_data": { 00:22:45.801 "id": 1, 00:22:45.801 "can_share": true 00:22:45.801 } 00:22:45.801 } 00:22:45.801 ], 00:22:45.801 "mp_policy": "active_passive" 00:22:45.801 } 00:22:45.801 } 00:22:45.801 ] 00:22:45.801 02:25:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:45.801 02:25:13 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:45.801 02:25:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:45.801 02:25:13 -- common/autotest_common.sh@10 -- # set +x 00:22:45.801 02:25:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:45.801 02:25:13 -- host/async_init.sh@53 -- # mktemp 00:22:45.801 02:25:13 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.Rt2MUE4Asq 00:22:45.801 02:25:13 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:22:45.801 02:25:13 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.Rt2MUE4Asq 00:22:45.801 02:25:13 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:22:45.801 02:25:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:45.801 02:25:13 -- common/autotest_common.sh@10 -- # set +x 00:22:45.801 02:25:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:45.801 02:25:13 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:22:45.801 02:25:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:45.801 02:25:13 -- common/autotest_common.sh@10 -- # set +x 00:22:45.801 [2024-12-08 02:25:13.524502] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:22:45.801 [2024-12-08 02:25:13.524693] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:22:45.801 02:25:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:45.801 02:25:13 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.Rt2MUE4Asq 00:22:45.801 02:25:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:45.801 02:25:13 -- common/autotest_common.sh@10 -- # set +x 00:22:45.801 02:25:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:45.801 02:25:13 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.Rt2MUE4Asq 00:22:45.801 02:25:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:45.801 02:25:13 -- common/autotest_common.sh@10 -- # set +x 00:22:45.801 [2024-12-08 02:25:13.540535] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:22:46.058 nvme0n1 00:22:46.058 02:25:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:46.058 02:25:13 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:22:46.058 02:25:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:46.058 02:25:13 -- common/autotest_common.sh@10 -- # set +x 00:22:46.058 [ 00:22:46.058 { 00:22:46.058 "name": "nvme0n1", 00:22:46.058 "aliases": [ 00:22:46.058 "bee0fe6c-c6b5-4d38-a2e6-fa6d1b8298ba" 00:22:46.058 ], 00:22:46.058 "product_name": "NVMe disk", 00:22:46.058 "block_size": 512, 00:22:46.058 "num_blocks": 2097152, 00:22:46.058 "uuid": "bee0fe6c-c6b5-4d38-a2e6-fa6d1b8298ba", 00:22:46.058 "assigned_rate_limits": { 00:22:46.058 "rw_ios_per_sec": 0, 00:22:46.058 "rw_mbytes_per_sec": 0, 00:22:46.058 "r_mbytes_per_sec": 0, 00:22:46.058 "w_mbytes_per_sec": 0 00:22:46.058 }, 00:22:46.058 "claimed": false, 00:22:46.058 "zoned": false, 00:22:46.058 "supported_io_types": { 00:22:46.058 "read": true, 00:22:46.058 "write": true, 00:22:46.058 "unmap": false, 00:22:46.058 "write_zeroes": true, 00:22:46.058 "flush": true, 00:22:46.058 "reset": true, 00:22:46.058 "compare": true, 00:22:46.058 "compare_and_write": true, 00:22:46.058 "abort": true, 00:22:46.058 "nvme_admin": true, 00:22:46.058 "nvme_io": true 00:22:46.059 }, 00:22:46.059 "driver_specific": { 00:22:46.059 "nvme": [ 00:22:46.059 { 00:22:46.059 "trid": { 00:22:46.059 "trtype": "TCP", 00:22:46.059 "adrfam": "IPv4", 00:22:46.059 "traddr": "10.0.0.2", 00:22:46.059 "trsvcid": "4421", 00:22:46.059 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:22:46.059 }, 00:22:46.059 "ctrlr_data": { 00:22:46.059 "cntlid": 3, 00:22:46.059 "vendor_id": "0x8086", 00:22:46.059 "model_number": "SPDK bdev Controller", 00:22:46.059 "serial_number": "00000000000000000000", 00:22:46.059 "firmware_revision": "24.01.1", 00:22:46.059 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:22:46.059 "oacs": { 00:22:46.059 "security": 0, 00:22:46.059 "format": 0, 00:22:46.059 "firmware": 0, 00:22:46.059 "ns_manage": 0 00:22:46.059 }, 00:22:46.059 "multi_ctrlr": true, 00:22:46.059 "ana_reporting": false 00:22:46.059 }, 00:22:46.059 "vs": { 00:22:46.059 "nvme_version": "1.3" 00:22:46.059 }, 00:22:46.059 "ns_data": { 00:22:46.059 "id": 1, 00:22:46.059 "can_share": true 00:22:46.059 } 00:22:46.059 } 00:22:46.059 ], 00:22:46.059 "mp_policy": "active_passive" 00:22:46.059 } 00:22:46.059 } 00:22:46.059 ] 00:22:46.059 02:25:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:46.059 02:25:13 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:46.059 02:25:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:46.059 02:25:13 -- common/autotest_common.sh@10 -- # set +x 00:22:46.059 02:25:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:46.059 02:25:13 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.Rt2MUE4Asq 00:22:46.059 02:25:13 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:22:46.059 02:25:13 -- host/async_init.sh@78 -- # nvmftestfini 00:22:46.059 02:25:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:46.059 02:25:13 -- nvmf/common.sh@116 -- # sync 00:22:46.059 02:25:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:46.059 02:25:13 -- nvmf/common.sh@119 -- # set +e 00:22:46.059 02:25:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:46.059 02:25:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:46.059 rmmod nvme_tcp 00:22:46.059 rmmod nvme_fabrics 00:22:46.059 rmmod nvme_keyring 00:22:46.059 02:25:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:46.059 02:25:13 -- nvmf/common.sh@123 -- # set -e 00:22:46.059 02:25:13 -- nvmf/common.sh@124 -- # return 0 00:22:46.059 02:25:13 -- nvmf/common.sh@477 -- # '[' -n 2182458 ']' 00:22:46.059 02:25:13 -- nvmf/common.sh@478 -- # killprocess 2182458 00:22:46.059 02:25:13 -- common/autotest_common.sh@936 -- # '[' -z 2182458 ']' 00:22:46.059 02:25:13 -- common/autotest_common.sh@940 -- # kill -0 2182458 00:22:46.059 02:25:13 -- common/autotest_common.sh@941 -- # uname 00:22:46.059 02:25:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:46.059 02:25:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2182458 00:22:46.059 02:25:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:46.059 02:25:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:46.059 02:25:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2182458' 00:22:46.059 killing process with pid 2182458 00:22:46.059 02:25:13 -- common/autotest_common.sh@955 -- # kill 2182458 00:22:46.059 02:25:13 -- common/autotest_common.sh@960 -- # wait 2182458 00:22:46.317 02:25:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:46.317 02:25:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:46.317 02:25:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:46.317 02:25:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:46.317 02:25:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:46.317 02:25:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:46.317 02:25:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:46.317 02:25:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:48.225 02:25:16 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:48.483 00:22:48.483 real 0m6.342s 00:22:48.483 user 0m3.273s 00:22:48.483 sys 0m1.789s 00:22:48.483 02:25:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:48.483 02:25:16 -- common/autotest_common.sh@10 -- # set +x 00:22:48.483 ************************************ 00:22:48.483 END TEST nvmf_async_init 00:22:48.483 ************************************ 00:22:48.483 02:25:16 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:22:48.483 02:25:16 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:48.483 02:25:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:48.483 02:25:16 -- common/autotest_common.sh@10 -- # set +x 00:22:48.483 ************************************ 00:22:48.483 START TEST dma 00:22:48.483 ************************************ 00:22:48.483 02:25:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:22:48.483 * Looking for test storage... 00:22:48.483 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:48.483 02:25:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:48.483 02:25:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:48.483 02:25:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:48.483 02:25:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:48.483 02:25:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:48.483 02:25:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:48.483 02:25:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:48.483 02:25:16 -- scripts/common.sh@335 -- # IFS=.-: 00:22:48.483 02:25:16 -- scripts/common.sh@335 -- # read -ra ver1 00:22:48.483 02:25:16 -- scripts/common.sh@336 -- # IFS=.-: 00:22:48.483 02:25:16 -- scripts/common.sh@336 -- # read -ra ver2 00:22:48.483 02:25:16 -- scripts/common.sh@337 -- # local 'op=<' 00:22:48.483 02:25:16 -- scripts/common.sh@339 -- # ver1_l=2 00:22:48.483 02:25:16 -- scripts/common.sh@340 -- # ver2_l=1 00:22:48.483 02:25:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:48.483 02:25:16 -- scripts/common.sh@343 -- # case "$op" in 00:22:48.483 02:25:16 -- scripts/common.sh@344 -- # : 1 00:22:48.483 02:25:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:48.483 02:25:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:48.483 02:25:16 -- scripts/common.sh@364 -- # decimal 1 00:22:48.483 02:25:16 -- scripts/common.sh@352 -- # local d=1 00:22:48.483 02:25:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:48.483 02:25:16 -- scripts/common.sh@354 -- # echo 1 00:22:48.483 02:25:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:48.483 02:25:16 -- scripts/common.sh@365 -- # decimal 2 00:22:48.483 02:25:16 -- scripts/common.sh@352 -- # local d=2 00:22:48.483 02:25:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:48.483 02:25:16 -- scripts/common.sh@354 -- # echo 2 00:22:48.483 02:25:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:48.483 02:25:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:48.483 02:25:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:48.483 02:25:16 -- scripts/common.sh@367 -- # return 0 00:22:48.483 02:25:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:48.483 02:25:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:48.483 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:48.483 --rc genhtml_branch_coverage=1 00:22:48.483 --rc genhtml_function_coverage=1 00:22:48.483 --rc genhtml_legend=1 00:22:48.483 --rc geninfo_all_blocks=1 00:22:48.483 --rc geninfo_unexecuted_blocks=1 00:22:48.483 00:22:48.483 ' 00:22:48.483 02:25:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:48.483 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:48.483 --rc genhtml_branch_coverage=1 00:22:48.483 --rc genhtml_function_coverage=1 00:22:48.483 --rc genhtml_legend=1 00:22:48.483 --rc geninfo_all_blocks=1 00:22:48.483 --rc geninfo_unexecuted_blocks=1 00:22:48.483 00:22:48.483 ' 00:22:48.483 02:25:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:48.483 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:48.483 --rc genhtml_branch_coverage=1 00:22:48.483 --rc genhtml_function_coverage=1 00:22:48.483 --rc genhtml_legend=1 00:22:48.484 --rc geninfo_all_blocks=1 00:22:48.484 --rc geninfo_unexecuted_blocks=1 00:22:48.484 00:22:48.484 ' 00:22:48.484 02:25:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:48.484 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:48.484 --rc genhtml_branch_coverage=1 00:22:48.484 --rc genhtml_function_coverage=1 00:22:48.484 --rc genhtml_legend=1 00:22:48.484 --rc geninfo_all_blocks=1 00:22:48.484 --rc geninfo_unexecuted_blocks=1 00:22:48.484 00:22:48.484 ' 00:22:48.484 02:25:16 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:48.484 02:25:16 -- nvmf/common.sh@7 -- # uname -s 00:22:48.484 02:25:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:48.484 02:25:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:48.484 02:25:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:48.484 02:25:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:48.484 02:25:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:48.484 02:25:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:48.484 02:25:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:48.484 02:25:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:48.484 02:25:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:48.484 02:25:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:48.484 02:25:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:48.484 02:25:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:48.484 02:25:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:48.484 02:25:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:48.484 02:25:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:48.484 02:25:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:48.484 02:25:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:48.484 02:25:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:48.484 02:25:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:48.484 02:25:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:48.484 02:25:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:48.484 02:25:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:48.484 02:25:16 -- paths/export.sh@5 -- # export PATH 00:22:48.484 02:25:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:48.484 02:25:16 -- nvmf/common.sh@46 -- # : 0 00:22:48.484 02:25:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:48.484 02:25:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:48.484 02:25:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:48.484 02:25:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:48.484 02:25:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:48.484 02:25:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:48.484 02:25:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:48.484 02:25:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:48.484 02:25:16 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:22:48.484 02:25:16 -- host/dma.sh@13 -- # exit 0 00:22:48.484 00:22:48.484 real 0m0.163s 00:22:48.484 user 0m0.112s 00:22:48.484 sys 0m0.061s 00:22:48.484 02:25:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:48.484 02:25:16 -- common/autotest_common.sh@10 -- # set +x 00:22:48.484 ************************************ 00:22:48.484 END TEST dma 00:22:48.484 ************************************ 00:22:48.484 02:25:16 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:22:48.484 02:25:16 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:48.484 02:25:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:48.484 02:25:16 -- common/autotest_common.sh@10 -- # set +x 00:22:48.484 ************************************ 00:22:48.484 START TEST nvmf_identify 00:22:48.484 ************************************ 00:22:48.484 02:25:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:22:48.743 * Looking for test storage... 00:22:48.743 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:48.743 02:25:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:48.743 02:25:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:48.743 02:25:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:48.743 02:25:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:48.743 02:25:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:48.743 02:25:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:48.743 02:25:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:48.743 02:25:16 -- scripts/common.sh@335 -- # IFS=.-: 00:22:48.743 02:25:16 -- scripts/common.sh@335 -- # read -ra ver1 00:22:48.743 02:25:16 -- scripts/common.sh@336 -- # IFS=.-: 00:22:48.743 02:25:16 -- scripts/common.sh@336 -- # read -ra ver2 00:22:48.743 02:25:16 -- scripts/common.sh@337 -- # local 'op=<' 00:22:48.743 02:25:16 -- scripts/common.sh@339 -- # ver1_l=2 00:22:48.743 02:25:16 -- scripts/common.sh@340 -- # ver2_l=1 00:22:48.743 02:25:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:48.743 02:25:16 -- scripts/common.sh@343 -- # case "$op" in 00:22:48.743 02:25:16 -- scripts/common.sh@344 -- # : 1 00:22:48.743 02:25:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:48.743 02:25:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:48.743 02:25:16 -- scripts/common.sh@364 -- # decimal 1 00:22:48.743 02:25:16 -- scripts/common.sh@352 -- # local d=1 00:22:48.743 02:25:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:48.743 02:25:16 -- scripts/common.sh@354 -- # echo 1 00:22:48.743 02:25:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:48.743 02:25:16 -- scripts/common.sh@365 -- # decimal 2 00:22:48.743 02:25:16 -- scripts/common.sh@352 -- # local d=2 00:22:48.743 02:25:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:48.743 02:25:16 -- scripts/common.sh@354 -- # echo 2 00:22:48.743 02:25:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:48.743 02:25:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:48.743 02:25:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:48.743 02:25:16 -- scripts/common.sh@367 -- # return 0 00:22:48.743 02:25:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:48.743 02:25:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:48.743 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:48.743 --rc genhtml_branch_coverage=1 00:22:48.743 --rc genhtml_function_coverage=1 00:22:48.743 --rc genhtml_legend=1 00:22:48.743 --rc geninfo_all_blocks=1 00:22:48.743 --rc geninfo_unexecuted_blocks=1 00:22:48.743 00:22:48.743 ' 00:22:48.743 02:25:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:48.743 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:48.743 --rc genhtml_branch_coverage=1 00:22:48.743 --rc genhtml_function_coverage=1 00:22:48.743 --rc genhtml_legend=1 00:22:48.743 --rc geninfo_all_blocks=1 00:22:48.743 --rc geninfo_unexecuted_blocks=1 00:22:48.743 00:22:48.743 ' 00:22:48.743 02:25:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:48.743 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:48.743 --rc genhtml_branch_coverage=1 00:22:48.743 --rc genhtml_function_coverage=1 00:22:48.743 --rc genhtml_legend=1 00:22:48.743 --rc geninfo_all_blocks=1 00:22:48.743 --rc geninfo_unexecuted_blocks=1 00:22:48.743 00:22:48.743 ' 00:22:48.743 02:25:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:48.743 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:48.743 --rc genhtml_branch_coverage=1 00:22:48.743 --rc genhtml_function_coverage=1 00:22:48.743 --rc genhtml_legend=1 00:22:48.743 --rc geninfo_all_blocks=1 00:22:48.743 --rc geninfo_unexecuted_blocks=1 00:22:48.743 00:22:48.743 ' 00:22:48.743 02:25:16 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:48.743 02:25:16 -- nvmf/common.sh@7 -- # uname -s 00:22:48.743 02:25:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:48.743 02:25:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:48.743 02:25:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:48.743 02:25:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:48.743 02:25:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:48.743 02:25:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:48.743 02:25:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:48.743 02:25:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:48.743 02:25:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:48.743 02:25:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:48.743 02:25:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:48.743 02:25:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:48.743 02:25:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:48.743 02:25:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:48.743 02:25:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:48.743 02:25:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:48.743 02:25:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:48.743 02:25:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:48.743 02:25:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:48.743 02:25:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:48.743 02:25:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:48.743 02:25:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:48.743 02:25:16 -- paths/export.sh@5 -- # export PATH 00:22:48.744 02:25:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:48.744 02:25:16 -- nvmf/common.sh@46 -- # : 0 00:22:48.744 02:25:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:48.744 02:25:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:48.744 02:25:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:48.744 02:25:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:48.744 02:25:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:48.744 02:25:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:48.744 02:25:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:48.744 02:25:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:48.744 02:25:16 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:48.744 02:25:16 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:48.744 02:25:16 -- host/identify.sh@14 -- # nvmftestinit 00:22:48.744 02:25:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:48.744 02:25:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:48.744 02:25:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:48.744 02:25:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:48.744 02:25:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:48.744 02:25:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:48.744 02:25:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:48.744 02:25:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:48.744 02:25:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:48.744 02:25:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:48.744 02:25:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:48.744 02:25:16 -- common/autotest_common.sh@10 -- # set +x 00:22:50.652 02:25:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:50.652 02:25:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:50.652 02:25:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:50.652 02:25:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:50.652 02:25:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:50.652 02:25:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:50.652 02:25:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:50.652 02:25:18 -- nvmf/common.sh@294 -- # net_devs=() 00:22:50.652 02:25:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:50.652 02:25:18 -- nvmf/common.sh@295 -- # e810=() 00:22:50.652 02:25:18 -- nvmf/common.sh@295 -- # local -ga e810 00:22:50.652 02:25:18 -- nvmf/common.sh@296 -- # x722=() 00:22:50.652 02:25:18 -- nvmf/common.sh@296 -- # local -ga x722 00:22:50.652 02:25:18 -- nvmf/common.sh@297 -- # mlx=() 00:22:50.652 02:25:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:50.652 02:25:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:50.652 02:25:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:50.652 02:25:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:50.652 02:25:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:50.652 02:25:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:50.652 02:25:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:50.652 02:25:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:50.652 02:25:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:50.652 02:25:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:50.652 02:25:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:50.652 02:25:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:50.652 02:25:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:50.652 02:25:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:50.652 02:25:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:50.652 02:25:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:50.652 02:25:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:50.652 02:25:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:50.652 02:25:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:50.652 02:25:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:50.652 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:50.652 02:25:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:50.652 02:25:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:50.652 02:25:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:50.652 02:25:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:50.652 02:25:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:50.652 02:25:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:50.652 02:25:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:50.652 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:50.652 02:25:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:50.652 02:25:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:50.652 02:25:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:50.652 02:25:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:50.652 02:25:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:50.652 02:25:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:50.652 02:25:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:50.652 02:25:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:50.652 02:25:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:50.652 02:25:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:50.652 02:25:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:50.652 02:25:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:50.652 02:25:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:50.652 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:50.652 02:25:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:50.652 02:25:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:50.652 02:25:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:50.652 02:25:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:50.652 02:25:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:50.652 02:25:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:50.652 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:50.652 02:25:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:50.652 02:25:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:50.652 02:25:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:50.652 02:25:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:50.652 02:25:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:50.652 02:25:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:50.652 02:25:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:50.652 02:25:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:50.652 02:25:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:50.652 02:25:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:50.652 02:25:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:50.652 02:25:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:50.652 02:25:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:50.652 02:25:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:50.652 02:25:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:50.652 02:25:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:50.652 02:25:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:50.652 02:25:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:50.652 02:25:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:50.652 02:25:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:50.652 02:25:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:50.652 02:25:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:50.652 02:25:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:50.652 02:25:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:50.653 02:25:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:50.653 02:25:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:50.653 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:50.653 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.227 ms 00:22:50.653 00:22:50.653 --- 10.0.0.2 ping statistics --- 00:22:50.653 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:50.653 rtt min/avg/max/mdev = 0.227/0.227/0.227/0.000 ms 00:22:50.653 02:25:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:50.653 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:50.653 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:22:50.653 00:22:50.653 --- 10.0.0.1 ping statistics --- 00:22:50.653 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:50.653 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:22:50.653 02:25:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:50.653 02:25:18 -- nvmf/common.sh@410 -- # return 0 00:22:50.653 02:25:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:50.653 02:25:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:50.653 02:25:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:50.653 02:25:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:50.653 02:25:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:50.653 02:25:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:50.653 02:25:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:50.911 02:25:18 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:22:50.911 02:25:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:50.911 02:25:18 -- common/autotest_common.sh@10 -- # set +x 00:22:50.911 02:25:18 -- host/identify.sh@19 -- # nvmfpid=2184744 00:22:50.912 02:25:18 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:50.912 02:25:18 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:50.912 02:25:18 -- host/identify.sh@23 -- # waitforlisten 2184744 00:22:50.912 02:25:18 -- common/autotest_common.sh@829 -- # '[' -z 2184744 ']' 00:22:50.912 02:25:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:50.912 02:25:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:50.912 02:25:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:50.912 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:50.912 02:25:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:50.912 02:25:18 -- common/autotest_common.sh@10 -- # set +x 00:22:50.912 [2024-12-08 02:25:18.494098] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:50.912 [2024-12-08 02:25:18.494177] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:50.912 EAL: No free 2048 kB hugepages reported on node 1 00:22:50.912 [2024-12-08 02:25:18.562678] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:50.912 [2024-12-08 02:25:18.677262] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:50.912 [2024-12-08 02:25:18.677418] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:50.912 [2024-12-08 02:25:18.677451] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:50.912 [2024-12-08 02:25:18.677463] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:50.912 [2024-12-08 02:25:18.677516] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:50.912 [2024-12-08 02:25:18.680558] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:50.912 [2024-12-08 02:25:18.680635] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:50.912 [2024-12-08 02:25:18.680640] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:51.852 02:25:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:51.852 02:25:19 -- common/autotest_common.sh@862 -- # return 0 00:22:51.852 02:25:19 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:51.852 02:25:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.852 02:25:19 -- common/autotest_common.sh@10 -- # set +x 00:22:51.852 [2024-12-08 02:25:19.464044] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:51.852 02:25:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:51.852 02:25:19 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:22:51.852 02:25:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:51.852 02:25:19 -- common/autotest_common.sh@10 -- # set +x 00:22:51.852 02:25:19 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:51.852 02:25:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.852 02:25:19 -- common/autotest_common.sh@10 -- # set +x 00:22:51.852 Malloc0 00:22:51.852 02:25:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:51.852 02:25:19 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:51.852 02:25:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.852 02:25:19 -- common/autotest_common.sh@10 -- # set +x 00:22:51.852 02:25:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:51.852 02:25:19 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:22:51.852 02:25:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.852 02:25:19 -- common/autotest_common.sh@10 -- # set +x 00:22:51.852 02:25:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:51.852 02:25:19 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:51.852 02:25:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.852 02:25:19 -- common/autotest_common.sh@10 -- # set +x 00:22:51.852 [2024-12-08 02:25:19.541267] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:51.852 02:25:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:51.852 02:25:19 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:22:51.852 02:25:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.852 02:25:19 -- common/autotest_common.sh@10 -- # set +x 00:22:51.852 02:25:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:51.852 02:25:19 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:22:51.852 02:25:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.852 02:25:19 -- common/autotest_common.sh@10 -- # set +x 00:22:51.852 [2024-12-08 02:25:19.557022] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:22:51.852 [ 00:22:51.852 { 00:22:51.852 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:22:51.852 "subtype": "Discovery", 00:22:51.852 "listen_addresses": [ 00:22:51.852 { 00:22:51.852 "transport": "TCP", 00:22:51.852 "trtype": "TCP", 00:22:51.852 "adrfam": "IPv4", 00:22:51.852 "traddr": "10.0.0.2", 00:22:51.852 "trsvcid": "4420" 00:22:51.852 } 00:22:51.852 ], 00:22:51.852 "allow_any_host": true, 00:22:51.852 "hosts": [] 00:22:51.852 }, 00:22:51.852 { 00:22:51.852 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:22:51.852 "subtype": "NVMe", 00:22:51.852 "listen_addresses": [ 00:22:51.852 { 00:22:51.852 "transport": "TCP", 00:22:51.852 "trtype": "TCP", 00:22:51.852 "adrfam": "IPv4", 00:22:51.852 "traddr": "10.0.0.2", 00:22:51.852 "trsvcid": "4420" 00:22:51.852 } 00:22:51.852 ], 00:22:51.852 "allow_any_host": true, 00:22:51.852 "hosts": [], 00:22:51.852 "serial_number": "SPDK00000000000001", 00:22:51.852 "model_number": "SPDK bdev Controller", 00:22:51.852 "max_namespaces": 32, 00:22:51.852 "min_cntlid": 1, 00:22:51.852 "max_cntlid": 65519, 00:22:51.852 "namespaces": [ 00:22:51.852 { 00:22:51.852 "nsid": 1, 00:22:51.852 "bdev_name": "Malloc0", 00:22:51.852 "name": "Malloc0", 00:22:51.852 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:22:51.852 "eui64": "ABCDEF0123456789", 00:22:51.852 "uuid": "2324ed10-ef26-4c0f-a163-4ee6c76ee40f" 00:22:51.852 } 00:22:51.852 ] 00:22:51.852 } 00:22:51.852 ] 00:22:51.852 02:25:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:51.852 02:25:19 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:22:51.853 [2024-12-08 02:25:19.582628] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:51.853 [2024-12-08 02:25:19.582672] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2184903 ] 00:22:51.853 EAL: No free 2048 kB hugepages reported on node 1 00:22:51.853 [2024-12-08 02:25:19.618901] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:22:51.853 [2024-12-08 02:25:19.618961] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:22:51.853 [2024-12-08 02:25:19.618971] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:22:51.853 [2024-12-08 02:25:19.618987] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:22:51.853 [2024-12-08 02:25:19.619000] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:22:51.853 [2024-12-08 02:25:19.619283] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:22:51.853 [2024-12-08 02:25:19.619346] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x8a2e10 0 00:22:51.853 [2024-12-08 02:25:19.625555] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:22:51.853 [2024-12-08 02:25:19.625576] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:22:51.853 [2024-12-08 02:25:19.625585] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:22:51.853 [2024-12-08 02:25:19.625591] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:22:51.853 [2024-12-08 02:25:19.625644] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:51.853 [2024-12-08 02:25:19.625657] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:51.853 [2024-12-08 02:25:19.625664] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x8a2e10) 00:22:51.853 [2024-12-08 02:25:19.625683] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:22:51.853 [2024-12-08 02:25:19.625710] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x922b30, cid 0, qid 0 00:22:52.117 [2024-12-08 02:25:19.633565] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.117 [2024-12-08 02:25:19.633584] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.117 [2024-12-08 02:25:19.633591] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.117 [2024-12-08 02:25:19.633598] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x922b30) on tqpair=0x8a2e10 00:22:52.117 [2024-12-08 02:25:19.633613] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:22:52.117 [2024-12-08 02:25:19.633639] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:22:52.117 [2024-12-08 02:25:19.633649] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:22:52.117 [2024-12-08 02:25:19.633667] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.117 [2024-12-08 02:25:19.633676] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.117 [2024-12-08 02:25:19.633686] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x8a2e10) 00:22:52.117 [2024-12-08 02:25:19.633698] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.117 [2024-12-08 02:25:19.633722] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x922b30, cid 0, qid 0 00:22:52.117 [2024-12-08 02:25:19.633856] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.117 [2024-12-08 02:25:19.633871] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.117 [2024-12-08 02:25:19.633878] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.117 [2024-12-08 02:25:19.633884] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x922b30) on tqpair=0x8a2e10 00:22:52.117 [2024-12-08 02:25:19.633893] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:22:52.117 [2024-12-08 02:25:19.633905] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:22:52.117 [2024-12-08 02:25:19.633917] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.117 [2024-12-08 02:25:19.633925] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.117 [2024-12-08 02:25:19.633931] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x8a2e10) 00:22:52.117 [2024-12-08 02:25:19.633941] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.117 [2024-12-08 02:25:19.633962] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x922b30, cid 0, qid 0 00:22:52.117 [2024-12-08 02:25:19.634055] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.117 [2024-12-08 02:25:19.634069] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.117 [2024-12-08 02:25:19.634075] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.117 [2024-12-08 02:25:19.634082] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x922b30) on tqpair=0x8a2e10 00:22:52.117 [2024-12-08 02:25:19.634090] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:22:52.117 [2024-12-08 02:25:19.634104] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:22:52.117 [2024-12-08 02:25:19.634116] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.117 [2024-12-08 02:25:19.634123] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.117 [2024-12-08 02:25:19.634129] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x8a2e10) 00:22:52.117 [2024-12-08 02:25:19.634139] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.117 [2024-12-08 02:25:19.634159] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x922b30, cid 0, qid 0 00:22:52.117 [2024-12-08 02:25:19.634241] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.117 [2024-12-08 02:25:19.634255] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.117 [2024-12-08 02:25:19.634262] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.117 [2024-12-08 02:25:19.634268] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x922b30) on tqpair=0x8a2e10 00:22:52.117 [2024-12-08 02:25:19.634277] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:22:52.117 [2024-12-08 02:25:19.634293] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.117 [2024-12-08 02:25:19.634301] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.117 [2024-12-08 02:25:19.634307] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x8a2e10) 00:22:52.117 [2024-12-08 02:25:19.634318] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.117 [2024-12-08 02:25:19.634343] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x922b30, cid 0, qid 0 00:22:52.117 [2024-12-08 02:25:19.634423] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.117 [2024-12-08 02:25:19.634437] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.117 [2024-12-08 02:25:19.634443] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.117 [2024-12-08 02:25:19.634450] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x922b30) on tqpair=0x8a2e10 00:22:52.117 [2024-12-08 02:25:19.634458] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:22:52.117 [2024-12-08 02:25:19.634466] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:22:52.118 [2024-12-08 02:25:19.634479] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:22:52.118 [2024-12-08 02:25:19.634589] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:22:52.118 [2024-12-08 02:25:19.634600] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:22:52.118 [2024-12-08 02:25:19.634615] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.118 [2024-12-08 02:25:19.634622] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.118 [2024-12-08 02:25:19.634628] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x8a2e10) 00:22:52.118 [2024-12-08 02:25:19.634638] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.118 [2024-12-08 02:25:19.634659] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x922b30, cid 0, qid 0 00:22:52.118 [2024-12-08 02:25:19.634795] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.118 [2024-12-08 02:25:19.634807] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.118 [2024-12-08 02:25:19.634814] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.118 [2024-12-08 02:25:19.634820] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x922b30) on tqpair=0x8a2e10 00:22:52.118 [2024-12-08 02:25:19.634828] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:22:52.118 [2024-12-08 02:25:19.634843] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.118 [2024-12-08 02:25:19.634852] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.118 [2024-12-08 02:25:19.634858] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x8a2e10) 00:22:52.118 [2024-12-08 02:25:19.634868] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.118 [2024-12-08 02:25:19.634888] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x922b30, cid 0, qid 0 00:22:52.118 [2024-12-08 02:25:19.634965] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.118 [2024-12-08 02:25:19.634977] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.118 [2024-12-08 02:25:19.634983] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.118 [2024-12-08 02:25:19.634989] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x922b30) on tqpair=0x8a2e10 00:22:52.118 [2024-12-08 02:25:19.634997] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:22:52.118 [2024-12-08 02:25:19.635005] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:22:52.118 [2024-12-08 02:25:19.635017] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:22:52.118 [2024-12-08 02:25:19.635040] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:22:52.118 [2024-12-08 02:25:19.635056] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.118 [2024-12-08 02:25:19.635064] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.118 [2024-12-08 02:25:19.635070] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x8a2e10) 00:22:52.118 [2024-12-08 02:25:19.635081] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.118 [2024-12-08 02:25:19.635102] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x922b30, cid 0, qid 0 00:22:52.118 [2024-12-08 02:25:19.635217] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:52.118 [2024-12-08 02:25:19.635232] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:52.118 [2024-12-08 02:25:19.635238] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:52.118 [2024-12-08 02:25:19.635245] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x8a2e10): datao=0, datal=4096, cccid=0 00:22:52.118 [2024-12-08 02:25:19.635253] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x922b30) on tqpair(0x8a2e10): expected_datao=0, payload_size=4096 00:22:52.118 [2024-12-08 02:25:19.635271] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:52.118 [2024-12-08 02:25:19.635281] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:52.118 [2024-12-08 02:25:19.635303] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.118 [2024-12-08 02:25:19.635314] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.118 [2024-12-08 02:25:19.635321] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.118 [2024-12-08 02:25:19.635327] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x922b30) on tqpair=0x8a2e10 00:22:52.118 [2024-12-08 02:25:19.635339] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:22:52.118 [2024-12-08 02:25:19.635348] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:22:52.118 [2024-12-08 02:25:19.635355] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:22:52.118 [2024-12-08 02:25:19.635363] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:22:52.118 [2024-12-08 02:25:19.635370] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:22:52.118 [2024-12-08 02:25:19.635378] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:22:52.118 [2024-12-08 02:25:19.635397] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:22:52.118 [2024-12-08 02:25:19.635410] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.118 [2024-12-08 02:25:19.635418] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.118 [2024-12-08 02:25:19.635424] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x8a2e10) 00:22:52.118 [2024-12-08 02:25:19.635435] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:22:52.118 [2024-12-08 02:25:19.635456] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x922b30, cid 0, qid 0 00:22:52.118 [2024-12-08 02:25:19.635553] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.118 [2024-12-08 02:25:19.635568] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.118 [2024-12-08 02:25:19.635575] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.118 [2024-12-08 02:25:19.635581] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x922b30) on tqpair=0x8a2e10 00:22:52.118 [2024-12-08 02:25:19.635597] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.118 [2024-12-08 02:25:19.635605] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.118 [2024-12-08 02:25:19.635612] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x8a2e10) 00:22:52.118 [2024-12-08 02:25:19.635621] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:52.118 [2024-12-08 02:25:19.635631] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.118 [2024-12-08 02:25:19.635638] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.118 [2024-12-08 02:25:19.635644] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x8a2e10) 00:22:52.118 [2024-12-08 02:25:19.635652] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:52.118 [2024-12-08 02:25:19.635662] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.118 [2024-12-08 02:25:19.635668] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.118 [2024-12-08 02:25:19.635674] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x8a2e10) 00:22:52.118 [2024-12-08 02:25:19.635683] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:52.118 [2024-12-08 02:25:19.635692] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.118 [2024-12-08 02:25:19.635699] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.118 [2024-12-08 02:25:19.635705] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8a2e10) 00:22:52.119 [2024-12-08 02:25:19.635713] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:52.119 [2024-12-08 02:25:19.635722] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:22:52.119 [2024-12-08 02:25:19.635740] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:22:52.119 [2024-12-08 02:25:19.635753] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.119 [2024-12-08 02:25:19.635760] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.119 [2024-12-08 02:25:19.635766] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x8a2e10) 00:22:52.119 [2024-12-08 02:25:19.635776] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.119 [2024-12-08 02:25:19.635799] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x922b30, cid 0, qid 0 00:22:52.119 [2024-12-08 02:25:19.635810] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x922c90, cid 1, qid 0 00:22:52.119 [2024-12-08 02:25:19.635817] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x922df0, cid 2, qid 0 00:22:52.119 [2024-12-08 02:25:19.635825] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x922f50, cid 3, qid 0 00:22:52.119 [2024-12-08 02:25:19.635832] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9230b0, cid 4, qid 0 00:22:52.119 [2024-12-08 02:25:19.636012] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.119 [2024-12-08 02:25:19.636026] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.119 [2024-12-08 02:25:19.636033] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.119 [2024-12-08 02:25:19.636039] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x9230b0) on tqpair=0x8a2e10 00:22:52.119 [2024-12-08 02:25:19.636048] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:22:52.119 [2024-12-08 02:25:19.636057] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:22:52.119 [2024-12-08 02:25:19.636078] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.119 [2024-12-08 02:25:19.636088] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.119 [2024-12-08 02:25:19.636094] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x8a2e10) 00:22:52.119 [2024-12-08 02:25:19.636105] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.119 [2024-12-08 02:25:19.636125] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9230b0, cid 4, qid 0 00:22:52.119 [2024-12-08 02:25:19.636255] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:52.119 [2024-12-08 02:25:19.636269] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:52.119 [2024-12-08 02:25:19.636276] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:52.119 [2024-12-08 02:25:19.636282] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x8a2e10): datao=0, datal=4096, cccid=4 00:22:52.119 [2024-12-08 02:25:19.636290] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x9230b0) on tqpair(0x8a2e10): expected_datao=0, payload_size=4096 00:22:52.119 [2024-12-08 02:25:19.636300] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:52.119 [2024-12-08 02:25:19.636308] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:52.119 [2024-12-08 02:25:19.636320] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.119 [2024-12-08 02:25:19.636329] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.119 [2024-12-08 02:25:19.636336] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.119 [2024-12-08 02:25:19.636342] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x9230b0) on tqpair=0x8a2e10 00:22:52.119 [2024-12-08 02:25:19.636360] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:22:52.119 [2024-12-08 02:25:19.636397] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.119 [2024-12-08 02:25:19.636408] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.119 [2024-12-08 02:25:19.636414] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x8a2e10) 00:22:52.119 [2024-12-08 02:25:19.636425] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.119 [2024-12-08 02:25:19.636436] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.119 [2024-12-08 02:25:19.636443] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.119 [2024-12-08 02:25:19.636449] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x8a2e10) 00:22:52.119 [2024-12-08 02:25:19.636457] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:22:52.119 [2024-12-08 02:25:19.636484] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9230b0, cid 4, qid 0 00:22:52.119 [2024-12-08 02:25:19.636496] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x923210, cid 5, qid 0 00:22:52.119 [2024-12-08 02:25:19.636620] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:52.119 [2024-12-08 02:25:19.636634] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:52.119 [2024-12-08 02:25:19.636641] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:52.119 [2024-12-08 02:25:19.636647] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x8a2e10): datao=0, datal=1024, cccid=4 00:22:52.119 [2024-12-08 02:25:19.636655] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x9230b0) on tqpair(0x8a2e10): expected_datao=0, payload_size=1024 00:22:52.119 [2024-12-08 02:25:19.636665] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:52.119 [2024-12-08 02:25:19.636673] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:52.119 [2024-12-08 02:25:19.636681] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.119 [2024-12-08 02:25:19.636690] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.119 [2024-12-08 02:25:19.636700] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.119 [2024-12-08 02:25:19.636707] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x923210) on tqpair=0x8a2e10 00:22:52.119 [2024-12-08 02:25:19.681550] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.119 [2024-12-08 02:25:19.681569] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.119 [2024-12-08 02:25:19.681576] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.119 [2024-12-08 02:25:19.681583] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x9230b0) on tqpair=0x8a2e10 00:22:52.119 [2024-12-08 02:25:19.681601] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.119 [2024-12-08 02:25:19.681610] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.119 [2024-12-08 02:25:19.681617] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x8a2e10) 00:22:52.119 [2024-12-08 02:25:19.681627] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.119 [2024-12-08 02:25:19.681673] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9230b0, cid 4, qid 0 00:22:52.119 [2024-12-08 02:25:19.681805] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:52.119 [2024-12-08 02:25:19.681820] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:52.119 [2024-12-08 02:25:19.681827] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:52.119 [2024-12-08 02:25:19.681833] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x8a2e10): datao=0, datal=3072, cccid=4 00:22:52.119 [2024-12-08 02:25:19.681840] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x9230b0) on tqpair(0x8a2e10): expected_datao=0, payload_size=3072 00:22:52.119 [2024-12-08 02:25:19.681866] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:52.119 [2024-12-08 02:25:19.681875] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:52.119 [2024-12-08 02:25:19.681956] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.119 [2024-12-08 02:25:19.681968] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.119 [2024-12-08 02:25:19.681974] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.119 [2024-12-08 02:25:19.681981] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x9230b0) on tqpair=0x8a2e10 00:22:52.119 [2024-12-08 02:25:19.681996] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.119 [2024-12-08 02:25:19.682004] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.119 [2024-12-08 02:25:19.682010] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x8a2e10) 00:22:52.120 [2024-12-08 02:25:19.682021] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.120 [2024-12-08 02:25:19.682048] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9230b0, cid 4, qid 0 00:22:52.120 [2024-12-08 02:25:19.682148] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:52.120 [2024-12-08 02:25:19.682161] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:52.120 [2024-12-08 02:25:19.682168] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:52.120 [2024-12-08 02:25:19.682174] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x8a2e10): datao=0, datal=8, cccid=4 00:22:52.120 [2024-12-08 02:25:19.682181] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x9230b0) on tqpair(0x8a2e10): expected_datao=0, payload_size=8 00:22:52.120 [2024-12-08 02:25:19.682192] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:52.120 [2024-12-08 02:25:19.682199] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:52.120 [2024-12-08 02:25:19.722696] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.120 [2024-12-08 02:25:19.722715] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.120 [2024-12-08 02:25:19.722723] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.120 [2024-12-08 02:25:19.722734] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x9230b0) on tqpair=0x8a2e10 00:22:52.120 ===================================================== 00:22:52.120 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:22:52.120 ===================================================== 00:22:52.120 Controller Capabilities/Features 00:22:52.120 ================================ 00:22:52.120 Vendor ID: 0000 00:22:52.120 Subsystem Vendor ID: 0000 00:22:52.120 Serial Number: .................... 00:22:52.120 Model Number: ........................................ 00:22:52.120 Firmware Version: 24.01.1 00:22:52.120 Recommended Arb Burst: 0 00:22:52.120 IEEE OUI Identifier: 00 00 00 00:22:52.120 Multi-path I/O 00:22:52.120 May have multiple subsystem ports: No 00:22:52.120 May have multiple controllers: No 00:22:52.120 Associated with SR-IOV VF: No 00:22:52.120 Max Data Transfer Size: 131072 00:22:52.120 Max Number of Namespaces: 0 00:22:52.120 Max Number of I/O Queues: 1024 00:22:52.120 NVMe Specification Version (VS): 1.3 00:22:52.120 NVMe Specification Version (Identify): 1.3 00:22:52.120 Maximum Queue Entries: 128 00:22:52.120 Contiguous Queues Required: Yes 00:22:52.120 Arbitration Mechanisms Supported 00:22:52.120 Weighted Round Robin: Not Supported 00:22:52.120 Vendor Specific: Not Supported 00:22:52.120 Reset Timeout: 15000 ms 00:22:52.120 Doorbell Stride: 4 bytes 00:22:52.120 NVM Subsystem Reset: Not Supported 00:22:52.120 Command Sets Supported 00:22:52.120 NVM Command Set: Supported 00:22:52.120 Boot Partition: Not Supported 00:22:52.120 Memory Page Size Minimum: 4096 bytes 00:22:52.120 Memory Page Size Maximum: 4096 bytes 00:22:52.120 Persistent Memory Region: Not Supported 00:22:52.120 Optional Asynchronous Events Supported 00:22:52.120 Namespace Attribute Notices: Not Supported 00:22:52.120 Firmware Activation Notices: Not Supported 00:22:52.120 ANA Change Notices: Not Supported 00:22:52.120 PLE Aggregate Log Change Notices: Not Supported 00:22:52.120 LBA Status Info Alert Notices: Not Supported 00:22:52.120 EGE Aggregate Log Change Notices: Not Supported 00:22:52.120 Normal NVM Subsystem Shutdown event: Not Supported 00:22:52.120 Zone Descriptor Change Notices: Not Supported 00:22:52.120 Discovery Log Change Notices: Supported 00:22:52.120 Controller Attributes 00:22:52.120 128-bit Host Identifier: Not Supported 00:22:52.120 Non-Operational Permissive Mode: Not Supported 00:22:52.120 NVM Sets: Not Supported 00:22:52.120 Read Recovery Levels: Not Supported 00:22:52.120 Endurance Groups: Not Supported 00:22:52.120 Predictable Latency Mode: Not Supported 00:22:52.120 Traffic Based Keep ALive: Not Supported 00:22:52.120 Namespace Granularity: Not Supported 00:22:52.120 SQ Associations: Not Supported 00:22:52.120 UUID List: Not Supported 00:22:52.120 Multi-Domain Subsystem: Not Supported 00:22:52.120 Fixed Capacity Management: Not Supported 00:22:52.120 Variable Capacity Management: Not Supported 00:22:52.120 Delete Endurance Group: Not Supported 00:22:52.120 Delete NVM Set: Not Supported 00:22:52.120 Extended LBA Formats Supported: Not Supported 00:22:52.120 Flexible Data Placement Supported: Not Supported 00:22:52.120 00:22:52.120 Controller Memory Buffer Support 00:22:52.120 ================================ 00:22:52.120 Supported: No 00:22:52.120 00:22:52.120 Persistent Memory Region Support 00:22:52.120 ================================ 00:22:52.120 Supported: No 00:22:52.120 00:22:52.120 Admin Command Set Attributes 00:22:52.120 ============================ 00:22:52.120 Security Send/Receive: Not Supported 00:22:52.120 Format NVM: Not Supported 00:22:52.120 Firmware Activate/Download: Not Supported 00:22:52.120 Namespace Management: Not Supported 00:22:52.120 Device Self-Test: Not Supported 00:22:52.120 Directives: Not Supported 00:22:52.120 NVMe-MI: Not Supported 00:22:52.120 Virtualization Management: Not Supported 00:22:52.120 Doorbell Buffer Config: Not Supported 00:22:52.120 Get LBA Status Capability: Not Supported 00:22:52.120 Command & Feature Lockdown Capability: Not Supported 00:22:52.120 Abort Command Limit: 1 00:22:52.120 Async Event Request Limit: 4 00:22:52.120 Number of Firmware Slots: N/A 00:22:52.120 Firmware Slot 1 Read-Only: N/A 00:22:52.120 Firmware Activation Without Reset: N/A 00:22:52.120 Multiple Update Detection Support: N/A 00:22:52.120 Firmware Update Granularity: No Information Provided 00:22:52.120 Per-Namespace SMART Log: No 00:22:52.120 Asymmetric Namespace Access Log Page: Not Supported 00:22:52.120 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:22:52.120 Command Effects Log Page: Not Supported 00:22:52.120 Get Log Page Extended Data: Supported 00:22:52.120 Telemetry Log Pages: Not Supported 00:22:52.120 Persistent Event Log Pages: Not Supported 00:22:52.120 Supported Log Pages Log Page: May Support 00:22:52.120 Commands Supported & Effects Log Page: Not Supported 00:22:52.120 Feature Identifiers & Effects Log Page:May Support 00:22:52.120 NVMe-MI Commands & Effects Log Page: May Support 00:22:52.120 Data Area 4 for Telemetry Log: Not Supported 00:22:52.120 Error Log Page Entries Supported: 128 00:22:52.120 Keep Alive: Not Supported 00:22:52.120 00:22:52.120 NVM Command Set Attributes 00:22:52.120 ========================== 00:22:52.120 Submission Queue Entry Size 00:22:52.120 Max: 1 00:22:52.120 Min: 1 00:22:52.120 Completion Queue Entry Size 00:22:52.121 Max: 1 00:22:52.121 Min: 1 00:22:52.121 Number of Namespaces: 0 00:22:52.121 Compare Command: Not Supported 00:22:52.121 Write Uncorrectable Command: Not Supported 00:22:52.121 Dataset Management Command: Not Supported 00:22:52.121 Write Zeroes Command: Not Supported 00:22:52.121 Set Features Save Field: Not Supported 00:22:52.121 Reservations: Not Supported 00:22:52.121 Timestamp: Not Supported 00:22:52.121 Copy: Not Supported 00:22:52.121 Volatile Write Cache: Not Present 00:22:52.121 Atomic Write Unit (Normal): 1 00:22:52.121 Atomic Write Unit (PFail): 1 00:22:52.121 Atomic Compare & Write Unit: 1 00:22:52.121 Fused Compare & Write: Supported 00:22:52.121 Scatter-Gather List 00:22:52.121 SGL Command Set: Supported 00:22:52.121 SGL Keyed: Supported 00:22:52.121 SGL Bit Bucket Descriptor: Not Supported 00:22:52.121 SGL Metadata Pointer: Not Supported 00:22:52.121 Oversized SGL: Not Supported 00:22:52.121 SGL Metadata Address: Not Supported 00:22:52.121 SGL Offset: Supported 00:22:52.121 Transport SGL Data Block: Not Supported 00:22:52.121 Replay Protected Memory Block: Not Supported 00:22:52.121 00:22:52.121 Firmware Slot Information 00:22:52.121 ========================= 00:22:52.121 Active slot: 0 00:22:52.121 00:22:52.121 00:22:52.121 Error Log 00:22:52.121 ========= 00:22:52.121 00:22:52.121 Active Namespaces 00:22:52.121 ================= 00:22:52.121 Discovery Log Page 00:22:52.121 ================== 00:22:52.121 Generation Counter: 2 00:22:52.121 Number of Records: 2 00:22:52.121 Record Format: 0 00:22:52.121 00:22:52.121 Discovery Log Entry 0 00:22:52.121 ---------------------- 00:22:52.121 Transport Type: 3 (TCP) 00:22:52.121 Address Family: 1 (IPv4) 00:22:52.121 Subsystem Type: 3 (Current Discovery Subsystem) 00:22:52.121 Entry Flags: 00:22:52.121 Duplicate Returned Information: 1 00:22:52.121 Explicit Persistent Connection Support for Discovery: 1 00:22:52.121 Transport Requirements: 00:22:52.121 Secure Channel: Not Required 00:22:52.121 Port ID: 0 (0x0000) 00:22:52.121 Controller ID: 65535 (0xffff) 00:22:52.121 Admin Max SQ Size: 128 00:22:52.121 Transport Service Identifier: 4420 00:22:52.121 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:22:52.121 Transport Address: 10.0.0.2 00:22:52.121 Discovery Log Entry 1 00:22:52.121 ---------------------- 00:22:52.121 Transport Type: 3 (TCP) 00:22:52.121 Address Family: 1 (IPv4) 00:22:52.121 Subsystem Type: 2 (NVM Subsystem) 00:22:52.121 Entry Flags: 00:22:52.121 Duplicate Returned Information: 0 00:22:52.121 Explicit Persistent Connection Support for Discovery: 0 00:22:52.121 Transport Requirements: 00:22:52.121 Secure Channel: Not Required 00:22:52.121 Port ID: 0 (0x0000) 00:22:52.121 Controller ID: 65535 (0xffff) 00:22:52.121 Admin Max SQ Size: 128 00:22:52.121 Transport Service Identifier: 4420 00:22:52.121 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:22:52.121 Transport Address: 10.0.0.2 [2024-12-08 02:25:19.722846] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:22:52.121 [2024-12-08 02:25:19.722872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:52.121 [2024-12-08 02:25:19.722884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:52.121 [2024-12-08 02:25:19.722893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:52.121 [2024-12-08 02:25:19.722903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:52.121 [2024-12-08 02:25:19.722915] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.121 [2024-12-08 02:25:19.722923] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.121 [2024-12-08 02:25:19.722929] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8a2e10) 00:22:52.121 [2024-12-08 02:25:19.722940] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.121 [2024-12-08 02:25:19.722965] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x922f50, cid 3, qid 0 00:22:52.121 [2024-12-08 02:25:19.723147] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.121 [2024-12-08 02:25:19.723159] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.121 [2024-12-08 02:25:19.723166] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.121 [2024-12-08 02:25:19.723172] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x922f50) on tqpair=0x8a2e10 00:22:52.121 [2024-12-08 02:25:19.723184] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.121 [2024-12-08 02:25:19.723191] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.121 [2024-12-08 02:25:19.723197] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8a2e10) 00:22:52.121 [2024-12-08 02:25:19.723208] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.121 [2024-12-08 02:25:19.723233] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x922f50, cid 3, qid 0 00:22:52.121 [2024-12-08 02:25:19.723382] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.121 [2024-12-08 02:25:19.723394] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.121 [2024-12-08 02:25:19.723401] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.121 [2024-12-08 02:25:19.723407] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x922f50) on tqpair=0x8a2e10 00:22:52.121 [2024-12-08 02:25:19.723416] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:22:52.121 [2024-12-08 02:25:19.723423] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:22:52.121 [2024-12-08 02:25:19.723438] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.121 [2024-12-08 02:25:19.723447] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.121 [2024-12-08 02:25:19.723453] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8a2e10) 00:22:52.121 [2024-12-08 02:25:19.723463] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.121 [2024-12-08 02:25:19.723484] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x922f50, cid 3, qid 0 00:22:52.121 [2024-12-08 02:25:19.727552] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.121 [2024-12-08 02:25:19.727569] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.121 [2024-12-08 02:25:19.727576] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.121 [2024-12-08 02:25:19.727586] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x922f50) on tqpair=0x8a2e10 00:22:52.122 [2024-12-08 02:25:19.727619] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.122 [2024-12-08 02:25:19.727629] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.122 [2024-12-08 02:25:19.727635] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8a2e10) 00:22:52.122 [2024-12-08 02:25:19.727646] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.122 [2024-12-08 02:25:19.727668] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x922f50, cid 3, qid 0 00:22:52.122 [2024-12-08 02:25:19.727804] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.122 [2024-12-08 02:25:19.727816] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.122 [2024-12-08 02:25:19.727823] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.122 [2024-12-08 02:25:19.727829] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x922f50) on tqpair=0x8a2e10 00:22:52.122 [2024-12-08 02:25:19.727842] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 4 milliseconds 00:22:52.122 00:22:52.122 02:25:19 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:22:52.122 [2024-12-08 02:25:19.761251] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:52.122 [2024-12-08 02:25:19.761293] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2184905 ] 00:22:52.122 EAL: No free 2048 kB hugepages reported on node 1 00:22:52.122 [2024-12-08 02:25:19.793372] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:22:52.122 [2024-12-08 02:25:19.793419] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:22:52.122 [2024-12-08 02:25:19.793428] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:22:52.122 [2024-12-08 02:25:19.793443] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:22:52.122 [2024-12-08 02:25:19.793455] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:22:52.122 [2024-12-08 02:25:19.796582] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:22:52.122 [2024-12-08 02:25:19.796626] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x61de10 0 00:22:52.122 [2024-12-08 02:25:19.804556] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:22:52.122 [2024-12-08 02:25:19.804576] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:22:52.122 [2024-12-08 02:25:19.804584] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:22:52.122 [2024-12-08 02:25:19.804590] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:22:52.122 [2024-12-08 02:25:19.804630] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.122 [2024-12-08 02:25:19.804643] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.122 [2024-12-08 02:25:19.804650] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x61de10) 00:22:52.122 [2024-12-08 02:25:19.804664] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:22:52.122 [2024-12-08 02:25:19.804691] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69db30, cid 0, qid 0 00:22:52.122 [2024-12-08 02:25:19.812566] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.122 [2024-12-08 02:25:19.812587] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.122 [2024-12-08 02:25:19.812596] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.122 [2024-12-08 02:25:19.812603] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69db30) on tqpair=0x61de10 00:22:52.122 [2024-12-08 02:25:19.812616] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:22:52.122 [2024-12-08 02:25:19.812641] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:22:52.122 [2024-12-08 02:25:19.812651] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:22:52.122 [2024-12-08 02:25:19.812667] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.122 [2024-12-08 02:25:19.812675] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.122 [2024-12-08 02:25:19.812682] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x61de10) 00:22:52.122 [2024-12-08 02:25:19.812693] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.122 [2024-12-08 02:25:19.812718] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69db30, cid 0, qid 0 00:22:52.122 [2024-12-08 02:25:19.812831] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.122 [2024-12-08 02:25:19.812846] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.122 [2024-12-08 02:25:19.812853] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.122 [2024-12-08 02:25:19.812860] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69db30) on tqpair=0x61de10 00:22:52.122 [2024-12-08 02:25:19.812868] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:22:52.122 [2024-12-08 02:25:19.812882] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:22:52.122 [2024-12-08 02:25:19.812894] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.122 [2024-12-08 02:25:19.812902] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.122 [2024-12-08 02:25:19.812908] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x61de10) 00:22:52.122 [2024-12-08 02:25:19.812919] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.122 [2024-12-08 02:25:19.812940] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69db30, cid 0, qid 0 00:22:52.122 [2024-12-08 02:25:19.813021] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.122 [2024-12-08 02:25:19.813034] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.122 [2024-12-08 02:25:19.813041] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.122 [2024-12-08 02:25:19.813047] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69db30) on tqpair=0x61de10 00:22:52.122 [2024-12-08 02:25:19.813056] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:22:52.122 [2024-12-08 02:25:19.813069] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:22:52.122 [2024-12-08 02:25:19.813081] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.122 [2024-12-08 02:25:19.813088] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.122 [2024-12-08 02:25:19.813094] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x61de10) 00:22:52.122 [2024-12-08 02:25:19.813105] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.122 [2024-12-08 02:25:19.813126] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69db30, cid 0, qid 0 00:22:52.122 [2024-12-08 02:25:19.813201] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.122 [2024-12-08 02:25:19.813213] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.122 [2024-12-08 02:25:19.813224] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.122 [2024-12-08 02:25:19.813231] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69db30) on tqpair=0x61de10 00:22:52.122 [2024-12-08 02:25:19.813240] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:22:52.122 [2024-12-08 02:25:19.813257] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.122 [2024-12-08 02:25:19.813266] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.122 [2024-12-08 02:25:19.813272] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x61de10) 00:22:52.122 [2024-12-08 02:25:19.813282] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.122 [2024-12-08 02:25:19.813304] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69db30, cid 0, qid 0 00:22:52.122 [2024-12-08 02:25:19.813378] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.122 [2024-12-08 02:25:19.813390] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.123 [2024-12-08 02:25:19.813397] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.123 [2024-12-08 02:25:19.813403] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69db30) on tqpair=0x61de10 00:22:52.123 [2024-12-08 02:25:19.813411] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:22:52.123 [2024-12-08 02:25:19.813419] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:22:52.123 [2024-12-08 02:25:19.813432] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:22:52.123 [2024-12-08 02:25:19.813543] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:22:52.123 [2024-12-08 02:25:19.813552] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:22:52.123 [2024-12-08 02:25:19.813564] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.123 [2024-12-08 02:25:19.813572] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.123 [2024-12-08 02:25:19.813578] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x61de10) 00:22:52.123 [2024-12-08 02:25:19.813589] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.123 [2024-12-08 02:25:19.813610] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69db30, cid 0, qid 0 00:22:52.123 [2024-12-08 02:25:19.813719] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.123 [2024-12-08 02:25:19.813732] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.123 [2024-12-08 02:25:19.813738] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.123 [2024-12-08 02:25:19.813745] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69db30) on tqpair=0x61de10 00:22:52.123 [2024-12-08 02:25:19.813753] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:22:52.123 [2024-12-08 02:25:19.813769] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.123 [2024-12-08 02:25:19.813778] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.123 [2024-12-08 02:25:19.813785] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x61de10) 00:22:52.123 [2024-12-08 02:25:19.813795] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.123 [2024-12-08 02:25:19.813816] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69db30, cid 0, qid 0 00:22:52.123 [2024-12-08 02:25:19.813894] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.123 [2024-12-08 02:25:19.813912] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.123 [2024-12-08 02:25:19.813920] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.123 [2024-12-08 02:25:19.813927] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69db30) on tqpair=0x61de10 00:22:52.123 [2024-12-08 02:25:19.813935] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:22:52.123 [2024-12-08 02:25:19.813943] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:22:52.123 [2024-12-08 02:25:19.813956] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:22:52.123 [2024-12-08 02:25:19.813971] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:22:52.123 [2024-12-08 02:25:19.813984] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.123 [2024-12-08 02:25:19.813992] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.123 [2024-12-08 02:25:19.813998] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x61de10) 00:22:52.123 [2024-12-08 02:25:19.814009] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.123 [2024-12-08 02:25:19.814031] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69db30, cid 0, qid 0 00:22:52.123 [2024-12-08 02:25:19.814159] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:52.123 [2024-12-08 02:25:19.814171] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:52.123 [2024-12-08 02:25:19.814178] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:52.123 [2024-12-08 02:25:19.814184] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x61de10): datao=0, datal=4096, cccid=0 00:22:52.123 [2024-12-08 02:25:19.814192] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x69db30) on tqpair(0x61de10): expected_datao=0, payload_size=4096 00:22:52.123 [2024-12-08 02:25:19.814210] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:52.123 [2024-12-08 02:25:19.814219] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:52.123 [2024-12-08 02:25:19.854629] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.123 [2024-12-08 02:25:19.854648] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.123 [2024-12-08 02:25:19.854656] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.123 [2024-12-08 02:25:19.854662] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69db30) on tqpair=0x61de10 00:22:52.123 [2024-12-08 02:25:19.854674] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:22:52.123 [2024-12-08 02:25:19.854683] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:22:52.123 [2024-12-08 02:25:19.854690] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:22:52.123 [2024-12-08 02:25:19.854697] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:22:52.123 [2024-12-08 02:25:19.854705] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:22:52.123 [2024-12-08 02:25:19.854713] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:22:52.123 [2024-12-08 02:25:19.854732] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:22:52.123 [2024-12-08 02:25:19.854746] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.123 [2024-12-08 02:25:19.854754] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.123 [2024-12-08 02:25:19.854760] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x61de10) 00:22:52.124 [2024-12-08 02:25:19.854775] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:22:52.124 [2024-12-08 02:25:19.854800] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69db30, cid 0, qid 0 00:22:52.124 [2024-12-08 02:25:19.854885] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.124 [2024-12-08 02:25:19.854900] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.124 [2024-12-08 02:25:19.854907] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.124 [2024-12-08 02:25:19.854913] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69db30) on tqpair=0x61de10 00:22:52.124 [2024-12-08 02:25:19.854924] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.124 [2024-12-08 02:25:19.854931] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.124 [2024-12-08 02:25:19.854938] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x61de10) 00:22:52.124 [2024-12-08 02:25:19.854948] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:52.124 [2024-12-08 02:25:19.854958] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.124 [2024-12-08 02:25:19.854965] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.124 [2024-12-08 02:25:19.854971] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x61de10) 00:22:52.124 [2024-12-08 02:25:19.854980] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:52.124 [2024-12-08 02:25:19.854990] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.124 [2024-12-08 02:25:19.854996] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.124 [2024-12-08 02:25:19.855003] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x61de10) 00:22:52.124 [2024-12-08 02:25:19.855011] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:52.124 [2024-12-08 02:25:19.855021] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.124 [2024-12-08 02:25:19.855028] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.124 [2024-12-08 02:25:19.855035] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x61de10) 00:22:52.124 [2024-12-08 02:25:19.855043] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:52.124 [2024-12-08 02:25:19.855052] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:22:52.124 [2024-12-08 02:25:19.855071] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:22:52.124 [2024-12-08 02:25:19.855100] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.124 [2024-12-08 02:25:19.855107] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.124 [2024-12-08 02:25:19.855113] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x61de10) 00:22:52.124 [2024-12-08 02:25:19.855123] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.124 [2024-12-08 02:25:19.855146] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69db30, cid 0, qid 0 00:22:52.124 [2024-12-08 02:25:19.855172] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69dc90, cid 1, qid 0 00:22:52.124 [2024-12-08 02:25:19.855180] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69ddf0, cid 2, qid 0 00:22:52.124 [2024-12-08 02:25:19.855187] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69df50, cid 3, qid 0 00:22:52.124 [2024-12-08 02:25:19.855195] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69e0b0, cid 4, qid 0 00:22:52.124 [2024-12-08 02:25:19.858546] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.124 [2024-12-08 02:25:19.858567] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.124 [2024-12-08 02:25:19.858575] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.124 [2024-12-08 02:25:19.858582] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69e0b0) on tqpair=0x61de10 00:22:52.124 [2024-12-08 02:25:19.858590] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:22:52.124 [2024-12-08 02:25:19.858599] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:22:52.124 [2024-12-08 02:25:19.858613] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:22:52.124 [2024-12-08 02:25:19.858644] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:22:52.124 [2024-12-08 02:25:19.858656] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.124 [2024-12-08 02:25:19.858663] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.124 [2024-12-08 02:25:19.858670] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x61de10) 00:22:52.124 [2024-12-08 02:25:19.858681] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:22:52.124 [2024-12-08 02:25:19.858704] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69e0b0, cid 4, qid 0 00:22:52.124 [2024-12-08 02:25:19.858839] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.124 [2024-12-08 02:25:19.858851] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.124 [2024-12-08 02:25:19.858858] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.124 [2024-12-08 02:25:19.858865] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69e0b0) on tqpair=0x61de10 00:22:52.124 [2024-12-08 02:25:19.858930] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:22:52.124 [2024-12-08 02:25:19.858948] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:22:52.124 [2024-12-08 02:25:19.858963] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.124 [2024-12-08 02:25:19.858970] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.124 [2024-12-08 02:25:19.858977] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x61de10) 00:22:52.124 [2024-12-08 02:25:19.858987] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.124 [2024-12-08 02:25:19.859010] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69e0b0, cid 4, qid 0 00:22:52.124 [2024-12-08 02:25:19.859135] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:52.124 [2024-12-08 02:25:19.859150] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:52.124 [2024-12-08 02:25:19.859157] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:52.124 [2024-12-08 02:25:19.859163] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x61de10): datao=0, datal=4096, cccid=4 00:22:52.124 [2024-12-08 02:25:19.859171] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x69e0b0) on tqpair(0x61de10): expected_datao=0, payload_size=4096 00:22:52.124 [2024-12-08 02:25:19.859189] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:52.124 [2024-12-08 02:25:19.859198] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:52.389 [2024-12-08 02:25:19.900552] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.389 [2024-12-08 02:25:19.900571] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.389 [2024-12-08 02:25:19.900579] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.389 [2024-12-08 02:25:19.900586] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69e0b0) on tqpair=0x61de10 00:22:52.389 [2024-12-08 02:25:19.900609] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:22:52.389 [2024-12-08 02:25:19.900630] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:22:52.389 [2024-12-08 02:25:19.900649] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:22:52.389 [2024-12-08 02:25:19.900679] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.389 [2024-12-08 02:25:19.900687] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.389 [2024-12-08 02:25:19.900693] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x61de10) 00:22:52.389 [2024-12-08 02:25:19.900704] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.389 [2024-12-08 02:25:19.900729] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69e0b0, cid 4, qid 0 00:22:52.389 [2024-12-08 02:25:19.900869] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:52.389 [2024-12-08 02:25:19.900884] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:52.389 [2024-12-08 02:25:19.900892] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:52.389 [2024-12-08 02:25:19.900898] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x61de10): datao=0, datal=4096, cccid=4 00:22:52.389 [2024-12-08 02:25:19.900906] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x69e0b0) on tqpair(0x61de10): expected_datao=0, payload_size=4096 00:22:52.389 [2024-12-08 02:25:19.900924] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:52.389 [2024-12-08 02:25:19.900933] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:52.389 [2024-12-08 02:25:19.941677] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.389 [2024-12-08 02:25:19.941695] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.389 [2024-12-08 02:25:19.941703] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.389 [2024-12-08 02:25:19.941710] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69e0b0) on tqpair=0x61de10 00:22:52.389 [2024-12-08 02:25:19.941734] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:22:52.389 [2024-12-08 02:25:19.941754] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:22:52.389 [2024-12-08 02:25:19.941769] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.389 [2024-12-08 02:25:19.941777] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.389 [2024-12-08 02:25:19.941783] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x61de10) 00:22:52.389 [2024-12-08 02:25:19.941795] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.389 [2024-12-08 02:25:19.941818] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69e0b0, cid 4, qid 0 00:22:52.389 [2024-12-08 02:25:19.941914] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:52.389 [2024-12-08 02:25:19.941929] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:52.389 [2024-12-08 02:25:19.941936] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:52.389 [2024-12-08 02:25:19.941942] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x61de10): datao=0, datal=4096, cccid=4 00:22:52.389 [2024-12-08 02:25:19.941950] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x69e0b0) on tqpair(0x61de10): expected_datao=0, payload_size=4096 00:22:52.389 [2024-12-08 02:25:19.941968] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:52.389 [2024-12-08 02:25:19.941977] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:52.389 [2024-12-08 02:25:19.982639] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.389 [2024-12-08 02:25:19.982657] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.389 [2024-12-08 02:25:19.982665] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.389 [2024-12-08 02:25:19.982672] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69e0b0) on tqpair=0x61de10 00:22:52.389 [2024-12-08 02:25:19.982686] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:22:52.389 [2024-12-08 02:25:19.982702] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:22:52.389 [2024-12-08 02:25:19.982718] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:22:52.389 [2024-12-08 02:25:19.982729] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:22:52.389 [2024-12-08 02:25:19.982738] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:22:52.389 [2024-12-08 02:25:19.982746] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:22:52.389 [2024-12-08 02:25:19.982753] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:22:52.389 [2024-12-08 02:25:19.982762] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:22:52.389 [2024-12-08 02:25:19.982781] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.389 [2024-12-08 02:25:19.982789] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.389 [2024-12-08 02:25:19.982796] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x61de10) 00:22:52.389 [2024-12-08 02:25:19.982807] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.389 [2024-12-08 02:25:19.982819] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.389 [2024-12-08 02:25:19.982826] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.389 [2024-12-08 02:25:19.982832] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x61de10) 00:22:52.389 [2024-12-08 02:25:19.982841] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:22:52.389 [2024-12-08 02:25:19.982868] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69e0b0, cid 4, qid 0 00:22:52.389 [2024-12-08 02:25:19.982880] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69e210, cid 5, qid 0 00:22:52.389 [2024-12-08 02:25:19.983012] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.389 [2024-12-08 02:25:19.983026] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.389 [2024-12-08 02:25:19.983033] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.389 [2024-12-08 02:25:19.983040] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69e0b0) on tqpair=0x61de10 00:22:52.389 [2024-12-08 02:25:19.983050] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.389 [2024-12-08 02:25:19.983058] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.389 [2024-12-08 02:25:19.983065] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.389 [2024-12-08 02:25:19.983071] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69e210) on tqpair=0x61de10 00:22:52.389 [2024-12-08 02:25:19.983087] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.389 [2024-12-08 02:25:19.983095] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.389 [2024-12-08 02:25:19.983102] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x61de10) 00:22:52.389 [2024-12-08 02:25:19.983112] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.389 [2024-12-08 02:25:19.983139] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69e210, cid 5, qid 0 00:22:52.389 [2024-12-08 02:25:19.983255] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.389 [2024-12-08 02:25:19.983269] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.389 [2024-12-08 02:25:19.983276] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.390 [2024-12-08 02:25:19.983283] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69e210) on tqpair=0x61de10 00:22:52.390 [2024-12-08 02:25:19.983298] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.390 [2024-12-08 02:25:19.983307] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.390 [2024-12-08 02:25:19.983314] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x61de10) 00:22:52.390 [2024-12-08 02:25:19.983324] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.390 [2024-12-08 02:25:19.983345] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69e210, cid 5, qid 0 00:22:52.390 [2024-12-08 02:25:19.983472] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.390 [2024-12-08 02:25:19.983485] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.390 [2024-12-08 02:25:19.983492] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.390 [2024-12-08 02:25:19.983498] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69e210) on tqpair=0x61de10 00:22:52.390 [2024-12-08 02:25:19.983514] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.390 [2024-12-08 02:25:19.983522] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.390 [2024-12-08 02:25:19.983529] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x61de10) 00:22:52.390 [2024-12-08 02:25:19.983548] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.390 [2024-12-08 02:25:19.983571] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69e210, cid 5, qid 0 00:22:52.390 [2024-12-08 02:25:19.983649] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.390 [2024-12-08 02:25:19.983661] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.390 [2024-12-08 02:25:19.983668] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.390 [2024-12-08 02:25:19.983674] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69e210) on tqpair=0x61de10 00:22:52.390 [2024-12-08 02:25:19.983693] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.390 [2024-12-08 02:25:19.983703] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.390 [2024-12-08 02:25:19.983709] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x61de10) 00:22:52.390 [2024-12-08 02:25:19.983720] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.390 [2024-12-08 02:25:19.983732] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.390 [2024-12-08 02:25:19.983740] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.390 [2024-12-08 02:25:19.983746] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x61de10) 00:22:52.390 [2024-12-08 02:25:19.983756] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.390 [2024-12-08 02:25:19.983768] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.390 [2024-12-08 02:25:19.983776] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.390 [2024-12-08 02:25:19.983782] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x61de10) 00:22:52.390 [2024-12-08 02:25:19.983791] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.390 [2024-12-08 02:25:19.983808] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.390 [2024-12-08 02:25:19.983817] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.390 [2024-12-08 02:25:19.983823] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x61de10) 00:22:52.390 [2024-12-08 02:25:19.983832] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.390 [2024-12-08 02:25:19.983855] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69e210, cid 5, qid 0 00:22:52.390 [2024-12-08 02:25:19.983867] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69e0b0, cid 4, qid 0 00:22:52.390 [2024-12-08 02:25:19.983874] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69e370, cid 6, qid 0 00:22:52.390 [2024-12-08 02:25:19.983882] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69e4d0, cid 7, qid 0 00:22:52.390 [2024-12-08 02:25:19.984062] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:52.390 [2024-12-08 02:25:19.984077] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:52.390 [2024-12-08 02:25:19.984084] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:52.390 [2024-12-08 02:25:19.984091] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x61de10): datao=0, datal=8192, cccid=5 00:22:52.390 [2024-12-08 02:25:19.984098] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x69e210) on tqpair(0x61de10): expected_datao=0, payload_size=8192 00:22:52.390 [2024-12-08 02:25:19.984132] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:52.390 [2024-12-08 02:25:19.984143] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:52.390 [2024-12-08 02:25:19.984152] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:52.390 [2024-12-08 02:25:19.984161] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:52.390 [2024-12-08 02:25:19.984168] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:52.390 [2024-12-08 02:25:19.984174] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x61de10): datao=0, datal=512, cccid=4 00:22:52.390 [2024-12-08 02:25:19.984181] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x69e0b0) on tqpair(0x61de10): expected_datao=0, payload_size=512 00:22:52.390 [2024-12-08 02:25:19.984191] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:52.390 [2024-12-08 02:25:19.984199] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:52.390 [2024-12-08 02:25:19.984207] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:52.390 [2024-12-08 02:25:19.984216] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:52.390 [2024-12-08 02:25:19.984222] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:52.390 [2024-12-08 02:25:19.984228] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x61de10): datao=0, datal=512, cccid=6 00:22:52.390 [2024-12-08 02:25:19.984236] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x69e370) on tqpair(0x61de10): expected_datao=0, payload_size=512 00:22:52.390 [2024-12-08 02:25:19.984245] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:52.390 [2024-12-08 02:25:19.984253] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:52.390 [2024-12-08 02:25:19.984261] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:52.390 [2024-12-08 02:25:19.984270] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:52.390 [2024-12-08 02:25:19.984276] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:52.390 [2024-12-08 02:25:19.984282] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x61de10): datao=0, datal=4096, cccid=7 00:22:52.390 [2024-12-08 02:25:19.984289] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x69e4d0) on tqpair(0x61de10): expected_datao=0, payload_size=4096 00:22:52.390 [2024-12-08 02:25:19.984300] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:52.390 [2024-12-08 02:25:19.984311] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:52.390 [2024-12-08 02:25:19.984323] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.390 [2024-12-08 02:25:19.984333] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.390 [2024-12-08 02:25:19.984340] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.390 [2024-12-08 02:25:19.984346] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69e210) on tqpair=0x61de10 00:22:52.390 [2024-12-08 02:25:19.984366] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.390 [2024-12-08 02:25:19.984377] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.390 [2024-12-08 02:25:19.984384] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.390 [2024-12-08 02:25:19.984391] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69e0b0) on tqpair=0x61de10 00:22:52.390 [2024-12-08 02:25:19.984404] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.390 [2024-12-08 02:25:19.984414] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.390 [2024-12-08 02:25:19.984421] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.390 [2024-12-08 02:25:19.984427] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69e370) on tqpair=0x61de10 00:22:52.390 [2024-12-08 02:25:19.984438] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.391 [2024-12-08 02:25:19.984462] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.391 [2024-12-08 02:25:19.984469] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.391 [2024-12-08 02:25:19.984475] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69e4d0) on tqpair=0x61de10 00:22:52.391 ===================================================== 00:22:52.391 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:52.391 ===================================================== 00:22:52.391 Controller Capabilities/Features 00:22:52.391 ================================ 00:22:52.391 Vendor ID: 8086 00:22:52.391 Subsystem Vendor ID: 8086 00:22:52.391 Serial Number: SPDK00000000000001 00:22:52.391 Model Number: SPDK bdev Controller 00:22:52.391 Firmware Version: 24.01.1 00:22:52.391 Recommended Arb Burst: 6 00:22:52.391 IEEE OUI Identifier: e4 d2 5c 00:22:52.391 Multi-path I/O 00:22:52.391 May have multiple subsystem ports: Yes 00:22:52.391 May have multiple controllers: Yes 00:22:52.391 Associated with SR-IOV VF: No 00:22:52.391 Max Data Transfer Size: 131072 00:22:52.391 Max Number of Namespaces: 32 00:22:52.391 Max Number of I/O Queues: 127 00:22:52.391 NVMe Specification Version (VS): 1.3 00:22:52.391 NVMe Specification Version (Identify): 1.3 00:22:52.391 Maximum Queue Entries: 128 00:22:52.391 Contiguous Queues Required: Yes 00:22:52.391 Arbitration Mechanisms Supported 00:22:52.391 Weighted Round Robin: Not Supported 00:22:52.391 Vendor Specific: Not Supported 00:22:52.391 Reset Timeout: 15000 ms 00:22:52.391 Doorbell Stride: 4 bytes 00:22:52.391 NVM Subsystem Reset: Not Supported 00:22:52.391 Command Sets Supported 00:22:52.391 NVM Command Set: Supported 00:22:52.391 Boot Partition: Not Supported 00:22:52.391 Memory Page Size Minimum: 4096 bytes 00:22:52.391 Memory Page Size Maximum: 4096 bytes 00:22:52.391 Persistent Memory Region: Not Supported 00:22:52.391 Optional Asynchronous Events Supported 00:22:52.391 Namespace Attribute Notices: Supported 00:22:52.391 Firmware Activation Notices: Not Supported 00:22:52.391 ANA Change Notices: Not Supported 00:22:52.391 PLE Aggregate Log Change Notices: Not Supported 00:22:52.391 LBA Status Info Alert Notices: Not Supported 00:22:52.391 EGE Aggregate Log Change Notices: Not Supported 00:22:52.391 Normal NVM Subsystem Shutdown event: Not Supported 00:22:52.391 Zone Descriptor Change Notices: Not Supported 00:22:52.391 Discovery Log Change Notices: Not Supported 00:22:52.391 Controller Attributes 00:22:52.391 128-bit Host Identifier: Supported 00:22:52.391 Non-Operational Permissive Mode: Not Supported 00:22:52.391 NVM Sets: Not Supported 00:22:52.391 Read Recovery Levels: Not Supported 00:22:52.391 Endurance Groups: Not Supported 00:22:52.391 Predictable Latency Mode: Not Supported 00:22:52.391 Traffic Based Keep ALive: Not Supported 00:22:52.391 Namespace Granularity: Not Supported 00:22:52.391 SQ Associations: Not Supported 00:22:52.391 UUID List: Not Supported 00:22:52.391 Multi-Domain Subsystem: Not Supported 00:22:52.391 Fixed Capacity Management: Not Supported 00:22:52.391 Variable Capacity Management: Not Supported 00:22:52.391 Delete Endurance Group: Not Supported 00:22:52.391 Delete NVM Set: Not Supported 00:22:52.391 Extended LBA Formats Supported: Not Supported 00:22:52.391 Flexible Data Placement Supported: Not Supported 00:22:52.391 00:22:52.391 Controller Memory Buffer Support 00:22:52.391 ================================ 00:22:52.391 Supported: No 00:22:52.391 00:22:52.391 Persistent Memory Region Support 00:22:52.391 ================================ 00:22:52.391 Supported: No 00:22:52.391 00:22:52.391 Admin Command Set Attributes 00:22:52.391 ============================ 00:22:52.391 Security Send/Receive: Not Supported 00:22:52.391 Format NVM: Not Supported 00:22:52.391 Firmware Activate/Download: Not Supported 00:22:52.391 Namespace Management: Not Supported 00:22:52.391 Device Self-Test: Not Supported 00:22:52.391 Directives: Not Supported 00:22:52.391 NVMe-MI: Not Supported 00:22:52.391 Virtualization Management: Not Supported 00:22:52.391 Doorbell Buffer Config: Not Supported 00:22:52.391 Get LBA Status Capability: Not Supported 00:22:52.391 Command & Feature Lockdown Capability: Not Supported 00:22:52.391 Abort Command Limit: 4 00:22:52.391 Async Event Request Limit: 4 00:22:52.391 Number of Firmware Slots: N/A 00:22:52.391 Firmware Slot 1 Read-Only: N/A 00:22:52.391 Firmware Activation Without Reset: N/A 00:22:52.391 Multiple Update Detection Support: N/A 00:22:52.391 Firmware Update Granularity: No Information Provided 00:22:52.391 Per-Namespace SMART Log: No 00:22:52.391 Asymmetric Namespace Access Log Page: Not Supported 00:22:52.391 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:22:52.391 Command Effects Log Page: Supported 00:22:52.391 Get Log Page Extended Data: Supported 00:22:52.391 Telemetry Log Pages: Not Supported 00:22:52.391 Persistent Event Log Pages: Not Supported 00:22:52.391 Supported Log Pages Log Page: May Support 00:22:52.391 Commands Supported & Effects Log Page: Not Supported 00:22:52.391 Feature Identifiers & Effects Log Page:May Support 00:22:52.391 NVMe-MI Commands & Effects Log Page: May Support 00:22:52.391 Data Area 4 for Telemetry Log: Not Supported 00:22:52.391 Error Log Page Entries Supported: 128 00:22:52.391 Keep Alive: Supported 00:22:52.391 Keep Alive Granularity: 10000 ms 00:22:52.391 00:22:52.391 NVM Command Set Attributes 00:22:52.391 ========================== 00:22:52.391 Submission Queue Entry Size 00:22:52.391 Max: 64 00:22:52.391 Min: 64 00:22:52.391 Completion Queue Entry Size 00:22:52.391 Max: 16 00:22:52.391 Min: 16 00:22:52.391 Number of Namespaces: 32 00:22:52.391 Compare Command: Supported 00:22:52.391 Write Uncorrectable Command: Not Supported 00:22:52.391 Dataset Management Command: Supported 00:22:52.391 Write Zeroes Command: Supported 00:22:52.391 Set Features Save Field: Not Supported 00:22:52.391 Reservations: Supported 00:22:52.391 Timestamp: Not Supported 00:22:52.391 Copy: Supported 00:22:52.391 Volatile Write Cache: Present 00:22:52.391 Atomic Write Unit (Normal): 1 00:22:52.391 Atomic Write Unit (PFail): 1 00:22:52.391 Atomic Compare & Write Unit: 1 00:22:52.391 Fused Compare & Write: Supported 00:22:52.391 Scatter-Gather List 00:22:52.391 SGL Command Set: Supported 00:22:52.391 SGL Keyed: Supported 00:22:52.391 SGL Bit Bucket Descriptor: Not Supported 00:22:52.392 SGL Metadata Pointer: Not Supported 00:22:52.392 Oversized SGL: Not Supported 00:22:52.392 SGL Metadata Address: Not Supported 00:22:52.392 SGL Offset: Supported 00:22:52.392 Transport SGL Data Block: Not Supported 00:22:52.392 Replay Protected Memory Block: Not Supported 00:22:52.392 00:22:52.392 Firmware Slot Information 00:22:52.392 ========================= 00:22:52.392 Active slot: 1 00:22:52.392 Slot 1 Firmware Revision: 24.01.1 00:22:52.392 00:22:52.392 00:22:52.392 Commands Supported and Effects 00:22:52.392 ============================== 00:22:52.392 Admin Commands 00:22:52.392 -------------- 00:22:52.392 Get Log Page (02h): Supported 00:22:52.392 Identify (06h): Supported 00:22:52.392 Abort (08h): Supported 00:22:52.392 Set Features (09h): Supported 00:22:52.392 Get Features (0Ah): Supported 00:22:52.392 Asynchronous Event Request (0Ch): Supported 00:22:52.392 Keep Alive (18h): Supported 00:22:52.392 I/O Commands 00:22:52.392 ------------ 00:22:52.392 Flush (00h): Supported LBA-Change 00:22:52.392 Write (01h): Supported LBA-Change 00:22:52.392 Read (02h): Supported 00:22:52.392 Compare (05h): Supported 00:22:52.392 Write Zeroes (08h): Supported LBA-Change 00:22:52.392 Dataset Management (09h): Supported LBA-Change 00:22:52.392 Copy (19h): Supported LBA-Change 00:22:52.392 Unknown (79h): Supported LBA-Change 00:22:52.392 Unknown (7Ah): Supported 00:22:52.392 00:22:52.392 Error Log 00:22:52.392 ========= 00:22:52.392 00:22:52.392 Arbitration 00:22:52.392 =========== 00:22:52.392 Arbitration Burst: 1 00:22:52.392 00:22:52.392 Power Management 00:22:52.392 ================ 00:22:52.392 Number of Power States: 1 00:22:52.392 Current Power State: Power State #0 00:22:52.392 Power State #0: 00:22:52.392 Max Power: 0.00 W 00:22:52.392 Non-Operational State: Operational 00:22:52.392 Entry Latency: Not Reported 00:22:52.392 Exit Latency: Not Reported 00:22:52.392 Relative Read Throughput: 0 00:22:52.392 Relative Read Latency: 0 00:22:52.392 Relative Write Throughput: 0 00:22:52.392 Relative Write Latency: 0 00:22:52.392 Idle Power: Not Reported 00:22:52.392 Active Power: Not Reported 00:22:52.392 Non-Operational Permissive Mode: Not Supported 00:22:52.392 00:22:52.392 Health Information 00:22:52.392 ================== 00:22:52.392 Critical Warnings: 00:22:52.392 Available Spare Space: OK 00:22:52.392 Temperature: OK 00:22:52.392 Device Reliability: OK 00:22:52.392 Read Only: No 00:22:52.392 Volatile Memory Backup: OK 00:22:52.392 Current Temperature: 0 Kelvin (-273 Celsius) 00:22:52.392 Temperature Threshold: [2024-12-08 02:25:19.988623] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.392 [2024-12-08 02:25:19.988637] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.392 [2024-12-08 02:25:19.988643] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x61de10) 00:22:52.392 [2024-12-08 02:25:19.988654] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.392 [2024-12-08 02:25:19.988679] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69e4d0, cid 7, qid 0 00:22:52.392 [2024-12-08 02:25:19.988784] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.392 [2024-12-08 02:25:19.988796] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.392 [2024-12-08 02:25:19.988803] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.392 [2024-12-08 02:25:19.988810] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69e4d0) on tqpair=0x61de10 00:22:52.392 [2024-12-08 02:25:19.988847] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:22:52.392 [2024-12-08 02:25:19.988869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:52.392 [2024-12-08 02:25:19.988881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:52.392 [2024-12-08 02:25:19.988891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:52.392 [2024-12-08 02:25:19.988900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:52.392 [2024-12-08 02:25:19.988912] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.392 [2024-12-08 02:25:19.988920] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.392 [2024-12-08 02:25:19.988926] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x61de10) 00:22:52.392 [2024-12-08 02:25:19.988937] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.392 [2024-12-08 02:25:19.988960] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69df50, cid 3, qid 0 00:22:52.392 [2024-12-08 02:25:19.989062] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.392 [2024-12-08 02:25:19.989075] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.392 [2024-12-08 02:25:19.989082] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.392 [2024-12-08 02:25:19.989089] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69df50) on tqpair=0x61de10 00:22:52.392 [2024-12-08 02:25:19.989100] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.392 [2024-12-08 02:25:19.989107] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.392 [2024-12-08 02:25:19.989114] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x61de10) 00:22:52.392 [2024-12-08 02:25:19.989124] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.392 [2024-12-08 02:25:19.989150] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69df50, cid 3, qid 0 00:22:52.392 [2024-12-08 02:25:19.989246] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.392 [2024-12-08 02:25:19.989260] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.392 [2024-12-08 02:25:19.989267] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.392 [2024-12-08 02:25:19.989274] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69df50) on tqpair=0x61de10 00:22:52.392 [2024-12-08 02:25:19.989281] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:22:52.392 [2024-12-08 02:25:19.989289] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:22:52.392 [2024-12-08 02:25:19.989305] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.392 [2024-12-08 02:25:19.989314] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.392 [2024-12-08 02:25:19.989320] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x61de10) 00:22:52.392 [2024-12-08 02:25:19.989330] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.392 [2024-12-08 02:25:19.989351] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69df50, cid 3, qid 0 00:22:52.392 [2024-12-08 02:25:19.989432] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.392 [2024-12-08 02:25:19.989447] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.393 [2024-12-08 02:25:19.989453] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.393 [2024-12-08 02:25:19.989460] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69df50) on tqpair=0x61de10 00:22:52.393 [2024-12-08 02:25:19.989476] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.393 [2024-12-08 02:25:19.989486] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.393 [2024-12-08 02:25:19.989492] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x61de10) 00:22:52.393 [2024-12-08 02:25:19.989503] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.393 [2024-12-08 02:25:19.989524] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69df50, cid 3, qid 0 00:22:52.393 [2024-12-08 02:25:19.989605] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.393 [2024-12-08 02:25:19.989619] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.393 [2024-12-08 02:25:19.989626] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.393 [2024-12-08 02:25:19.989633] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69df50) on tqpair=0x61de10 00:22:52.393 [2024-12-08 02:25:19.989649] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.393 [2024-12-08 02:25:19.989658] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.393 [2024-12-08 02:25:19.989664] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x61de10) 00:22:52.393 [2024-12-08 02:25:19.989675] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.393 [2024-12-08 02:25:19.989700] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69df50, cid 3, qid 0 00:22:52.393 [2024-12-08 02:25:19.989774] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.393 [2024-12-08 02:25:19.989786] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.393 [2024-12-08 02:25:19.989793] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.393 [2024-12-08 02:25:19.989800] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69df50) on tqpair=0x61de10 00:22:52.393 [2024-12-08 02:25:19.989816] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.393 [2024-12-08 02:25:19.989824] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.393 [2024-12-08 02:25:19.989831] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x61de10) 00:22:52.393 [2024-12-08 02:25:19.989841] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.393 [2024-12-08 02:25:19.989862] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69df50, cid 3, qid 0 00:22:52.393 [2024-12-08 02:25:19.989942] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.393 [2024-12-08 02:25:19.989956] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.393 [2024-12-08 02:25:19.989963] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.393 [2024-12-08 02:25:19.989970] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69df50) on tqpair=0x61de10 00:22:52.393 [2024-12-08 02:25:19.989986] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.393 [2024-12-08 02:25:19.989995] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.393 [2024-12-08 02:25:19.990001] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x61de10) 00:22:52.393 [2024-12-08 02:25:19.990012] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.393 [2024-12-08 02:25:19.990033] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69df50, cid 3, qid 0 00:22:52.393 [2024-12-08 02:25:19.990105] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.393 [2024-12-08 02:25:19.990118] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.393 [2024-12-08 02:25:19.990125] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.393 [2024-12-08 02:25:19.990131] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69df50) on tqpair=0x61de10 00:22:52.393 [2024-12-08 02:25:19.990147] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.393 [2024-12-08 02:25:19.990156] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.393 [2024-12-08 02:25:19.990162] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x61de10) 00:22:52.393 [2024-12-08 02:25:19.990173] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.393 [2024-12-08 02:25:19.990193] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69df50, cid 3, qid 0 00:22:52.393 [2024-12-08 02:25:19.990270] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.393 [2024-12-08 02:25:19.990285] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.393 [2024-12-08 02:25:19.990292] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.393 [2024-12-08 02:25:19.990298] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69df50) on tqpair=0x61de10 00:22:52.393 [2024-12-08 02:25:19.990314] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.393 [2024-12-08 02:25:19.990323] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.393 [2024-12-08 02:25:19.990329] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x61de10) 00:22:52.393 [2024-12-08 02:25:19.990339] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.393 [2024-12-08 02:25:19.990360] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69df50, cid 3, qid 0 00:22:52.393 [2024-12-08 02:25:19.990434] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.393 [2024-12-08 02:25:19.990447] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.393 [2024-12-08 02:25:19.990454] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.393 [2024-12-08 02:25:19.990460] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69df50) on tqpair=0x61de10 00:22:52.393 [2024-12-08 02:25:19.990476] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.393 [2024-12-08 02:25:19.990485] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.393 [2024-12-08 02:25:19.990492] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x61de10) 00:22:52.393 [2024-12-08 02:25:19.990502] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.393 [2024-12-08 02:25:19.990522] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69df50, cid 3, qid 0 00:22:52.393 [2024-12-08 02:25:19.990603] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.393 [2024-12-08 02:25:19.990617] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.393 [2024-12-08 02:25:19.990624] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.393 [2024-12-08 02:25:19.990630] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69df50) on tqpair=0x61de10 00:22:52.393 [2024-12-08 02:25:19.990646] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.393 [2024-12-08 02:25:19.990655] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.393 [2024-12-08 02:25:19.990661] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x61de10) 00:22:52.393 [2024-12-08 02:25:19.990672] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.393 [2024-12-08 02:25:19.990693] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69df50, cid 3, qid 0 00:22:52.393 [2024-12-08 02:25:19.990770] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.393 [2024-12-08 02:25:19.990782] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.393 [2024-12-08 02:25:19.990789] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.393 [2024-12-08 02:25:19.990795] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69df50) on tqpair=0x61de10 00:22:52.393 [2024-12-08 02:25:19.990811] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.393 [2024-12-08 02:25:19.990820] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.393 [2024-12-08 02:25:19.990827] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x61de10) 00:22:52.393 [2024-12-08 02:25:19.990837] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.394 [2024-12-08 02:25:19.990857] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69df50, cid 3, qid 0 00:22:52.394 [2024-12-08 02:25:19.990930] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.394 [2024-12-08 02:25:19.990943] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.394 [2024-12-08 02:25:19.990949] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.394 [2024-12-08 02:25:19.990956] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69df50) on tqpair=0x61de10 00:22:52.394 [2024-12-08 02:25:19.990972] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.394 [2024-12-08 02:25:19.990980] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.394 [2024-12-08 02:25:19.990987] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x61de10) 00:22:52.394 [2024-12-08 02:25:19.990997] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.394 [2024-12-08 02:25:19.991018] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69df50, cid 3, qid 0 00:22:52.394 [2024-12-08 02:25:19.991088] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.394 [2024-12-08 02:25:19.991101] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.394 [2024-12-08 02:25:19.991108] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.394 [2024-12-08 02:25:19.991114] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69df50) on tqpair=0x61de10 00:22:52.394 [2024-12-08 02:25:19.991130] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.394 [2024-12-08 02:25:19.991139] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.394 [2024-12-08 02:25:19.991146] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x61de10) 00:22:52.394 [2024-12-08 02:25:19.991156] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.394 [2024-12-08 02:25:19.991177] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69df50, cid 3, qid 0 00:22:52.394 [2024-12-08 02:25:19.991252] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.394 [2024-12-08 02:25:19.991265] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.394 [2024-12-08 02:25:19.991271] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.394 [2024-12-08 02:25:19.991278] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69df50) on tqpair=0x61de10 00:22:52.394 [2024-12-08 02:25:19.991294] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.394 [2024-12-08 02:25:19.991303] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.394 [2024-12-08 02:25:19.991309] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x61de10) 00:22:52.394 [2024-12-08 02:25:19.991320] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.394 [2024-12-08 02:25:19.991340] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69df50, cid 3, qid 0 00:22:52.394 [2024-12-08 02:25:19.991436] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.394 [2024-12-08 02:25:19.991450] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.394 [2024-12-08 02:25:19.991457] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.394 [2024-12-08 02:25:19.991464] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69df50) on tqpair=0x61de10 00:22:52.394 [2024-12-08 02:25:19.991480] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.394 [2024-12-08 02:25:19.991489] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.394 [2024-12-08 02:25:19.991495] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x61de10) 00:22:52.394 [2024-12-08 02:25:19.991506] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.394 [2024-12-08 02:25:19.991526] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69df50, cid 3, qid 0 00:22:52.394 [2024-12-08 02:25:19.991607] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.394 [2024-12-08 02:25:19.991620] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.394 [2024-12-08 02:25:19.991627] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.394 [2024-12-08 02:25:19.991634] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69df50) on tqpair=0x61de10 00:22:52.394 [2024-12-08 02:25:19.991650] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.394 [2024-12-08 02:25:19.991659] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.394 [2024-12-08 02:25:19.991665] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x61de10) 00:22:52.394 [2024-12-08 02:25:19.991676] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.394 [2024-12-08 02:25:19.991697] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69df50, cid 3, qid 0 00:22:52.394 [2024-12-08 02:25:19.991770] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.394 [2024-12-08 02:25:19.991786] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.394 [2024-12-08 02:25:19.991794] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.394 [2024-12-08 02:25:19.991801] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69df50) on tqpair=0x61de10 00:22:52.394 [2024-12-08 02:25:19.991817] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.394 [2024-12-08 02:25:19.991826] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.394 [2024-12-08 02:25:19.991832] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x61de10) 00:22:52.394 [2024-12-08 02:25:19.991843] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.394 [2024-12-08 02:25:19.991863] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69df50, cid 3, qid 0 00:22:52.394 [2024-12-08 02:25:19.991933] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.394 [2024-12-08 02:25:19.991945] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.394 [2024-12-08 02:25:19.991952] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.394 [2024-12-08 02:25:19.991959] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69df50) on tqpair=0x61de10 00:22:52.394 [2024-12-08 02:25:19.991974] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.394 [2024-12-08 02:25:19.991983] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.394 [2024-12-08 02:25:19.991990] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x61de10) 00:22:52.394 [2024-12-08 02:25:19.992000] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.394 [2024-12-08 02:25:19.992021] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69df50, cid 3, qid 0 00:22:52.394 [2024-12-08 02:25:19.992147] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.394 [2024-12-08 02:25:19.992159] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.394 [2024-12-08 02:25:19.992166] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.394 [2024-12-08 02:25:19.992173] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69df50) on tqpair=0x61de10 00:22:52.394 [2024-12-08 02:25:19.992188] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.394 [2024-12-08 02:25:19.992197] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.394 [2024-12-08 02:25:19.992204] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x61de10) 00:22:52.394 [2024-12-08 02:25:19.992214] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.394 [2024-12-08 02:25:19.992234] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69df50, cid 3, qid 0 00:22:52.394 [2024-12-08 02:25:19.992314] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.394 [2024-12-08 02:25:19.992329] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.394 [2024-12-08 02:25:19.992335] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.394 [2024-12-08 02:25:19.992342] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69df50) on tqpair=0x61de10 00:22:52.395 [2024-12-08 02:25:19.992358] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.395 [2024-12-08 02:25:19.992367] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.395 [2024-12-08 02:25:19.992374] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x61de10) 00:22:52.395 [2024-12-08 02:25:19.992384] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.395 [2024-12-08 02:25:19.992404] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69df50, cid 3, qid 0 00:22:52.395 [2024-12-08 02:25:19.992514] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.395 [2024-12-08 02:25:19.992529] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.395 [2024-12-08 02:25:19.996543] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.395 [2024-12-08 02:25:19.996562] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69df50) on tqpair=0x61de10 00:22:52.395 [2024-12-08 02:25:19.996583] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:52.395 [2024-12-08 02:25:19.996592] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:52.395 [2024-12-08 02:25:19.996599] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x61de10) 00:22:52.395 [2024-12-08 02:25:19.996609] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:52.395 [2024-12-08 02:25:19.996632] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x69df50, cid 3, qid 0 00:22:52.395 [2024-12-08 02:25:19.996724] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:52.395 [2024-12-08 02:25:19.996739] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:52.395 [2024-12-08 02:25:19.996746] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:52.395 [2024-12-08 02:25:19.996752] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x69df50) on tqpair=0x61de10 00:22:52.395 [2024-12-08 02:25:19.996765] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 7 milliseconds 00:22:52.395 0 Kelvin (-273 Celsius) 00:22:52.395 Available Spare: 0% 00:22:52.395 Available Spare Threshold: 0% 00:22:52.395 Life Percentage Used: 0% 00:22:52.395 Data Units Read: 0 00:22:52.395 Data Units Written: 0 00:22:52.395 Host Read Commands: 0 00:22:52.395 Host Write Commands: 0 00:22:52.395 Controller Busy Time: 0 minutes 00:22:52.395 Power Cycles: 0 00:22:52.395 Power On Hours: 0 hours 00:22:52.395 Unsafe Shutdowns: 0 00:22:52.395 Unrecoverable Media Errors: 0 00:22:52.395 Lifetime Error Log Entries: 0 00:22:52.395 Warning Temperature Time: 0 minutes 00:22:52.395 Critical Temperature Time: 0 minutes 00:22:52.395 00:22:52.395 Number of Queues 00:22:52.395 ================ 00:22:52.395 Number of I/O Submission Queues: 127 00:22:52.395 Number of I/O Completion Queues: 127 00:22:52.395 00:22:52.395 Active Namespaces 00:22:52.395 ================= 00:22:52.395 Namespace ID:1 00:22:52.395 Error Recovery Timeout: Unlimited 00:22:52.395 Command Set Identifier: NVM (00h) 00:22:52.395 Deallocate: Supported 00:22:52.395 Deallocated/Unwritten Error: Not Supported 00:22:52.395 Deallocated Read Value: Unknown 00:22:52.395 Deallocate in Write Zeroes: Not Supported 00:22:52.395 Deallocated Guard Field: 0xFFFF 00:22:52.395 Flush: Supported 00:22:52.395 Reservation: Supported 00:22:52.395 Namespace Sharing Capabilities: Multiple Controllers 00:22:52.395 Size (in LBAs): 131072 (0GiB) 00:22:52.395 Capacity (in LBAs): 131072 (0GiB) 00:22:52.395 Utilization (in LBAs): 131072 (0GiB) 00:22:52.395 NGUID: ABCDEF0123456789ABCDEF0123456789 00:22:52.395 EUI64: ABCDEF0123456789 00:22:52.395 UUID: 2324ed10-ef26-4c0f-a163-4ee6c76ee40f 00:22:52.395 Thin Provisioning: Not Supported 00:22:52.395 Per-NS Atomic Units: Yes 00:22:52.395 Atomic Boundary Size (Normal): 0 00:22:52.395 Atomic Boundary Size (PFail): 0 00:22:52.395 Atomic Boundary Offset: 0 00:22:52.395 Maximum Single Source Range Length: 65535 00:22:52.395 Maximum Copy Length: 65535 00:22:52.395 Maximum Source Range Count: 1 00:22:52.395 NGUID/EUI64 Never Reused: No 00:22:52.395 Namespace Write Protected: No 00:22:52.395 Number of LBA Formats: 1 00:22:52.395 Current LBA Format: LBA Format #00 00:22:52.395 LBA Format #00: Data Size: 512 Metadata Size: 0 00:22:52.395 00:22:52.395 02:25:20 -- host/identify.sh@51 -- # sync 00:22:52.395 02:25:20 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:52.395 02:25:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:52.395 02:25:20 -- common/autotest_common.sh@10 -- # set +x 00:22:52.395 02:25:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:52.395 02:25:20 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:22:52.395 02:25:20 -- host/identify.sh@56 -- # nvmftestfini 00:22:52.395 02:25:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:52.395 02:25:20 -- nvmf/common.sh@116 -- # sync 00:22:52.395 02:25:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:52.395 02:25:20 -- nvmf/common.sh@119 -- # set +e 00:22:52.395 02:25:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:52.395 02:25:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:52.395 rmmod nvme_tcp 00:22:52.395 rmmod nvme_fabrics 00:22:52.395 rmmod nvme_keyring 00:22:52.395 02:25:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:52.395 02:25:20 -- nvmf/common.sh@123 -- # set -e 00:22:52.395 02:25:20 -- nvmf/common.sh@124 -- # return 0 00:22:52.395 02:25:20 -- nvmf/common.sh@477 -- # '[' -n 2184744 ']' 00:22:52.396 02:25:20 -- nvmf/common.sh@478 -- # killprocess 2184744 00:22:52.396 02:25:20 -- common/autotest_common.sh@936 -- # '[' -z 2184744 ']' 00:22:52.396 02:25:20 -- common/autotest_common.sh@940 -- # kill -0 2184744 00:22:52.396 02:25:20 -- common/autotest_common.sh@941 -- # uname 00:22:52.396 02:25:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:52.396 02:25:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2184744 00:22:52.396 02:25:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:52.396 02:25:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:52.396 02:25:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2184744' 00:22:52.396 killing process with pid 2184744 00:22:52.396 02:25:20 -- common/autotest_common.sh@955 -- # kill 2184744 00:22:52.396 [2024-12-08 02:25:20.121667] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:22:52.396 02:25:20 -- common/autotest_common.sh@960 -- # wait 2184744 00:22:52.655 02:25:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:52.655 02:25:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:52.655 02:25:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:52.655 02:25:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:52.655 02:25:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:52.655 02:25:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:52.655 02:25:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:52.655 02:25:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:55.198 02:25:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:55.198 00:22:55.198 real 0m6.240s 00:22:55.198 user 0m7.712s 00:22:55.198 sys 0m1.915s 00:22:55.198 02:25:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:55.198 02:25:22 -- common/autotest_common.sh@10 -- # set +x 00:22:55.198 ************************************ 00:22:55.198 END TEST nvmf_identify 00:22:55.198 ************************************ 00:22:55.198 02:25:22 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:22:55.198 02:25:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:55.198 02:25:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:55.198 02:25:22 -- common/autotest_common.sh@10 -- # set +x 00:22:55.198 ************************************ 00:22:55.198 START TEST nvmf_perf 00:22:55.198 ************************************ 00:22:55.198 02:25:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:22:55.198 * Looking for test storage... 00:22:55.198 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:55.198 02:25:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:55.198 02:25:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:55.198 02:25:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:55.198 02:25:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:55.198 02:25:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:55.198 02:25:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:55.198 02:25:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:55.198 02:25:22 -- scripts/common.sh@335 -- # IFS=.-: 00:22:55.198 02:25:22 -- scripts/common.sh@335 -- # read -ra ver1 00:22:55.198 02:25:22 -- scripts/common.sh@336 -- # IFS=.-: 00:22:55.198 02:25:22 -- scripts/common.sh@336 -- # read -ra ver2 00:22:55.198 02:25:22 -- scripts/common.sh@337 -- # local 'op=<' 00:22:55.198 02:25:22 -- scripts/common.sh@339 -- # ver1_l=2 00:22:55.198 02:25:22 -- scripts/common.sh@340 -- # ver2_l=1 00:22:55.198 02:25:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:55.198 02:25:22 -- scripts/common.sh@343 -- # case "$op" in 00:22:55.198 02:25:22 -- scripts/common.sh@344 -- # : 1 00:22:55.198 02:25:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:55.198 02:25:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:55.198 02:25:22 -- scripts/common.sh@364 -- # decimal 1 00:22:55.198 02:25:22 -- scripts/common.sh@352 -- # local d=1 00:22:55.198 02:25:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:55.198 02:25:22 -- scripts/common.sh@354 -- # echo 1 00:22:55.198 02:25:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:55.198 02:25:22 -- scripts/common.sh@365 -- # decimal 2 00:22:55.198 02:25:22 -- scripts/common.sh@352 -- # local d=2 00:22:55.198 02:25:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:55.198 02:25:22 -- scripts/common.sh@354 -- # echo 2 00:22:55.198 02:25:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:55.198 02:25:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:55.198 02:25:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:55.198 02:25:22 -- scripts/common.sh@367 -- # return 0 00:22:55.198 02:25:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:55.198 02:25:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:55.198 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:55.198 --rc genhtml_branch_coverage=1 00:22:55.198 --rc genhtml_function_coverage=1 00:22:55.198 --rc genhtml_legend=1 00:22:55.198 --rc geninfo_all_blocks=1 00:22:55.198 --rc geninfo_unexecuted_blocks=1 00:22:55.198 00:22:55.198 ' 00:22:55.198 02:25:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:55.198 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:55.199 --rc genhtml_branch_coverage=1 00:22:55.199 --rc genhtml_function_coverage=1 00:22:55.199 --rc genhtml_legend=1 00:22:55.199 --rc geninfo_all_blocks=1 00:22:55.199 --rc geninfo_unexecuted_blocks=1 00:22:55.199 00:22:55.199 ' 00:22:55.199 02:25:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:55.199 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:55.199 --rc genhtml_branch_coverage=1 00:22:55.199 --rc genhtml_function_coverage=1 00:22:55.199 --rc genhtml_legend=1 00:22:55.199 --rc geninfo_all_blocks=1 00:22:55.199 --rc geninfo_unexecuted_blocks=1 00:22:55.199 00:22:55.199 ' 00:22:55.199 02:25:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:55.199 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:55.199 --rc genhtml_branch_coverage=1 00:22:55.199 --rc genhtml_function_coverage=1 00:22:55.199 --rc genhtml_legend=1 00:22:55.199 --rc geninfo_all_blocks=1 00:22:55.199 --rc geninfo_unexecuted_blocks=1 00:22:55.199 00:22:55.199 ' 00:22:55.199 02:25:22 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:55.199 02:25:22 -- nvmf/common.sh@7 -- # uname -s 00:22:55.199 02:25:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:55.199 02:25:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:55.199 02:25:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:55.199 02:25:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:55.199 02:25:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:55.199 02:25:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:55.199 02:25:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:55.199 02:25:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:55.199 02:25:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:55.199 02:25:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:55.199 02:25:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:55.199 02:25:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:55.199 02:25:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:55.199 02:25:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:55.199 02:25:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:55.199 02:25:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:55.199 02:25:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:55.199 02:25:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:55.199 02:25:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:55.199 02:25:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:55.199 02:25:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:55.199 02:25:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:55.199 02:25:22 -- paths/export.sh@5 -- # export PATH 00:22:55.199 02:25:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:55.199 02:25:22 -- nvmf/common.sh@46 -- # : 0 00:22:55.199 02:25:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:55.199 02:25:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:55.199 02:25:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:55.199 02:25:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:55.199 02:25:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:55.199 02:25:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:55.199 02:25:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:55.199 02:25:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:55.199 02:25:22 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:22:55.199 02:25:22 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:22:55.199 02:25:22 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:22:55.199 02:25:22 -- host/perf.sh@17 -- # nvmftestinit 00:22:55.199 02:25:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:55.199 02:25:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:55.199 02:25:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:55.199 02:25:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:55.199 02:25:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:55.199 02:25:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:55.199 02:25:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:55.199 02:25:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:55.199 02:25:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:55.199 02:25:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:55.199 02:25:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:55.199 02:25:22 -- common/autotest_common.sh@10 -- # set +x 00:22:57.106 02:25:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:57.106 02:25:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:57.106 02:25:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:57.106 02:25:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:57.106 02:25:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:57.106 02:25:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:57.106 02:25:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:57.106 02:25:24 -- nvmf/common.sh@294 -- # net_devs=() 00:22:57.106 02:25:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:57.106 02:25:24 -- nvmf/common.sh@295 -- # e810=() 00:22:57.106 02:25:24 -- nvmf/common.sh@295 -- # local -ga e810 00:22:57.106 02:25:24 -- nvmf/common.sh@296 -- # x722=() 00:22:57.106 02:25:24 -- nvmf/common.sh@296 -- # local -ga x722 00:22:57.106 02:25:24 -- nvmf/common.sh@297 -- # mlx=() 00:22:57.106 02:25:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:57.106 02:25:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:57.106 02:25:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:57.106 02:25:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:57.106 02:25:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:57.106 02:25:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:57.106 02:25:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:57.106 02:25:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:57.106 02:25:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:57.106 02:25:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:57.106 02:25:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:57.106 02:25:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:57.106 02:25:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:57.106 02:25:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:57.106 02:25:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:57.106 02:25:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:57.106 02:25:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:57.106 02:25:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:57.106 02:25:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:57.106 02:25:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:57.106 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:57.106 02:25:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:57.106 02:25:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:57.106 02:25:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:57.106 02:25:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:57.106 02:25:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:57.106 02:25:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:57.106 02:25:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:57.106 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:57.106 02:25:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:57.106 02:25:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:57.106 02:25:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:57.106 02:25:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:57.106 02:25:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:57.106 02:25:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:57.106 02:25:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:57.106 02:25:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:57.106 02:25:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:57.106 02:25:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:57.106 02:25:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:57.106 02:25:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:57.106 02:25:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:57.106 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:57.106 02:25:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:57.106 02:25:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:57.106 02:25:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:57.106 02:25:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:57.106 02:25:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:57.106 02:25:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:57.106 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:57.106 02:25:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:57.106 02:25:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:57.106 02:25:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:57.106 02:25:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:57.106 02:25:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:57.106 02:25:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:57.106 02:25:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:57.106 02:25:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:57.106 02:25:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:57.106 02:25:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:57.106 02:25:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:57.106 02:25:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:57.106 02:25:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:57.106 02:25:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:57.106 02:25:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:57.106 02:25:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:57.106 02:25:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:57.106 02:25:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:57.106 02:25:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:57.106 02:25:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:57.106 02:25:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:57.106 02:25:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:57.106 02:25:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:57.106 02:25:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:57.106 02:25:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:57.106 02:25:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:57.106 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:57.106 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.269 ms 00:22:57.106 00:22:57.106 --- 10.0.0.2 ping statistics --- 00:22:57.106 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:57.106 rtt min/avg/max/mdev = 0.269/0.269/0.269/0.000 ms 00:22:57.107 02:25:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:57.107 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:57.107 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.142 ms 00:22:57.107 00:22:57.107 --- 10.0.0.1 ping statistics --- 00:22:57.107 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:57.107 rtt min/avg/max/mdev = 0.142/0.142/0.142/0.000 ms 00:22:57.107 02:25:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:57.107 02:25:24 -- nvmf/common.sh@410 -- # return 0 00:22:57.107 02:25:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:57.107 02:25:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:57.107 02:25:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:57.107 02:25:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:57.107 02:25:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:57.107 02:25:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:57.107 02:25:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:57.107 02:25:24 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:22:57.107 02:25:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:57.107 02:25:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:57.107 02:25:24 -- common/autotest_common.sh@10 -- # set +x 00:22:57.107 02:25:24 -- nvmf/common.sh@469 -- # nvmfpid=2186876 00:22:57.107 02:25:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:57.107 02:25:24 -- nvmf/common.sh@470 -- # waitforlisten 2186876 00:22:57.107 02:25:24 -- common/autotest_common.sh@829 -- # '[' -z 2186876 ']' 00:22:57.107 02:25:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:57.107 02:25:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:57.107 02:25:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:57.107 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:57.107 02:25:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:57.107 02:25:24 -- common/autotest_common.sh@10 -- # set +x 00:22:57.107 [2024-12-08 02:25:24.863928] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:57.107 [2024-12-08 02:25:24.864011] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:57.367 EAL: No free 2048 kB hugepages reported on node 1 00:22:57.367 [2024-12-08 02:25:24.934878] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:57.367 [2024-12-08 02:25:25.051983] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:57.367 [2024-12-08 02:25:25.052128] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:57.367 [2024-12-08 02:25:25.052147] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:57.368 [2024-12-08 02:25:25.052161] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:57.368 [2024-12-08 02:25:25.052256] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:57.368 [2024-12-08 02:25:25.052327] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:57.368 [2024-12-08 02:25:25.052386] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:57.368 [2024-12-08 02:25:25.052388] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:58.303 02:25:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:58.303 02:25:25 -- common/autotest_common.sh@862 -- # return 0 00:22:58.303 02:25:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:58.303 02:25:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:58.303 02:25:25 -- common/autotest_common.sh@10 -- # set +x 00:22:58.303 02:25:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:58.303 02:25:25 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:22:58.303 02:25:25 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:23:01.591 02:25:28 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:23:01.592 02:25:28 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:23:01.592 02:25:29 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:23:01.592 02:25:29 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:23:01.850 02:25:29 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:23:01.850 02:25:29 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:23:01.850 02:25:29 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:23:01.850 02:25:29 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:23:01.850 02:25:29 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:23:02.107 [2024-12-08 02:25:29.761151] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:02.107 02:25:29 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:02.366 02:25:30 -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:02.366 02:25:30 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:02.624 02:25:30 -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:02.624 02:25:30 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:23:02.882 02:25:30 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:03.140 [2024-12-08 02:25:30.793014] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:03.140 02:25:30 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:03.399 02:25:31 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:23:03.399 02:25:31 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:03.399 02:25:31 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:23:03.399 02:25:31 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:04.776 Initializing NVMe Controllers 00:23:04.776 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:23:04.776 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:23:04.776 Initialization complete. Launching workers. 00:23:04.776 ======================================================== 00:23:04.776 Latency(us) 00:23:04.776 Device Information : IOPS MiB/s Average min max 00:23:04.776 PCIE (0000:88:00.0) NSID 1 from core 0: 85920.00 335.62 371.64 39.38 7249.11 00:23:04.776 ======================================================== 00:23:04.776 Total : 85920.00 335.62 371.64 39.38 7249.11 00:23:04.776 00:23:04.776 02:25:32 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:04.776 EAL: No free 2048 kB hugepages reported on node 1 00:23:06.154 Initializing NVMe Controllers 00:23:06.154 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:06.154 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:06.154 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:06.154 Initialization complete. Launching workers. 00:23:06.154 ======================================================== 00:23:06.154 Latency(us) 00:23:06.154 Device Information : IOPS MiB/s Average min max 00:23:06.154 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 77.00 0.30 13499.29 152.77 47437.37 00:23:06.154 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 65.00 0.25 15990.46 7953.16 50880.31 00:23:06.154 ======================================================== 00:23:06.154 Total : 142.00 0.55 14639.61 152.77 50880.31 00:23:06.154 00:23:06.154 02:25:33 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:06.154 EAL: No free 2048 kB hugepages reported on node 1 00:23:07.553 Initializing NVMe Controllers 00:23:07.553 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:07.553 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:07.553 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:07.553 Initialization complete. Launching workers. 00:23:07.553 ======================================================== 00:23:07.553 Latency(us) 00:23:07.553 Device Information : IOPS MiB/s Average min max 00:23:07.553 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8189.56 31.99 3930.15 702.82 44465.04 00:23:07.553 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3902.79 15.25 8236.32 6404.78 16358.73 00:23:07.553 ======================================================== 00:23:07.553 Total : 12092.35 47.24 5319.96 702.82 44465.04 00:23:07.553 00:23:07.553 02:25:34 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:23:07.553 02:25:34 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:23:07.553 02:25:34 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:07.553 EAL: No free 2048 kB hugepages reported on node 1 00:23:10.089 Initializing NVMe Controllers 00:23:10.089 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:10.089 Controller IO queue size 128, less than required. 00:23:10.089 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:10.089 Controller IO queue size 128, less than required. 00:23:10.089 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:10.089 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:10.089 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:10.089 Initialization complete. Launching workers. 00:23:10.089 ======================================================== 00:23:10.089 Latency(us) 00:23:10.089 Device Information : IOPS MiB/s Average min max 00:23:10.089 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1703.36 425.84 76206.49 55312.71 114560.98 00:23:10.089 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 574.27 143.57 231223.19 72263.85 391293.12 00:23:10.089 ======================================================== 00:23:10.089 Total : 2277.64 569.41 115291.75 55312.71 391293.12 00:23:10.089 00:23:10.089 02:25:37 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:23:10.089 EAL: No free 2048 kB hugepages reported on node 1 00:23:10.089 No valid NVMe controllers or AIO or URING devices found 00:23:10.089 Initializing NVMe Controllers 00:23:10.089 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:10.089 Controller IO queue size 128, less than required. 00:23:10.089 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:10.089 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:23:10.089 Controller IO queue size 128, less than required. 00:23:10.089 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:10.089 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:23:10.089 WARNING: Some requested NVMe devices were skipped 00:23:10.089 02:25:37 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:23:10.089 EAL: No free 2048 kB hugepages reported on node 1 00:23:13.376 Initializing NVMe Controllers 00:23:13.376 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:13.376 Controller IO queue size 128, less than required. 00:23:13.376 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:13.376 Controller IO queue size 128, less than required. 00:23:13.376 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:13.376 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:13.376 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:13.376 Initialization complete. Launching workers. 00:23:13.376 00:23:13.376 ==================== 00:23:13.376 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:23:13.376 TCP transport: 00:23:13.376 polls: 8810 00:23:13.376 idle_polls: 5784 00:23:13.376 sock_completions: 3026 00:23:13.376 nvme_completions: 5790 00:23:13.376 submitted_requests: 8908 00:23:13.376 queued_requests: 1 00:23:13.376 00:23:13.376 ==================== 00:23:13.376 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:23:13.376 TCP transport: 00:23:13.376 polls: 9089 00:23:13.376 idle_polls: 5522 00:23:13.376 sock_completions: 3567 00:23:13.376 nvme_completions: 6071 00:23:13.376 submitted_requests: 9191 00:23:13.376 queued_requests: 1 00:23:13.376 ======================================================== 00:23:13.376 Latency(us) 00:23:13.376 Device Information : IOPS MiB/s Average min max 00:23:13.376 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1510.94 377.74 87267.99 45700.87 150450.55 00:23:13.376 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1581.44 395.36 82084.55 45960.84 125331.09 00:23:13.376 ======================================================== 00:23:13.376 Total : 3092.38 773.10 84617.19 45700.87 150450.55 00:23:13.376 00:23:13.376 02:25:40 -- host/perf.sh@66 -- # sync 00:23:13.376 02:25:40 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:13.376 02:25:40 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:23:13.376 02:25:40 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:23:13.376 02:25:40 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:23:16.665 02:25:44 -- host/perf.sh@72 -- # ls_guid=345919e2-0d0f-4111-8429-876a3e0a9cce 00:23:16.665 02:25:44 -- host/perf.sh@73 -- # get_lvs_free_mb 345919e2-0d0f-4111-8429-876a3e0a9cce 00:23:16.665 02:25:44 -- common/autotest_common.sh@1353 -- # local lvs_uuid=345919e2-0d0f-4111-8429-876a3e0a9cce 00:23:16.665 02:25:44 -- common/autotest_common.sh@1354 -- # local lvs_info 00:23:16.665 02:25:44 -- common/autotest_common.sh@1355 -- # local fc 00:23:16.665 02:25:44 -- common/autotest_common.sh@1356 -- # local cs 00:23:16.665 02:25:44 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:16.924 02:25:44 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:23:16.924 { 00:23:16.924 "uuid": "345919e2-0d0f-4111-8429-876a3e0a9cce", 00:23:16.924 "name": "lvs_0", 00:23:16.924 "base_bdev": "Nvme0n1", 00:23:16.924 "total_data_clusters": 238234, 00:23:16.924 "free_clusters": 238234, 00:23:16.924 "block_size": 512, 00:23:16.924 "cluster_size": 4194304 00:23:16.924 } 00:23:16.924 ]' 00:23:16.924 02:25:44 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="345919e2-0d0f-4111-8429-876a3e0a9cce") .free_clusters' 00:23:16.924 02:25:44 -- common/autotest_common.sh@1358 -- # fc=238234 00:23:16.924 02:25:44 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="345919e2-0d0f-4111-8429-876a3e0a9cce") .cluster_size' 00:23:16.924 02:25:44 -- common/autotest_common.sh@1359 -- # cs=4194304 00:23:16.924 02:25:44 -- common/autotest_common.sh@1362 -- # free_mb=952936 00:23:16.924 02:25:44 -- common/autotest_common.sh@1363 -- # echo 952936 00:23:16.924 952936 00:23:16.924 02:25:44 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:23:16.924 02:25:44 -- host/perf.sh@78 -- # free_mb=20480 00:23:16.924 02:25:44 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 345919e2-0d0f-4111-8429-876a3e0a9cce lbd_0 20480 00:23:17.491 02:25:44 -- host/perf.sh@80 -- # lb_guid=8cb226a2-f359-443e-a60e-f6a8736399bf 00:23:17.491 02:25:44 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore 8cb226a2-f359-443e-a60e-f6a8736399bf lvs_n_0 00:23:18.057 02:25:45 -- host/perf.sh@83 -- # ls_nested_guid=970b2581-68af-40b0-9a8c-ef20ddf8f568 00:23:18.057 02:25:45 -- host/perf.sh@84 -- # get_lvs_free_mb 970b2581-68af-40b0-9a8c-ef20ddf8f568 00:23:18.057 02:25:45 -- common/autotest_common.sh@1353 -- # local lvs_uuid=970b2581-68af-40b0-9a8c-ef20ddf8f568 00:23:18.057 02:25:45 -- common/autotest_common.sh@1354 -- # local lvs_info 00:23:18.057 02:25:45 -- common/autotest_common.sh@1355 -- # local fc 00:23:18.057 02:25:45 -- common/autotest_common.sh@1356 -- # local cs 00:23:18.057 02:25:45 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:18.315 02:25:45 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:23:18.315 { 00:23:18.315 "uuid": "345919e2-0d0f-4111-8429-876a3e0a9cce", 00:23:18.315 "name": "lvs_0", 00:23:18.315 "base_bdev": "Nvme0n1", 00:23:18.315 "total_data_clusters": 238234, 00:23:18.315 "free_clusters": 233114, 00:23:18.315 "block_size": 512, 00:23:18.315 "cluster_size": 4194304 00:23:18.315 }, 00:23:18.315 { 00:23:18.315 "uuid": "970b2581-68af-40b0-9a8c-ef20ddf8f568", 00:23:18.315 "name": "lvs_n_0", 00:23:18.315 "base_bdev": "8cb226a2-f359-443e-a60e-f6a8736399bf", 00:23:18.315 "total_data_clusters": 5114, 00:23:18.315 "free_clusters": 5114, 00:23:18.315 "block_size": 512, 00:23:18.315 "cluster_size": 4194304 00:23:18.315 } 00:23:18.315 ]' 00:23:18.315 02:25:45 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="970b2581-68af-40b0-9a8c-ef20ddf8f568") .free_clusters' 00:23:18.315 02:25:46 -- common/autotest_common.sh@1358 -- # fc=5114 00:23:18.315 02:25:46 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="970b2581-68af-40b0-9a8c-ef20ddf8f568") .cluster_size' 00:23:18.315 02:25:46 -- common/autotest_common.sh@1359 -- # cs=4194304 00:23:18.315 02:25:46 -- common/autotest_common.sh@1362 -- # free_mb=20456 00:23:18.315 02:25:46 -- common/autotest_common.sh@1363 -- # echo 20456 00:23:18.315 20456 00:23:18.315 02:25:46 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:23:18.315 02:25:46 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 970b2581-68af-40b0-9a8c-ef20ddf8f568 lbd_nest_0 20456 00:23:18.881 02:25:46 -- host/perf.sh@88 -- # lb_nested_guid=66234f48-5ef6-47c7-b703-786e726fcdd8 00:23:18.881 02:25:46 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:18.881 02:25:46 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:23:18.881 02:25:46 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 66234f48-5ef6-47c7-b703-786e726fcdd8 00:23:19.140 02:25:46 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:19.434 02:25:47 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:23:19.434 02:25:47 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:23:19.434 02:25:47 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:23:19.434 02:25:47 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:19.434 02:25:47 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:19.434 EAL: No free 2048 kB hugepages reported on node 1 00:23:31.678 Initializing NVMe Controllers 00:23:31.678 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:31.678 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:31.678 Initialization complete. Launching workers. 00:23:31.678 ======================================================== 00:23:31.678 Latency(us) 00:23:31.678 Device Information : IOPS MiB/s Average min max 00:23:31.678 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 42.20 0.02 23775.52 162.59 45839.98 00:23:31.678 ======================================================== 00:23:31.678 Total : 42.20 0.02 23775.52 162.59 45839.98 00:23:31.678 00:23:31.678 02:25:57 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:31.678 02:25:57 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:31.678 EAL: No free 2048 kB hugepages reported on node 1 00:23:41.658 Initializing NVMe Controllers 00:23:41.658 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:41.658 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:41.658 Initialization complete. Launching workers. 00:23:41.658 ======================================================== 00:23:41.658 Latency(us) 00:23:41.658 Device Information : IOPS MiB/s Average min max 00:23:41.658 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 81.27 10.16 12323.53 4810.10 50827.55 00:23:41.658 ======================================================== 00:23:41.658 Total : 81.27 10.16 12323.53 4810.10 50827.55 00:23:41.658 00:23:41.658 02:26:07 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:23:41.658 02:26:07 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:41.658 02:26:07 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:41.658 EAL: No free 2048 kB hugepages reported on node 1 00:23:51.628 Initializing NVMe Controllers 00:23:51.628 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:51.628 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:51.628 Initialization complete. Launching workers. 00:23:51.628 ======================================================== 00:23:51.628 Latency(us) 00:23:51.628 Device Information : IOPS MiB/s Average min max 00:23:51.628 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7861.48 3.84 4079.03 279.60 43111.95 00:23:51.628 ======================================================== 00:23:51.628 Total : 7861.48 3.84 4079.03 279.60 43111.95 00:23:51.628 00:23:51.628 02:26:18 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:51.628 02:26:18 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:51.628 EAL: No free 2048 kB hugepages reported on node 1 00:24:01.617 Initializing NVMe Controllers 00:24:01.617 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:01.617 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:01.617 Initialization complete. Launching workers. 00:24:01.617 ======================================================== 00:24:01.617 Latency(us) 00:24:01.617 Device Information : IOPS MiB/s Average min max 00:24:01.617 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 3997.30 499.66 8006.57 1091.16 17656.70 00:24:01.617 ======================================================== 00:24:01.617 Total : 3997.30 499.66 8006.57 1091.16 17656.70 00:24:01.617 00:24:01.617 02:26:28 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:24:01.617 02:26:28 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:01.617 02:26:28 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:01.617 EAL: No free 2048 kB hugepages reported on node 1 00:24:11.616 Initializing NVMe Controllers 00:24:11.616 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:11.616 Controller IO queue size 128, less than required. 00:24:11.616 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:11.616 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:11.616 Initialization complete. Launching workers. 00:24:11.616 ======================================================== 00:24:11.616 Latency(us) 00:24:11.617 Device Information : IOPS MiB/s Average min max 00:24:11.617 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 12100.00 5.91 10580.03 1849.62 26828.07 00:24:11.617 ======================================================== 00:24:11.617 Total : 12100.00 5.91 10580.03 1849.62 26828.07 00:24:11.617 00:24:11.617 02:26:39 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:11.617 02:26:39 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:11.617 EAL: No free 2048 kB hugepages reported on node 1 00:24:21.603 Initializing NVMe Controllers 00:24:21.603 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:21.603 Controller IO queue size 128, less than required. 00:24:21.603 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:21.603 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:21.603 Initialization complete. Launching workers. 00:24:21.603 ======================================================== 00:24:21.603 Latency(us) 00:24:21.603 Device Information : IOPS MiB/s Average min max 00:24:21.603 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1185.19 148.15 108794.23 9719.04 230584.88 00:24:21.603 ======================================================== 00:24:21.603 Total : 1185.19 148.15 108794.23 9719.04 230584.88 00:24:21.603 00:24:21.603 02:26:49 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:21.861 02:26:49 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 66234f48-5ef6-47c7-b703-786e726fcdd8 00:24:22.811 02:26:50 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:24:23.069 02:26:50 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 8cb226a2-f359-443e-a60e-f6a8736399bf 00:24:23.325 02:26:50 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:24:23.582 02:26:51 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:24:23.582 02:26:51 -- host/perf.sh@114 -- # nvmftestfini 00:24:23.582 02:26:51 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:23.582 02:26:51 -- nvmf/common.sh@116 -- # sync 00:24:23.582 02:26:51 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:23.582 02:26:51 -- nvmf/common.sh@119 -- # set +e 00:24:23.582 02:26:51 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:23.582 02:26:51 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:23.582 rmmod nvme_tcp 00:24:23.582 rmmod nvme_fabrics 00:24:23.582 rmmod nvme_keyring 00:24:23.582 02:26:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:23.582 02:26:51 -- nvmf/common.sh@123 -- # set -e 00:24:23.582 02:26:51 -- nvmf/common.sh@124 -- # return 0 00:24:23.582 02:26:51 -- nvmf/common.sh@477 -- # '[' -n 2186876 ']' 00:24:23.582 02:26:51 -- nvmf/common.sh@478 -- # killprocess 2186876 00:24:23.582 02:26:51 -- common/autotest_common.sh@936 -- # '[' -z 2186876 ']' 00:24:23.582 02:26:51 -- common/autotest_common.sh@940 -- # kill -0 2186876 00:24:23.582 02:26:51 -- common/autotest_common.sh@941 -- # uname 00:24:23.582 02:26:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:23.582 02:26:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2186876 00:24:23.582 02:26:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:23.582 02:26:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:23.582 02:26:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2186876' 00:24:23.582 killing process with pid 2186876 00:24:23.582 02:26:51 -- common/autotest_common.sh@955 -- # kill 2186876 00:24:23.582 02:26:51 -- common/autotest_common.sh@960 -- # wait 2186876 00:24:25.485 02:26:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:25.485 02:26:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:25.485 02:26:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:25.485 02:26:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:25.485 02:26:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:25.485 02:26:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:25.485 02:26:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:25.485 02:26:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:27.388 02:26:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:27.388 00:24:27.388 real 1m32.497s 00:24:27.388 user 5m42.661s 00:24:27.388 sys 0m15.209s 00:24:27.389 02:26:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:27.389 02:26:54 -- common/autotest_common.sh@10 -- # set +x 00:24:27.389 ************************************ 00:24:27.389 END TEST nvmf_perf 00:24:27.389 ************************************ 00:24:27.389 02:26:55 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:24:27.389 02:26:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:27.389 02:26:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:27.389 02:26:55 -- common/autotest_common.sh@10 -- # set +x 00:24:27.389 ************************************ 00:24:27.389 START TEST nvmf_fio_host 00:24:27.389 ************************************ 00:24:27.389 02:26:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:24:27.389 * Looking for test storage... 00:24:27.389 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:24:27.389 02:26:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:27.389 02:26:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:27.389 02:26:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:27.389 02:26:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:27.389 02:26:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:27.389 02:26:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:27.389 02:26:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:27.389 02:26:55 -- scripts/common.sh@335 -- # IFS=.-: 00:24:27.389 02:26:55 -- scripts/common.sh@335 -- # read -ra ver1 00:24:27.389 02:26:55 -- scripts/common.sh@336 -- # IFS=.-: 00:24:27.389 02:26:55 -- scripts/common.sh@336 -- # read -ra ver2 00:24:27.389 02:26:55 -- scripts/common.sh@337 -- # local 'op=<' 00:24:27.389 02:26:55 -- scripts/common.sh@339 -- # ver1_l=2 00:24:27.389 02:26:55 -- scripts/common.sh@340 -- # ver2_l=1 00:24:27.389 02:26:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:27.389 02:26:55 -- scripts/common.sh@343 -- # case "$op" in 00:24:27.389 02:26:55 -- scripts/common.sh@344 -- # : 1 00:24:27.389 02:26:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:27.389 02:26:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:27.389 02:26:55 -- scripts/common.sh@364 -- # decimal 1 00:24:27.389 02:26:55 -- scripts/common.sh@352 -- # local d=1 00:24:27.389 02:26:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:27.389 02:26:55 -- scripts/common.sh@354 -- # echo 1 00:24:27.389 02:26:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:27.389 02:26:55 -- scripts/common.sh@365 -- # decimal 2 00:24:27.389 02:26:55 -- scripts/common.sh@352 -- # local d=2 00:24:27.389 02:26:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:27.389 02:26:55 -- scripts/common.sh@354 -- # echo 2 00:24:27.389 02:26:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:27.389 02:26:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:27.389 02:26:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:27.389 02:26:55 -- scripts/common.sh@367 -- # return 0 00:24:27.389 02:26:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:27.389 02:26:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:27.389 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:27.389 --rc genhtml_branch_coverage=1 00:24:27.389 --rc genhtml_function_coverage=1 00:24:27.389 --rc genhtml_legend=1 00:24:27.389 --rc geninfo_all_blocks=1 00:24:27.389 --rc geninfo_unexecuted_blocks=1 00:24:27.389 00:24:27.389 ' 00:24:27.389 02:26:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:27.389 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:27.389 --rc genhtml_branch_coverage=1 00:24:27.389 --rc genhtml_function_coverage=1 00:24:27.389 --rc genhtml_legend=1 00:24:27.389 --rc geninfo_all_blocks=1 00:24:27.389 --rc geninfo_unexecuted_blocks=1 00:24:27.389 00:24:27.389 ' 00:24:27.389 02:26:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:27.389 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:27.389 --rc genhtml_branch_coverage=1 00:24:27.389 --rc genhtml_function_coverage=1 00:24:27.389 --rc genhtml_legend=1 00:24:27.389 --rc geninfo_all_blocks=1 00:24:27.389 --rc geninfo_unexecuted_blocks=1 00:24:27.389 00:24:27.389 ' 00:24:27.389 02:26:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:27.389 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:27.389 --rc genhtml_branch_coverage=1 00:24:27.389 --rc genhtml_function_coverage=1 00:24:27.389 --rc genhtml_legend=1 00:24:27.389 --rc geninfo_all_blocks=1 00:24:27.389 --rc geninfo_unexecuted_blocks=1 00:24:27.389 00:24:27.389 ' 00:24:27.389 02:26:55 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:27.389 02:26:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:27.389 02:26:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:27.389 02:26:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:27.389 02:26:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:27.389 02:26:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:27.389 02:26:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:27.389 02:26:55 -- paths/export.sh@5 -- # export PATH 00:24:27.389 02:26:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:27.389 02:26:55 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:27.389 02:26:55 -- nvmf/common.sh@7 -- # uname -s 00:24:27.389 02:26:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:27.389 02:26:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:27.389 02:26:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:27.389 02:26:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:27.389 02:26:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:27.389 02:26:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:27.389 02:26:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:27.389 02:26:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:27.389 02:26:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:27.389 02:26:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:27.389 02:26:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:27.389 02:26:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:27.389 02:26:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:27.389 02:26:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:27.389 02:26:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:27.389 02:26:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:27.389 02:26:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:27.389 02:26:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:27.389 02:26:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:27.389 02:26:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:27.389 02:26:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:27.390 02:26:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:27.390 02:26:55 -- paths/export.sh@5 -- # export PATH 00:24:27.390 02:26:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:27.390 02:26:55 -- nvmf/common.sh@46 -- # : 0 00:24:27.390 02:26:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:27.390 02:26:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:27.390 02:26:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:27.390 02:26:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:27.390 02:26:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:27.390 02:26:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:27.390 02:26:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:27.390 02:26:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:27.390 02:26:55 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:24:27.390 02:26:55 -- host/fio.sh@14 -- # nvmftestinit 00:24:27.390 02:26:55 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:27.390 02:26:55 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:27.390 02:26:55 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:27.390 02:26:55 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:27.390 02:26:55 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:27.648 02:26:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:27.648 02:26:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:27.648 02:26:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:27.648 02:26:55 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:27.648 02:26:55 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:27.648 02:26:55 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:27.648 02:26:55 -- common/autotest_common.sh@10 -- # set +x 00:24:29.548 02:26:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:29.548 02:26:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:29.548 02:26:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:29.548 02:26:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:29.548 02:26:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:29.548 02:26:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:29.548 02:26:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:29.548 02:26:57 -- nvmf/common.sh@294 -- # net_devs=() 00:24:29.548 02:26:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:29.548 02:26:57 -- nvmf/common.sh@295 -- # e810=() 00:24:29.548 02:26:57 -- nvmf/common.sh@295 -- # local -ga e810 00:24:29.548 02:26:57 -- nvmf/common.sh@296 -- # x722=() 00:24:29.548 02:26:57 -- nvmf/common.sh@296 -- # local -ga x722 00:24:29.548 02:26:57 -- nvmf/common.sh@297 -- # mlx=() 00:24:29.548 02:26:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:29.548 02:26:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:29.548 02:26:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:29.548 02:26:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:29.548 02:26:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:29.548 02:26:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:29.548 02:26:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:29.548 02:26:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:29.548 02:26:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:29.548 02:26:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:29.548 02:26:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:29.548 02:26:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:29.548 02:26:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:29.548 02:26:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:29.548 02:26:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:29.548 02:26:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:29.548 02:26:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:29.548 02:26:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:29.548 02:26:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:29.548 02:26:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:29.548 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:29.548 02:26:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:29.549 02:26:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:29.549 02:26:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:29.549 02:26:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:29.549 02:26:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:29.549 02:26:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:29.549 02:26:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:29.549 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:29.549 02:26:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:29.549 02:26:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:29.549 02:26:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:29.549 02:26:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:29.549 02:26:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:29.549 02:26:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:29.549 02:26:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:29.549 02:26:57 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:29.549 02:26:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:29.549 02:26:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:29.549 02:26:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:29.549 02:26:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:29.549 02:26:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:29.549 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:29.549 02:26:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:29.549 02:26:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:29.549 02:26:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:29.549 02:26:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:29.549 02:26:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:29.549 02:26:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:29.549 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:29.549 02:26:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:29.549 02:26:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:29.549 02:26:57 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:29.549 02:26:57 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:29.549 02:26:57 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:29.549 02:26:57 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:29.549 02:26:57 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:29.549 02:26:57 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:29.549 02:26:57 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:29.549 02:26:57 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:29.549 02:26:57 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:29.549 02:26:57 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:29.549 02:26:57 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:29.549 02:26:57 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:29.549 02:26:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:29.549 02:26:57 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:29.549 02:26:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:29.549 02:26:57 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:29.549 02:26:57 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:29.549 02:26:57 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:29.549 02:26:57 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:29.807 02:26:57 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:29.807 02:26:57 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:29.807 02:26:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:29.807 02:26:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:29.807 02:26:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:29.807 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:29.807 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.200 ms 00:24:29.807 00:24:29.807 --- 10.0.0.2 ping statistics --- 00:24:29.807 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:29.807 rtt min/avg/max/mdev = 0.200/0.200/0.200/0.000 ms 00:24:29.807 02:26:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:29.807 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:29.807 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.088 ms 00:24:29.807 00:24:29.807 --- 10.0.0.1 ping statistics --- 00:24:29.807 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:29.807 rtt min/avg/max/mdev = 0.088/0.088/0.088/0.000 ms 00:24:29.807 02:26:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:29.807 02:26:57 -- nvmf/common.sh@410 -- # return 0 00:24:29.807 02:26:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:29.807 02:26:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:29.807 02:26:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:29.807 02:26:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:29.807 02:26:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:29.807 02:26:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:29.807 02:26:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:29.807 02:26:57 -- host/fio.sh@16 -- # [[ y != y ]] 00:24:29.807 02:26:57 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:24:29.807 02:26:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:29.807 02:26:57 -- common/autotest_common.sh@10 -- # set +x 00:24:29.807 02:26:57 -- host/fio.sh@24 -- # nvmfpid=2199429 00:24:29.807 02:26:57 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:24:29.807 02:26:57 -- host/fio.sh@28 -- # waitforlisten 2199429 00:24:29.807 02:26:57 -- common/autotest_common.sh@829 -- # '[' -z 2199429 ']' 00:24:29.807 02:26:57 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:24:29.807 02:26:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:29.807 02:26:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:29.807 02:26:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:29.808 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:29.808 02:26:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:29.808 02:26:57 -- common/autotest_common.sh@10 -- # set +x 00:24:29.808 [2024-12-08 02:26:57.457318] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:29.808 [2024-12-08 02:26:57.457392] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:29.808 EAL: No free 2048 kB hugepages reported on node 1 00:24:29.808 [2024-12-08 02:26:57.526241] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:30.067 [2024-12-08 02:26:57.643763] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:30.067 [2024-12-08 02:26:57.643929] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:30.067 [2024-12-08 02:26:57.643960] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:30.067 [2024-12-08 02:26:57.643974] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:30.067 [2024-12-08 02:26:57.644089] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:30.067 [2024-12-08 02:26:57.644156] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:30.067 [2024-12-08 02:26:57.644249] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:30.067 [2024-12-08 02:26:57.644252] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:30.635 02:26:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:30.635 02:26:58 -- common/autotest_common.sh@862 -- # return 0 00:24:30.635 02:26:58 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:24:30.894 [2024-12-08 02:26:58.640723] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:30.894 02:26:58 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:24:30.894 02:26:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:30.894 02:26:58 -- common/autotest_common.sh@10 -- # set +x 00:24:31.154 02:26:58 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:24:31.154 Malloc1 00:24:31.414 02:26:58 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:31.675 02:26:59 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:31.675 02:26:59 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:31.934 [2024-12-08 02:26:59.677393] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:31.934 02:26:59 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:24:32.261 02:26:59 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:24:32.261 02:26:59 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:32.261 02:26:59 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:32.261 02:26:59 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:24:32.261 02:26:59 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:32.261 02:26:59 -- common/autotest_common.sh@1328 -- # local sanitizers 00:24:32.261 02:26:59 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:32.261 02:26:59 -- common/autotest_common.sh@1330 -- # shift 00:24:32.261 02:26:59 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:24:32.261 02:26:59 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:32.261 02:26:59 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:32.261 02:26:59 -- common/autotest_common.sh@1334 -- # grep libasan 00:24:32.261 02:26:59 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:32.261 02:26:59 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:32.261 02:26:59 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:32.261 02:26:59 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:32.261 02:26:59 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:32.261 02:26:59 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:24:32.261 02:26:59 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:32.560 02:26:59 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:32.560 02:26:59 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:32.560 02:26:59 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:32.560 02:26:59 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:32.560 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:24:32.560 fio-3.35 00:24:32.560 Starting 1 thread 00:24:32.560 EAL: No free 2048 kB hugepages reported on node 1 00:24:35.124 00:24:35.124 test: (groupid=0, jobs=1): err= 0: pid=2199964: Sun Dec 8 02:27:02 2024 00:24:35.124 read: IOPS=9443, BW=36.9MiB/s (38.7MB/s)(74.0MiB/2006msec) 00:24:35.124 slat (nsec): min=1943, max=114271, avg=2558.28, stdev=1651.73 00:24:35.124 clat (usec): min=2388, max=12851, avg=7461.19, stdev=581.92 00:24:35.124 lat (usec): min=2410, max=12853, avg=7463.75, stdev=581.82 00:24:35.124 clat percentiles (usec): 00:24:35.124 | 1.00th=[ 6128], 5.00th=[ 6521], 10.00th=[ 6783], 20.00th=[ 6980], 00:24:35.124 | 30.00th=[ 7177], 40.00th=[ 7308], 50.00th=[ 7439], 60.00th=[ 7635], 00:24:35.124 | 70.00th=[ 7767], 80.00th=[ 7963], 90.00th=[ 8160], 95.00th=[ 8356], 00:24:35.124 | 99.00th=[ 8717], 99.50th=[ 8979], 99.90th=[ 9896], 99.95th=[11731], 00:24:35.124 | 99.99th=[12780] 00:24:35.124 bw ( KiB/s): min=36840, max=38360, per=99.95%, avg=37756.00, stdev=649.45, samples=4 00:24:35.124 iops : min= 9210, max= 9590, avg=9439.00, stdev=162.36, samples=4 00:24:35.124 write: IOPS=9443, BW=36.9MiB/s (38.7MB/s)(74.0MiB/2006msec); 0 zone resets 00:24:35.124 slat (nsec): min=1992, max=87670, avg=2632.96, stdev=1437.84 00:24:35.124 clat (usec): min=1065, max=11871, avg=6050.12, stdev=500.01 00:24:35.124 lat (usec): min=1071, max=11873, avg=6052.76, stdev=499.97 00:24:35.124 clat percentiles (usec): 00:24:35.124 | 1.00th=[ 4948], 5.00th=[ 5342], 10.00th=[ 5473], 20.00th=[ 5669], 00:24:35.124 | 30.00th=[ 5800], 40.00th=[ 5932], 50.00th=[ 6063], 60.00th=[ 6194], 00:24:35.124 | 70.00th=[ 6259], 80.00th=[ 6390], 90.00th=[ 6587], 95.00th=[ 6783], 00:24:35.124 | 99.00th=[ 7111], 99.50th=[ 7242], 99.90th=[ 9896], 99.95th=[10814], 00:24:35.124 | 99.99th=[11863] 00:24:35.124 bw ( KiB/s): min=37472, max=38056, per=99.98%, avg=37764.00, stdev=238.44, samples=4 00:24:35.124 iops : min= 9368, max= 9514, avg=9441.00, stdev=59.61, samples=4 00:24:35.124 lat (msec) : 2=0.03%, 4=0.11%, 10=99.78%, 20=0.08% 00:24:35.124 cpu : usr=66.03%, sys=31.97%, ctx=79, majf=0, minf=41 00:24:35.124 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:24:35.124 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:35.124 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:35.124 issued rwts: total=18944,18943,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:35.124 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:35.124 00:24:35.124 Run status group 0 (all jobs): 00:24:35.124 READ: bw=36.9MiB/s (38.7MB/s), 36.9MiB/s-36.9MiB/s (38.7MB/s-38.7MB/s), io=74.0MiB (77.6MB), run=2006-2006msec 00:24:35.124 WRITE: bw=36.9MiB/s (38.7MB/s), 36.9MiB/s-36.9MiB/s (38.7MB/s-38.7MB/s), io=74.0MiB (77.6MB), run=2006-2006msec 00:24:35.124 02:27:02 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:35.124 02:27:02 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:35.124 02:27:02 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:24:35.124 02:27:02 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:35.124 02:27:02 -- common/autotest_common.sh@1328 -- # local sanitizers 00:24:35.124 02:27:02 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:35.124 02:27:02 -- common/autotest_common.sh@1330 -- # shift 00:24:35.124 02:27:02 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:24:35.124 02:27:02 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:35.124 02:27:02 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:35.124 02:27:02 -- common/autotest_common.sh@1334 -- # grep libasan 00:24:35.124 02:27:02 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:35.124 02:27:02 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:35.124 02:27:02 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:35.124 02:27:02 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:35.124 02:27:02 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:35.124 02:27:02 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:24:35.124 02:27:02 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:35.124 02:27:02 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:35.124 02:27:02 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:35.124 02:27:02 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:35.124 02:27:02 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:35.124 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:24:35.124 fio-3.35 00:24:35.124 Starting 1 thread 00:24:35.124 EAL: No free 2048 kB hugepages reported on node 1 00:24:37.654 00:24:37.654 test: (groupid=0, jobs=1): err= 0: pid=2200388: Sun Dec 8 02:27:05 2024 00:24:37.654 read: IOPS=8307, BW=130MiB/s (136MB/s)(261MiB/2008msec) 00:24:37.654 slat (usec): min=2, max=103, avg= 3.77, stdev= 2.03 00:24:37.654 clat (usec): min=2467, max=16470, avg=8877.64, stdev=2141.05 00:24:37.654 lat (usec): min=2470, max=16473, avg=8881.41, stdev=2141.09 00:24:37.654 clat percentiles (usec): 00:24:37.654 | 1.00th=[ 4686], 5.00th=[ 5538], 10.00th=[ 6128], 20.00th=[ 6980], 00:24:37.654 | 30.00th=[ 7635], 40.00th=[ 8225], 50.00th=[ 8979], 60.00th=[ 9503], 00:24:37.654 | 70.00th=[ 9896], 80.00th=[10552], 90.00th=[11338], 95.00th=[12649], 00:24:37.654 | 99.00th=[15139], 99.50th=[15533], 99.90th=[16188], 99.95th=[16188], 00:24:37.654 | 99.99th=[16450] 00:24:37.654 bw ( KiB/s): min=60576, max=80544, per=51.90%, avg=68992.00, stdev=8491.64, samples=4 00:24:37.654 iops : min= 3786, max= 5034, avg=4312.00, stdev=530.73, samples=4 00:24:37.654 write: IOPS=4988, BW=77.9MiB/s (81.7MB/s)(141MiB/1807msec); 0 zone resets 00:24:37.654 slat (usec): min=31, max=188, avg=35.10, stdev= 6.46 00:24:37.654 clat (usec): min=3722, max=18499, avg=11284.57, stdev=2068.61 00:24:37.654 lat (usec): min=3756, max=18530, avg=11319.67, stdev=2068.75 00:24:37.654 clat percentiles (usec): 00:24:37.654 | 1.00th=[ 7177], 5.00th=[ 8225], 10.00th=[ 8848], 20.00th=[ 9503], 00:24:37.654 | 30.00th=[10028], 40.00th=[10552], 50.00th=[11076], 60.00th=[11600], 00:24:37.654 | 70.00th=[12256], 80.00th=[12911], 90.00th=[14091], 95.00th=[15139], 00:24:37.654 | 99.00th=[16319], 99.50th=[16909], 99.90th=[18220], 99.95th=[18220], 00:24:37.654 | 99.99th=[18482] 00:24:37.654 bw ( KiB/s): min=63648, max=83808, per=90.09%, avg=71904.00, stdev=8801.14, samples=4 00:24:37.654 iops : min= 3978, max= 5238, avg=4494.00, stdev=550.07, samples=4 00:24:37.654 lat (msec) : 4=0.18%, 10=55.83%, 20=43.99% 00:24:37.654 cpu : usr=76.53%, sys=22.17%, ctx=43, majf=0, minf=70 00:24:37.654 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:24:37.654 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:37.654 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:37.654 issued rwts: total=16682,9014,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:37.654 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:37.654 00:24:37.654 Run status group 0 (all jobs): 00:24:37.654 READ: bw=130MiB/s (136MB/s), 130MiB/s-130MiB/s (136MB/s-136MB/s), io=261MiB (273MB), run=2008-2008msec 00:24:37.654 WRITE: bw=77.9MiB/s (81.7MB/s), 77.9MiB/s-77.9MiB/s (81.7MB/s-81.7MB/s), io=141MiB (148MB), run=1807-1807msec 00:24:37.654 02:27:05 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:37.654 02:27:05 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:24:37.654 02:27:05 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:24:37.654 02:27:05 -- host/fio.sh@51 -- # get_nvme_bdfs 00:24:37.654 02:27:05 -- common/autotest_common.sh@1508 -- # bdfs=() 00:24:37.654 02:27:05 -- common/autotest_common.sh@1508 -- # local bdfs 00:24:37.654 02:27:05 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:24:37.654 02:27:05 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:24:37.654 02:27:05 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:24:37.654 02:27:05 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:24:37.654 02:27:05 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:24:37.654 02:27:05 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:24:40.929 Nvme0n1 00:24:40.929 02:27:08 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:24:44.205 02:27:11 -- host/fio.sh@53 -- # ls_guid=bf387ecf-03c3-4fc3-a57e-490b30386763 00:24:44.205 02:27:11 -- host/fio.sh@54 -- # get_lvs_free_mb bf387ecf-03c3-4fc3-a57e-490b30386763 00:24:44.205 02:27:11 -- common/autotest_common.sh@1353 -- # local lvs_uuid=bf387ecf-03c3-4fc3-a57e-490b30386763 00:24:44.205 02:27:11 -- common/autotest_common.sh@1354 -- # local lvs_info 00:24:44.205 02:27:11 -- common/autotest_common.sh@1355 -- # local fc 00:24:44.205 02:27:11 -- common/autotest_common.sh@1356 -- # local cs 00:24:44.205 02:27:11 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:24:44.205 02:27:11 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:24:44.205 { 00:24:44.205 "uuid": "bf387ecf-03c3-4fc3-a57e-490b30386763", 00:24:44.205 "name": "lvs_0", 00:24:44.205 "base_bdev": "Nvme0n1", 00:24:44.205 "total_data_clusters": 930, 00:24:44.205 "free_clusters": 930, 00:24:44.205 "block_size": 512, 00:24:44.205 "cluster_size": 1073741824 00:24:44.205 } 00:24:44.205 ]' 00:24:44.205 02:27:11 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="bf387ecf-03c3-4fc3-a57e-490b30386763") .free_clusters' 00:24:44.205 02:27:11 -- common/autotest_common.sh@1358 -- # fc=930 00:24:44.205 02:27:11 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="bf387ecf-03c3-4fc3-a57e-490b30386763") .cluster_size' 00:24:44.205 02:27:11 -- common/autotest_common.sh@1359 -- # cs=1073741824 00:24:44.205 02:27:11 -- common/autotest_common.sh@1362 -- # free_mb=952320 00:24:44.205 02:27:11 -- common/autotest_common.sh@1363 -- # echo 952320 00:24:44.205 952320 00:24:44.205 02:27:11 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:24:44.462 0e512c2e-7d5b-4d3a-aa29-becdb39b0535 00:24:44.462 02:27:12 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:24:44.719 02:27:12 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:24:44.976 02:27:12 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:24:45.234 02:27:12 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:45.234 02:27:12 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:45.234 02:27:12 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:24:45.234 02:27:12 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:45.234 02:27:12 -- common/autotest_common.sh@1328 -- # local sanitizers 00:24:45.234 02:27:12 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:45.234 02:27:12 -- common/autotest_common.sh@1330 -- # shift 00:24:45.234 02:27:12 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:24:45.234 02:27:12 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:45.234 02:27:12 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:45.234 02:27:12 -- common/autotest_common.sh@1334 -- # grep libasan 00:24:45.234 02:27:12 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:45.234 02:27:12 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:45.234 02:27:12 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:45.234 02:27:12 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:45.234 02:27:12 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:45.234 02:27:12 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:24:45.234 02:27:12 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:45.234 02:27:12 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:45.234 02:27:12 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:45.234 02:27:12 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:45.234 02:27:12 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:45.510 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:24:45.510 fio-3.35 00:24:45.510 Starting 1 thread 00:24:45.510 EAL: No free 2048 kB hugepages reported on node 1 00:24:48.035 00:24:48.035 test: (groupid=0, jobs=1): err= 0: pid=2202210: Sun Dec 8 02:27:15 2024 00:24:48.035 read: IOPS=6092, BW=23.8MiB/s (25.0MB/s)(47.7MiB/2006msec) 00:24:48.035 slat (nsec): min=1864, max=175738, avg=2449.90, stdev=2299.11 00:24:48.035 clat (usec): min=940, max=170962, avg=11523.13, stdev=11537.46 00:24:48.035 lat (usec): min=944, max=171008, avg=11525.58, stdev=11537.87 00:24:48.035 clat percentiles (msec): 00:24:48.035 | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 10], 20.00th=[ 10], 00:24:48.035 | 30.00th=[ 11], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 11], 00:24:48.035 | 70.00th=[ 12], 80.00th=[ 12], 90.00th=[ 12], 95.00th=[ 13], 00:24:48.035 | 99.00th=[ 14], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:24:48.035 | 99.99th=[ 171] 00:24:48.035 bw ( KiB/s): min=17368, max=26944, per=99.70%, avg=24296.00, stdev=4625.59, samples=4 00:24:48.035 iops : min= 4342, max= 6736, avg=6074.00, stdev=1156.40, samples=4 00:24:48.035 write: IOPS=6071, BW=23.7MiB/s (24.9MB/s)(47.6MiB/2006msec); 0 zone resets 00:24:48.035 slat (nsec): min=1982, max=141416, avg=2551.99, stdev=1621.28 00:24:48.035 clat (usec): min=290, max=169040, avg=9419.99, stdev=10838.01 00:24:48.035 lat (usec): min=294, max=169047, avg=9422.54, stdev=10838.38 00:24:48.035 clat percentiles (msec): 00:24:48.035 | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9], 00:24:48.035 | 30.00th=[ 9], 40.00th=[ 9], 50.00th=[ 9], 60.00th=[ 9], 00:24:48.035 | 70.00th=[ 10], 80.00th=[ 10], 90.00th=[ 10], 95.00th=[ 10], 00:24:48.035 | 99.00th=[ 11], 99.50th=[ 15], 99.90th=[ 169], 99.95th=[ 169], 00:24:48.035 | 99.99th=[ 169] 00:24:48.035 bw ( KiB/s): min=18344, max=26240, per=99.86%, avg=24250.00, stdev=3937.45, samples=4 00:24:48.035 iops : min= 4586, max= 6560, avg=6062.50, stdev=984.36, samples=4 00:24:48.035 lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01% 00:24:48.035 lat (msec) : 2=0.02%, 4=0.12%, 10=59.25%, 20=40.05%, 250=0.52% 00:24:48.035 cpu : usr=63.04%, sys=35.46%, ctx=93, majf=0, minf=41 00:24:48.035 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:24:48.035 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:48.035 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:48.035 issued rwts: total=12221,12179,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:48.035 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:48.035 00:24:48.035 Run status group 0 (all jobs): 00:24:48.035 READ: bw=23.8MiB/s (25.0MB/s), 23.8MiB/s-23.8MiB/s (25.0MB/s-25.0MB/s), io=47.7MiB (50.1MB), run=2006-2006msec 00:24:48.035 WRITE: bw=23.7MiB/s (24.9MB/s), 23.7MiB/s-23.7MiB/s (24.9MB/s-24.9MB/s), io=47.6MiB (49.9MB), run=2006-2006msec 00:24:48.035 02:27:15 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:24:48.035 02:27:15 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:24:49.405 02:27:16 -- host/fio.sh@64 -- # ls_nested_guid=f9f841bd-8396-47a1-bd3a-c3346d8f9523 00:24:49.405 02:27:16 -- host/fio.sh@65 -- # get_lvs_free_mb f9f841bd-8396-47a1-bd3a-c3346d8f9523 00:24:49.405 02:27:16 -- common/autotest_common.sh@1353 -- # local lvs_uuid=f9f841bd-8396-47a1-bd3a-c3346d8f9523 00:24:49.405 02:27:16 -- common/autotest_common.sh@1354 -- # local lvs_info 00:24:49.405 02:27:16 -- common/autotest_common.sh@1355 -- # local fc 00:24:49.405 02:27:16 -- common/autotest_common.sh@1356 -- # local cs 00:24:49.405 02:27:16 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:24:49.405 02:27:17 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:24:49.405 { 00:24:49.405 "uuid": "bf387ecf-03c3-4fc3-a57e-490b30386763", 00:24:49.405 "name": "lvs_0", 00:24:49.405 "base_bdev": "Nvme0n1", 00:24:49.405 "total_data_clusters": 930, 00:24:49.405 "free_clusters": 0, 00:24:49.405 "block_size": 512, 00:24:49.405 "cluster_size": 1073741824 00:24:49.405 }, 00:24:49.405 { 00:24:49.405 "uuid": "f9f841bd-8396-47a1-bd3a-c3346d8f9523", 00:24:49.405 "name": "lvs_n_0", 00:24:49.405 "base_bdev": "0e512c2e-7d5b-4d3a-aa29-becdb39b0535", 00:24:49.405 "total_data_clusters": 237847, 00:24:49.405 "free_clusters": 237847, 00:24:49.405 "block_size": 512, 00:24:49.405 "cluster_size": 4194304 00:24:49.405 } 00:24:49.405 ]' 00:24:49.405 02:27:17 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="f9f841bd-8396-47a1-bd3a-c3346d8f9523") .free_clusters' 00:24:49.405 02:27:17 -- common/autotest_common.sh@1358 -- # fc=237847 00:24:49.405 02:27:17 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="f9f841bd-8396-47a1-bd3a-c3346d8f9523") .cluster_size' 00:24:49.662 02:27:17 -- common/autotest_common.sh@1359 -- # cs=4194304 00:24:49.662 02:27:17 -- common/autotest_common.sh@1362 -- # free_mb=951388 00:24:49.662 02:27:17 -- common/autotest_common.sh@1363 -- # echo 951388 00:24:49.662 951388 00:24:49.662 02:27:17 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:24:50.227 e0e6df48-651a-46eb-bdf1-ca0e13cc6a44 00:24:50.227 02:27:17 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:24:50.484 02:27:18 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:24:50.741 02:27:18 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:24:50.999 02:27:18 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:50.999 02:27:18 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:50.999 02:27:18 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:24:50.999 02:27:18 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:50.999 02:27:18 -- common/autotest_common.sh@1328 -- # local sanitizers 00:24:50.999 02:27:18 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:50.999 02:27:18 -- common/autotest_common.sh@1330 -- # shift 00:24:50.999 02:27:18 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:24:50.999 02:27:18 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:50.999 02:27:18 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:50.999 02:27:18 -- common/autotest_common.sh@1334 -- # grep libasan 00:24:50.999 02:27:18 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:50.999 02:27:18 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:50.999 02:27:18 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:50.999 02:27:18 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:50.999 02:27:18 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:50.999 02:27:18 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:24:50.999 02:27:18 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:50.999 02:27:18 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:50.999 02:27:18 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:50.999 02:27:18 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:50.999 02:27:18 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:51.256 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:24:51.256 fio-3.35 00:24:51.256 Starting 1 thread 00:24:51.256 EAL: No free 2048 kB hugepages reported on node 1 00:24:53.782 00:24:53.782 test: (groupid=0, jobs=1): err= 0: pid=2202971: Sun Dec 8 02:27:21 2024 00:24:53.782 read: IOPS=6042, BW=23.6MiB/s (24.8MB/s)(47.4MiB/2008msec) 00:24:53.782 slat (nsec): min=1920, max=131690, avg=2610.41, stdev=2195.56 00:24:53.782 clat (usec): min=4426, max=18636, avg=11676.33, stdev=999.60 00:24:53.782 lat (usec): min=4434, max=18638, avg=11678.94, stdev=999.52 00:24:53.782 clat percentiles (usec): 00:24:53.782 | 1.00th=[ 9372], 5.00th=[10028], 10.00th=[10421], 20.00th=[10814], 00:24:53.782 | 30.00th=[11207], 40.00th=[11469], 50.00th=[11731], 60.00th=[11994], 00:24:53.782 | 70.00th=[12256], 80.00th=[12518], 90.00th=[12911], 95.00th=[13173], 00:24:53.782 | 99.00th=[13960], 99.50th=[14222], 99.90th=[15795], 99.95th=[17171], 00:24:53.782 | 99.99th=[18482] 00:24:53.782 bw ( KiB/s): min=23056, max=24704, per=99.79%, avg=24120.00, stdev=731.17, samples=4 00:24:53.782 iops : min= 5764, max= 6176, avg=6030.00, stdev=182.79, samples=4 00:24:53.782 write: IOPS=6023, BW=23.5MiB/s (24.7MB/s)(47.2MiB/2008msec); 0 zone resets 00:24:53.782 slat (usec): min=2, max=102, avg= 2.74, stdev= 1.87 00:24:53.782 clat (usec): min=2136, max=17150, avg=9398.31, stdev=870.85 00:24:53.782 lat (usec): min=2142, max=17153, avg=9401.06, stdev=870.82 00:24:53.782 clat percentiles (usec): 00:24:53.782 | 1.00th=[ 7308], 5.00th=[ 8094], 10.00th=[ 8455], 20.00th=[ 8717], 00:24:53.782 | 30.00th=[ 8979], 40.00th=[ 9241], 50.00th=[ 9372], 60.00th=[ 9634], 00:24:53.782 | 70.00th=[ 9765], 80.00th=[10028], 90.00th=[10421], 95.00th=[10683], 00:24:53.782 | 99.00th=[11338], 99.50th=[11731], 99.90th=[15401], 99.95th=[15795], 00:24:53.782 | 99.99th=[17171] 00:24:53.782 bw ( KiB/s): min=23920, max=24296, per=99.96%, avg=24086.00, stdev=155.59, samples=4 00:24:53.782 iops : min= 5980, max= 6074, avg=6021.50, stdev=38.90, samples=4 00:24:53.782 lat (msec) : 4=0.05%, 10=41.00%, 20=58.96% 00:24:53.782 cpu : usr=59.64%, sys=38.76%, ctx=132, majf=0, minf=41 00:24:53.782 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:24:53.782 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:53.782 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:53.782 issued rwts: total=12134,12096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:53.782 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:53.782 00:24:53.782 Run status group 0 (all jobs): 00:24:53.782 READ: bw=23.6MiB/s (24.8MB/s), 23.6MiB/s-23.6MiB/s (24.8MB/s-24.8MB/s), io=47.4MiB (49.7MB), run=2008-2008msec 00:24:53.782 WRITE: bw=23.5MiB/s (24.7MB/s), 23.5MiB/s-23.5MiB/s (24.7MB/s-24.7MB/s), io=47.2MiB (49.5MB), run=2008-2008msec 00:24:53.782 02:27:21 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:24:53.782 02:27:21 -- host/fio.sh@74 -- # sync 00:24:53.782 02:27:21 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:24:57.959 02:27:25 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:24:57.959 02:27:25 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:25:01.235 02:27:28 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:25:01.235 02:27:28 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:25:03.134 02:27:30 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:25:03.134 02:27:30 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:25:03.134 02:27:30 -- host/fio.sh@86 -- # nvmftestfini 00:25:03.134 02:27:30 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:03.134 02:27:30 -- nvmf/common.sh@116 -- # sync 00:25:03.134 02:27:30 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:03.134 02:27:30 -- nvmf/common.sh@119 -- # set +e 00:25:03.134 02:27:30 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:03.134 02:27:30 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:03.134 rmmod nvme_tcp 00:25:03.134 rmmod nvme_fabrics 00:25:03.134 rmmod nvme_keyring 00:25:03.134 02:27:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:03.134 02:27:30 -- nvmf/common.sh@123 -- # set -e 00:25:03.134 02:27:30 -- nvmf/common.sh@124 -- # return 0 00:25:03.134 02:27:30 -- nvmf/common.sh@477 -- # '[' -n 2199429 ']' 00:25:03.134 02:27:30 -- nvmf/common.sh@478 -- # killprocess 2199429 00:25:03.134 02:27:30 -- common/autotest_common.sh@936 -- # '[' -z 2199429 ']' 00:25:03.134 02:27:30 -- common/autotest_common.sh@940 -- # kill -0 2199429 00:25:03.134 02:27:30 -- common/autotest_common.sh@941 -- # uname 00:25:03.134 02:27:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:03.134 02:27:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2199429 00:25:03.134 02:27:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:03.134 02:27:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:03.134 02:27:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2199429' 00:25:03.134 killing process with pid 2199429 00:25:03.134 02:27:30 -- common/autotest_common.sh@955 -- # kill 2199429 00:25:03.134 02:27:30 -- common/autotest_common.sh@960 -- # wait 2199429 00:25:03.394 02:27:31 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:03.394 02:27:31 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:03.394 02:27:31 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:03.394 02:27:31 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:03.394 02:27:31 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:03.394 02:27:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:03.394 02:27:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:03.394 02:27:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:05.934 02:27:33 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:05.934 00:25:05.934 real 0m38.097s 00:25:05.934 user 2m25.732s 00:25:05.934 sys 0m6.918s 00:25:05.934 02:27:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:05.934 02:27:33 -- common/autotest_common.sh@10 -- # set +x 00:25:05.934 ************************************ 00:25:05.934 END TEST nvmf_fio_host 00:25:05.934 ************************************ 00:25:05.934 02:27:33 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:05.934 02:27:33 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:05.934 02:27:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:05.934 02:27:33 -- common/autotest_common.sh@10 -- # set +x 00:25:05.934 ************************************ 00:25:05.934 START TEST nvmf_failover 00:25:05.934 ************************************ 00:25:05.934 02:27:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:05.934 * Looking for test storage... 00:25:05.934 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:05.934 02:27:33 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:05.934 02:27:33 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:05.934 02:27:33 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:05.934 02:27:33 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:05.934 02:27:33 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:05.934 02:27:33 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:05.934 02:27:33 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:05.934 02:27:33 -- scripts/common.sh@335 -- # IFS=.-: 00:25:05.934 02:27:33 -- scripts/common.sh@335 -- # read -ra ver1 00:25:05.934 02:27:33 -- scripts/common.sh@336 -- # IFS=.-: 00:25:05.934 02:27:33 -- scripts/common.sh@336 -- # read -ra ver2 00:25:05.934 02:27:33 -- scripts/common.sh@337 -- # local 'op=<' 00:25:05.934 02:27:33 -- scripts/common.sh@339 -- # ver1_l=2 00:25:05.934 02:27:33 -- scripts/common.sh@340 -- # ver2_l=1 00:25:05.934 02:27:33 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:05.934 02:27:33 -- scripts/common.sh@343 -- # case "$op" in 00:25:05.934 02:27:33 -- scripts/common.sh@344 -- # : 1 00:25:05.934 02:27:33 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:05.934 02:27:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:05.934 02:27:33 -- scripts/common.sh@364 -- # decimal 1 00:25:05.934 02:27:33 -- scripts/common.sh@352 -- # local d=1 00:25:05.934 02:27:33 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:05.934 02:27:33 -- scripts/common.sh@354 -- # echo 1 00:25:05.934 02:27:33 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:05.934 02:27:33 -- scripts/common.sh@365 -- # decimal 2 00:25:05.934 02:27:33 -- scripts/common.sh@352 -- # local d=2 00:25:05.934 02:27:33 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:05.934 02:27:33 -- scripts/common.sh@354 -- # echo 2 00:25:05.934 02:27:33 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:05.934 02:27:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:05.934 02:27:33 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:05.934 02:27:33 -- scripts/common.sh@367 -- # return 0 00:25:05.934 02:27:33 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:05.934 02:27:33 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:05.934 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:05.934 --rc genhtml_branch_coverage=1 00:25:05.934 --rc genhtml_function_coverage=1 00:25:05.934 --rc genhtml_legend=1 00:25:05.934 --rc geninfo_all_blocks=1 00:25:05.934 --rc geninfo_unexecuted_blocks=1 00:25:05.934 00:25:05.934 ' 00:25:05.934 02:27:33 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:05.934 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:05.934 --rc genhtml_branch_coverage=1 00:25:05.934 --rc genhtml_function_coverage=1 00:25:05.934 --rc genhtml_legend=1 00:25:05.934 --rc geninfo_all_blocks=1 00:25:05.934 --rc geninfo_unexecuted_blocks=1 00:25:05.934 00:25:05.934 ' 00:25:05.934 02:27:33 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:05.934 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:05.934 --rc genhtml_branch_coverage=1 00:25:05.934 --rc genhtml_function_coverage=1 00:25:05.934 --rc genhtml_legend=1 00:25:05.934 --rc geninfo_all_blocks=1 00:25:05.934 --rc geninfo_unexecuted_blocks=1 00:25:05.934 00:25:05.934 ' 00:25:05.934 02:27:33 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:05.934 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:05.934 --rc genhtml_branch_coverage=1 00:25:05.934 --rc genhtml_function_coverage=1 00:25:05.934 --rc genhtml_legend=1 00:25:05.934 --rc geninfo_all_blocks=1 00:25:05.934 --rc geninfo_unexecuted_blocks=1 00:25:05.934 00:25:05.934 ' 00:25:05.934 02:27:33 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:05.934 02:27:33 -- nvmf/common.sh@7 -- # uname -s 00:25:05.934 02:27:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:05.934 02:27:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:05.934 02:27:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:05.934 02:27:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:05.934 02:27:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:05.934 02:27:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:05.934 02:27:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:05.934 02:27:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:05.934 02:27:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:05.934 02:27:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:05.934 02:27:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:05.934 02:27:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:05.934 02:27:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:05.934 02:27:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:05.934 02:27:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:05.934 02:27:33 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:05.935 02:27:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:05.935 02:27:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:05.935 02:27:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:05.935 02:27:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:05.935 02:27:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:05.935 02:27:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:05.935 02:27:33 -- paths/export.sh@5 -- # export PATH 00:25:05.935 02:27:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:05.935 02:27:33 -- nvmf/common.sh@46 -- # : 0 00:25:05.935 02:27:33 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:05.935 02:27:33 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:05.935 02:27:33 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:05.935 02:27:33 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:05.935 02:27:33 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:05.935 02:27:33 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:05.935 02:27:33 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:05.935 02:27:33 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:05.935 02:27:33 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:05.935 02:27:33 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:05.935 02:27:33 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:25:05.935 02:27:33 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:05.935 02:27:33 -- host/failover.sh@18 -- # nvmftestinit 00:25:05.935 02:27:33 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:05.935 02:27:33 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:05.935 02:27:33 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:05.935 02:27:33 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:05.935 02:27:33 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:05.935 02:27:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:05.935 02:27:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:05.935 02:27:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:05.935 02:27:33 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:05.935 02:27:33 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:05.935 02:27:33 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:05.935 02:27:33 -- common/autotest_common.sh@10 -- # set +x 00:25:07.839 02:27:35 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:07.839 02:27:35 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:07.839 02:27:35 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:07.839 02:27:35 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:07.839 02:27:35 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:07.839 02:27:35 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:07.839 02:27:35 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:07.839 02:27:35 -- nvmf/common.sh@294 -- # net_devs=() 00:25:07.839 02:27:35 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:07.839 02:27:35 -- nvmf/common.sh@295 -- # e810=() 00:25:07.839 02:27:35 -- nvmf/common.sh@295 -- # local -ga e810 00:25:07.839 02:27:35 -- nvmf/common.sh@296 -- # x722=() 00:25:07.839 02:27:35 -- nvmf/common.sh@296 -- # local -ga x722 00:25:07.839 02:27:35 -- nvmf/common.sh@297 -- # mlx=() 00:25:07.839 02:27:35 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:07.839 02:27:35 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:07.839 02:27:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:07.839 02:27:35 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:07.839 02:27:35 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:07.839 02:27:35 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:07.839 02:27:35 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:07.839 02:27:35 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:07.839 02:27:35 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:07.839 02:27:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:07.839 02:27:35 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:07.839 02:27:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:07.839 02:27:35 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:07.839 02:27:35 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:07.839 02:27:35 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:07.839 02:27:35 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:07.839 02:27:35 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:07.839 02:27:35 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:07.839 02:27:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:07.839 02:27:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:07.839 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:07.839 02:27:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:07.839 02:27:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:07.839 02:27:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:07.839 02:27:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:07.839 02:27:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:07.839 02:27:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:07.839 02:27:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:07.839 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:07.839 02:27:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:07.840 02:27:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:07.840 02:27:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:07.840 02:27:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:07.840 02:27:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:07.840 02:27:35 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:07.840 02:27:35 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:07.840 02:27:35 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:07.840 02:27:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:07.840 02:27:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:07.840 02:27:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:07.840 02:27:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:07.840 02:27:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:07.840 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:07.840 02:27:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:07.840 02:27:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:07.840 02:27:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:07.840 02:27:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:07.840 02:27:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:07.840 02:27:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:07.840 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:07.840 02:27:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:07.840 02:27:35 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:07.840 02:27:35 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:07.840 02:27:35 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:07.840 02:27:35 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:07.840 02:27:35 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:07.840 02:27:35 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:07.840 02:27:35 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:07.840 02:27:35 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:07.840 02:27:35 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:07.840 02:27:35 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:07.840 02:27:35 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:07.840 02:27:35 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:07.840 02:27:35 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:07.840 02:27:35 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:07.840 02:27:35 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:07.840 02:27:35 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:07.840 02:27:35 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:07.840 02:27:35 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:07.840 02:27:35 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:07.840 02:27:35 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:07.840 02:27:35 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:07.840 02:27:35 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:07.840 02:27:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:07.840 02:27:35 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:07.840 02:27:35 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:07.840 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:07.840 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.296 ms 00:25:07.840 00:25:07.840 --- 10.0.0.2 ping statistics --- 00:25:07.840 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:07.840 rtt min/avg/max/mdev = 0.296/0.296/0.296/0.000 ms 00:25:07.840 02:27:35 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:07.840 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:07.840 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.156 ms 00:25:07.840 00:25:07.840 --- 10.0.0.1 ping statistics --- 00:25:07.840 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:07.840 rtt min/avg/max/mdev = 0.156/0.156/0.156/0.000 ms 00:25:07.840 02:27:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:07.840 02:27:35 -- nvmf/common.sh@410 -- # return 0 00:25:07.840 02:27:35 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:07.840 02:27:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:07.840 02:27:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:07.840 02:27:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:07.840 02:27:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:07.840 02:27:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:07.840 02:27:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:07.840 02:27:35 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:25:07.840 02:27:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:07.840 02:27:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:07.840 02:27:35 -- common/autotest_common.sh@10 -- # set +x 00:25:07.840 02:27:35 -- nvmf/common.sh@469 -- # nvmfpid=2206411 00:25:07.840 02:27:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:07.840 02:27:35 -- nvmf/common.sh@470 -- # waitforlisten 2206411 00:25:07.840 02:27:35 -- common/autotest_common.sh@829 -- # '[' -z 2206411 ']' 00:25:07.840 02:27:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:07.840 02:27:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:07.840 02:27:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:07.840 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:07.840 02:27:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:07.840 02:27:35 -- common/autotest_common.sh@10 -- # set +x 00:25:07.840 [2024-12-08 02:27:35.449844] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:07.840 [2024-12-08 02:27:35.449919] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:07.840 EAL: No free 2048 kB hugepages reported on node 1 00:25:07.840 [2024-12-08 02:27:35.514210] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:08.098 [2024-12-08 02:27:35.624050] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:08.098 [2024-12-08 02:27:35.624212] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:08.098 [2024-12-08 02:27:35.624230] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:08.098 [2024-12-08 02:27:35.624243] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:08.098 [2024-12-08 02:27:35.624343] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:08.098 [2024-12-08 02:27:35.624437] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:08.098 [2024-12-08 02:27:35.624440] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:09.028 02:27:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:09.028 02:27:36 -- common/autotest_common.sh@862 -- # return 0 00:25:09.028 02:27:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:09.028 02:27:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:09.028 02:27:36 -- common/autotest_common.sh@10 -- # set +x 00:25:09.028 02:27:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:09.028 02:27:36 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:25:09.028 [2024-12-08 02:27:36.716176] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:09.028 02:27:36 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:25:09.286 Malloc0 00:25:09.286 02:27:37 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:09.543 02:27:37 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:09.801 02:27:37 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:10.058 [2024-12-08 02:27:37.745950] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:10.058 02:27:37 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:10.317 [2024-12-08 02:27:37.994703] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:10.317 02:27:38 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:10.575 [2024-12-08 02:27:38.279729] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:25:10.575 02:27:38 -- host/failover.sh@31 -- # bdevperf_pid=2206723 00:25:10.575 02:27:38 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:25:10.575 02:27:38 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:10.575 02:27:38 -- host/failover.sh@34 -- # waitforlisten 2206723 /var/tmp/bdevperf.sock 00:25:10.575 02:27:38 -- common/autotest_common.sh@829 -- # '[' -z 2206723 ']' 00:25:10.575 02:27:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:10.575 02:27:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:10.575 02:27:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:10.575 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:10.575 02:27:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:10.575 02:27:38 -- common/autotest_common.sh@10 -- # set +x 00:25:11.945 02:27:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:11.945 02:27:39 -- common/autotest_common.sh@862 -- # return 0 00:25:11.946 02:27:39 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:12.202 NVMe0n1 00:25:12.202 02:27:39 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:12.459 00:25:12.717 02:27:40 -- host/failover.sh@39 -- # run_test_pid=2206995 00:25:12.717 02:27:40 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:12.717 02:27:40 -- host/failover.sh@41 -- # sleep 1 00:25:13.701 02:27:41 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:13.987 [2024-12-08 02:27:41.487810] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.987 [2024-12-08 02:27:41.487887] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.987 [2024-12-08 02:27:41.487902] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.987 [2024-12-08 02:27:41.487915] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.987 [2024-12-08 02:27:41.487927] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.987 [2024-12-08 02:27:41.487939] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.987 [2024-12-08 02:27:41.487961] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.987 [2024-12-08 02:27:41.487973] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.987 [2024-12-08 02:27:41.487985] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.987 [2024-12-08 02:27:41.487997] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.987 [2024-12-08 02:27:41.488009] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.987 [2024-12-08 02:27:41.488020] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.987 [2024-12-08 02:27:41.488032] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.987 [2024-12-08 02:27:41.488043] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.987 [2024-12-08 02:27:41.488055] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.987 [2024-12-08 02:27:41.488066] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.987 [2024-12-08 02:27:41.488077] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.987 [2024-12-08 02:27:41.488089] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.987 [2024-12-08 02:27:41.488101] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.987 [2024-12-08 02:27:41.488112] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.987 [2024-12-08 02:27:41.488124] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.987 [2024-12-08 02:27:41.488136] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.987 [2024-12-08 02:27:41.488147] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.987 [2024-12-08 02:27:41.488159] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.987 [2024-12-08 02:27:41.488170] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.987 [2024-12-08 02:27:41.488181] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.987 [2024-12-08 02:27:41.488193] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.987 [2024-12-08 02:27:41.488204] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.987 [2024-12-08 02:27:41.488215] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.987 [2024-12-08 02:27:41.488227] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.987 [2024-12-08 02:27:41.488239] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.987 [2024-12-08 02:27:41.488251] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.987 [2024-12-08 02:27:41.488263] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.987 [2024-12-08 02:27:41.488278] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.987 [2024-12-08 02:27:41.488291] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.988 [2024-12-08 02:27:41.488303] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.988 [2024-12-08 02:27:41.488315] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.988 [2024-12-08 02:27:41.488327] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.988 [2024-12-08 02:27:41.488338] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.988 [2024-12-08 02:27:41.488350] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731cb0 is same with the state(5) to be set 00:25:13.988 02:27:41 -- host/failover.sh@45 -- # sleep 3 00:25:17.266 02:27:44 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:17.266 00:25:17.266 02:27:44 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:17.530 [2024-12-08 02:27:45.129423] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7333a0 is same with the state(5) to be set 00:25:17.530 [2024-12-08 02:27:45.129480] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7333a0 is same with the state(5) to be set 00:25:17.530 [2024-12-08 02:27:45.129510] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7333a0 is same with the state(5) to be set 00:25:17.530 [2024-12-08 02:27:45.129531] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7333a0 is same with the state(5) to be set 00:25:17.530 [2024-12-08 02:27:45.129554] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7333a0 is same with the state(5) to be set 00:25:17.530 [2024-12-08 02:27:45.129568] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7333a0 is same with the state(5) to be set 00:25:17.530 [2024-12-08 02:27:45.129580] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7333a0 is same with the state(5) to be set 00:25:17.530 [2024-12-08 02:27:45.129592] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7333a0 is same with the state(5) to be set 00:25:17.530 [2024-12-08 02:27:45.129604] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7333a0 is same with the state(5) to be set 00:25:17.530 [2024-12-08 02:27:45.129616] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7333a0 is same with the state(5) to be set 00:25:17.530 [2024-12-08 02:27:45.129627] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7333a0 is same with the state(5) to be set 00:25:17.530 [2024-12-08 02:27:45.129639] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7333a0 is same with the state(5) to be set 00:25:17.530 [2024-12-08 02:27:45.129651] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7333a0 is same with the state(5) to be set 00:25:17.530 [2024-12-08 02:27:45.129662] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7333a0 is same with the state(5) to be set 00:25:17.530 [2024-12-08 02:27:45.129674] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7333a0 is same with the state(5) to be set 00:25:17.530 [2024-12-08 02:27:45.129686] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7333a0 is same with the state(5) to be set 00:25:17.530 [2024-12-08 02:27:45.129697] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7333a0 is same with the state(5) to be set 00:25:17.530 [2024-12-08 02:27:45.129709] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7333a0 is same with the state(5) to be set 00:25:17.530 [2024-12-08 02:27:45.129731] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7333a0 is same with the state(5) to be set 00:25:17.530 [2024-12-08 02:27:45.129743] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7333a0 is same with the state(5) to be set 00:25:17.530 [2024-12-08 02:27:45.129756] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7333a0 is same with the state(5) to be set 00:25:17.530 [2024-12-08 02:27:45.129767] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7333a0 is same with the state(5) to be set 00:25:17.530 [2024-12-08 02:27:45.129779] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7333a0 is same with the state(5) to be set 00:25:17.530 [2024-12-08 02:27:45.129791] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7333a0 is same with the state(5) to be set 00:25:17.530 02:27:45 -- host/failover.sh@50 -- # sleep 3 00:25:20.807 02:27:48 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:20.807 [2024-12-08 02:27:48.438612] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:20.807 02:27:48 -- host/failover.sh@55 -- # sleep 1 00:25:21.741 02:27:49 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:22.000 [2024-12-08 02:27:49.748024] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.000 [2024-12-08 02:27:49.748085] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.000 [2024-12-08 02:27:49.748116] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.000 [2024-12-08 02:27:49.748129] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.000 [2024-12-08 02:27:49.748141] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.000 [2024-12-08 02:27:49.748152] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.000 [2024-12-08 02:27:49.748164] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.000 [2024-12-08 02:27:49.748176] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.000 [2024-12-08 02:27:49.748188] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.000 [2024-12-08 02:27:49.748199] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.000 [2024-12-08 02:27:49.748211] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.000 [2024-12-08 02:27:49.748222] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.000 [2024-12-08 02:27:49.748234] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.000 [2024-12-08 02:27:49.748246] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.001 [2024-12-08 02:27:49.748257] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.001 [2024-12-08 02:27:49.748269] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.001 [2024-12-08 02:27:49.748280] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.001 [2024-12-08 02:27:49.748316] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.001 [2024-12-08 02:27:49.748328] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.001 [2024-12-08 02:27:49.748339] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.001 [2024-12-08 02:27:49.748350] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.001 [2024-12-08 02:27:49.748361] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.001 [2024-12-08 02:27:49.748372] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.001 [2024-12-08 02:27:49.748383] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.001 [2024-12-08 02:27:49.748394] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.001 [2024-12-08 02:27:49.748405] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.001 [2024-12-08 02:27:49.748416] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.001 [2024-12-08 02:27:49.748427] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.001 [2024-12-08 02:27:49.748438] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.001 [2024-12-08 02:27:49.748449] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.001 [2024-12-08 02:27:49.748460] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.001 [2024-12-08 02:27:49.748470] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.001 [2024-12-08 02:27:49.748481] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.001 [2024-12-08 02:27:49.748492] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.001 [2024-12-08 02:27:49.748503] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.001 [2024-12-08 02:27:49.748514] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.001 [2024-12-08 02:27:49.748525] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.001 [2024-12-08 02:27:49.748562] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.001 [2024-12-08 02:27:49.748578] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.001 [2024-12-08 02:27:49.748589] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.001 [2024-12-08 02:27:49.748603] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.001 [2024-12-08 02:27:49.748615] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.001 [2024-12-08 02:27:49.748626] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.001 [2024-12-08 02:27:49.748638] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.001 [2024-12-08 02:27:49.748653] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.001 [2024-12-08 02:27:49.748666] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.001 [2024-12-08 02:27:49.748677] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733a80 is same with the state(5) to be set 00:25:22.001 02:27:49 -- host/failover.sh@59 -- # wait 2206995 00:25:28.598 0 00:25:28.598 02:27:55 -- host/failover.sh@61 -- # killprocess 2206723 00:25:28.598 02:27:55 -- common/autotest_common.sh@936 -- # '[' -z 2206723 ']' 00:25:28.598 02:27:55 -- common/autotest_common.sh@940 -- # kill -0 2206723 00:25:28.598 02:27:55 -- common/autotest_common.sh@941 -- # uname 00:25:28.598 02:27:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:28.598 02:27:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2206723 00:25:28.598 02:27:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:28.598 02:27:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:28.598 02:27:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2206723' 00:25:28.598 killing process with pid 2206723 00:25:28.598 02:27:55 -- common/autotest_common.sh@955 -- # kill 2206723 00:25:28.598 02:27:55 -- common/autotest_common.sh@960 -- # wait 2206723 00:25:28.598 02:27:55 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:28.598 [2024-12-08 02:27:38.334309] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:28.599 [2024-12-08 02:27:38.334394] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2206723 ] 00:25:28.599 EAL: No free 2048 kB hugepages reported on node 1 00:25:28.599 [2024-12-08 02:27:38.394360] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:28.599 [2024-12-08 02:27:38.500533] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:28.599 Running I/O for 15 seconds... 00:25:28.599 [2024-12-08 02:27:41.488641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:115664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.599 [2024-12-08 02:27:41.488683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.599 [2024-12-08 02:27:41.488712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:115672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.599 [2024-12-08 02:27:41.488728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.599 [2024-12-08 02:27:41.488745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:115680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.599 [2024-12-08 02:27:41.488759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.599 [2024-12-08 02:27:41.488775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:115712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.599 [2024-12-08 02:27:41.488788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.599 [2024-12-08 02:27:41.488804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:115720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.599 [2024-12-08 02:27:41.488817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.599 [2024-12-08 02:27:41.488832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:115736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.599 [2024-12-08 02:27:41.488846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.599 [2024-12-08 02:27:41.488861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:115752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.599 [2024-12-08 02:27:41.488875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.599 [2024-12-08 02:27:41.488890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:115760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.599 [2024-12-08 02:27:41.488903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.599 [2024-12-08 02:27:41.488918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:115768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.599 [2024-12-08 02:27:41.488932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.599 [2024-12-08 02:27:41.488947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:115776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.599 [2024-12-08 02:27:41.488960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.599 [2024-12-08 02:27:41.488975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:115792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.599 [2024-12-08 02:27:41.488988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.599 [2024-12-08 02:27:41.489012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:115104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.599 [2024-12-08 02:27:41.489026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.599 [2024-12-08 02:27:41.489041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:115120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.599 [2024-12-08 02:27:41.489055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.599 [2024-12-08 02:27:41.489070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:115136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.599 [2024-12-08 02:27:41.489084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.599 [2024-12-08 02:27:41.489098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:115176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.599 [2024-12-08 02:27:41.489112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.599 [2024-12-08 02:27:41.489126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:115184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.599 [2024-12-08 02:27:41.489140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.599 [2024-12-08 02:27:41.489155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:115208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.599 [2024-12-08 02:27:41.489168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.599 [2024-12-08 02:27:41.489183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:115224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.599 [2024-12-08 02:27:41.489196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.599 [2024-12-08 02:27:41.489211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:115232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.599 [2024-12-08 02:27:41.489224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.599 [2024-12-08 02:27:41.489239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:115816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.599 [2024-12-08 02:27:41.489252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.599 [2024-12-08 02:27:41.489267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:115824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.599 [2024-12-08 02:27:41.489280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.599 [2024-12-08 02:27:41.489295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:115864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.599 [2024-12-08 02:27:41.489308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.599 [2024-12-08 02:27:41.489323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:115880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.599 [2024-12-08 02:27:41.489336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.599 [2024-12-08 02:27:41.489351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:115888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.599 [2024-12-08 02:27:41.489369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.599 [2024-12-08 02:27:41.489384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:115896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.599 [2024-12-08 02:27:41.489398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.599 [2024-12-08 02:27:41.489413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:115904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.599 [2024-12-08 02:27:41.489426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.599 [2024-12-08 02:27:41.489441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:115912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.599 [2024-12-08 02:27:41.489454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.599 [2024-12-08 02:27:41.489469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:115920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.599 [2024-12-08 02:27:41.489482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.599 [2024-12-08 02:27:41.489497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:115928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.599 [2024-12-08 02:27:41.489510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.599 [2024-12-08 02:27:41.489525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:115936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.599 [2024-12-08 02:27:41.489549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.599 [2024-12-08 02:27:41.489567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:115944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.599 [2024-12-08 02:27:41.489581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.599 [2024-12-08 02:27:41.489596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:115952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.599 [2024-12-08 02:27:41.489610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.599 [2024-12-08 02:27:41.489625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:115960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.599 [2024-12-08 02:27:41.489639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.599 [2024-12-08 02:27:41.489653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:115968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.599 [2024-12-08 02:27:41.489667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.599 [2024-12-08 02:27:41.489682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:115976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.600 [2024-12-08 02:27:41.489695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.489710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:115984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.600 [2024-12-08 02:27:41.489723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.489741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:115992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.600 [2024-12-08 02:27:41.489756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.489771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:116000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.600 [2024-12-08 02:27:41.489784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.489799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:116008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.600 [2024-12-08 02:27:41.489813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.489828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:116016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.600 [2024-12-08 02:27:41.489841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.489856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:116024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.600 [2024-12-08 02:27:41.489869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.489884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:116032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.600 [2024-12-08 02:27:41.489897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.489912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:116040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.600 [2024-12-08 02:27:41.489925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.489941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:116048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.600 [2024-12-08 02:27:41.489954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.489970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:116056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.600 [2024-12-08 02:27:41.489984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.489999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:116064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.600 [2024-12-08 02:27:41.490012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.490027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:116072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.600 [2024-12-08 02:27:41.490041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.490056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:116080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.600 [2024-12-08 02:27:41.490069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.490083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:116088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.600 [2024-12-08 02:27:41.490100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.490115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:115264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.600 [2024-12-08 02:27:41.490128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.490143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:115280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.600 [2024-12-08 02:27:41.490156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.490171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:115288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.600 [2024-12-08 02:27:41.490184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.490199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:115304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.600 [2024-12-08 02:27:41.490212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.490227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:115312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.600 [2024-12-08 02:27:41.490240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.490255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:115320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.600 [2024-12-08 02:27:41.490268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.490283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:115336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.600 [2024-12-08 02:27:41.490297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.490311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:115344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.600 [2024-12-08 02:27:41.490324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.490339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:115352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.600 [2024-12-08 02:27:41.490353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.490367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:115368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.600 [2024-12-08 02:27:41.490381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.490396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:115376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.600 [2024-12-08 02:27:41.490409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.490424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:115392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.600 [2024-12-08 02:27:41.490438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.490460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:115408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.600 [2024-12-08 02:27:41.490475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.490489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:115416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.600 [2024-12-08 02:27:41.490503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.490518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:115424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.600 [2024-12-08 02:27:41.490531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.490553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:115456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.600 [2024-12-08 02:27:41.490567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.490582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:116096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.600 [2024-12-08 02:27:41.490596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.490611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:116104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.600 [2024-12-08 02:27:41.490624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.490638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:116112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.600 [2024-12-08 02:27:41.490651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.490666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:116120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.600 [2024-12-08 02:27:41.490679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.490694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:116128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.600 [2024-12-08 02:27:41.490707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.490721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:116136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.600 [2024-12-08 02:27:41.490735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.490749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:116144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.600 [2024-12-08 02:27:41.490762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.490777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:116152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.600 [2024-12-08 02:27:41.490790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.600 [2024-12-08 02:27:41.490805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:116160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.600 [2024-12-08 02:27:41.490828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.490844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:116168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.601 [2024-12-08 02:27:41.490857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.490872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:116176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.601 [2024-12-08 02:27:41.490885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.490900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:116184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.601 [2024-12-08 02:27:41.490914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.490929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:116192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.601 [2024-12-08 02:27:41.490942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.490957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:116200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.601 [2024-12-08 02:27:41.490970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.490985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:116208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.601 [2024-12-08 02:27:41.490999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.491013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:116216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.601 [2024-12-08 02:27:41.491026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.491041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:116224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.601 [2024-12-08 02:27:41.491055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.491070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:116232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.601 [2024-12-08 02:27:41.491082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.491097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:116240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.601 [2024-12-08 02:27:41.491110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.491124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:116248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.601 [2024-12-08 02:27:41.491147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.491171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:116256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.601 [2024-12-08 02:27:41.491187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.491203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:116264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.601 [2024-12-08 02:27:41.491220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.491236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:116272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.601 [2024-12-08 02:27:41.491250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.491264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:116280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.601 [2024-12-08 02:27:41.491277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.491293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:116288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.601 [2024-12-08 02:27:41.491306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.491321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:116296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.601 [2024-12-08 02:27:41.491334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.491349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:116304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.601 [2024-12-08 02:27:41.491362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.491377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:116312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.601 [2024-12-08 02:27:41.491390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.491405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:115488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.601 [2024-12-08 02:27:41.491418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.491433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:115504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.601 [2024-12-08 02:27:41.491447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.491461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:115512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.601 [2024-12-08 02:27:41.491474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.491489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:115520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.601 [2024-12-08 02:27:41.491502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.491517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:115536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.601 [2024-12-08 02:27:41.491531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.491557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:115552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.601 [2024-12-08 02:27:41.491572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.491591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:115624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.601 [2024-12-08 02:27:41.491605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.491620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:115632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.601 [2024-12-08 02:27:41.491633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.491648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:115640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.601 [2024-12-08 02:27:41.491669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.491684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:115648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.601 [2024-12-08 02:27:41.491698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.491713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:115656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.601 [2024-12-08 02:27:41.491726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.491741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:115688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.601 [2024-12-08 02:27:41.491755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.491769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:115696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.601 [2024-12-08 02:27:41.491782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.491797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:115704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.601 [2024-12-08 02:27:41.491810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.491825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:115728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.601 [2024-12-08 02:27:41.491838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.491853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:115744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.601 [2024-12-08 02:27:41.491866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.491881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:116320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.601 [2024-12-08 02:27:41.491895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.491909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:116328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.601 [2024-12-08 02:27:41.491922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.491937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:116336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.601 [2024-12-08 02:27:41.491953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.491968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:116344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.601 [2024-12-08 02:27:41.491982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.601 [2024-12-08 02:27:41.491997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:116352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.602 [2024-12-08 02:27:41.492010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.602 [2024-12-08 02:27:41.492025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:116360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.602 [2024-12-08 02:27:41.492039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.602 [2024-12-08 02:27:41.492054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:116368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.602 [2024-12-08 02:27:41.492067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.602 [2024-12-08 02:27:41.492082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:116376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.602 [2024-12-08 02:27:41.492095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.602 [2024-12-08 02:27:41.492110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:116384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.602 [2024-12-08 02:27:41.492123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.602 [2024-12-08 02:27:41.492138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:116392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.602 [2024-12-08 02:27:41.492151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.602 [2024-12-08 02:27:41.492165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:116400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.602 [2024-12-08 02:27:41.492178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.602 [2024-12-08 02:27:41.492193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:115784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.602 [2024-12-08 02:27:41.492207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.602 [2024-12-08 02:27:41.492222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:115800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.602 [2024-12-08 02:27:41.492235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.602 [2024-12-08 02:27:41.492250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:115808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.602 [2024-12-08 02:27:41.492263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.602 [2024-12-08 02:27:41.492278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:115832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.602 [2024-12-08 02:27:41.492291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.602 [2024-12-08 02:27:41.492310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:115840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.602 [2024-12-08 02:27:41.492324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.602 [2024-12-08 02:27:41.492339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:115848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.602 [2024-12-08 02:27:41.492353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.602 [2024-12-08 02:27:41.492367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:115856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.602 [2024-12-08 02:27:41.492380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.602 [2024-12-08 02:27:41.492394] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17086a0 is same with the state(5) to be set 00:25:28.602 [2024-12-08 02:27:41.492410] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:28.602 [2024-12-08 02:27:41.492421] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:28.602 [2024-12-08 02:27:41.492433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:115872 len:8 PRP1 0x0 PRP2 0x0 00:25:28.602 [2024-12-08 02:27:41.492445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.602 [2024-12-08 02:27:41.492505] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x17086a0 was disconnected and freed. reset controller. 00:25:28.602 [2024-12-08 02:27:41.492530] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:25:28.602 [2024-12-08 02:27:41.492575] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.602 [2024-12-08 02:27:41.492595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.602 [2024-12-08 02:27:41.492609] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.602 [2024-12-08 02:27:41.492622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.602 [2024-12-08 02:27:41.492635] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.602 [2024-12-08 02:27:41.492647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.602 [2024-12-08 02:27:41.492661] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.602 [2024-12-08 02:27:41.492673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.602 [2024-12-08 02:27:41.492686] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:28.602 [2024-12-08 02:27:41.494882] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:28.602 [2024-12-08 02:27:41.494920] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x16e9870 (9): Bad file descriptor 00:25:28.602 [2024-12-08 02:27:41.566746] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:28.602 [2024-12-08 02:27:45.129998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:122472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.602 [2024-12-08 02:27:45.130040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.602 [2024-12-08 02:27:45.130076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:122488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.602 [2024-12-08 02:27:45.130094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.602 [2024-12-08 02:27:45.130111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:122496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.602 [2024-12-08 02:27:45.130125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.602 [2024-12-08 02:27:45.130140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:122512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.602 [2024-12-08 02:27:45.130154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.602 [2024-12-08 02:27:45.130169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:121816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.602 [2024-12-08 02:27:45.130183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.602 [2024-12-08 02:27:45.130198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:121832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.602 [2024-12-08 02:27:45.130211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.602 [2024-12-08 02:27:45.130226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:121864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.602 [2024-12-08 02:27:45.130254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.602 [2024-12-08 02:27:45.130269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:121880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.602 [2024-12-08 02:27:45.130282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.602 [2024-12-08 02:27:45.130296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:121888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.602 [2024-12-08 02:27:45.130308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.602 [2024-12-08 02:27:45.130323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:121920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.602 [2024-12-08 02:27:45.130336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.602 [2024-12-08 02:27:45.130351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:121936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.602 [2024-12-08 02:27:45.130364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.602 [2024-12-08 02:27:45.130378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:121944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.602 [2024-12-08 02:27:45.130390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.602 [2024-12-08 02:27:45.130405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:121952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.602 [2024-12-08 02:27:45.130417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.602 [2024-12-08 02:27:45.130431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:121976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.602 [2024-12-08 02:27:45.130449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.602 [2024-12-08 02:27:45.130464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:121984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.602 [2024-12-08 02:27:45.130476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.602 [2024-12-08 02:27:45.130491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:121992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.603 [2024-12-08 02:27:45.130504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.603 [2024-12-08 02:27:45.130518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:122024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.603 [2024-12-08 02:27:45.130555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.603 [2024-12-08 02:27:45.130572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:122040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.603 [2024-12-08 02:27:45.130587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.603 [2024-12-08 02:27:45.130602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:122048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.603 [2024-12-08 02:27:45.130615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.603 [2024-12-08 02:27:45.130630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:122056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.603 [2024-12-08 02:27:45.130643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.603 [2024-12-08 02:27:45.130658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:122528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.603 [2024-12-08 02:27:45.130672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.603 [2024-12-08 02:27:45.130686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:122544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.603 [2024-12-08 02:27:45.130699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.603 [2024-12-08 02:27:45.130714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:122552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.603 [2024-12-08 02:27:45.130728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.603 [2024-12-08 02:27:45.130742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:122560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.603 [2024-12-08 02:27:45.130756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.603 [2024-12-08 02:27:45.130770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:122568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.603 [2024-12-08 02:27:45.130783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.603 [2024-12-08 02:27:45.130798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:122584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.603 [2024-12-08 02:27:45.130812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.603 [2024-12-08 02:27:45.130831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:122592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.603 [2024-12-08 02:27:45.130866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.603 [2024-12-08 02:27:45.130881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:122600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.603 [2024-12-08 02:27:45.130894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.603 [2024-12-08 02:27:45.130909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:122608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.603 [2024-12-08 02:27:45.130921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.603 [2024-12-08 02:27:45.130936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:122616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.603 [2024-12-08 02:27:45.130948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.603 [2024-12-08 02:27:45.130963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:122624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.603 [2024-12-08 02:27:45.130975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.603 [2024-12-08 02:27:45.130989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:122632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.603 [2024-12-08 02:27:45.131002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.603 [2024-12-08 02:27:45.131016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:122640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.603 [2024-12-08 02:27:45.131029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.603 [2024-12-08 02:27:45.131043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:122648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.603 [2024-12-08 02:27:45.131056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.603 [2024-12-08 02:27:45.131071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:122656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.603 [2024-12-08 02:27:45.131083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.603 [2024-12-08 02:27:45.131097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:122664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.603 [2024-12-08 02:27:45.131110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.603 [2024-12-08 02:27:45.131124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:122672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.603 [2024-12-08 02:27:45.131137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.603 [2024-12-08 02:27:45.131151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:122680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.603 [2024-12-08 02:27:45.131164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.603 [2024-12-08 02:27:45.131178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:122688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.603 [2024-12-08 02:27:45.131201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.603 [2024-12-08 02:27:45.131216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:122696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.603 [2024-12-08 02:27:45.131229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.603 [2024-12-08 02:27:45.131244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:122704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.603 [2024-12-08 02:27:45.131257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.603 [2024-12-08 02:27:45.131271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:122712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.603 [2024-12-08 02:27:45.131284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.603 [2024-12-08 02:27:45.131299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:122720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.603 [2024-12-08 02:27:45.131312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.603 [2024-12-08 02:27:45.131326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:122728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.603 [2024-12-08 02:27:45.131338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.603 [2024-12-08 02:27:45.131352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:122096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.603 [2024-12-08 02:27:45.131366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.603 [2024-12-08 02:27:45.131380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:122112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.603 [2024-12-08 02:27:45.131393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.603 [2024-12-08 02:27:45.131407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:122120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.603 [2024-12-08 02:27:45.131420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.603 [2024-12-08 02:27:45.131434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:122136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.603 [2024-12-08 02:27:45.131447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.131461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:122144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.604 [2024-12-08 02:27:45.131473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.131488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:122176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.604 [2024-12-08 02:27:45.131500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.131515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:122192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.604 [2024-12-08 02:27:45.131555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.131572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:122200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.604 [2024-12-08 02:27:45.131590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.131606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:122736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.604 [2024-12-08 02:27:45.131619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.131634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:122744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.604 [2024-12-08 02:27:45.131647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.131662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:122752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.604 [2024-12-08 02:27:45.131675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.131690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:122760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.604 [2024-12-08 02:27:45.131703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.131718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:122768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.604 [2024-12-08 02:27:45.131731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.131746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:122776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.604 [2024-12-08 02:27:45.131760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.131775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:122784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.604 [2024-12-08 02:27:45.131788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.131802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:122792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.604 [2024-12-08 02:27:45.131815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.131830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:122800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.604 [2024-12-08 02:27:45.131859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.131874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:122808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.604 [2024-12-08 02:27:45.131888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.131902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:122816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.604 [2024-12-08 02:27:45.131915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.131929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:122824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.604 [2024-12-08 02:27:45.131942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.131960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:122832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.604 [2024-12-08 02:27:45.131974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.131988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:122840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.604 [2024-12-08 02:27:45.132000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.132015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:122848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.604 [2024-12-08 02:27:45.132028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.132042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:122856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.604 [2024-12-08 02:27:45.132055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.132069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:122864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.604 [2024-12-08 02:27:45.132083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.132097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:122872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.604 [2024-12-08 02:27:45.132110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.132124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:122880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.604 [2024-12-08 02:27:45.132136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.132151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:122888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.604 [2024-12-08 02:27:45.132164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.132178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:122896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.604 [2024-12-08 02:27:45.132191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.132205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:122904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.604 [2024-12-08 02:27:45.132218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.132232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:122912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.604 [2024-12-08 02:27:45.132245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.132259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:122920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.604 [2024-12-08 02:27:45.132271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.132285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:122928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.604 [2024-12-08 02:27:45.132302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.132317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:122936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.604 [2024-12-08 02:27:45.132330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.132344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:122944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.604 [2024-12-08 02:27:45.132357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.132371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:122952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.604 [2024-12-08 02:27:45.132384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.132399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:122960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.604 [2024-12-08 02:27:45.132411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.132425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:122968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.604 [2024-12-08 02:27:45.132438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.132455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:122976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.604 [2024-12-08 02:27:45.132467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.132481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:122984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.604 [2024-12-08 02:27:45.132495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.132509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:122224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.604 [2024-12-08 02:27:45.132530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.132566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:122232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.604 [2024-12-08 02:27:45.132582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.132597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:122240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.604 [2024-12-08 02:27:45.132611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.604 [2024-12-08 02:27:45.132625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:122248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.605 [2024-12-08 02:27:45.132638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.132653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:122264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.605 [2024-12-08 02:27:45.132666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.132684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:122272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.605 [2024-12-08 02:27:45.132698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.132712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:122296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.605 [2024-12-08 02:27:45.132725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.132740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:122304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.605 [2024-12-08 02:27:45.132752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.132767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:122320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.605 [2024-12-08 02:27:45.132781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.132795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:122328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.605 [2024-12-08 02:27:45.132808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.132823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:122352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.605 [2024-12-08 02:27:45.132837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.132871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:122376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.605 [2024-12-08 02:27:45.132884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.132898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:122400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.605 [2024-12-08 02:27:45.132911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.132926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:122408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.605 [2024-12-08 02:27:45.132939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.132953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:122416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.605 [2024-12-08 02:27:45.132965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.132980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:122432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.605 [2024-12-08 02:27:45.132993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.133007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:122992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.605 [2024-12-08 02:27:45.133020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.133035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:123000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.605 [2024-12-08 02:27:45.133051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.133066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:123008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.605 [2024-12-08 02:27:45.133079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.133093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:123016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.605 [2024-12-08 02:27:45.133106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.133120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:123024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.605 [2024-12-08 02:27:45.133133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.133147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:123032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.605 [2024-12-08 02:27:45.133160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.133174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:123040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.605 [2024-12-08 02:27:45.133187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.133201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:123048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.605 [2024-12-08 02:27:45.133215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.133229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:123056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.605 [2024-12-08 02:27:45.133242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.133257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:123064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.605 [2024-12-08 02:27:45.133270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.133284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:123072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.605 [2024-12-08 02:27:45.133297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.133311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:123080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.605 [2024-12-08 02:27:45.133324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.133338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:123088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.605 [2024-12-08 02:27:45.133351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.133366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:123096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.605 [2024-12-08 02:27:45.133379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.133397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:123104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.605 [2024-12-08 02:27:45.133410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.133425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:123112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.605 [2024-12-08 02:27:45.133438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.133453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:123120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.605 [2024-12-08 02:27:45.133466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.133481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:123128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.605 [2024-12-08 02:27:45.133494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.133508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:123136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.605 [2024-12-08 02:27:45.133521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.133544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:123144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.605 [2024-12-08 02:27:45.133576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.133592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:122448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.605 [2024-12-08 02:27:45.133605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.133621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:122456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.605 [2024-12-08 02:27:45.133635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.133649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:122464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.605 [2024-12-08 02:27:45.133662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.133677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:122480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.605 [2024-12-08 02:27:45.133691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.133705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:122504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.605 [2024-12-08 02:27:45.133719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.133734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:122520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.605 [2024-12-08 02:27:45.133746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.605 [2024-12-08 02:27:45.133761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:122536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.606 [2024-12-08 02:27:45.133777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.606 [2024-12-08 02:27:45.133792] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16f5d10 is same with the state(5) to be set 00:25:28.606 [2024-12-08 02:27:45.133809] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:28.606 [2024-12-08 02:27:45.133820] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:28.606 [2024-12-08 02:27:45.133831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:122576 len:8 PRP1 0x0 PRP2 0x0 00:25:28.606 [2024-12-08 02:27:45.133863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.606 [2024-12-08 02:27:45.133934] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x16f5d10 was disconnected and freed. reset controller. 00:25:28.606 [2024-12-08 02:27:45.133953] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:25:28.606 [2024-12-08 02:27:45.133986] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.606 [2024-12-08 02:27:45.134004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.606 [2024-12-08 02:27:45.134019] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.606 [2024-12-08 02:27:45.134032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.606 [2024-12-08 02:27:45.134045] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.606 [2024-12-08 02:27:45.134057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.606 [2024-12-08 02:27:45.134070] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.606 [2024-12-08 02:27:45.134083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.606 [2024-12-08 02:27:45.134096] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:28.606 [2024-12-08 02:27:45.134133] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x16e9870 (9): Bad file descriptor 00:25:28.606 [2024-12-08 02:27:45.136286] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:28.606 [2024-12-08 02:27:45.243688] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:28.606 [2024-12-08 02:27:49.748784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:113648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.606 [2024-12-08 02:27:49.748827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.606 [2024-12-08 02:27:49.748858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:113656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.606 [2024-12-08 02:27:49.748874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.606 [2024-12-08 02:27:49.748891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:113672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.606 [2024-12-08 02:27:49.748905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.606 [2024-12-08 02:27:49.748921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:113696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.606 [2024-12-08 02:27:49.748935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.606 [2024-12-08 02:27:49.748957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:113712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.606 [2024-12-08 02:27:49.748972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.606 [2024-12-08 02:27:49.748987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:113720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.606 [2024-12-08 02:27:49.749001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.606 [2024-12-08 02:27:49.749016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:113736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.606 [2024-12-08 02:27:49.749030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.606 [2024-12-08 02:27:49.749060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:113760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.606 [2024-12-08 02:27:49.749073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.606 [2024-12-08 02:27:49.749087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:113768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.606 [2024-12-08 02:27:49.749100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.606 [2024-12-08 02:27:49.749115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:113776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.606 [2024-12-08 02:27:49.749128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.606 [2024-12-08 02:27:49.749143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:113784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.606 [2024-12-08 02:27:49.749156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.606 [2024-12-08 02:27:49.749170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:113792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.606 [2024-12-08 02:27:49.749184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.606 [2024-12-08 02:27:49.749198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:113800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.606 [2024-12-08 02:27:49.749212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.606 [2024-12-08 02:27:49.749227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:113824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.606 [2024-12-08 02:27:49.749240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.606 [2024-12-08 02:27:49.749254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:113832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.606 [2024-12-08 02:27:49.749268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.606 [2024-12-08 02:27:49.749282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:113856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.606 [2024-12-08 02:27:49.749294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.606 [2024-12-08 02:27:49.749309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:113880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.606 [2024-12-08 02:27:49.749326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.606 [2024-12-08 02:27:49.749341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:113896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.606 [2024-12-08 02:27:49.749354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.606 [2024-12-08 02:27:49.749369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:113904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.606 [2024-12-08 02:27:49.749381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.606 [2024-12-08 02:27:49.749396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:113912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.606 [2024-12-08 02:27:49.749409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.606 [2024-12-08 02:27:49.749423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:113920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.606 [2024-12-08 02:27:49.749435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.606 [2024-12-08 02:27:49.749450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:113928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.606 [2024-12-08 02:27:49.749462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.606 [2024-12-08 02:27:49.749477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:113936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.606 [2024-12-08 02:27:49.749490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.606 [2024-12-08 02:27:49.749504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:113944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.606 [2024-12-08 02:27:49.749517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.606 [2024-12-08 02:27:49.749531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:113952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.606 [2024-12-08 02:27:49.749570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.606 [2024-12-08 02:27:49.749587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:113960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.606 [2024-12-08 02:27:49.749601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.606 [2024-12-08 02:27:49.749616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:113136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.606 [2024-12-08 02:27:49.749629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.606 [2024-12-08 02:27:49.749644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:113160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.607 [2024-12-08 02:27:49.749657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.749672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:113168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.607 [2024-12-08 02:27:49.749686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.749710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:113192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.607 [2024-12-08 02:27:49.749724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.749740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:113216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.607 [2024-12-08 02:27:49.749753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.749769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:113248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.607 [2024-12-08 02:27:49.749782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.749797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:113256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.607 [2024-12-08 02:27:49.749810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.749825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:113272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.607 [2024-12-08 02:27:49.749839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.749869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:113968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.607 [2024-12-08 02:27:49.749882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.749896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:113976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.607 [2024-12-08 02:27:49.749909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.749924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:113984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.607 [2024-12-08 02:27:49.749936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.749951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:113992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.607 [2024-12-08 02:27:49.749964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.749978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:114000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.607 [2024-12-08 02:27:49.749991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.750006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:114008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.607 [2024-12-08 02:27:49.750019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.750033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:114016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.607 [2024-12-08 02:27:49.750046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.750061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:114024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.607 [2024-12-08 02:27:49.750077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.750092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:114032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.607 [2024-12-08 02:27:49.750105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.750120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:114040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.607 [2024-12-08 02:27:49.750132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.750146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:114048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.607 [2024-12-08 02:27:49.750160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.750174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:114056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.607 [2024-12-08 02:27:49.750188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.750202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:113296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.607 [2024-12-08 02:27:49.750215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.750230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:113312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.607 [2024-12-08 02:27:49.750243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.750258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:113376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.607 [2024-12-08 02:27:49.750271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.750285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:113384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.607 [2024-12-08 02:27:49.750298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.750313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:113400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.607 [2024-12-08 02:27:49.750326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.750340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:113424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.607 [2024-12-08 02:27:49.750353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.750368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:113440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.607 [2024-12-08 02:27:49.750380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.750395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:113448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.607 [2024-12-08 02:27:49.750408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.750426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:113456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.607 [2024-12-08 02:27:49.750440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.750454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:113496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.607 [2024-12-08 02:27:49.750467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.750481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:113504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.607 [2024-12-08 02:27:49.750494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.750508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:113528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.607 [2024-12-08 02:27:49.750521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.750542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:113552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.607 [2024-12-08 02:27:49.750573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.750589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:113576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.607 [2024-12-08 02:27:49.750602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.750617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:113584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.607 [2024-12-08 02:27:49.750632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.750647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:113592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.607 [2024-12-08 02:27:49.750661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.750676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:114064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.607 [2024-12-08 02:27:49.750690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.750704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:114072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.607 [2024-12-08 02:27:49.750718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.750733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:114080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.607 [2024-12-08 02:27:49.750747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.607 [2024-12-08 02:27:49.750762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:114088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.608 [2024-12-08 02:27:49.750775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.608 [2024-12-08 02:27:49.750790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:114096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.608 [2024-12-08 02:27:49.750807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.608 [2024-12-08 02:27:49.750823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:114104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.608 [2024-12-08 02:27:49.750837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.608 [2024-12-08 02:27:49.750867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:114112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.608 [2024-12-08 02:27:49.750879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.608 [2024-12-08 02:27:49.750894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:114120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.608 [2024-12-08 02:27:49.750907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.608 [2024-12-08 02:27:49.750921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:114128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.608 [2024-12-08 02:27:49.750934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.608 [2024-12-08 02:27:49.750948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:114136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.608 [2024-12-08 02:27:49.750961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.608 [2024-12-08 02:27:49.750975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:114144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.608 [2024-12-08 02:27:49.750988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.608 [2024-12-08 02:27:49.751002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:114152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.608 [2024-12-08 02:27:49.751015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.608 [2024-12-08 02:27:49.751029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:114160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.608 [2024-12-08 02:27:49.751042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.608 [2024-12-08 02:27:49.751056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:114168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.608 [2024-12-08 02:27:49.751069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.608 [2024-12-08 02:27:49.751083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:114176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.608 [2024-12-08 02:27:49.751096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.608 [2024-12-08 02:27:49.751111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:114184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.608 [2024-12-08 02:27:49.751124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.608 [2024-12-08 02:27:49.751138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:114192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.608 [2024-12-08 02:27:49.751150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.608 [2024-12-08 02:27:49.751168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:114200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.608 [2024-12-08 02:27:49.751182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.608 [2024-12-08 02:27:49.751196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:114208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.608 [2024-12-08 02:27:49.751209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.608 [2024-12-08 02:27:49.751223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:114216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.608 [2024-12-08 02:27:49.751236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.608 [2024-12-08 02:27:49.751250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:114224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.608 [2024-12-08 02:27:49.751263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.608 [2024-12-08 02:27:49.751277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:114232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.608 [2024-12-08 02:27:49.751290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.608 [2024-12-08 02:27:49.751304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:114240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.608 [2024-12-08 02:27:49.751317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.608 [2024-12-08 02:27:49.751331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:114248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.608 [2024-12-08 02:27:49.751344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.608 [2024-12-08 02:27:49.751358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:114256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.608 [2024-12-08 02:27:49.751371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.608 [2024-12-08 02:27:49.751385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:114264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.608 [2024-12-08 02:27:49.751398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.608 [2024-12-08 02:27:49.751412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:114272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.608 [2024-12-08 02:27:49.751425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.608 [2024-12-08 02:27:49.751439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:114280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.608 [2024-12-08 02:27:49.751452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.608 [2024-12-08 02:27:49.751467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:113632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.608 [2024-12-08 02:27:49.751480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.608 [2024-12-08 02:27:49.751494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:113640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.608 [2024-12-08 02:27:49.751507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.608 [2024-12-08 02:27:49.751545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:113664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.608 [2024-12-08 02:27:49.751563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.608 [2024-12-08 02:27:49.751578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:113680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.608 [2024-12-08 02:27:49.751591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.608 [2024-12-08 02:27:49.751606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:113688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.608 [2024-12-08 02:27:49.751619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.608 [2024-12-08 02:27:49.751634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:113704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.608 [2024-12-08 02:27:49.751647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.608 [2024-12-08 02:27:49.751662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:113728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.608 [2024-12-08 02:27:49.751675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.608 [2024-12-08 02:27:49.751690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:113744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.608 [2024-12-08 02:27:49.751703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.608 [2024-12-08 02:27:49.751718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:114288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.608 [2024-12-08 02:27:49.751731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.608 [2024-12-08 02:27:49.751746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:114296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.609 [2024-12-08 02:27:49.751759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.609 [2024-12-08 02:27:49.751783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:114304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.609 [2024-12-08 02:27:49.751796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.609 [2024-12-08 02:27:49.751810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:114312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.609 [2024-12-08 02:27:49.751823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.609 [2024-12-08 02:27:49.751853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:114320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.609 [2024-12-08 02:27:49.751867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.609 [2024-12-08 02:27:49.751881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:114328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.609 [2024-12-08 02:27:49.751894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.609 [2024-12-08 02:27:49.751908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:114336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.609 [2024-12-08 02:27:49.751924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.609 [2024-12-08 02:27:49.751939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:114344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.609 [2024-12-08 02:27:49.751952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.609 [2024-12-08 02:27:49.751966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:114352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.609 [2024-12-08 02:27:49.751979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.609 [2024-12-08 02:27:49.751993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:114360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.609 [2024-12-08 02:27:49.752006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.609 [2024-12-08 02:27:49.752021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:114368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.609 [2024-12-08 02:27:49.752034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.609 [2024-12-08 02:27:49.752048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:114376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.609 [2024-12-08 02:27:49.752061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.609 [2024-12-08 02:27:49.752075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:114384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.609 [2024-12-08 02:27:49.752088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.609 [2024-12-08 02:27:49.752102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:114392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.609 [2024-12-08 02:27:49.752115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.609 [2024-12-08 02:27:49.752130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:114400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.609 [2024-12-08 02:27:49.752142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.609 [2024-12-08 02:27:49.752157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:114408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.609 [2024-12-08 02:27:49.752170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.609 [2024-12-08 02:27:49.752184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:114416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.609 [2024-12-08 02:27:49.752196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.609 [2024-12-08 02:27:49.752210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:114424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.609 [2024-12-08 02:27:49.752223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.609 [2024-12-08 02:27:49.752237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:114432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.609 [2024-12-08 02:27:49.752250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.609 [2024-12-08 02:27:49.752267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:114440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.609 [2024-12-08 02:27:49.752281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.609 [2024-12-08 02:27:49.752295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:114448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.609 [2024-12-08 02:27:49.752308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.609 [2024-12-08 02:27:49.752322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:114456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:28.609 [2024-12-08 02:27:49.752335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.609 [2024-12-08 02:27:49.752349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:113752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.609 [2024-12-08 02:27:49.752362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.609 [2024-12-08 02:27:49.752376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:113808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.609 [2024-12-08 02:27:49.752389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.609 [2024-12-08 02:27:49.752404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:113816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.609 [2024-12-08 02:27:49.752416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.609 [2024-12-08 02:27:49.752430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:113840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.609 [2024-12-08 02:27:49.752443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.609 [2024-12-08 02:27:49.752457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:113848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.609 [2024-12-08 02:27:49.752470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.609 [2024-12-08 02:27:49.752484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:113864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.609 [2024-12-08 02:27:49.752497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.609 [2024-12-08 02:27:49.752511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:113872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:28.609 [2024-12-08 02:27:49.752523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.609 [2024-12-08 02:27:49.752558] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x170c630 is same with the state(5) to be set 00:25:28.609 [2024-12-08 02:27:49.752578] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:28.609 [2024-12-08 02:27:49.752589] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:28.609 [2024-12-08 02:27:49.752600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:113888 len:8 PRP1 0x0 PRP2 0x0 00:25:28.609 [2024-12-08 02:27:49.752613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.609 [2024-12-08 02:27:49.752678] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x170c630 was disconnected and freed. reset controller. 00:25:28.609 [2024-12-08 02:27:49.752701] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:25:28.609 [2024-12-08 02:27:49.752735] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.609 [2024-12-08 02:27:49.752754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.609 [2024-12-08 02:27:49.752768] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.609 [2024-12-08 02:27:49.752782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.609 [2024-12-08 02:27:49.752795] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.609 [2024-12-08 02:27:49.752808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.609 [2024-12-08 02:27:49.752821] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:28.609 [2024-12-08 02:27:49.752836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:28.609 [2024-12-08 02:27:49.752850] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:28.609 [2024-12-08 02:27:49.754854] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:28.609 [2024-12-08 02:27:49.754895] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x16e9870 (9): Bad file descriptor 00:25:28.609 [2024-12-08 02:27:49.864599] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:28.609 00:25:28.609 Latency(us) 00:25:28.609 [2024-12-08T01:27:56.390Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:28.609 [2024-12-08T01:27:56.390Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:25:28.609 Verification LBA range: start 0x0 length 0x4000 00:25:28.609 NVMe0n1 : 15.01 12612.33 49.27 1132.04 0.00 9296.23 442.97 16214.09 00:25:28.609 [2024-12-08T01:27:56.390Z] =================================================================================================================== 00:25:28.609 [2024-12-08T01:27:56.390Z] Total : 12612.33 49.27 1132.04 0.00 9296.23 442.97 16214.09 00:25:28.609 Received shutdown signal, test time was about 15.000000 seconds 00:25:28.609 00:25:28.609 Latency(us) 00:25:28.609 [2024-12-08T01:27:56.391Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:28.610 [2024-12-08T01:27:56.391Z] =================================================================================================================== 00:25:28.610 [2024-12-08T01:27:56.391Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:28.610 02:27:55 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:25:28.610 02:27:55 -- host/failover.sh@65 -- # count=3 00:25:28.610 02:27:55 -- host/failover.sh@67 -- # (( count != 3 )) 00:25:28.610 02:27:55 -- host/failover.sh@73 -- # bdevperf_pid=2208891 00:25:28.610 02:27:55 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:25:28.610 02:27:55 -- host/failover.sh@75 -- # waitforlisten 2208891 /var/tmp/bdevperf.sock 00:25:28.610 02:27:55 -- common/autotest_common.sh@829 -- # '[' -z 2208891 ']' 00:25:28.610 02:27:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:28.610 02:27:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:28.610 02:27:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:28.610 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:28.610 02:27:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:28.610 02:27:55 -- common/autotest_common.sh@10 -- # set +x 00:25:29.176 02:27:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:29.176 02:27:56 -- common/autotest_common.sh@862 -- # return 0 00:25:29.176 02:27:56 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:29.434 [2024-12-08 02:27:56.965328] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:29.434 02:27:56 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:29.692 [2024-12-08 02:27:57.222095] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:25:29.692 02:27:57 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:29.951 NVMe0n1 00:25:29.951 02:27:57 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:30.210 00:25:30.210 02:27:57 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:30.777 00:25:30.777 02:27:58 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:30.777 02:27:58 -- host/failover.sh@82 -- # grep -q NVMe0 00:25:31.037 02:27:58 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:31.037 02:27:58 -- host/failover.sh@87 -- # sleep 3 00:25:34.322 02:28:01 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:34.322 02:28:01 -- host/failover.sh@88 -- # grep -q NVMe0 00:25:34.322 02:28:02 -- host/failover.sh@90 -- # run_test_pid=2209592 00:25:34.322 02:28:02 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:34.322 02:28:02 -- host/failover.sh@92 -- # wait 2209592 00:25:35.700 0 00:25:35.700 02:28:03 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:35.700 [2024-12-08 02:27:55.767288] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:35.700 [2024-12-08 02:27:55.767375] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2208891 ] 00:25:35.700 EAL: No free 2048 kB hugepages reported on node 1 00:25:35.700 [2024-12-08 02:27:55.826058] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:35.700 [2024-12-08 02:27:55.930228] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:35.700 [2024-12-08 02:27:58.796898] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:25:35.700 [2024-12-08 02:27:58.796978] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:35.700 [2024-12-08 02:27:58.797000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:35.700 [2024-12-08 02:27:58.797032] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:35.700 [2024-12-08 02:27:58.797046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:35.700 [2024-12-08 02:27:58.797060] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:35.700 [2024-12-08 02:27:58.797074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:35.700 [2024-12-08 02:27:58.797088] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:35.700 [2024-12-08 02:27:58.797101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:35.700 [2024-12-08 02:27:58.797114] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:35.700 [2024-12-08 02:27:58.797151] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:35.700 [2024-12-08 02:27:58.797182] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x71d870 (9): Bad file descriptor 00:25:35.700 [2024-12-08 02:27:58.846995] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:35.700 Running I/O for 1 seconds... 00:25:35.700 00:25:35.700 Latency(us) 00:25:35.700 [2024-12-08T01:28:03.481Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:35.700 [2024-12-08T01:28:03.481Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:25:35.700 Verification LBA range: start 0x0 length 0x4000 00:25:35.700 NVMe0n1 : 1.01 12714.51 49.67 0.00 0.00 10018.96 1207.56 15049.01 00:25:35.700 [2024-12-08T01:28:03.481Z] =================================================================================================================== 00:25:35.700 [2024-12-08T01:28:03.481Z] Total : 12714.51 49.67 0.00 0.00 10018.96 1207.56 15049.01 00:25:35.700 02:28:03 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:35.700 02:28:03 -- host/failover.sh@95 -- # grep -q NVMe0 00:25:35.700 02:28:03 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:35.959 02:28:03 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:35.959 02:28:03 -- host/failover.sh@99 -- # grep -q NVMe0 00:25:36.217 02:28:03 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:36.476 02:28:04 -- host/failover.sh@101 -- # sleep 3 00:25:39.765 02:28:07 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:39.765 02:28:07 -- host/failover.sh@103 -- # grep -q NVMe0 00:25:39.765 02:28:07 -- host/failover.sh@108 -- # killprocess 2208891 00:25:39.765 02:28:07 -- common/autotest_common.sh@936 -- # '[' -z 2208891 ']' 00:25:39.765 02:28:07 -- common/autotest_common.sh@940 -- # kill -0 2208891 00:25:39.765 02:28:07 -- common/autotest_common.sh@941 -- # uname 00:25:39.765 02:28:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:39.765 02:28:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2208891 00:25:39.765 02:28:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:39.765 02:28:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:39.765 02:28:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2208891' 00:25:39.765 killing process with pid 2208891 00:25:39.765 02:28:07 -- common/autotest_common.sh@955 -- # kill 2208891 00:25:39.765 02:28:07 -- common/autotest_common.sh@960 -- # wait 2208891 00:25:40.023 02:28:07 -- host/failover.sh@110 -- # sync 00:25:40.023 02:28:07 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:40.587 02:28:08 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:25:40.587 02:28:08 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:40.587 02:28:08 -- host/failover.sh@116 -- # nvmftestfini 00:25:40.587 02:28:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:40.587 02:28:08 -- nvmf/common.sh@116 -- # sync 00:25:40.587 02:28:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:40.587 02:28:08 -- nvmf/common.sh@119 -- # set +e 00:25:40.587 02:28:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:40.587 02:28:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:40.587 rmmod nvme_tcp 00:25:40.587 rmmod nvme_fabrics 00:25:40.587 rmmod nvme_keyring 00:25:40.587 02:28:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:40.587 02:28:08 -- nvmf/common.sh@123 -- # set -e 00:25:40.587 02:28:08 -- nvmf/common.sh@124 -- # return 0 00:25:40.587 02:28:08 -- nvmf/common.sh@477 -- # '[' -n 2206411 ']' 00:25:40.587 02:28:08 -- nvmf/common.sh@478 -- # killprocess 2206411 00:25:40.587 02:28:08 -- common/autotest_common.sh@936 -- # '[' -z 2206411 ']' 00:25:40.587 02:28:08 -- common/autotest_common.sh@940 -- # kill -0 2206411 00:25:40.587 02:28:08 -- common/autotest_common.sh@941 -- # uname 00:25:40.587 02:28:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:40.587 02:28:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2206411 00:25:40.587 02:28:08 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:40.587 02:28:08 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:40.587 02:28:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2206411' 00:25:40.587 killing process with pid 2206411 00:25:40.587 02:28:08 -- common/autotest_common.sh@955 -- # kill 2206411 00:25:40.587 02:28:08 -- common/autotest_common.sh@960 -- # wait 2206411 00:25:40.846 02:28:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:40.846 02:28:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:40.846 02:28:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:40.846 02:28:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:40.846 02:28:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:40.846 02:28:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:40.846 02:28:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:40.846 02:28:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:42.753 02:28:10 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:42.753 00:25:42.753 real 0m37.386s 00:25:42.753 user 2m11.069s 00:25:42.753 sys 0m6.737s 00:25:42.753 02:28:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:42.753 02:28:10 -- common/autotest_common.sh@10 -- # set +x 00:25:42.753 ************************************ 00:25:42.753 END TEST nvmf_failover 00:25:42.753 ************************************ 00:25:43.013 02:28:10 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:25:43.013 02:28:10 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:43.013 02:28:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:43.013 02:28:10 -- common/autotest_common.sh@10 -- # set +x 00:25:43.013 ************************************ 00:25:43.013 START TEST nvmf_discovery 00:25:43.013 ************************************ 00:25:43.013 02:28:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:25:43.013 * Looking for test storage... 00:25:43.013 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:43.013 02:28:10 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:43.013 02:28:10 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:43.013 02:28:10 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:43.013 02:28:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:43.013 02:28:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:43.013 02:28:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:43.013 02:28:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:43.013 02:28:10 -- scripts/common.sh@335 -- # IFS=.-: 00:25:43.013 02:28:10 -- scripts/common.sh@335 -- # read -ra ver1 00:25:43.013 02:28:10 -- scripts/common.sh@336 -- # IFS=.-: 00:25:43.013 02:28:10 -- scripts/common.sh@336 -- # read -ra ver2 00:25:43.013 02:28:10 -- scripts/common.sh@337 -- # local 'op=<' 00:25:43.013 02:28:10 -- scripts/common.sh@339 -- # ver1_l=2 00:25:43.013 02:28:10 -- scripts/common.sh@340 -- # ver2_l=1 00:25:43.013 02:28:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:43.013 02:28:10 -- scripts/common.sh@343 -- # case "$op" in 00:25:43.013 02:28:10 -- scripts/common.sh@344 -- # : 1 00:25:43.013 02:28:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:43.013 02:28:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:43.013 02:28:10 -- scripts/common.sh@364 -- # decimal 1 00:25:43.013 02:28:10 -- scripts/common.sh@352 -- # local d=1 00:25:43.013 02:28:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:43.013 02:28:10 -- scripts/common.sh@354 -- # echo 1 00:25:43.013 02:28:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:43.013 02:28:10 -- scripts/common.sh@365 -- # decimal 2 00:25:43.013 02:28:10 -- scripts/common.sh@352 -- # local d=2 00:25:43.013 02:28:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:43.013 02:28:10 -- scripts/common.sh@354 -- # echo 2 00:25:43.013 02:28:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:43.013 02:28:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:43.013 02:28:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:43.013 02:28:10 -- scripts/common.sh@367 -- # return 0 00:25:43.013 02:28:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:43.013 02:28:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:43.013 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:43.013 --rc genhtml_branch_coverage=1 00:25:43.013 --rc genhtml_function_coverage=1 00:25:43.013 --rc genhtml_legend=1 00:25:43.013 --rc geninfo_all_blocks=1 00:25:43.013 --rc geninfo_unexecuted_blocks=1 00:25:43.013 00:25:43.013 ' 00:25:43.013 02:28:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:43.013 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:43.013 --rc genhtml_branch_coverage=1 00:25:43.013 --rc genhtml_function_coverage=1 00:25:43.013 --rc genhtml_legend=1 00:25:43.013 --rc geninfo_all_blocks=1 00:25:43.013 --rc geninfo_unexecuted_blocks=1 00:25:43.013 00:25:43.013 ' 00:25:43.013 02:28:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:43.013 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:43.013 --rc genhtml_branch_coverage=1 00:25:43.013 --rc genhtml_function_coverage=1 00:25:43.013 --rc genhtml_legend=1 00:25:43.013 --rc geninfo_all_blocks=1 00:25:43.013 --rc geninfo_unexecuted_blocks=1 00:25:43.013 00:25:43.013 ' 00:25:43.013 02:28:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:43.013 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:43.013 --rc genhtml_branch_coverage=1 00:25:43.013 --rc genhtml_function_coverage=1 00:25:43.013 --rc genhtml_legend=1 00:25:43.013 --rc geninfo_all_blocks=1 00:25:43.013 --rc geninfo_unexecuted_blocks=1 00:25:43.013 00:25:43.013 ' 00:25:43.013 02:28:10 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:43.013 02:28:10 -- nvmf/common.sh@7 -- # uname -s 00:25:43.013 02:28:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:43.013 02:28:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:43.013 02:28:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:43.013 02:28:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:43.013 02:28:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:43.013 02:28:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:43.013 02:28:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:43.013 02:28:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:43.013 02:28:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:43.013 02:28:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:43.013 02:28:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:43.013 02:28:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:43.013 02:28:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:43.013 02:28:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:43.013 02:28:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:43.013 02:28:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:43.013 02:28:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:43.014 02:28:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:43.014 02:28:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:43.014 02:28:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:43.014 02:28:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:43.014 02:28:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:43.014 02:28:10 -- paths/export.sh@5 -- # export PATH 00:25:43.014 02:28:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:43.014 02:28:10 -- nvmf/common.sh@46 -- # : 0 00:25:43.014 02:28:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:43.014 02:28:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:43.014 02:28:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:43.014 02:28:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:43.014 02:28:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:43.014 02:28:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:43.014 02:28:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:43.014 02:28:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:43.014 02:28:10 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:25:43.014 02:28:10 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:25:43.014 02:28:10 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:25:43.014 02:28:10 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:25:43.014 02:28:10 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:25:43.014 02:28:10 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:25:43.014 02:28:10 -- host/discovery.sh@25 -- # nvmftestinit 00:25:43.014 02:28:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:43.014 02:28:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:43.014 02:28:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:43.014 02:28:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:43.014 02:28:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:43.014 02:28:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:43.014 02:28:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:43.014 02:28:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:43.014 02:28:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:43.014 02:28:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:43.014 02:28:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:43.014 02:28:10 -- common/autotest_common.sh@10 -- # set +x 00:25:44.924 02:28:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:44.924 02:28:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:44.924 02:28:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:44.924 02:28:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:44.924 02:28:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:44.924 02:28:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:44.924 02:28:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:44.924 02:28:12 -- nvmf/common.sh@294 -- # net_devs=() 00:25:44.924 02:28:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:44.924 02:28:12 -- nvmf/common.sh@295 -- # e810=() 00:25:44.924 02:28:12 -- nvmf/common.sh@295 -- # local -ga e810 00:25:44.924 02:28:12 -- nvmf/common.sh@296 -- # x722=() 00:25:44.924 02:28:12 -- nvmf/common.sh@296 -- # local -ga x722 00:25:44.924 02:28:12 -- nvmf/common.sh@297 -- # mlx=() 00:25:44.924 02:28:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:44.924 02:28:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:44.924 02:28:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:44.924 02:28:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:44.924 02:28:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:44.924 02:28:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:44.924 02:28:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:44.924 02:28:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:44.924 02:28:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:44.924 02:28:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:44.924 02:28:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:44.924 02:28:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:44.924 02:28:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:44.924 02:28:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:44.924 02:28:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:44.924 02:28:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:44.924 02:28:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:44.924 02:28:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:44.924 02:28:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:44.924 02:28:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:44.924 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:44.924 02:28:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:44.924 02:28:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:44.924 02:28:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:44.924 02:28:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:44.924 02:28:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:44.924 02:28:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:44.924 02:28:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:44.924 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:44.924 02:28:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:44.924 02:28:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:44.924 02:28:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:44.924 02:28:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:44.924 02:28:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:44.924 02:28:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:44.924 02:28:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:44.924 02:28:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:44.924 02:28:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:44.924 02:28:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:44.924 02:28:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:44.924 02:28:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:44.924 02:28:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:44.924 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:44.924 02:28:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:44.924 02:28:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:44.924 02:28:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:44.924 02:28:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:44.924 02:28:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:44.924 02:28:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:44.924 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:44.924 02:28:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:44.924 02:28:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:44.924 02:28:12 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:44.924 02:28:12 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:44.924 02:28:12 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:44.924 02:28:12 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:44.924 02:28:12 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:44.924 02:28:12 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:44.924 02:28:12 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:44.924 02:28:12 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:44.924 02:28:12 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:44.924 02:28:12 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:44.924 02:28:12 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:44.924 02:28:12 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:44.924 02:28:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:44.924 02:28:12 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:44.924 02:28:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:44.924 02:28:12 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:44.924 02:28:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:44.924 02:28:12 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:44.924 02:28:12 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:44.924 02:28:12 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:45.185 02:28:12 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:45.185 02:28:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:45.185 02:28:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:45.185 02:28:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:45.185 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:45.185 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.141 ms 00:25:45.185 00:25:45.185 --- 10.0.0.2 ping statistics --- 00:25:45.185 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:45.185 rtt min/avg/max/mdev = 0.141/0.141/0.141/0.000 ms 00:25:45.185 02:28:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:45.185 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:45.185 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.099 ms 00:25:45.185 00:25:45.185 --- 10.0.0.1 ping statistics --- 00:25:45.185 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:45.185 rtt min/avg/max/mdev = 0.099/0.099/0.099/0.000 ms 00:25:45.185 02:28:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:45.185 02:28:12 -- nvmf/common.sh@410 -- # return 0 00:25:45.185 02:28:12 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:45.185 02:28:12 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:45.185 02:28:12 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:45.185 02:28:12 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:45.185 02:28:12 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:45.185 02:28:12 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:45.185 02:28:12 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:45.185 02:28:12 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:25:45.185 02:28:12 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:45.185 02:28:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:45.185 02:28:12 -- common/autotest_common.sh@10 -- # set +x 00:25:45.185 02:28:12 -- nvmf/common.sh@469 -- # nvmfpid=2212352 00:25:45.185 02:28:12 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:25:45.185 02:28:12 -- nvmf/common.sh@470 -- # waitforlisten 2212352 00:25:45.185 02:28:12 -- common/autotest_common.sh@829 -- # '[' -z 2212352 ']' 00:25:45.185 02:28:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:45.185 02:28:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:45.185 02:28:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:45.185 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:45.185 02:28:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:45.185 02:28:12 -- common/autotest_common.sh@10 -- # set +x 00:25:45.185 [2024-12-08 02:28:12.824847] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:45.185 [2024-12-08 02:28:12.824919] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:45.185 EAL: No free 2048 kB hugepages reported on node 1 00:25:45.185 [2024-12-08 02:28:12.887911] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:45.447 [2024-12-08 02:28:12.998700] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:45.447 [2024-12-08 02:28:12.998872] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:45.447 [2024-12-08 02:28:12.998905] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:45.447 [2024-12-08 02:28:12.998918] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:45.447 [2024-12-08 02:28:12.998955] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:46.382 02:28:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:46.382 02:28:13 -- common/autotest_common.sh@862 -- # return 0 00:25:46.382 02:28:13 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:46.382 02:28:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:46.382 02:28:13 -- common/autotest_common.sh@10 -- # set +x 00:25:46.382 02:28:13 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:46.382 02:28:13 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:46.382 02:28:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.382 02:28:13 -- common/autotest_common.sh@10 -- # set +x 00:25:46.382 [2024-12-08 02:28:13.869981] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:46.382 02:28:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.382 02:28:13 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:25:46.382 02:28:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.382 02:28:13 -- common/autotest_common.sh@10 -- # set +x 00:25:46.382 [2024-12-08 02:28:13.878156] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:25:46.382 02:28:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.382 02:28:13 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:25:46.382 02:28:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.382 02:28:13 -- common/autotest_common.sh@10 -- # set +x 00:25:46.382 null0 00:25:46.382 02:28:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.382 02:28:13 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:25:46.382 02:28:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.382 02:28:13 -- common/autotest_common.sh@10 -- # set +x 00:25:46.382 null1 00:25:46.382 02:28:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.382 02:28:13 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:25:46.382 02:28:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.382 02:28:13 -- common/autotest_common.sh@10 -- # set +x 00:25:46.382 02:28:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.382 02:28:13 -- host/discovery.sh@45 -- # hostpid=2212508 00:25:46.382 02:28:13 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:25:46.383 02:28:13 -- host/discovery.sh@46 -- # waitforlisten 2212508 /tmp/host.sock 00:25:46.383 02:28:13 -- common/autotest_common.sh@829 -- # '[' -z 2212508 ']' 00:25:46.383 02:28:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:25:46.383 02:28:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:46.383 02:28:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:25:46.383 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:25:46.383 02:28:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:46.383 02:28:13 -- common/autotest_common.sh@10 -- # set +x 00:25:46.383 [2024-12-08 02:28:13.946464] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:46.383 [2024-12-08 02:28:13.946550] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2212508 ] 00:25:46.383 EAL: No free 2048 kB hugepages reported on node 1 00:25:46.383 [2024-12-08 02:28:14.006820] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:46.383 [2024-12-08 02:28:14.120328] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:46.383 [2024-12-08 02:28:14.120513] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:47.317 02:28:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:47.317 02:28:14 -- common/autotest_common.sh@862 -- # return 0 00:25:47.317 02:28:14 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:47.317 02:28:14 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:25:47.317 02:28:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.317 02:28:14 -- common/autotest_common.sh@10 -- # set +x 00:25:47.317 02:28:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.317 02:28:14 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:25:47.318 02:28:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.318 02:28:14 -- common/autotest_common.sh@10 -- # set +x 00:25:47.318 02:28:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.318 02:28:14 -- host/discovery.sh@72 -- # notify_id=0 00:25:47.318 02:28:14 -- host/discovery.sh@78 -- # get_subsystem_names 00:25:47.318 02:28:14 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:47.318 02:28:14 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:47.318 02:28:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.318 02:28:14 -- common/autotest_common.sh@10 -- # set +x 00:25:47.318 02:28:14 -- host/discovery.sh@59 -- # sort 00:25:47.318 02:28:14 -- host/discovery.sh@59 -- # xargs 00:25:47.318 02:28:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.318 02:28:14 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:25:47.318 02:28:14 -- host/discovery.sh@79 -- # get_bdev_list 00:25:47.318 02:28:14 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:47.318 02:28:14 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:47.318 02:28:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.318 02:28:14 -- host/discovery.sh@55 -- # sort 00:25:47.318 02:28:14 -- common/autotest_common.sh@10 -- # set +x 00:25:47.318 02:28:14 -- host/discovery.sh@55 -- # xargs 00:25:47.318 02:28:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.318 02:28:14 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:25:47.318 02:28:14 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:25:47.318 02:28:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.318 02:28:14 -- common/autotest_common.sh@10 -- # set +x 00:25:47.318 02:28:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.318 02:28:15 -- host/discovery.sh@82 -- # get_subsystem_names 00:25:47.318 02:28:15 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:47.318 02:28:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.318 02:28:15 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:47.318 02:28:15 -- common/autotest_common.sh@10 -- # set +x 00:25:47.318 02:28:15 -- host/discovery.sh@59 -- # sort 00:25:47.318 02:28:15 -- host/discovery.sh@59 -- # xargs 00:25:47.318 02:28:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.318 02:28:15 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:25:47.318 02:28:15 -- host/discovery.sh@83 -- # get_bdev_list 00:25:47.318 02:28:15 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:47.318 02:28:15 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:47.318 02:28:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.318 02:28:15 -- common/autotest_common.sh@10 -- # set +x 00:25:47.318 02:28:15 -- host/discovery.sh@55 -- # sort 00:25:47.318 02:28:15 -- host/discovery.sh@55 -- # xargs 00:25:47.318 02:28:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.318 02:28:15 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:25:47.318 02:28:15 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:25:47.318 02:28:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.318 02:28:15 -- common/autotest_common.sh@10 -- # set +x 00:25:47.318 02:28:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.318 02:28:15 -- host/discovery.sh@86 -- # get_subsystem_names 00:25:47.318 02:28:15 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:47.318 02:28:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.318 02:28:15 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:47.318 02:28:15 -- common/autotest_common.sh@10 -- # set +x 00:25:47.318 02:28:15 -- host/discovery.sh@59 -- # sort 00:25:47.318 02:28:15 -- host/discovery.sh@59 -- # xargs 00:25:47.575 02:28:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.575 02:28:15 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:25:47.575 02:28:15 -- host/discovery.sh@87 -- # get_bdev_list 00:25:47.575 02:28:15 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:47.575 02:28:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.575 02:28:15 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:47.575 02:28:15 -- common/autotest_common.sh@10 -- # set +x 00:25:47.575 02:28:15 -- host/discovery.sh@55 -- # sort 00:25:47.575 02:28:15 -- host/discovery.sh@55 -- # xargs 00:25:47.575 02:28:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.575 02:28:15 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:25:47.575 02:28:15 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:25:47.575 02:28:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.575 02:28:15 -- common/autotest_common.sh@10 -- # set +x 00:25:47.575 [2024-12-08 02:28:15.177721] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:47.575 02:28:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.575 02:28:15 -- host/discovery.sh@92 -- # get_subsystem_names 00:25:47.575 02:28:15 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:47.575 02:28:15 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:47.575 02:28:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.575 02:28:15 -- common/autotest_common.sh@10 -- # set +x 00:25:47.575 02:28:15 -- host/discovery.sh@59 -- # sort 00:25:47.575 02:28:15 -- host/discovery.sh@59 -- # xargs 00:25:47.575 02:28:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.575 02:28:15 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:25:47.575 02:28:15 -- host/discovery.sh@93 -- # get_bdev_list 00:25:47.575 02:28:15 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:47.575 02:28:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.575 02:28:15 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:47.575 02:28:15 -- common/autotest_common.sh@10 -- # set +x 00:25:47.575 02:28:15 -- host/discovery.sh@55 -- # sort 00:25:47.575 02:28:15 -- host/discovery.sh@55 -- # xargs 00:25:47.575 02:28:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.575 02:28:15 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:25:47.575 02:28:15 -- host/discovery.sh@94 -- # get_notification_count 00:25:47.575 02:28:15 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:25:47.575 02:28:15 -- host/discovery.sh@74 -- # jq '. | length' 00:25:47.575 02:28:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.575 02:28:15 -- common/autotest_common.sh@10 -- # set +x 00:25:47.575 02:28:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.575 02:28:15 -- host/discovery.sh@74 -- # notification_count=0 00:25:47.575 02:28:15 -- host/discovery.sh@75 -- # notify_id=0 00:25:47.575 02:28:15 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:25:47.575 02:28:15 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:25:47.575 02:28:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.575 02:28:15 -- common/autotest_common.sh@10 -- # set +x 00:25:47.575 02:28:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.575 02:28:15 -- host/discovery.sh@100 -- # sleep 1 00:25:48.142 [2024-12-08 02:28:15.918601] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:25:48.142 [2024-12-08 02:28:15.918660] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:25:48.142 [2024-12-08 02:28:15.918690] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:25:48.401 [2024-12-08 02:28:16.004920] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:25:48.401 [2024-12-08 02:28:16.061370] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:25:48.401 [2024-12-08 02:28:16.061394] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:25:48.659 02:28:16 -- host/discovery.sh@101 -- # get_subsystem_names 00:25:48.659 02:28:16 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:48.659 02:28:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:48.659 02:28:16 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:48.659 02:28:16 -- common/autotest_common.sh@10 -- # set +x 00:25:48.659 02:28:16 -- host/discovery.sh@59 -- # sort 00:25:48.659 02:28:16 -- host/discovery.sh@59 -- # xargs 00:25:48.659 02:28:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:48.659 02:28:16 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:25:48.659 02:28:16 -- host/discovery.sh@102 -- # get_bdev_list 00:25:48.659 02:28:16 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:48.659 02:28:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:48.659 02:28:16 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:48.659 02:28:16 -- common/autotest_common.sh@10 -- # set +x 00:25:48.659 02:28:16 -- host/discovery.sh@55 -- # sort 00:25:48.659 02:28:16 -- host/discovery.sh@55 -- # xargs 00:25:48.659 02:28:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:48.659 02:28:16 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:25:48.659 02:28:16 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:25:48.659 02:28:16 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:25:48.659 02:28:16 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:25:48.659 02:28:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:48.659 02:28:16 -- host/discovery.sh@63 -- # sort -n 00:25:48.659 02:28:16 -- common/autotest_common.sh@10 -- # set +x 00:25:48.659 02:28:16 -- host/discovery.sh@63 -- # xargs 00:25:48.659 02:28:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:48.919 02:28:16 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:25:48.919 02:28:16 -- host/discovery.sh@104 -- # get_notification_count 00:25:48.919 02:28:16 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:25:48.919 02:28:16 -- host/discovery.sh@74 -- # jq '. | length' 00:25:48.919 02:28:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:48.919 02:28:16 -- common/autotest_common.sh@10 -- # set +x 00:25:48.919 02:28:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:48.919 02:28:16 -- host/discovery.sh@74 -- # notification_count=1 00:25:48.919 02:28:16 -- host/discovery.sh@75 -- # notify_id=1 00:25:48.919 02:28:16 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:25:48.919 02:28:16 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:25:48.919 02:28:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:48.919 02:28:16 -- common/autotest_common.sh@10 -- # set +x 00:25:48.919 02:28:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:48.919 02:28:16 -- host/discovery.sh@109 -- # sleep 1 00:25:49.859 02:28:17 -- host/discovery.sh@110 -- # get_bdev_list 00:25:49.859 02:28:17 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:49.859 02:28:17 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:49.859 02:28:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:49.859 02:28:17 -- common/autotest_common.sh@10 -- # set +x 00:25:49.859 02:28:17 -- host/discovery.sh@55 -- # sort 00:25:49.859 02:28:17 -- host/discovery.sh@55 -- # xargs 00:25:49.859 02:28:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:49.859 02:28:17 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:25:49.859 02:28:17 -- host/discovery.sh@111 -- # get_notification_count 00:25:49.859 02:28:17 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:25:49.859 02:28:17 -- host/discovery.sh@74 -- # jq '. | length' 00:25:49.859 02:28:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:49.859 02:28:17 -- common/autotest_common.sh@10 -- # set +x 00:25:49.859 02:28:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:49.859 02:28:17 -- host/discovery.sh@74 -- # notification_count=1 00:25:49.859 02:28:17 -- host/discovery.sh@75 -- # notify_id=2 00:25:49.859 02:28:17 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:25:49.859 02:28:17 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:25:49.859 02:28:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:49.859 02:28:17 -- common/autotest_common.sh@10 -- # set +x 00:25:49.859 [2024-12-08 02:28:17.576951] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:49.859 [2024-12-08 02:28:17.577692] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:25:49.859 [2024-12-08 02:28:17.577728] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:25:49.859 02:28:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:49.859 02:28:17 -- host/discovery.sh@117 -- # sleep 1 00:25:50.120 [2024-12-08 02:28:17.664020] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:25:50.380 [2024-12-08 02:28:17.927363] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:25:50.380 [2024-12-08 02:28:17.927396] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:25:50.380 [2024-12-08 02:28:17.927406] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:25:50.948 02:28:18 -- host/discovery.sh@118 -- # get_subsystem_names 00:25:50.948 02:28:18 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:50.948 02:28:18 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:50.948 02:28:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:50.948 02:28:18 -- common/autotest_common.sh@10 -- # set +x 00:25:50.948 02:28:18 -- host/discovery.sh@59 -- # sort 00:25:50.948 02:28:18 -- host/discovery.sh@59 -- # xargs 00:25:50.948 02:28:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:50.948 02:28:18 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:25:50.948 02:28:18 -- host/discovery.sh@119 -- # get_bdev_list 00:25:50.948 02:28:18 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:50.948 02:28:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:50.948 02:28:18 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:50.948 02:28:18 -- common/autotest_common.sh@10 -- # set +x 00:25:50.948 02:28:18 -- host/discovery.sh@55 -- # sort 00:25:50.948 02:28:18 -- host/discovery.sh@55 -- # xargs 00:25:50.948 02:28:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:50.948 02:28:18 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:25:50.948 02:28:18 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:25:50.948 02:28:18 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:25:50.948 02:28:18 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:25:50.948 02:28:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:50.948 02:28:18 -- common/autotest_common.sh@10 -- # set +x 00:25:50.948 02:28:18 -- host/discovery.sh@63 -- # sort -n 00:25:50.948 02:28:18 -- host/discovery.sh@63 -- # xargs 00:25:50.948 02:28:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:50.948 02:28:18 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:25:50.948 02:28:18 -- host/discovery.sh@121 -- # get_notification_count 00:25:50.948 02:28:18 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:25:50.948 02:28:18 -- host/discovery.sh@74 -- # jq '. | length' 00:25:50.948 02:28:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:50.948 02:28:18 -- common/autotest_common.sh@10 -- # set +x 00:25:50.948 02:28:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:51.208 02:28:18 -- host/discovery.sh@74 -- # notification_count=0 00:25:51.208 02:28:18 -- host/discovery.sh@75 -- # notify_id=2 00:25:51.208 02:28:18 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:25:51.208 02:28:18 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:25:51.208 02:28:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:51.208 02:28:18 -- common/autotest_common.sh@10 -- # set +x 00:25:51.208 [2024-12-08 02:28:18.757061] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:25:51.208 [2024-12-08 02:28:18.757104] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:25:51.208 02:28:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:51.208 02:28:18 -- host/discovery.sh@127 -- # sleep 1 00:25:51.208 [2024-12-08 02:28:18.765820] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:51.208 [2024-12-08 02:28:18.765865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:51.208 [2024-12-08 02:28:18.765900] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:51.208 [2024-12-08 02:28:18.765926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:51.208 [2024-12-08 02:28:18.765941] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:51.208 [2024-12-08 02:28:18.765956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:51.208 [2024-12-08 02:28:18.765971] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:51.208 [2024-12-08 02:28:18.765986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:51.208 [2024-12-08 02:28:18.766000] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x743810 is same with the state(5) to be set 00:25:51.208 [2024-12-08 02:28:18.775839] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x743810 (9): Bad file descriptor 00:25:51.208 [2024-12-08 02:28:18.785885] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:51.208 [2024-12-08 02:28:18.786130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:51.209 [2024-12-08 02:28:18.786270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:51.209 [2024-12-08 02:28:18.786300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x743810 with addr=10.0.0.2, port=4420 00:25:51.209 [2024-12-08 02:28:18.786318] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x743810 is same with the state(5) to be set 00:25:51.209 [2024-12-08 02:28:18.786344] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x743810 (9): Bad file descriptor 00:25:51.209 [2024-12-08 02:28:18.786396] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:51.209 [2024-12-08 02:28:18.786418] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:51.209 [2024-12-08 02:28:18.786435] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:51.209 [2024-12-08 02:28:18.786458] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:51.209 [2024-12-08 02:28:18.795980] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:51.209 [2024-12-08 02:28:18.796137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:51.209 [2024-12-08 02:28:18.796272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:51.209 [2024-12-08 02:28:18.796301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x743810 with addr=10.0.0.2, port=4420 00:25:51.209 [2024-12-08 02:28:18.796319] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x743810 is same with the state(5) to be set 00:25:51.209 [2024-12-08 02:28:18.796352] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x743810 (9): Bad file descriptor 00:25:51.209 [2024-12-08 02:28:18.796375] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:51.209 [2024-12-08 02:28:18.796391] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:51.209 [2024-12-08 02:28:18.796406] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:51.209 [2024-12-08 02:28:18.796427] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:51.209 [2024-12-08 02:28:18.806059] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:51.209 [2024-12-08 02:28:18.806246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:51.209 [2024-12-08 02:28:18.806342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:51.209 [2024-12-08 02:28:18.806371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x743810 with addr=10.0.0.2, port=4420 00:25:51.209 [2024-12-08 02:28:18.806389] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x743810 is same with the state(5) to be set 00:25:51.209 [2024-12-08 02:28:18.806413] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x743810 (9): Bad file descriptor 00:25:51.209 [2024-12-08 02:28:18.806448] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:51.209 [2024-12-08 02:28:18.806467] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:51.209 [2024-12-08 02:28:18.806482] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:51.209 [2024-12-08 02:28:18.806503] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:51.209 [2024-12-08 02:28:18.816141] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:51.209 [2024-12-08 02:28:18.816318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:51.209 [2024-12-08 02:28:18.816417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:51.209 [2024-12-08 02:28:18.816446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x743810 with addr=10.0.0.2, port=4420 00:25:51.209 [2024-12-08 02:28:18.816463] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x743810 is same with the state(5) to be set 00:25:51.209 [2024-12-08 02:28:18.816488] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x743810 (9): Bad file descriptor 00:25:51.209 [2024-12-08 02:28:18.816511] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:51.209 [2024-12-08 02:28:18.816526] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:51.209 [2024-12-08 02:28:18.816550] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:51.209 [2024-12-08 02:28:18.816591] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:51.209 [2024-12-08 02:28:18.826218] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:51.209 [2024-12-08 02:28:18.826370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:51.209 [2024-12-08 02:28:18.826524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:51.209 [2024-12-08 02:28:18.826562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x743810 with addr=10.0.0.2, port=4420 00:25:51.209 [2024-12-08 02:28:18.826594] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x743810 is same with the state(5) to be set 00:25:51.209 [2024-12-08 02:28:18.826616] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x743810 (9): Bad file descriptor 00:25:51.209 [2024-12-08 02:28:18.826654] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:51.209 [2024-12-08 02:28:18.826672] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:51.209 [2024-12-08 02:28:18.826685] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:51.209 [2024-12-08 02:28:18.826716] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:51.209 [2024-12-08 02:28:18.836293] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:51.209 [2024-12-08 02:28:18.836441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:51.209 [2024-12-08 02:28:18.836593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:51.209 [2024-12-08 02:28:18.836620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x743810 with addr=10.0.0.2, port=4420 00:25:51.209 [2024-12-08 02:28:18.836635] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x743810 is same with the state(5) to be set 00:25:51.209 [2024-12-08 02:28:18.836657] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x743810 (9): Bad file descriptor 00:25:51.209 [2024-12-08 02:28:18.836677] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:51.209 [2024-12-08 02:28:18.836691] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:51.209 [2024-12-08 02:28:18.836704] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:51.209 [2024-12-08 02:28:18.836722] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:51.209 [2024-12-08 02:28:18.843786] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:25:51.209 [2024-12-08 02:28:18.843817] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:25:52.146 02:28:19 -- host/discovery.sh@128 -- # get_subsystem_names 00:25:52.146 02:28:19 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:52.146 02:28:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:52.146 02:28:19 -- common/autotest_common.sh@10 -- # set +x 00:25:52.146 02:28:19 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:52.146 02:28:19 -- host/discovery.sh@59 -- # sort 00:25:52.146 02:28:19 -- host/discovery.sh@59 -- # xargs 00:25:52.146 02:28:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:52.146 02:28:19 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:25:52.146 02:28:19 -- host/discovery.sh@129 -- # get_bdev_list 00:25:52.146 02:28:19 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:52.146 02:28:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:52.146 02:28:19 -- common/autotest_common.sh@10 -- # set +x 00:25:52.146 02:28:19 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:52.146 02:28:19 -- host/discovery.sh@55 -- # sort 00:25:52.146 02:28:19 -- host/discovery.sh@55 -- # xargs 00:25:52.146 02:28:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:52.146 02:28:19 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:25:52.146 02:28:19 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:25:52.146 02:28:19 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:25:52.146 02:28:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:52.146 02:28:19 -- common/autotest_common.sh@10 -- # set +x 00:25:52.146 02:28:19 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:25:52.146 02:28:19 -- host/discovery.sh@63 -- # sort -n 00:25:52.146 02:28:19 -- host/discovery.sh@63 -- # xargs 00:25:52.146 02:28:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:52.146 02:28:19 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:25:52.146 02:28:19 -- host/discovery.sh@131 -- # get_notification_count 00:25:52.146 02:28:19 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:25:52.146 02:28:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:52.146 02:28:19 -- host/discovery.sh@74 -- # jq '. | length' 00:25:52.146 02:28:19 -- common/autotest_common.sh@10 -- # set +x 00:25:52.146 02:28:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:52.146 02:28:19 -- host/discovery.sh@74 -- # notification_count=0 00:25:52.146 02:28:19 -- host/discovery.sh@75 -- # notify_id=2 00:25:52.146 02:28:19 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:25:52.146 02:28:19 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:25:52.146 02:28:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:52.146 02:28:19 -- common/autotest_common.sh@10 -- # set +x 00:25:52.403 02:28:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:52.403 02:28:19 -- host/discovery.sh@135 -- # sleep 1 00:25:53.431 02:28:20 -- host/discovery.sh@136 -- # get_subsystem_names 00:25:53.431 02:28:20 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:53.431 02:28:20 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:53.431 02:28:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:53.431 02:28:20 -- common/autotest_common.sh@10 -- # set +x 00:25:53.431 02:28:20 -- host/discovery.sh@59 -- # sort 00:25:53.431 02:28:20 -- host/discovery.sh@59 -- # xargs 00:25:53.431 02:28:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:53.431 02:28:20 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:25:53.431 02:28:20 -- host/discovery.sh@137 -- # get_bdev_list 00:25:53.431 02:28:20 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:53.431 02:28:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:53.431 02:28:20 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:53.431 02:28:20 -- common/autotest_common.sh@10 -- # set +x 00:25:53.431 02:28:20 -- host/discovery.sh@55 -- # sort 00:25:53.431 02:28:20 -- host/discovery.sh@55 -- # xargs 00:25:53.431 02:28:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:53.431 02:28:21 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:25:53.431 02:28:21 -- host/discovery.sh@138 -- # get_notification_count 00:25:53.431 02:28:21 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:25:53.431 02:28:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:53.431 02:28:21 -- common/autotest_common.sh@10 -- # set +x 00:25:53.432 02:28:21 -- host/discovery.sh@74 -- # jq '. | length' 00:25:53.432 02:28:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:53.432 02:28:21 -- host/discovery.sh@74 -- # notification_count=2 00:25:53.432 02:28:21 -- host/discovery.sh@75 -- # notify_id=4 00:25:53.432 02:28:21 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:25:53.432 02:28:21 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:53.432 02:28:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:53.432 02:28:21 -- common/autotest_common.sh@10 -- # set +x 00:25:54.367 [2024-12-08 02:28:22.115677] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:25:54.367 [2024-12-08 02:28:22.115704] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:25:54.367 [2024-12-08 02:28:22.115726] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:25:54.626 [2024-12-08 02:28:22.202021] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:25:54.626 [2024-12-08 02:28:22.310190] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:25:54.626 [2024-12-08 02:28:22.310230] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:25:54.626 02:28:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.626 02:28:22 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:54.626 02:28:22 -- common/autotest_common.sh@650 -- # local es=0 00:25:54.626 02:28:22 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:54.626 02:28:22 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:54.626 02:28:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:54.626 02:28:22 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:54.626 02:28:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:54.626 02:28:22 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:54.626 02:28:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.626 02:28:22 -- common/autotest_common.sh@10 -- # set +x 00:25:54.626 request: 00:25:54.626 { 00:25:54.626 "name": "nvme", 00:25:54.626 "trtype": "tcp", 00:25:54.626 "traddr": "10.0.0.2", 00:25:54.626 "hostnqn": "nqn.2021-12.io.spdk:test", 00:25:54.626 "adrfam": "ipv4", 00:25:54.626 "trsvcid": "8009", 00:25:54.626 "wait_for_attach": true, 00:25:54.626 "method": "bdev_nvme_start_discovery", 00:25:54.626 "req_id": 1 00:25:54.626 } 00:25:54.626 Got JSON-RPC error response 00:25:54.626 response: 00:25:54.626 { 00:25:54.626 "code": -17, 00:25:54.626 "message": "File exists" 00:25:54.626 } 00:25:54.626 02:28:22 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:54.626 02:28:22 -- common/autotest_common.sh@653 -- # es=1 00:25:54.626 02:28:22 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:54.626 02:28:22 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:54.626 02:28:22 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:54.626 02:28:22 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:25:54.626 02:28:22 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:25:54.626 02:28:22 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:25:54.626 02:28:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.626 02:28:22 -- common/autotest_common.sh@10 -- # set +x 00:25:54.626 02:28:22 -- host/discovery.sh@67 -- # sort 00:25:54.626 02:28:22 -- host/discovery.sh@67 -- # xargs 00:25:54.626 02:28:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.626 02:28:22 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:25:54.626 02:28:22 -- host/discovery.sh@147 -- # get_bdev_list 00:25:54.626 02:28:22 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:54.626 02:28:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.626 02:28:22 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:54.626 02:28:22 -- common/autotest_common.sh@10 -- # set +x 00:25:54.626 02:28:22 -- host/discovery.sh@55 -- # sort 00:25:54.626 02:28:22 -- host/discovery.sh@55 -- # xargs 00:25:54.626 02:28:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.886 02:28:22 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:25:54.887 02:28:22 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:54.887 02:28:22 -- common/autotest_common.sh@650 -- # local es=0 00:25:54.887 02:28:22 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:54.887 02:28:22 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:54.887 02:28:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:54.887 02:28:22 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:54.887 02:28:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:54.887 02:28:22 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:54.887 02:28:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.887 02:28:22 -- common/autotest_common.sh@10 -- # set +x 00:25:54.887 request: 00:25:54.887 { 00:25:54.887 "name": "nvme_second", 00:25:54.887 "trtype": "tcp", 00:25:54.887 "traddr": "10.0.0.2", 00:25:54.887 "hostnqn": "nqn.2021-12.io.spdk:test", 00:25:54.887 "adrfam": "ipv4", 00:25:54.887 "trsvcid": "8009", 00:25:54.887 "wait_for_attach": true, 00:25:54.887 "method": "bdev_nvme_start_discovery", 00:25:54.887 "req_id": 1 00:25:54.887 } 00:25:54.887 Got JSON-RPC error response 00:25:54.887 response: 00:25:54.887 { 00:25:54.887 "code": -17, 00:25:54.887 "message": "File exists" 00:25:54.887 } 00:25:54.887 02:28:22 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:54.887 02:28:22 -- common/autotest_common.sh@653 -- # es=1 00:25:54.887 02:28:22 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:54.887 02:28:22 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:54.887 02:28:22 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:54.887 02:28:22 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:25:54.887 02:28:22 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:25:54.887 02:28:22 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:25:54.887 02:28:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.887 02:28:22 -- common/autotest_common.sh@10 -- # set +x 00:25:54.887 02:28:22 -- host/discovery.sh@67 -- # sort 00:25:54.887 02:28:22 -- host/discovery.sh@67 -- # xargs 00:25:54.887 02:28:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.887 02:28:22 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:25:54.887 02:28:22 -- host/discovery.sh@153 -- # get_bdev_list 00:25:54.887 02:28:22 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:54.887 02:28:22 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:54.887 02:28:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.887 02:28:22 -- common/autotest_common.sh@10 -- # set +x 00:25:54.887 02:28:22 -- host/discovery.sh@55 -- # sort 00:25:54.887 02:28:22 -- host/discovery.sh@55 -- # xargs 00:25:54.887 02:28:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.887 02:28:22 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:25:54.887 02:28:22 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:25:54.887 02:28:22 -- common/autotest_common.sh@650 -- # local es=0 00:25:54.887 02:28:22 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:25:54.887 02:28:22 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:54.887 02:28:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:54.887 02:28:22 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:54.887 02:28:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:54.887 02:28:22 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:25:54.887 02:28:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.887 02:28:22 -- common/autotest_common.sh@10 -- # set +x 00:25:55.821 [2024-12-08 02:28:23.526750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:55.821 [2024-12-08 02:28:23.526876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:55.821 [2024-12-08 02:28:23.526903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7673d0 with addr=10.0.0.2, port=8010 00:25:55.821 [2024-12-08 02:28:23.526924] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:25:55.821 [2024-12-08 02:28:23.526938] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:25:55.821 [2024-12-08 02:28:23.526950] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:25:56.755 [2024-12-08 02:28:24.529151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:56.755 [2024-12-08 02:28:24.529318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:56.755 [2024-12-08 02:28:24.529348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x733d30 with addr=10.0.0.2, port=8010 00:25:56.755 [2024-12-08 02:28:24.529370] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:25:56.755 [2024-12-08 02:28:24.529384] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:25:56.755 [2024-12-08 02:28:24.529397] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:25:58.130 [2024-12-08 02:28:25.531435] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:25:58.130 request: 00:25:58.131 { 00:25:58.131 "name": "nvme_second", 00:25:58.131 "trtype": "tcp", 00:25:58.131 "traddr": "10.0.0.2", 00:25:58.131 "hostnqn": "nqn.2021-12.io.spdk:test", 00:25:58.131 "adrfam": "ipv4", 00:25:58.131 "trsvcid": "8010", 00:25:58.131 "attach_timeout_ms": 3000, 00:25:58.131 "method": "bdev_nvme_start_discovery", 00:25:58.131 "req_id": 1 00:25:58.131 } 00:25:58.131 Got JSON-RPC error response 00:25:58.131 response: 00:25:58.131 { 00:25:58.131 "code": -110, 00:25:58.131 "message": "Connection timed out" 00:25:58.131 } 00:25:58.131 02:28:25 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:58.131 02:28:25 -- common/autotest_common.sh@653 -- # es=1 00:25:58.131 02:28:25 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:58.131 02:28:25 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:58.131 02:28:25 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:58.131 02:28:25 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:25:58.131 02:28:25 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:25:58.131 02:28:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:58.131 02:28:25 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:25:58.131 02:28:25 -- common/autotest_common.sh@10 -- # set +x 00:25:58.131 02:28:25 -- host/discovery.sh@67 -- # sort 00:25:58.131 02:28:25 -- host/discovery.sh@67 -- # xargs 00:25:58.131 02:28:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:58.131 02:28:25 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:25:58.131 02:28:25 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:25:58.131 02:28:25 -- host/discovery.sh@162 -- # kill 2212508 00:25:58.131 02:28:25 -- host/discovery.sh@163 -- # nvmftestfini 00:25:58.131 02:28:25 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:58.131 02:28:25 -- nvmf/common.sh@116 -- # sync 00:25:58.131 02:28:25 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:58.131 02:28:25 -- nvmf/common.sh@119 -- # set +e 00:25:58.131 02:28:25 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:58.131 02:28:25 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:58.131 rmmod nvme_tcp 00:25:58.131 rmmod nvme_fabrics 00:25:58.131 rmmod nvme_keyring 00:25:58.131 02:28:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:58.131 02:28:25 -- nvmf/common.sh@123 -- # set -e 00:25:58.131 02:28:25 -- nvmf/common.sh@124 -- # return 0 00:25:58.131 02:28:25 -- nvmf/common.sh@477 -- # '[' -n 2212352 ']' 00:25:58.131 02:28:25 -- nvmf/common.sh@478 -- # killprocess 2212352 00:25:58.131 02:28:25 -- common/autotest_common.sh@936 -- # '[' -z 2212352 ']' 00:25:58.131 02:28:25 -- common/autotest_common.sh@940 -- # kill -0 2212352 00:25:58.131 02:28:25 -- common/autotest_common.sh@941 -- # uname 00:25:58.131 02:28:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:58.131 02:28:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2212352 00:25:58.131 02:28:25 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:58.131 02:28:25 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:58.131 02:28:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2212352' 00:25:58.131 killing process with pid 2212352 00:25:58.131 02:28:25 -- common/autotest_common.sh@955 -- # kill 2212352 00:25:58.131 02:28:25 -- common/autotest_common.sh@960 -- # wait 2212352 00:25:58.391 02:28:25 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:58.391 02:28:25 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:58.391 02:28:25 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:58.391 02:28:25 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:58.391 02:28:25 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:58.391 02:28:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:58.391 02:28:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:58.391 02:28:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:00.295 02:28:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:00.295 00:26:00.295 real 0m17.450s 00:26:00.295 user 0m27.101s 00:26:00.295 sys 0m2.858s 00:26:00.295 02:28:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:00.295 02:28:28 -- common/autotest_common.sh@10 -- # set +x 00:26:00.295 ************************************ 00:26:00.295 END TEST nvmf_discovery 00:26:00.295 ************************************ 00:26:00.295 02:28:28 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:26:00.295 02:28:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:00.295 02:28:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:00.295 02:28:28 -- common/autotest_common.sh@10 -- # set +x 00:26:00.295 ************************************ 00:26:00.295 START TEST nvmf_discovery_remove_ifc 00:26:00.295 ************************************ 00:26:00.295 02:28:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:26:00.559 * Looking for test storage... 00:26:00.559 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:00.559 02:28:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:00.559 02:28:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:00.559 02:28:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:00.559 02:28:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:00.559 02:28:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:00.559 02:28:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:00.559 02:28:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:00.559 02:28:28 -- scripts/common.sh@335 -- # IFS=.-: 00:26:00.559 02:28:28 -- scripts/common.sh@335 -- # read -ra ver1 00:26:00.559 02:28:28 -- scripts/common.sh@336 -- # IFS=.-: 00:26:00.559 02:28:28 -- scripts/common.sh@336 -- # read -ra ver2 00:26:00.559 02:28:28 -- scripts/common.sh@337 -- # local 'op=<' 00:26:00.559 02:28:28 -- scripts/common.sh@339 -- # ver1_l=2 00:26:00.559 02:28:28 -- scripts/common.sh@340 -- # ver2_l=1 00:26:00.559 02:28:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:00.559 02:28:28 -- scripts/common.sh@343 -- # case "$op" in 00:26:00.559 02:28:28 -- scripts/common.sh@344 -- # : 1 00:26:00.559 02:28:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:00.559 02:28:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:00.559 02:28:28 -- scripts/common.sh@364 -- # decimal 1 00:26:00.559 02:28:28 -- scripts/common.sh@352 -- # local d=1 00:26:00.559 02:28:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:00.559 02:28:28 -- scripts/common.sh@354 -- # echo 1 00:26:00.559 02:28:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:00.559 02:28:28 -- scripts/common.sh@365 -- # decimal 2 00:26:00.559 02:28:28 -- scripts/common.sh@352 -- # local d=2 00:26:00.559 02:28:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:00.559 02:28:28 -- scripts/common.sh@354 -- # echo 2 00:26:00.559 02:28:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:00.559 02:28:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:00.559 02:28:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:00.559 02:28:28 -- scripts/common.sh@367 -- # return 0 00:26:00.559 02:28:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:00.559 02:28:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:00.559 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:00.559 --rc genhtml_branch_coverage=1 00:26:00.559 --rc genhtml_function_coverage=1 00:26:00.559 --rc genhtml_legend=1 00:26:00.559 --rc geninfo_all_blocks=1 00:26:00.559 --rc geninfo_unexecuted_blocks=1 00:26:00.559 00:26:00.559 ' 00:26:00.559 02:28:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:00.559 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:00.559 --rc genhtml_branch_coverage=1 00:26:00.559 --rc genhtml_function_coverage=1 00:26:00.559 --rc genhtml_legend=1 00:26:00.559 --rc geninfo_all_blocks=1 00:26:00.559 --rc geninfo_unexecuted_blocks=1 00:26:00.559 00:26:00.559 ' 00:26:00.559 02:28:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:00.559 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:00.559 --rc genhtml_branch_coverage=1 00:26:00.559 --rc genhtml_function_coverage=1 00:26:00.559 --rc genhtml_legend=1 00:26:00.559 --rc geninfo_all_blocks=1 00:26:00.559 --rc geninfo_unexecuted_blocks=1 00:26:00.559 00:26:00.559 ' 00:26:00.559 02:28:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:00.559 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:00.559 --rc genhtml_branch_coverage=1 00:26:00.559 --rc genhtml_function_coverage=1 00:26:00.559 --rc genhtml_legend=1 00:26:00.559 --rc geninfo_all_blocks=1 00:26:00.559 --rc geninfo_unexecuted_blocks=1 00:26:00.559 00:26:00.559 ' 00:26:00.559 02:28:28 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:00.559 02:28:28 -- nvmf/common.sh@7 -- # uname -s 00:26:00.559 02:28:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:00.559 02:28:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:00.559 02:28:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:00.559 02:28:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:00.559 02:28:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:00.559 02:28:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:00.559 02:28:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:00.559 02:28:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:00.559 02:28:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:00.559 02:28:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:00.559 02:28:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:00.559 02:28:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:00.559 02:28:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:00.559 02:28:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:00.559 02:28:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:00.559 02:28:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:00.559 02:28:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:00.559 02:28:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:00.559 02:28:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:00.559 02:28:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:00.559 02:28:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:00.559 02:28:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:00.559 02:28:28 -- paths/export.sh@5 -- # export PATH 00:26:00.560 02:28:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:00.560 02:28:28 -- nvmf/common.sh@46 -- # : 0 00:26:00.560 02:28:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:00.560 02:28:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:00.560 02:28:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:00.560 02:28:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:00.560 02:28:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:00.560 02:28:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:00.560 02:28:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:00.560 02:28:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:00.560 02:28:28 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:26:00.560 02:28:28 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:26:00.560 02:28:28 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:26:00.560 02:28:28 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:26:00.560 02:28:28 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:26:00.560 02:28:28 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:26:00.560 02:28:28 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:26:00.560 02:28:28 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:00.560 02:28:28 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:00.560 02:28:28 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:00.560 02:28:28 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:00.560 02:28:28 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:00.560 02:28:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:00.560 02:28:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:00.560 02:28:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:00.560 02:28:28 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:00.560 02:28:28 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:00.560 02:28:28 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:00.560 02:28:28 -- common/autotest_common.sh@10 -- # set +x 00:26:02.468 02:28:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:02.468 02:28:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:02.468 02:28:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:02.468 02:28:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:02.468 02:28:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:02.468 02:28:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:02.468 02:28:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:02.468 02:28:30 -- nvmf/common.sh@294 -- # net_devs=() 00:26:02.468 02:28:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:02.468 02:28:30 -- nvmf/common.sh@295 -- # e810=() 00:26:02.468 02:28:30 -- nvmf/common.sh@295 -- # local -ga e810 00:26:02.468 02:28:30 -- nvmf/common.sh@296 -- # x722=() 00:26:02.468 02:28:30 -- nvmf/common.sh@296 -- # local -ga x722 00:26:02.468 02:28:30 -- nvmf/common.sh@297 -- # mlx=() 00:26:02.468 02:28:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:02.468 02:28:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:02.468 02:28:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:02.468 02:28:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:02.468 02:28:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:02.468 02:28:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:02.468 02:28:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:02.468 02:28:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:02.468 02:28:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:02.468 02:28:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:02.468 02:28:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:02.468 02:28:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:02.468 02:28:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:02.468 02:28:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:02.468 02:28:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:02.468 02:28:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:02.468 02:28:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:02.468 02:28:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:02.468 02:28:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:02.468 02:28:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:02.468 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:02.468 02:28:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:02.468 02:28:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:02.468 02:28:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:02.468 02:28:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:02.468 02:28:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:02.468 02:28:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:02.468 02:28:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:02.468 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:02.468 02:28:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:02.468 02:28:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:02.468 02:28:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:02.468 02:28:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:02.468 02:28:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:02.468 02:28:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:02.468 02:28:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:02.468 02:28:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:02.468 02:28:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:02.468 02:28:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:02.468 02:28:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:02.468 02:28:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:02.468 02:28:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:02.468 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:02.468 02:28:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:02.468 02:28:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:02.468 02:28:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:02.468 02:28:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:02.468 02:28:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:02.468 02:28:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:02.468 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:02.468 02:28:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:02.468 02:28:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:02.468 02:28:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:02.468 02:28:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:02.468 02:28:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:02.468 02:28:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:02.468 02:28:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:02.468 02:28:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:02.468 02:28:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:02.468 02:28:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:02.468 02:28:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:02.468 02:28:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:02.468 02:28:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:02.468 02:28:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:02.468 02:28:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:02.468 02:28:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:02.468 02:28:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:02.468 02:28:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:02.468 02:28:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:02.727 02:28:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:02.727 02:28:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:02.727 02:28:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:02.727 02:28:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:02.727 02:28:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:02.727 02:28:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:02.727 02:28:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:02.727 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:02.727 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.233 ms 00:26:02.727 00:26:02.727 --- 10.0.0.2 ping statistics --- 00:26:02.727 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:02.727 rtt min/avg/max/mdev = 0.233/0.233/0.233/0.000 ms 00:26:02.727 02:28:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:02.727 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:02.727 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.075 ms 00:26:02.727 00:26:02.727 --- 10.0.0.1 ping statistics --- 00:26:02.727 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:02.727 rtt min/avg/max/mdev = 0.075/0.075/0.075/0.000 ms 00:26:02.727 02:28:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:02.727 02:28:30 -- nvmf/common.sh@410 -- # return 0 00:26:02.727 02:28:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:02.727 02:28:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:02.727 02:28:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:02.727 02:28:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:02.727 02:28:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:02.727 02:28:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:02.727 02:28:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:02.727 02:28:30 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:26:02.727 02:28:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:02.727 02:28:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:02.727 02:28:30 -- common/autotest_common.sh@10 -- # set +x 00:26:02.727 02:28:30 -- nvmf/common.sh@469 -- # nvmfpid=2215987 00:26:02.727 02:28:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:26:02.727 02:28:30 -- nvmf/common.sh@470 -- # waitforlisten 2215987 00:26:02.727 02:28:30 -- common/autotest_common.sh@829 -- # '[' -z 2215987 ']' 00:26:02.727 02:28:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:02.727 02:28:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:02.727 02:28:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:02.727 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:02.727 02:28:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:02.727 02:28:30 -- common/autotest_common.sh@10 -- # set +x 00:26:02.727 [2024-12-08 02:28:30.461079] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:02.727 [2024-12-08 02:28:30.461160] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:02.727 EAL: No free 2048 kB hugepages reported on node 1 00:26:02.987 [2024-12-08 02:28:30.528717] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:02.987 [2024-12-08 02:28:30.634107] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:02.987 [2024-12-08 02:28:30.634262] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:02.987 [2024-12-08 02:28:30.634294] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:02.987 [2024-12-08 02:28:30.634307] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:02.987 [2024-12-08 02:28:30.634342] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:03.923 02:28:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:03.923 02:28:31 -- common/autotest_common.sh@862 -- # return 0 00:26:03.923 02:28:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:03.923 02:28:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:03.923 02:28:31 -- common/autotest_common.sh@10 -- # set +x 00:26:03.923 02:28:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:03.923 02:28:31 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:26:03.924 02:28:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:03.924 02:28:31 -- common/autotest_common.sh@10 -- # set +x 00:26:03.924 [2024-12-08 02:28:31.489792] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:03.924 [2024-12-08 02:28:31.497992] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:26:03.924 null0 00:26:03.924 [2024-12-08 02:28:31.529968] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:03.924 02:28:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:03.924 02:28:31 -- host/discovery_remove_ifc.sh@59 -- # hostpid=2216144 00:26:03.924 02:28:31 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:26:03.924 02:28:31 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 2216144 /tmp/host.sock 00:26:03.924 02:28:31 -- common/autotest_common.sh@829 -- # '[' -z 2216144 ']' 00:26:03.924 02:28:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:26:03.924 02:28:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:03.924 02:28:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:26:03.924 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:26:03.924 02:28:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:03.924 02:28:31 -- common/autotest_common.sh@10 -- # set +x 00:26:03.924 [2024-12-08 02:28:31.591147] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:03.924 [2024-12-08 02:28:31.591226] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2216144 ] 00:26:03.924 EAL: No free 2048 kB hugepages reported on node 1 00:26:03.924 [2024-12-08 02:28:31.651850] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:04.183 [2024-12-08 02:28:31.767403] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:04.183 [2024-12-08 02:28:31.767588] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:04.183 02:28:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:04.183 02:28:31 -- common/autotest_common.sh@862 -- # return 0 00:26:04.183 02:28:31 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:04.183 02:28:31 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:26:04.183 02:28:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:04.183 02:28:31 -- common/autotest_common.sh@10 -- # set +x 00:26:04.184 02:28:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:04.184 02:28:31 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:26:04.184 02:28:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:04.184 02:28:31 -- common/autotest_common.sh@10 -- # set +x 00:26:04.443 02:28:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:04.443 02:28:31 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:26:04.443 02:28:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:04.443 02:28:31 -- common/autotest_common.sh@10 -- # set +x 00:26:05.378 [2024-12-08 02:28:32.987167] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:05.378 [2024-12-08 02:28:32.987201] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:05.378 [2024-12-08 02:28:32.987227] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:05.378 [2024-12-08 02:28:33.073490] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:26:05.378 [2024-12-08 02:28:33.129869] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:05.378 [2024-12-08 02:28:33.129923] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:05.378 [2024-12-08 02:28:33.129965] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:05.378 [2024-12-08 02:28:33.129990] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:05.378 [2024-12-08 02:28:33.130027] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:05.378 02:28:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.378 02:28:33 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:26:05.378 02:28:33 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:05.378 02:28:33 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:05.378 02:28:33 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:05.378 02:28:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.378 02:28:33 -- common/autotest_common.sh@10 -- # set +x 00:26:05.378 02:28:33 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:05.378 02:28:33 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:05.378 02:28:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.638 02:28:33 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:26:05.638 02:28:33 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:26:05.638 02:28:33 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:26:05.638 02:28:33 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:26:05.638 02:28:33 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:05.638 02:28:33 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:05.638 02:28:33 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:05.638 02:28:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.638 02:28:33 -- common/autotest_common.sh@10 -- # set +x 00:26:05.638 02:28:33 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:05.638 02:28:33 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:05.638 02:28:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.638 02:28:33 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:05.638 02:28:33 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:07.015 02:28:34 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:07.015 02:28:34 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:07.015 02:28:34 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:07.015 02:28:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.015 02:28:34 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:07.015 02:28:34 -- common/autotest_common.sh@10 -- # set +x 00:26:07.015 02:28:34 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:07.015 02:28:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.015 02:28:34 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:07.015 02:28:34 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:07.955 02:28:35 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:07.955 02:28:35 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:07.955 02:28:35 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:07.955 02:28:35 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:07.955 02:28:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.955 02:28:35 -- common/autotest_common.sh@10 -- # set +x 00:26:07.955 02:28:35 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:07.955 02:28:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.955 02:28:35 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:07.955 02:28:35 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:08.890 02:28:36 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:08.890 02:28:36 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:08.890 02:28:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.890 02:28:36 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:08.890 02:28:36 -- common/autotest_common.sh@10 -- # set +x 00:26:08.890 02:28:36 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:08.891 02:28:36 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:08.891 02:28:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.891 02:28:36 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:08.891 02:28:36 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:09.830 02:28:37 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:09.830 02:28:37 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:09.830 02:28:37 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:09.830 02:28:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:09.830 02:28:37 -- common/autotest_common.sh@10 -- # set +x 00:26:09.830 02:28:37 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:09.830 02:28:37 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:09.830 02:28:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:09.830 02:28:37 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:09.830 02:28:37 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:10.766 02:28:38 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:10.766 02:28:38 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:10.766 02:28:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.766 02:28:38 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:10.766 02:28:38 -- common/autotest_common.sh@10 -- # set +x 00:26:10.766 02:28:38 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:10.766 02:28:38 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:11.026 02:28:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:11.026 [2024-12-08 02:28:38.571564] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:26:11.026 [2024-12-08 02:28:38.571638] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:11.026 [2024-12-08 02:28:38.571661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:11.026 [2024-12-08 02:28:38.571678] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:11.026 [2024-12-08 02:28:38.571693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:11.026 [2024-12-08 02:28:38.571707] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:11.026 [2024-12-08 02:28:38.571721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:11.026 [2024-12-08 02:28:38.571735] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:11.026 [2024-12-08 02:28:38.571748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:11.026 [2024-12-08 02:28:38.571762] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:11.026 [2024-12-08 02:28:38.571783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:11.026 [2024-12-08 02:28:38.571797] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdde430 is same with the state(5) to be set 00:26:11.026 02:28:38 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:11.026 02:28:38 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:11.026 [2024-12-08 02:28:38.581594] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdde430 (9): Bad file descriptor 00:26:11.026 [2024-12-08 02:28:38.591685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:0 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:11.026 [2024-12-08 02:28:38.591710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:11.026 [2024-12-08 02:28:38.591760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:0 len:64 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:11.026 [2024-12-08 02:28:38.591778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:11.026 [2024-12-08 02:28:38.591795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:0 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:11.026 [2024-12-08 02:28:38.591809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:11.026 [2024-12-08 02:28:38.591928] bdev_nvme.c:1582:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0xe17d40 was disconnected and freed in a reset ctrlr sequence. 00:26:11.026 [2024-12-08 02:28:38.591952] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:11.961 02:28:39 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:11.961 02:28:39 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:11.961 02:28:39 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:11.961 02:28:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.961 02:28:39 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:11.961 02:28:39 -- common/autotest_common.sh@10 -- # set +x 00:26:11.961 02:28:39 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:11.961 [2024-12-08 02:28:39.605563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:12.895 [2024-12-08 02:28:40.629577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:12.895 [2024-12-08 02:28:40.629652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdde430 with addr=10.0.0.2, port=4420 00:26:12.895 [2024-12-08 02:28:40.629680] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdde430 is same with the state(5) to be set 00:26:12.895 [2024-12-08 02:28:40.629728] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:12.895 [2024-12-08 02:28:40.629748] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:12.895 [2024-12-08 02:28:40.629762] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:12.895 [2024-12-08 02:28:40.629777] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:26:12.895 [2024-12-08 02:28:40.630222] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdde430 (9): Bad file descriptor 00:26:12.895 [2024-12-08 02:28:40.630297] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:12.895 [2024-12-08 02:28:40.630348] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:26:12.895 [2024-12-08 02:28:40.630388] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:12.895 [2024-12-08 02:28:40.630411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:12.895 [2024-12-08 02:28:40.630441] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:12.895 [2024-12-08 02:28:40.630457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:12.895 [2024-12-08 02:28:40.630472] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:12.895 [2024-12-08 02:28:40.630486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:12.895 [2024-12-08 02:28:40.630501] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:12.895 [2024-12-08 02:28:40.630515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:12.895 [2024-12-08 02:28:40.630530] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:12.895 [2024-12-08 02:28:40.630728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:12.895 [2024-12-08 02:28:40.630745] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:26:12.895 [2024-12-08 02:28:40.630779] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdde840 (9): Bad file descriptor 00:26:12.895 [2024-12-08 02:28:40.630816] bdev.c:4968:_tmp_bdev_event_cb: *NOTICE*: Unexpected event type: 0 00:26:12.895 [2024-12-08 02:28:40.631804] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:26:12.895 [2024-12-08 02:28:40.631844] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:26:12.895 02:28:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:12.895 02:28:40 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:12.895 02:28:40 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:14.271 [2024-12-08 02:28:41.632772] bdev_raid.c:3350:raid_bdev_examine_load_sb_cb: *ERROR*: Failed to examine bdev nvme0n1: Input/output error 00:26:14.271 [2024-12-08 02:28:41.632831] vbdev_gpt.c: 468:gpt_bdev_complete: *ERROR*: Gpt: bdev=nvme0n1 io error status=0 00:26:14.271 02:28:41 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:14.271 02:28:41 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:14.271 02:28:41 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:14.271 02:28:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:14.271 02:28:41 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:14.271 02:28:41 -- common/autotest_common.sh@10 -- # set +x 00:26:14.271 02:28:41 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:14.271 02:28:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:14.271 02:28:41 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:26:14.271 02:28:41 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:14.271 02:28:41 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:14.271 02:28:41 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:26:14.271 02:28:41 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:14.271 02:28:41 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:14.271 02:28:41 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:14.271 02:28:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:14.271 02:28:41 -- common/autotest_common.sh@10 -- # set +x 00:26:14.271 02:28:41 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:14.271 02:28:41 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:14.271 02:28:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:14.271 02:28:41 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:14.271 02:28:41 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:15.210 [2024-12-08 02:28:42.683101] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:15.210 [2024-12-08 02:28:42.683124] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:15.210 [2024-12-08 02:28:42.683151] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:15.210 02:28:42 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:15.210 02:28:42 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:15.210 02:28:42 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:15.210 02:28:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.210 02:28:42 -- common/autotest_common.sh@10 -- # set +x 00:26:15.210 02:28:42 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:15.210 02:28:42 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:15.210 02:28:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.210 02:28:42 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:15.210 02:28:42 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:15.210 [2024-12-08 02:28:42.810596] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:26:15.210 [2024-12-08 02:28:42.873329] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:15.211 [2024-12-08 02:28:42.873381] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:15.211 [2024-12-08 02:28:42.873417] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:15.211 [2024-12-08 02:28:42.873442] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:26:15.211 [2024-12-08 02:28:42.873457] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:15.211 [2024-12-08 02:28:42.881965] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0xdfc580 was disconnected and freed. delete nvme_qpair. 00:26:16.148 02:28:43 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:16.148 02:28:43 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:16.148 02:28:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.148 02:28:43 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:16.148 02:28:43 -- common/autotest_common.sh@10 -- # set +x 00:26:16.148 02:28:43 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:16.148 02:28:43 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:16.148 02:28:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.148 02:28:43 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:26:16.148 02:28:43 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:26:16.148 02:28:43 -- host/discovery_remove_ifc.sh@90 -- # killprocess 2216144 00:26:16.148 02:28:43 -- common/autotest_common.sh@936 -- # '[' -z 2216144 ']' 00:26:16.148 02:28:43 -- common/autotest_common.sh@940 -- # kill -0 2216144 00:26:16.148 02:28:43 -- common/autotest_common.sh@941 -- # uname 00:26:16.148 02:28:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:16.148 02:28:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2216144 00:26:16.148 02:28:43 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:16.148 02:28:43 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:16.148 02:28:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2216144' 00:26:16.148 killing process with pid 2216144 00:26:16.148 02:28:43 -- common/autotest_common.sh@955 -- # kill 2216144 00:26:16.148 02:28:43 -- common/autotest_common.sh@960 -- # wait 2216144 00:26:16.406 02:28:44 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:26:16.406 02:28:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:16.406 02:28:44 -- nvmf/common.sh@116 -- # sync 00:26:16.406 02:28:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:16.406 02:28:44 -- nvmf/common.sh@119 -- # set +e 00:26:16.406 02:28:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:16.406 02:28:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:16.406 rmmod nvme_tcp 00:26:16.406 rmmod nvme_fabrics 00:26:16.406 rmmod nvme_keyring 00:26:16.665 02:28:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:16.665 02:28:44 -- nvmf/common.sh@123 -- # set -e 00:26:16.665 02:28:44 -- nvmf/common.sh@124 -- # return 0 00:26:16.665 02:28:44 -- nvmf/common.sh@477 -- # '[' -n 2215987 ']' 00:26:16.665 02:28:44 -- nvmf/common.sh@478 -- # killprocess 2215987 00:26:16.665 02:28:44 -- common/autotest_common.sh@936 -- # '[' -z 2215987 ']' 00:26:16.665 02:28:44 -- common/autotest_common.sh@940 -- # kill -0 2215987 00:26:16.665 02:28:44 -- common/autotest_common.sh@941 -- # uname 00:26:16.665 02:28:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:16.665 02:28:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2215987 00:26:16.665 02:28:44 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:16.665 02:28:44 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:16.665 02:28:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2215987' 00:26:16.665 killing process with pid 2215987 00:26:16.665 02:28:44 -- common/autotest_common.sh@955 -- # kill 2215987 00:26:16.665 02:28:44 -- common/autotest_common.sh@960 -- # wait 2215987 00:26:16.665 [2024-12-08 02:28:44.238626] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x119cb50 is same with the state(5) to be set 00:26:16.665 [2024-12-08 02:28:44.238668] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x119cb50 is same with the state(5) to be set 00:26:16.923 02:28:44 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:16.923 02:28:44 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:16.923 02:28:44 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:16.923 02:28:44 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:16.923 02:28:44 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:16.923 02:28:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:16.923 02:28:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:16.923 02:28:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:18.832 02:28:46 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:18.832 00:26:18.832 real 0m18.529s 00:26:18.832 user 0m25.442s 00:26:18.832 sys 0m3.168s 00:26:18.832 02:28:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:18.832 02:28:46 -- common/autotest_common.sh@10 -- # set +x 00:26:18.832 ************************************ 00:26:18.832 END TEST nvmf_discovery_remove_ifc 00:26:18.832 ************************************ 00:26:18.832 02:28:46 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:26:18.832 02:28:46 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:18.832 02:28:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:18.832 02:28:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:18.832 02:28:46 -- common/autotest_common.sh@10 -- # set +x 00:26:18.832 ************************************ 00:26:18.832 START TEST nvmf_digest 00:26:18.832 ************************************ 00:26:18.832 02:28:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:19.091 * Looking for test storage... 00:26:19.091 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:19.091 02:28:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:19.091 02:28:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:19.091 02:28:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:19.091 02:28:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:19.091 02:28:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:19.091 02:28:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:19.091 02:28:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:19.091 02:28:46 -- scripts/common.sh@335 -- # IFS=.-: 00:26:19.091 02:28:46 -- scripts/common.sh@335 -- # read -ra ver1 00:26:19.091 02:28:46 -- scripts/common.sh@336 -- # IFS=.-: 00:26:19.091 02:28:46 -- scripts/common.sh@336 -- # read -ra ver2 00:26:19.091 02:28:46 -- scripts/common.sh@337 -- # local 'op=<' 00:26:19.091 02:28:46 -- scripts/common.sh@339 -- # ver1_l=2 00:26:19.091 02:28:46 -- scripts/common.sh@340 -- # ver2_l=1 00:26:19.091 02:28:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:19.091 02:28:46 -- scripts/common.sh@343 -- # case "$op" in 00:26:19.091 02:28:46 -- scripts/common.sh@344 -- # : 1 00:26:19.091 02:28:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:19.091 02:28:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:19.091 02:28:46 -- scripts/common.sh@364 -- # decimal 1 00:26:19.091 02:28:46 -- scripts/common.sh@352 -- # local d=1 00:26:19.091 02:28:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:19.091 02:28:46 -- scripts/common.sh@354 -- # echo 1 00:26:19.091 02:28:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:19.091 02:28:46 -- scripts/common.sh@365 -- # decimal 2 00:26:19.091 02:28:46 -- scripts/common.sh@352 -- # local d=2 00:26:19.091 02:28:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:19.091 02:28:46 -- scripts/common.sh@354 -- # echo 2 00:26:19.091 02:28:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:19.092 02:28:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:19.092 02:28:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:19.092 02:28:46 -- scripts/common.sh@367 -- # return 0 00:26:19.092 02:28:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:19.092 02:28:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:19.092 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:19.092 --rc genhtml_branch_coverage=1 00:26:19.092 --rc genhtml_function_coverage=1 00:26:19.092 --rc genhtml_legend=1 00:26:19.092 --rc geninfo_all_blocks=1 00:26:19.092 --rc geninfo_unexecuted_blocks=1 00:26:19.092 00:26:19.092 ' 00:26:19.092 02:28:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:19.092 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:19.092 --rc genhtml_branch_coverage=1 00:26:19.092 --rc genhtml_function_coverage=1 00:26:19.092 --rc genhtml_legend=1 00:26:19.092 --rc geninfo_all_blocks=1 00:26:19.092 --rc geninfo_unexecuted_blocks=1 00:26:19.092 00:26:19.092 ' 00:26:19.092 02:28:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:19.092 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:19.092 --rc genhtml_branch_coverage=1 00:26:19.092 --rc genhtml_function_coverage=1 00:26:19.092 --rc genhtml_legend=1 00:26:19.092 --rc geninfo_all_blocks=1 00:26:19.092 --rc geninfo_unexecuted_blocks=1 00:26:19.092 00:26:19.092 ' 00:26:19.092 02:28:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:19.092 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:19.092 --rc genhtml_branch_coverage=1 00:26:19.092 --rc genhtml_function_coverage=1 00:26:19.092 --rc genhtml_legend=1 00:26:19.092 --rc geninfo_all_blocks=1 00:26:19.092 --rc geninfo_unexecuted_blocks=1 00:26:19.092 00:26:19.092 ' 00:26:19.092 02:28:46 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:19.092 02:28:46 -- nvmf/common.sh@7 -- # uname -s 00:26:19.092 02:28:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:19.092 02:28:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:19.092 02:28:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:19.092 02:28:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:19.092 02:28:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:19.092 02:28:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:19.092 02:28:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:19.092 02:28:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:19.092 02:28:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:19.092 02:28:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:19.092 02:28:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:19.092 02:28:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:19.092 02:28:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:19.092 02:28:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:19.092 02:28:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:19.092 02:28:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:19.092 02:28:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:19.092 02:28:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:19.092 02:28:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:19.092 02:28:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:19.092 02:28:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:19.092 02:28:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:19.092 02:28:46 -- paths/export.sh@5 -- # export PATH 00:26:19.092 02:28:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:19.092 02:28:46 -- nvmf/common.sh@46 -- # : 0 00:26:19.092 02:28:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:19.092 02:28:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:19.092 02:28:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:19.092 02:28:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:19.092 02:28:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:19.092 02:28:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:19.092 02:28:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:19.092 02:28:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:19.092 02:28:46 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:26:19.092 02:28:46 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:26:19.092 02:28:46 -- host/digest.sh@16 -- # runtime=2 00:26:19.092 02:28:46 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:26:19.092 02:28:46 -- host/digest.sh@132 -- # nvmftestinit 00:26:19.092 02:28:46 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:19.092 02:28:46 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:19.092 02:28:46 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:19.092 02:28:46 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:19.092 02:28:46 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:19.092 02:28:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:19.092 02:28:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:19.092 02:28:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:19.092 02:28:46 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:19.092 02:28:46 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:19.092 02:28:46 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:19.092 02:28:46 -- common/autotest_common.sh@10 -- # set +x 00:26:21.624 02:28:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:21.624 02:28:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:21.624 02:28:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:21.624 02:28:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:21.624 02:28:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:21.624 02:28:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:21.624 02:28:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:21.624 02:28:48 -- nvmf/common.sh@294 -- # net_devs=() 00:26:21.624 02:28:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:21.624 02:28:48 -- nvmf/common.sh@295 -- # e810=() 00:26:21.624 02:28:48 -- nvmf/common.sh@295 -- # local -ga e810 00:26:21.624 02:28:48 -- nvmf/common.sh@296 -- # x722=() 00:26:21.624 02:28:48 -- nvmf/common.sh@296 -- # local -ga x722 00:26:21.624 02:28:48 -- nvmf/common.sh@297 -- # mlx=() 00:26:21.624 02:28:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:21.624 02:28:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:21.624 02:28:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:21.624 02:28:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:21.624 02:28:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:21.624 02:28:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:21.624 02:28:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:21.624 02:28:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:21.624 02:28:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:21.624 02:28:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:21.624 02:28:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:21.624 02:28:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:21.624 02:28:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:21.624 02:28:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:21.624 02:28:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:21.624 02:28:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:21.624 02:28:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:21.624 02:28:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:21.624 02:28:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:21.624 02:28:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:21.625 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:21.625 02:28:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:21.625 02:28:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:21.625 02:28:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:21.625 02:28:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:21.625 02:28:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:21.625 02:28:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:21.625 02:28:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:21.625 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:21.625 02:28:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:21.625 02:28:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:21.625 02:28:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:21.625 02:28:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:21.625 02:28:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:21.625 02:28:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:21.625 02:28:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:21.625 02:28:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:21.625 02:28:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:21.625 02:28:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:21.625 02:28:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:21.625 02:28:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:21.625 02:28:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:21.625 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:21.625 02:28:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:21.625 02:28:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:21.625 02:28:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:21.625 02:28:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:21.625 02:28:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:21.625 02:28:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:21.625 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:21.625 02:28:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:21.625 02:28:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:21.625 02:28:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:21.625 02:28:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:21.625 02:28:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:21.625 02:28:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:21.625 02:28:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:21.625 02:28:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:21.625 02:28:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:21.625 02:28:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:21.625 02:28:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:21.625 02:28:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:21.625 02:28:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:21.625 02:28:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:21.625 02:28:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:21.625 02:28:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:21.625 02:28:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:21.625 02:28:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:21.625 02:28:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:21.625 02:28:49 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:21.625 02:28:49 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:21.625 02:28:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:21.625 02:28:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:21.625 02:28:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:21.625 02:28:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:21.625 02:28:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:21.625 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:21.625 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.229 ms 00:26:21.625 00:26:21.625 --- 10.0.0.2 ping statistics --- 00:26:21.625 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:21.625 rtt min/avg/max/mdev = 0.229/0.229/0.229/0.000 ms 00:26:21.625 02:28:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:21.625 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:21.625 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.122 ms 00:26:21.625 00:26:21.625 --- 10.0.0.1 ping statistics --- 00:26:21.625 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:21.625 rtt min/avg/max/mdev = 0.122/0.122/0.122/0.000 ms 00:26:21.625 02:28:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:21.625 02:28:49 -- nvmf/common.sh@410 -- # return 0 00:26:21.625 02:28:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:21.625 02:28:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:21.625 02:28:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:21.625 02:28:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:21.625 02:28:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:21.625 02:28:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:21.625 02:28:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:21.625 02:28:49 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:26:21.625 02:28:49 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:26:21.625 02:28:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:21.625 02:28:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:21.625 02:28:49 -- common/autotest_common.sh@10 -- # set +x 00:26:21.625 ************************************ 00:26:21.625 START TEST nvmf_digest_clean 00:26:21.625 ************************************ 00:26:21.625 02:28:49 -- common/autotest_common.sh@1114 -- # run_digest 00:26:21.625 02:28:49 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:26:21.625 02:28:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:21.625 02:28:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:21.625 02:28:49 -- common/autotest_common.sh@10 -- # set +x 00:26:21.625 02:28:49 -- nvmf/common.sh@469 -- # nvmfpid=2219675 00:26:21.625 02:28:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:26:21.625 02:28:49 -- nvmf/common.sh@470 -- # waitforlisten 2219675 00:26:21.625 02:28:49 -- common/autotest_common.sh@829 -- # '[' -z 2219675 ']' 00:26:21.625 02:28:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:21.625 02:28:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:21.625 02:28:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:21.625 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:21.625 02:28:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:21.625 02:28:49 -- common/autotest_common.sh@10 -- # set +x 00:26:21.625 [2024-12-08 02:28:49.151948] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:21.625 [2024-12-08 02:28:49.152031] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:21.625 EAL: No free 2048 kB hugepages reported on node 1 00:26:21.625 [2024-12-08 02:28:49.217829] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:21.625 [2024-12-08 02:28:49.325296] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:21.625 [2024-12-08 02:28:49.325442] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:21.625 [2024-12-08 02:28:49.325459] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:21.625 [2024-12-08 02:28:49.325472] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:21.625 [2024-12-08 02:28:49.325505] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:21.625 02:28:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:21.625 02:28:49 -- common/autotest_common.sh@862 -- # return 0 00:26:21.625 02:28:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:21.625 02:28:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:21.625 02:28:49 -- common/autotest_common.sh@10 -- # set +x 00:26:21.625 02:28:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:21.625 02:28:49 -- host/digest.sh@120 -- # common_target_config 00:26:21.625 02:28:49 -- host/digest.sh@43 -- # rpc_cmd 00:26:21.885 02:28:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.885 02:28:49 -- common/autotest_common.sh@10 -- # set +x 00:26:21.885 null0 00:26:21.885 [2024-12-08 02:28:49.521511] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:21.885 [2024-12-08 02:28:49.545764] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:21.885 02:28:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.885 02:28:49 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:26:21.885 02:28:49 -- host/digest.sh@77 -- # local rw bs qd 00:26:21.885 02:28:49 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:21.885 02:28:49 -- host/digest.sh@80 -- # rw=randread 00:26:21.885 02:28:49 -- host/digest.sh@80 -- # bs=4096 00:26:21.885 02:28:49 -- host/digest.sh@80 -- # qd=128 00:26:21.885 02:28:49 -- host/digest.sh@82 -- # bperfpid=2219815 00:26:21.885 02:28:49 -- host/digest.sh@83 -- # waitforlisten 2219815 /var/tmp/bperf.sock 00:26:21.885 02:28:49 -- common/autotest_common.sh@829 -- # '[' -z 2219815 ']' 00:26:21.885 02:28:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:21.885 02:28:49 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:21.885 02:28:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:21.885 02:28:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:21.885 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:21.885 02:28:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:21.885 02:28:49 -- common/autotest_common.sh@10 -- # set +x 00:26:21.885 [2024-12-08 02:28:49.591776] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:21.885 [2024-12-08 02:28:49.591849] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2219815 ] 00:26:21.885 EAL: No free 2048 kB hugepages reported on node 1 00:26:21.885 [2024-12-08 02:28:49.652671] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:22.143 [2024-12-08 02:28:49.768568] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:22.143 02:28:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:22.143 02:28:49 -- common/autotest_common.sh@862 -- # return 0 00:26:22.143 02:28:49 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:22.143 02:28:49 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:22.143 02:28:49 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:22.402 02:28:50 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:22.403 02:28:50 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:22.971 nvme0n1 00:26:22.971 02:28:50 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:22.971 02:28:50 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:23.230 Running I/O for 2 seconds... 00:26:25.136 00:26:25.136 Latency(us) 00:26:25.136 [2024-12-08T01:28:52.917Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:25.136 [2024-12-08T01:28:52.917Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:26:25.136 nvme0n1 : 2.05 15631.71 61.06 0.00 0.00 8019.60 3543.80 48933.55 00:26:25.136 [2024-12-08T01:28:52.917Z] =================================================================================================================== 00:26:25.136 [2024-12-08T01:28:52.917Z] Total : 15631.71 61.06 0.00 0.00 8019.60 3543.80 48933.55 00:26:25.136 0 00:26:25.136 02:28:52 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:25.136 02:28:52 -- host/digest.sh@92 -- # get_accel_stats 00:26:25.136 02:28:52 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:25.136 02:28:52 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:25.136 02:28:52 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:25.136 | select(.opcode=="crc32c") 00:26:25.136 | "\(.module_name) \(.executed)"' 00:26:25.395 02:28:53 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:25.395 02:28:53 -- host/digest.sh@93 -- # exp_module=software 00:26:25.395 02:28:53 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:25.395 02:28:53 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:25.395 02:28:53 -- host/digest.sh@97 -- # killprocess 2219815 00:26:25.395 02:28:53 -- common/autotest_common.sh@936 -- # '[' -z 2219815 ']' 00:26:25.395 02:28:53 -- common/autotest_common.sh@940 -- # kill -0 2219815 00:26:25.395 02:28:53 -- common/autotest_common.sh@941 -- # uname 00:26:25.395 02:28:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:25.395 02:28:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2219815 00:26:25.655 02:28:53 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:25.655 02:28:53 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:25.655 02:28:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2219815' 00:26:25.655 killing process with pid 2219815 00:26:25.655 02:28:53 -- common/autotest_common.sh@955 -- # kill 2219815 00:26:25.655 Received shutdown signal, test time was about 2.000000 seconds 00:26:25.655 00:26:25.655 Latency(us) 00:26:25.655 [2024-12-08T01:28:53.436Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:25.655 [2024-12-08T01:28:53.436Z] =================================================================================================================== 00:26:25.655 [2024-12-08T01:28:53.436Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:25.655 02:28:53 -- common/autotest_common.sh@960 -- # wait 2219815 00:26:25.914 02:28:53 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:26:25.914 02:28:53 -- host/digest.sh@77 -- # local rw bs qd 00:26:25.914 02:28:53 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:25.914 02:28:53 -- host/digest.sh@80 -- # rw=randread 00:26:25.914 02:28:53 -- host/digest.sh@80 -- # bs=131072 00:26:25.914 02:28:53 -- host/digest.sh@80 -- # qd=16 00:26:25.914 02:28:53 -- host/digest.sh@82 -- # bperfpid=2220246 00:26:25.914 02:28:53 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:26:25.914 02:28:53 -- host/digest.sh@83 -- # waitforlisten 2220246 /var/tmp/bperf.sock 00:26:25.914 02:28:53 -- common/autotest_common.sh@829 -- # '[' -z 2220246 ']' 00:26:25.914 02:28:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:25.914 02:28:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:25.914 02:28:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:25.914 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:25.914 02:28:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:25.914 02:28:53 -- common/autotest_common.sh@10 -- # set +x 00:26:25.914 [2024-12-08 02:28:53.510040] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:25.914 [2024-12-08 02:28:53.510117] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2220246 ] 00:26:25.914 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:25.914 Zero copy mechanism will not be used. 00:26:25.914 EAL: No free 2048 kB hugepages reported on node 1 00:26:25.914 [2024-12-08 02:28:53.567316] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:25.914 [2024-12-08 02:28:53.679499] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:26.171 02:28:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:26.171 02:28:53 -- common/autotest_common.sh@862 -- # return 0 00:26:26.171 02:28:53 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:26.171 02:28:53 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:26.171 02:28:53 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:26.430 02:28:54 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:26.430 02:28:54 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:26.995 nvme0n1 00:26:26.995 02:28:54 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:26.995 02:28:54 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:26.995 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:26.995 Zero copy mechanism will not be used. 00:26:26.995 Running I/O for 2 seconds... 00:26:28.947 00:26:28.947 Latency(us) 00:26:28.947 [2024-12-08T01:28:56.728Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:28.947 [2024-12-08T01:28:56.728Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:26:28.947 nvme0n1 : 2.00 5970.98 746.37 0.00 0.00 2675.83 761.55 11359.57 00:26:28.947 [2024-12-08T01:28:56.728Z] =================================================================================================================== 00:26:28.947 [2024-12-08T01:28:56.728Z] Total : 5970.98 746.37 0.00 0.00 2675.83 761.55 11359.57 00:26:28.947 0 00:26:29.206 02:28:56 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:29.206 02:28:56 -- host/digest.sh@92 -- # get_accel_stats 00:26:29.206 02:28:56 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:29.206 02:28:56 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:29.206 | select(.opcode=="crc32c") 00:26:29.206 | "\(.module_name) \(.executed)"' 00:26:29.206 02:28:56 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:29.206 02:28:56 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:29.206 02:28:56 -- host/digest.sh@93 -- # exp_module=software 00:26:29.206 02:28:56 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:29.206 02:28:56 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:29.206 02:28:56 -- host/digest.sh@97 -- # killprocess 2220246 00:26:29.206 02:28:56 -- common/autotest_common.sh@936 -- # '[' -z 2220246 ']' 00:26:29.206 02:28:56 -- common/autotest_common.sh@940 -- # kill -0 2220246 00:26:29.206 02:28:56 -- common/autotest_common.sh@941 -- # uname 00:26:29.465 02:28:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:29.465 02:28:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2220246 00:26:29.465 02:28:57 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:29.465 02:28:57 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:29.465 02:28:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2220246' 00:26:29.465 killing process with pid 2220246 00:26:29.465 02:28:57 -- common/autotest_common.sh@955 -- # kill 2220246 00:26:29.465 Received shutdown signal, test time was about 2.000000 seconds 00:26:29.465 00:26:29.465 Latency(us) 00:26:29.465 [2024-12-08T01:28:57.246Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:29.465 [2024-12-08T01:28:57.247Z] =================================================================================================================== 00:26:29.466 [2024-12-08T01:28:57.247Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:29.466 02:28:57 -- common/autotest_common.sh@960 -- # wait 2220246 00:26:29.724 02:28:57 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:26:29.724 02:28:57 -- host/digest.sh@77 -- # local rw bs qd 00:26:29.724 02:28:57 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:29.724 02:28:57 -- host/digest.sh@80 -- # rw=randwrite 00:26:29.724 02:28:57 -- host/digest.sh@80 -- # bs=4096 00:26:29.724 02:28:57 -- host/digest.sh@80 -- # qd=128 00:26:29.724 02:28:57 -- host/digest.sh@82 -- # bperfpid=2220790 00:26:29.724 02:28:57 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:29.724 02:28:57 -- host/digest.sh@83 -- # waitforlisten 2220790 /var/tmp/bperf.sock 00:26:29.724 02:28:57 -- common/autotest_common.sh@829 -- # '[' -z 2220790 ']' 00:26:29.724 02:28:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:29.724 02:28:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:29.724 02:28:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:29.724 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:29.724 02:28:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:29.724 02:28:57 -- common/autotest_common.sh@10 -- # set +x 00:26:29.724 [2024-12-08 02:28:57.330341] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:29.724 [2024-12-08 02:28:57.330415] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2220790 ] 00:26:29.724 EAL: No free 2048 kB hugepages reported on node 1 00:26:29.724 [2024-12-08 02:28:57.390745] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:29.724 [2024-12-08 02:28:57.501988] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:29.982 02:28:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:29.982 02:28:57 -- common/autotest_common.sh@862 -- # return 0 00:26:29.982 02:28:57 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:29.982 02:28:57 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:29.982 02:28:57 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:30.241 02:28:57 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:30.241 02:28:57 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:30.809 nvme0n1 00:26:30.809 02:28:58 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:30.809 02:28:58 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:30.809 Running I/O for 2 seconds... 00:26:33.347 00:26:33.347 Latency(us) 00:26:33.347 [2024-12-08T01:29:01.128Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:33.347 [2024-12-08T01:29:01.128Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:26:33.347 nvme0n1 : 2.00 21185.20 82.75 0.00 0.00 6033.40 2487.94 10340.12 00:26:33.347 [2024-12-08T01:29:01.128Z] =================================================================================================================== 00:26:33.347 [2024-12-08T01:29:01.128Z] Total : 21185.20 82.75 0.00 0.00 6033.40 2487.94 10340.12 00:26:33.347 0 00:26:33.347 02:29:00 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:33.347 02:29:00 -- host/digest.sh@92 -- # get_accel_stats 00:26:33.347 02:29:00 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:33.347 02:29:00 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:33.347 02:29:00 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:33.347 | select(.opcode=="crc32c") 00:26:33.347 | "\(.module_name) \(.executed)"' 00:26:33.347 02:29:00 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:33.347 02:29:00 -- host/digest.sh@93 -- # exp_module=software 00:26:33.347 02:29:00 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:33.347 02:29:00 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:33.347 02:29:00 -- host/digest.sh@97 -- # killprocess 2220790 00:26:33.347 02:29:00 -- common/autotest_common.sh@936 -- # '[' -z 2220790 ']' 00:26:33.347 02:29:00 -- common/autotest_common.sh@940 -- # kill -0 2220790 00:26:33.347 02:29:00 -- common/autotest_common.sh@941 -- # uname 00:26:33.347 02:29:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:33.347 02:29:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2220790 00:26:33.347 02:29:00 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:33.347 02:29:00 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:33.347 02:29:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2220790' 00:26:33.347 killing process with pid 2220790 00:26:33.347 02:29:00 -- common/autotest_common.sh@955 -- # kill 2220790 00:26:33.347 Received shutdown signal, test time was about 2.000000 seconds 00:26:33.347 00:26:33.347 Latency(us) 00:26:33.347 [2024-12-08T01:29:01.128Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:33.347 [2024-12-08T01:29:01.128Z] =================================================================================================================== 00:26:33.347 [2024-12-08T01:29:01.128Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:33.347 02:29:00 -- common/autotest_common.sh@960 -- # wait 2220790 00:26:33.347 02:29:01 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:26:33.347 02:29:01 -- host/digest.sh@77 -- # local rw bs qd 00:26:33.347 02:29:01 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:33.347 02:29:01 -- host/digest.sh@80 -- # rw=randwrite 00:26:33.347 02:29:01 -- host/digest.sh@80 -- # bs=131072 00:26:33.347 02:29:01 -- host/digest.sh@80 -- # qd=16 00:26:33.348 02:29:01 -- host/digest.sh@82 -- # bperfpid=2221214 00:26:33.348 02:29:01 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:26:33.348 02:29:01 -- host/digest.sh@83 -- # waitforlisten 2221214 /var/tmp/bperf.sock 00:26:33.348 02:29:01 -- common/autotest_common.sh@829 -- # '[' -z 2221214 ']' 00:26:33.348 02:29:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:33.348 02:29:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:33.348 02:29:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:33.348 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:33.348 02:29:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:33.348 02:29:01 -- common/autotest_common.sh@10 -- # set +x 00:26:33.605 [2024-12-08 02:29:01.145427] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:33.605 [2024-12-08 02:29:01.145505] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2221214 ] 00:26:33.605 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:33.605 Zero copy mechanism will not be used. 00:26:33.605 EAL: No free 2048 kB hugepages reported on node 1 00:26:33.605 [2024-12-08 02:29:01.203892] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:33.605 [2024-12-08 02:29:01.315887] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:33.605 02:29:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:33.605 02:29:01 -- common/autotest_common.sh@862 -- # return 0 00:26:33.605 02:29:01 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:33.605 02:29:01 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:33.605 02:29:01 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:34.171 02:29:01 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:34.171 02:29:01 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:34.429 nvme0n1 00:26:34.429 02:29:02 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:34.429 02:29:02 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:34.688 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:34.688 Zero copy mechanism will not be used. 00:26:34.688 Running I/O for 2 seconds... 00:26:36.593 00:26:36.593 Latency(us) 00:26:36.593 [2024-12-08T01:29:04.374Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:36.593 [2024-12-08T01:29:04.374Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:26:36.593 nvme0n1 : 2.00 6408.08 801.01 0.00 0.00 2489.55 1808.31 11262.48 00:26:36.593 [2024-12-08T01:29:04.374Z] =================================================================================================================== 00:26:36.593 [2024-12-08T01:29:04.374Z] Total : 6408.08 801.01 0.00 0.00 2489.55 1808.31 11262.48 00:26:36.593 0 00:26:36.593 02:29:04 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:36.593 02:29:04 -- host/digest.sh@92 -- # get_accel_stats 00:26:36.593 02:29:04 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:36.593 02:29:04 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:36.593 | select(.opcode=="crc32c") 00:26:36.593 | "\(.module_name) \(.executed)"' 00:26:36.593 02:29:04 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:36.851 02:29:04 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:36.851 02:29:04 -- host/digest.sh@93 -- # exp_module=software 00:26:36.851 02:29:04 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:36.851 02:29:04 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:36.851 02:29:04 -- host/digest.sh@97 -- # killprocess 2221214 00:26:36.851 02:29:04 -- common/autotest_common.sh@936 -- # '[' -z 2221214 ']' 00:26:36.851 02:29:04 -- common/autotest_common.sh@940 -- # kill -0 2221214 00:26:36.851 02:29:04 -- common/autotest_common.sh@941 -- # uname 00:26:36.851 02:29:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:36.851 02:29:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2221214 00:26:36.851 02:29:04 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:36.851 02:29:04 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:36.851 02:29:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2221214' 00:26:36.851 killing process with pid 2221214 00:26:36.851 02:29:04 -- common/autotest_common.sh@955 -- # kill 2221214 00:26:36.851 Received shutdown signal, test time was about 2.000000 seconds 00:26:36.851 00:26:36.851 Latency(us) 00:26:36.851 [2024-12-08T01:29:04.632Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:36.851 [2024-12-08T01:29:04.632Z] =================================================================================================================== 00:26:36.852 [2024-12-08T01:29:04.633Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:36.852 02:29:04 -- common/autotest_common.sh@960 -- # wait 2221214 00:26:37.111 02:29:04 -- host/digest.sh@126 -- # killprocess 2219675 00:26:37.111 02:29:04 -- common/autotest_common.sh@936 -- # '[' -z 2219675 ']' 00:26:37.111 02:29:04 -- common/autotest_common.sh@940 -- # kill -0 2219675 00:26:37.111 02:29:04 -- common/autotest_common.sh@941 -- # uname 00:26:37.111 02:29:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:37.111 02:29:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2219675 00:26:37.111 02:29:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:37.111 02:29:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:37.111 02:29:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2219675' 00:26:37.111 killing process with pid 2219675 00:26:37.111 02:29:04 -- common/autotest_common.sh@955 -- # kill 2219675 00:26:37.111 02:29:04 -- common/autotest_common.sh@960 -- # wait 2219675 00:26:37.677 00:26:37.677 real 0m16.042s 00:26:37.677 user 0m31.841s 00:26:37.677 sys 0m4.392s 00:26:37.677 02:29:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:37.677 02:29:05 -- common/autotest_common.sh@10 -- # set +x 00:26:37.677 ************************************ 00:26:37.677 END TEST nvmf_digest_clean 00:26:37.677 ************************************ 00:26:37.677 02:29:05 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:26:37.677 02:29:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:37.677 02:29:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:37.677 02:29:05 -- common/autotest_common.sh@10 -- # set +x 00:26:37.677 ************************************ 00:26:37.677 START TEST nvmf_digest_error 00:26:37.677 ************************************ 00:26:37.677 02:29:05 -- common/autotest_common.sh@1114 -- # run_digest_error 00:26:37.677 02:29:05 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:26:37.677 02:29:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:37.677 02:29:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:37.677 02:29:05 -- common/autotest_common.sh@10 -- # set +x 00:26:37.677 02:29:05 -- nvmf/common.sh@469 -- # nvmfpid=2221785 00:26:37.677 02:29:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:26:37.677 02:29:05 -- nvmf/common.sh@470 -- # waitforlisten 2221785 00:26:37.677 02:29:05 -- common/autotest_common.sh@829 -- # '[' -z 2221785 ']' 00:26:37.677 02:29:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:37.677 02:29:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:37.677 02:29:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:37.677 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:37.677 02:29:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:37.677 02:29:05 -- common/autotest_common.sh@10 -- # set +x 00:26:37.677 [2024-12-08 02:29:05.224756] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:37.677 [2024-12-08 02:29:05.224835] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:37.677 EAL: No free 2048 kB hugepages reported on node 1 00:26:37.677 [2024-12-08 02:29:05.286424] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:37.677 [2024-12-08 02:29:05.390185] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:37.677 [2024-12-08 02:29:05.390337] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:37.677 [2024-12-08 02:29:05.390354] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:37.677 [2024-12-08 02:29:05.390365] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:37.677 [2024-12-08 02:29:05.390391] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:37.677 02:29:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:37.677 02:29:05 -- common/autotest_common.sh@862 -- # return 0 00:26:37.677 02:29:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:37.677 02:29:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:37.677 02:29:05 -- common/autotest_common.sh@10 -- # set +x 00:26:37.934 02:29:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:37.934 02:29:05 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:26:37.934 02:29:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:37.934 02:29:05 -- common/autotest_common.sh@10 -- # set +x 00:26:37.934 [2024-12-08 02:29:05.462991] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:26:37.934 02:29:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:37.934 02:29:05 -- host/digest.sh@104 -- # common_target_config 00:26:37.934 02:29:05 -- host/digest.sh@43 -- # rpc_cmd 00:26:37.934 02:29:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:37.934 02:29:05 -- common/autotest_common.sh@10 -- # set +x 00:26:37.934 null0 00:26:37.934 [2024-12-08 02:29:05.577444] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:37.934 [2024-12-08 02:29:05.601689] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:37.934 02:29:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:37.934 02:29:05 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:26:37.934 02:29:05 -- host/digest.sh@54 -- # local rw bs qd 00:26:37.934 02:29:05 -- host/digest.sh@56 -- # rw=randread 00:26:37.934 02:29:05 -- host/digest.sh@56 -- # bs=4096 00:26:37.934 02:29:05 -- host/digest.sh@56 -- # qd=128 00:26:37.934 02:29:05 -- host/digest.sh@58 -- # bperfpid=2221806 00:26:37.934 02:29:05 -- host/digest.sh@60 -- # waitforlisten 2221806 /var/tmp/bperf.sock 00:26:37.934 02:29:05 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:26:37.934 02:29:05 -- common/autotest_common.sh@829 -- # '[' -z 2221806 ']' 00:26:37.934 02:29:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:37.934 02:29:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:37.934 02:29:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:37.934 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:37.934 02:29:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:37.934 02:29:05 -- common/autotest_common.sh@10 -- # set +x 00:26:37.934 [2024-12-08 02:29:05.641384] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:37.934 [2024-12-08 02:29:05.641457] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2221806 ] 00:26:37.934 EAL: No free 2048 kB hugepages reported on node 1 00:26:37.934 [2024-12-08 02:29:05.701733] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:38.193 [2024-12-08 02:29:05.816096] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:39.127 02:29:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:39.127 02:29:06 -- common/autotest_common.sh@862 -- # return 0 00:26:39.127 02:29:06 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:39.127 02:29:06 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:39.385 02:29:06 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:26:39.385 02:29:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:39.385 02:29:06 -- common/autotest_common.sh@10 -- # set +x 00:26:39.385 02:29:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:39.385 02:29:06 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:39.385 02:29:06 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:39.643 nvme0n1 00:26:39.643 02:29:07 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:26:39.643 02:29:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:39.643 02:29:07 -- common/autotest_common.sh@10 -- # set +x 00:26:39.643 02:29:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:39.643 02:29:07 -- host/digest.sh@69 -- # bperf_py perform_tests 00:26:39.643 02:29:07 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:39.903 Running I/O for 2 seconds... 00:26:39.903 [2024-12-08 02:29:07.485375] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:39.903 [2024-12-08 02:29:07.485444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20150 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.903 [2024-12-08 02:29:07.485465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.903 [2024-12-08 02:29:07.496125] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:39.903 [2024-12-08 02:29:07.496155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:11433 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.903 [2024-12-08 02:29:07.496186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.903 [2024-12-08 02:29:07.507743] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:39.903 [2024-12-08 02:29:07.507772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:7147 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.903 [2024-12-08 02:29:07.507813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.903 [2024-12-08 02:29:07.523430] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:39.903 [2024-12-08 02:29:07.523459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:17139 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.903 [2024-12-08 02:29:07.523490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.903 [2024-12-08 02:29:07.539208] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:39.903 [2024-12-08 02:29:07.539237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:18698 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.903 [2024-12-08 02:29:07.539268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.903 [2024-12-08 02:29:07.554410] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:39.904 [2024-12-08 02:29:07.554438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:640 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.904 [2024-12-08 02:29:07.554470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.904 [2024-12-08 02:29:07.569944] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:39.904 [2024-12-08 02:29:07.569988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:5433 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.904 [2024-12-08 02:29:07.570004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.904 [2024-12-08 02:29:07.585441] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:39.904 [2024-12-08 02:29:07.585472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:17264 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.904 [2024-12-08 02:29:07.585504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.904 [2024-12-08 02:29:07.595627] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:39.904 [2024-12-08 02:29:07.595672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:23963 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.904 [2024-12-08 02:29:07.595689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.904 [2024-12-08 02:29:07.610148] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:39.904 [2024-12-08 02:29:07.610176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:4942 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.904 [2024-12-08 02:29:07.610207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.904 [2024-12-08 02:29:07.626882] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:39.904 [2024-12-08 02:29:07.626910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:12790 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.904 [2024-12-08 02:29:07.626941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.904 [2024-12-08 02:29:07.642363] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:39.904 [2024-12-08 02:29:07.642392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:5962 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.904 [2024-12-08 02:29:07.642424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.904 [2024-12-08 02:29:07.657086] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:39.904 [2024-12-08 02:29:07.657133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:9320 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.904 [2024-12-08 02:29:07.657150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.904 [2024-12-08 02:29:07.668341] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:39.904 [2024-12-08 02:29:07.668368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:19806 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.904 [2024-12-08 02:29:07.668397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.165 [2024-12-08 02:29:07.683946] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.165 [2024-12-08 02:29:07.683994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23576 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.165 [2024-12-08 02:29:07.684011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.165 [2024-12-08 02:29:07.699732] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.165 [2024-12-08 02:29:07.699760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:20612 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.165 [2024-12-08 02:29:07.699791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.165 [2024-12-08 02:29:07.714982] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.165 [2024-12-08 02:29:07.715011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:18142 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.165 [2024-12-08 02:29:07.715027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.165 [2024-12-08 02:29:07.730113] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.165 [2024-12-08 02:29:07.730140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:22504 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.165 [2024-12-08 02:29:07.730170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.165 [2024-12-08 02:29:07.745801] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.165 [2024-12-08 02:29:07.745830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:15875 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.165 [2024-12-08 02:29:07.745861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.165 [2024-12-08 02:29:07.756571] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.165 [2024-12-08 02:29:07.756599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:13584 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.165 [2024-12-08 02:29:07.756637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.165 [2024-12-08 02:29:07.772497] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.165 [2024-12-08 02:29:07.772549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:19932 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.165 [2024-12-08 02:29:07.772569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.165 [2024-12-08 02:29:07.786993] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.165 [2024-12-08 02:29:07.787020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:7445 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.165 [2024-12-08 02:29:07.787050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.165 [2024-12-08 02:29:07.802718] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.165 [2024-12-08 02:29:07.802746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:16525 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.165 [2024-12-08 02:29:07.802777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.165 [2024-12-08 02:29:07.816502] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.165 [2024-12-08 02:29:07.816550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:19661 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.165 [2024-12-08 02:29:07.816567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.165 [2024-12-08 02:29:07.832386] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.165 [2024-12-08 02:29:07.832429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:12206 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.165 [2024-12-08 02:29:07.832444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.165 [2024-12-08 02:29:07.843283] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.165 [2024-12-08 02:29:07.843310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:9214 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.165 [2024-12-08 02:29:07.843341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.165 [2024-12-08 02:29:07.857065] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.165 [2024-12-08 02:29:07.857091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:253 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.165 [2024-12-08 02:29:07.857121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.165 [2024-12-08 02:29:07.872786] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.165 [2024-12-08 02:29:07.872814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:14222 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.165 [2024-12-08 02:29:07.872844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.165 [2024-12-08 02:29:07.887654] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.165 [2024-12-08 02:29:07.887686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:22033 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.165 [2024-12-08 02:29:07.887718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.165 [2024-12-08 02:29:07.903034] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.165 [2024-12-08 02:29:07.903061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:8879 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.165 [2024-12-08 02:29:07.903090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.165 [2024-12-08 02:29:07.919054] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.165 [2024-12-08 02:29:07.919081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:11015 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.165 [2024-12-08 02:29:07.919111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.165 [2024-12-08 02:29:07.934274] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.165 [2024-12-08 02:29:07.934301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:20244 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.165 [2024-12-08 02:29:07.934331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.424 [2024-12-08 02:29:07.948458] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.424 [2024-12-08 02:29:07.948489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:7219 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.424 [2024-12-08 02:29:07.948505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.424 [2024-12-08 02:29:07.963602] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.424 [2024-12-08 02:29:07.963630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:21536 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.424 [2024-12-08 02:29:07.963660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.424 [2024-12-08 02:29:07.978777] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.424 [2024-12-08 02:29:07.978805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:19153 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.424 [2024-12-08 02:29:07.978836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.424 [2024-12-08 02:29:07.994078] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.424 [2024-12-08 02:29:07.994105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:24850 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.424 [2024-12-08 02:29:07.994136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.424 [2024-12-08 02:29:08.009271] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.424 [2024-12-08 02:29:08.009299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:179 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.424 [2024-12-08 02:29:08.009328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.424 [2024-12-08 02:29:08.019523] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.424 [2024-12-08 02:29:08.019604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:20026 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.424 [2024-12-08 02:29:08.019623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.424 [2024-12-08 02:29:08.035990] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.424 [2024-12-08 02:29:08.036024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:18161 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.424 [2024-12-08 02:29:08.036043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.424 [2024-12-08 02:29:08.052831] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.424 [2024-12-08 02:29:08.052875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:17704 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.424 [2024-12-08 02:29:08.052894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.424 [2024-12-08 02:29:08.069828] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.424 [2024-12-08 02:29:08.069869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:8092 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.424 [2024-12-08 02:29:08.069885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.424 [2024-12-08 02:29:08.086951] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.424 [2024-12-08 02:29:08.086985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:8152 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.424 [2024-12-08 02:29:08.087004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.424 [2024-12-08 02:29:08.102913] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.424 [2024-12-08 02:29:08.102947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:1644 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.424 [2024-12-08 02:29:08.102965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.424 [2024-12-08 02:29:08.119123] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.424 [2024-12-08 02:29:08.119161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:21223 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.424 [2024-12-08 02:29:08.119180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.424 [2024-12-08 02:29:08.131175] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.424 [2024-12-08 02:29:08.131210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:13421 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.424 [2024-12-08 02:29:08.131228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.424 [2024-12-08 02:29:08.145877] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.424 [2024-12-08 02:29:08.145910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:10945 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.424 [2024-12-08 02:29:08.145935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.424 [2024-12-08 02:29:08.162766] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.424 [2024-12-08 02:29:08.162795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:16054 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.424 [2024-12-08 02:29:08.162828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.424 [2024-12-08 02:29:08.179818] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.424 [2024-12-08 02:29:08.179866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:17362 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.424 [2024-12-08 02:29:08.179885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.424 [2024-12-08 02:29:08.196680] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.424 [2024-12-08 02:29:08.196709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:5140 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.425 [2024-12-08 02:29:08.196740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.682 [2024-12-08 02:29:08.213743] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.682 [2024-12-08 02:29:08.213773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:11698 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.682 [2024-12-08 02:29:08.213803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.682 [2024-12-08 02:29:08.230593] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.682 [2024-12-08 02:29:08.230621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:19896 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.682 [2024-12-08 02:29:08.230653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.682 [2024-12-08 02:29:08.247738] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.682 [2024-12-08 02:29:08.247766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:5466 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.682 [2024-12-08 02:29:08.247797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.682 [2024-12-08 02:29:08.264617] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.682 [2024-12-08 02:29:08.264644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:24301 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.682 [2024-12-08 02:29:08.264675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.682 [2024-12-08 02:29:08.281657] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.682 [2024-12-08 02:29:08.281686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:13906 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.682 [2024-12-08 02:29:08.281703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.682 [2024-12-08 02:29:08.298582] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.682 [2024-12-08 02:29:08.298617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:964 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.682 [2024-12-08 02:29:08.298648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.682 [2024-12-08 02:29:08.315563] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.682 [2024-12-08 02:29:08.315605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:25312 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.682 [2024-12-08 02:29:08.315620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.682 [2024-12-08 02:29:08.332640] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.682 [2024-12-08 02:29:08.332668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:23239 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.682 [2024-12-08 02:29:08.332698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.682 [2024-12-08 02:29:08.349599] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.682 [2024-12-08 02:29:08.349629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:13114 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.682 [2024-12-08 02:29:08.349660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.682 [2024-12-08 02:29:08.367371] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.682 [2024-12-08 02:29:08.367405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11682 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.682 [2024-12-08 02:29:08.367423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.682 [2024-12-08 02:29:08.383153] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.683 [2024-12-08 02:29:08.383188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:22454 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.683 [2024-12-08 02:29:08.383206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.683 [2024-12-08 02:29:08.400667] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.683 [2024-12-08 02:29:08.400695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:14558 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.683 [2024-12-08 02:29:08.400724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.683 [2024-12-08 02:29:08.417481] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.683 [2024-12-08 02:29:08.417517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:14839 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.683 [2024-12-08 02:29:08.417545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.683 [2024-12-08 02:29:08.434297] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.683 [2024-12-08 02:29:08.434332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:6790 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.683 [2024-12-08 02:29:08.434352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.683 [2024-12-08 02:29:08.450265] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.683 [2024-12-08 02:29:08.450301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:6430 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.683 [2024-12-08 02:29:08.450320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.683 [2024-12-08 02:29:08.461181] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.683 [2024-12-08 02:29:08.461216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:23520 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.683 [2024-12-08 02:29:08.461234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.941 [2024-12-08 02:29:08.478630] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.941 [2024-12-08 02:29:08.478660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:2302 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.941 [2024-12-08 02:29:08.478692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.941 [2024-12-08 02:29:08.495441] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.941 [2024-12-08 02:29:08.495475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5654 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.941 [2024-12-08 02:29:08.495494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.941 [2024-12-08 02:29:08.512104] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.941 [2024-12-08 02:29:08.512139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:12360 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.941 [2024-12-08 02:29:08.512157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.941 [2024-12-08 02:29:08.529245] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.941 [2024-12-08 02:29:08.529279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:7659 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.941 [2024-12-08 02:29:08.529298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.941 [2024-12-08 02:29:08.546253] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.941 [2024-12-08 02:29:08.546288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:21948 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.941 [2024-12-08 02:29:08.546307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.941 [2024-12-08 02:29:08.563260] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.941 [2024-12-08 02:29:08.563295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:10855 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.941 [2024-12-08 02:29:08.563313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.941 [2024-12-08 02:29:08.580179] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.941 [2024-12-08 02:29:08.580220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:8279 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.941 [2024-12-08 02:29:08.580240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.941 [2024-12-08 02:29:08.597105] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.941 [2024-12-08 02:29:08.597139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:13964 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.941 [2024-12-08 02:29:08.597157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.941 [2024-12-08 02:29:08.613902] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.941 [2024-12-08 02:29:08.613935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:16008 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.941 [2024-12-08 02:29:08.613955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.941 [2024-12-08 02:29:08.630943] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.941 [2024-12-08 02:29:08.630978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:14848 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.941 [2024-12-08 02:29:08.630997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.941 [2024-12-08 02:29:08.648184] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.941 [2024-12-08 02:29:08.648218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:21595 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.941 [2024-12-08 02:29:08.648237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.941 [2024-12-08 02:29:08.664455] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.941 [2024-12-08 02:29:08.664490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:13505 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.941 [2024-12-08 02:29:08.664508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.941 [2024-12-08 02:29:08.681405] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.941 [2024-12-08 02:29:08.681440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:24749 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.941 [2024-12-08 02:29:08.681458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.941 [2024-12-08 02:29:08.698721] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.941 [2024-12-08 02:29:08.698748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:17877 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.941 [2024-12-08 02:29:08.698779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.941 [2024-12-08 02:29:08.714078] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:40.941 [2024-12-08 02:29:08.714111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10583 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.941 [2024-12-08 02:29:08.714130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.199 [2024-12-08 02:29:08.725694] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.199 [2024-12-08 02:29:08.725723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:10488 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.199 [2024-12-08 02:29:08.725755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.199 [2024-12-08 02:29:08.743107] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.199 [2024-12-08 02:29:08.743141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:21092 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.199 [2024-12-08 02:29:08.743160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.199 [2024-12-08 02:29:08.759811] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.199 [2024-12-08 02:29:08.759857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:13132 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.199 [2024-12-08 02:29:08.759876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.199 [2024-12-08 02:29:08.776686] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.199 [2024-12-08 02:29:08.776713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:4156 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.199 [2024-12-08 02:29:08.776743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.199 [2024-12-08 02:29:08.793731] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.199 [2024-12-08 02:29:08.793761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13068 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.199 [2024-12-08 02:29:08.793793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.199 [2024-12-08 02:29:08.810616] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.199 [2024-12-08 02:29:08.810662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:23767 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.199 [2024-12-08 02:29:08.810678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.199 [2024-12-08 02:29:08.821982] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.199 [2024-12-08 02:29:08.822015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:3643 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.199 [2024-12-08 02:29:08.822033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.199 [2024-12-08 02:29:08.838295] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.199 [2024-12-08 02:29:08.838328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:10219 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.199 [2024-12-08 02:29:08.838347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.199 [2024-12-08 02:29:08.855245] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.199 [2024-12-08 02:29:08.855280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:24653 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.199 [2024-12-08 02:29:08.855305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.199 [2024-12-08 02:29:08.873048] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.199 [2024-12-08 02:29:08.873083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:21023 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.199 [2024-12-08 02:29:08.873103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.199 [2024-12-08 02:29:08.890291] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.199 [2024-12-08 02:29:08.890325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:15078 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.199 [2024-12-08 02:29:08.890344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.199 [2024-12-08 02:29:08.901598] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.199 [2024-12-08 02:29:08.901628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:12086 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.199 [2024-12-08 02:29:08.901645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.199 [2024-12-08 02:29:08.917508] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.199 [2024-12-08 02:29:08.917548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:4473 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.199 [2024-12-08 02:29:08.917569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.200 [2024-12-08 02:29:08.935496] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.200 [2024-12-08 02:29:08.935530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:24388 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.200 [2024-12-08 02:29:08.935559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.200 [2024-12-08 02:29:08.947123] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.200 [2024-12-08 02:29:08.947156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:20484 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.200 [2024-12-08 02:29:08.947175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.200 [2024-12-08 02:29:08.963127] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.200 [2024-12-08 02:29:08.963161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:24286 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.200 [2024-12-08 02:29:08.963179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.458 [2024-12-08 02:29:08.979623] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.458 [2024-12-08 02:29:08.979654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:1211 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.458 [2024-12-08 02:29:08.979685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.458 [2024-12-08 02:29:08.994843] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.458 [2024-12-08 02:29:08.994897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:22084 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.458 [2024-12-08 02:29:08.994918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.458 [2024-12-08 02:29:09.006296] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.458 [2024-12-08 02:29:09.006329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:18618 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.458 [2024-12-08 02:29:09.006347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.458 [2024-12-08 02:29:09.023259] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.458 [2024-12-08 02:29:09.023293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23445 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.458 [2024-12-08 02:29:09.023311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.458 [2024-12-08 02:29:09.040003] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.458 [2024-12-08 02:29:09.040037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:16306 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.458 [2024-12-08 02:29:09.040055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.458 [2024-12-08 02:29:09.057260] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.458 [2024-12-08 02:29:09.057296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:6147 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.458 [2024-12-08 02:29:09.057315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.458 [2024-12-08 02:29:09.074756] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.458 [2024-12-08 02:29:09.074785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:1693 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.458 [2024-12-08 02:29:09.074821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.458 [2024-12-08 02:29:09.091721] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.458 [2024-12-08 02:29:09.091750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:5116 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.458 [2024-12-08 02:29:09.091780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.458 [2024-12-08 02:29:09.108556] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.458 [2024-12-08 02:29:09.108600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:19819 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.458 [2024-12-08 02:29:09.108616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.458 [2024-12-08 02:29:09.125753] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.458 [2024-12-08 02:29:09.125781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:12895 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.458 [2024-12-08 02:29:09.125811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.458 [2024-12-08 02:29:09.141345] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.458 [2024-12-08 02:29:09.141378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:12211 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.458 [2024-12-08 02:29:09.141398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.458 [2024-12-08 02:29:09.158117] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.458 [2024-12-08 02:29:09.158151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:12966 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.458 [2024-12-08 02:29:09.158170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.458 [2024-12-08 02:29:09.174910] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.458 [2024-12-08 02:29:09.174945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:8293 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.458 [2024-12-08 02:29:09.174963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.458 [2024-12-08 02:29:09.191793] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.458 [2024-12-08 02:29:09.191822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:8735 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.458 [2024-12-08 02:29:09.191851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.458 [2024-12-08 02:29:09.208503] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.458 [2024-12-08 02:29:09.208555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20595 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.458 [2024-12-08 02:29:09.208576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.458 [2024-12-08 02:29:09.225926] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.458 [2024-12-08 02:29:09.225961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:19 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.458 [2024-12-08 02:29:09.225979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.750 [2024-12-08 02:29:09.243175] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.750 [2024-12-08 02:29:09.243209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:2186 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.750 [2024-12-08 02:29:09.243228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.750 [2024-12-08 02:29:09.259928] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.750 [2024-12-08 02:29:09.259976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:5372 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.750 [2024-12-08 02:29:09.259994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.750 [2024-12-08 02:29:09.277662] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.750 [2024-12-08 02:29:09.277690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:5568 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.750 [2024-12-08 02:29:09.277715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.750 [2024-12-08 02:29:09.294403] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.750 [2024-12-08 02:29:09.294438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:16564 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.750 [2024-12-08 02:29:09.294457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.750 [2024-12-08 02:29:09.311255] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.750 [2024-12-08 02:29:09.311288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:2363 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.750 [2024-12-08 02:29:09.311306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.750 [2024-12-08 02:29:09.327461] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.750 [2024-12-08 02:29:09.327494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:19362 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.750 [2024-12-08 02:29:09.327513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.750 [2024-12-08 02:29:09.339336] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.750 [2024-12-08 02:29:09.339368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:21231 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.750 [2024-12-08 02:29:09.339387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.750 [2024-12-08 02:29:09.356971] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.750 [2024-12-08 02:29:09.357004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7917 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.750 [2024-12-08 02:29:09.357023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.750 [2024-12-08 02:29:09.374361] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.750 [2024-12-08 02:29:09.374396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:15173 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.750 [2024-12-08 02:29:09.374415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.750 [2024-12-08 02:29:09.385579] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.750 [2024-12-08 02:29:09.385607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14249 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.750 [2024-12-08 02:29:09.385623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.750 [2024-12-08 02:29:09.401311] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.750 [2024-12-08 02:29:09.401344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:21449 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.750 [2024-12-08 02:29:09.401363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.750 [2024-12-08 02:29:09.418788] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.750 [2024-12-08 02:29:09.418820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:12556 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.750 [2024-12-08 02:29:09.418836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.750 [2024-12-08 02:29:09.434684] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.750 [2024-12-08 02:29:09.434711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:10980 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.750 [2024-12-08 02:29:09.434741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.750 [2024-12-08 02:29:09.451714] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.750 [2024-12-08 02:29:09.451751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:24987 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.750 [2024-12-08 02:29:09.451782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.750 [2024-12-08 02:29:09.469042] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xb80bb0) 00:26:41.750 [2024-12-08 02:29:09.469076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:7809 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.750 [2024-12-08 02:29:09.469094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.750 00:26:41.750 Latency(us) 00:26:41.750 [2024-12-08T01:29:09.531Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:41.750 [2024-12-08T01:29:09.531Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:26:41.750 nvme0n1 : 2.00 16219.78 63.36 0.00 0.00 7884.07 3349.62 27185.30 00:26:41.750 [2024-12-08T01:29:09.531Z] =================================================================================================================== 00:26:41.750 [2024-12-08T01:29:09.531Z] Total : 16219.78 63.36 0.00 0.00 7884.07 3349.62 27185.30 00:26:41.750 0 00:26:41.750 02:29:09 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:26:41.750 02:29:09 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:26:41.750 02:29:09 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:26:41.750 02:29:09 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:26:41.750 | .driver_specific 00:26:41.750 | .nvme_error 00:26:41.750 | .status_code 00:26:41.750 | .command_transient_transport_error' 00:26:42.007 02:29:09 -- host/digest.sh@71 -- # (( 127 > 0 )) 00:26:42.007 02:29:09 -- host/digest.sh@73 -- # killprocess 2221806 00:26:42.007 02:29:09 -- common/autotest_common.sh@936 -- # '[' -z 2221806 ']' 00:26:42.007 02:29:09 -- common/autotest_common.sh@940 -- # kill -0 2221806 00:26:42.007 02:29:09 -- common/autotest_common.sh@941 -- # uname 00:26:42.007 02:29:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:42.007 02:29:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2221806 00:26:42.267 02:29:09 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:42.267 02:29:09 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:42.267 02:29:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2221806' 00:26:42.267 killing process with pid 2221806 00:26:42.267 02:29:09 -- common/autotest_common.sh@955 -- # kill 2221806 00:26:42.267 Received shutdown signal, test time was about 2.000000 seconds 00:26:42.267 00:26:42.267 Latency(us) 00:26:42.267 [2024-12-08T01:29:10.048Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:42.267 [2024-12-08T01:29:10.048Z] =================================================================================================================== 00:26:42.267 [2024-12-08T01:29:10.048Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:42.267 02:29:09 -- common/autotest_common.sh@960 -- # wait 2221806 00:26:42.525 02:29:10 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:26:42.525 02:29:10 -- host/digest.sh@54 -- # local rw bs qd 00:26:42.525 02:29:10 -- host/digest.sh@56 -- # rw=randread 00:26:42.525 02:29:10 -- host/digest.sh@56 -- # bs=131072 00:26:42.525 02:29:10 -- host/digest.sh@56 -- # qd=16 00:26:42.525 02:29:10 -- host/digest.sh@58 -- # bperfpid=2222356 00:26:42.525 02:29:10 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:26:42.525 02:29:10 -- host/digest.sh@60 -- # waitforlisten 2222356 /var/tmp/bperf.sock 00:26:42.525 02:29:10 -- common/autotest_common.sh@829 -- # '[' -z 2222356 ']' 00:26:42.525 02:29:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:42.525 02:29:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:42.525 02:29:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:42.525 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:42.525 02:29:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:42.525 02:29:10 -- common/autotest_common.sh@10 -- # set +x 00:26:42.525 [2024-12-08 02:29:10.108793] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:42.525 [2024-12-08 02:29:10.108902] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2222356 ] 00:26:42.525 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:42.525 Zero copy mechanism will not be used. 00:26:42.525 EAL: No free 2048 kB hugepages reported on node 1 00:26:42.525 [2024-12-08 02:29:10.172583] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:42.525 [2024-12-08 02:29:10.289420] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:43.457 02:29:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:43.457 02:29:11 -- common/autotest_common.sh@862 -- # return 0 00:26:43.457 02:29:11 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:43.458 02:29:11 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:43.715 02:29:11 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:26:43.715 02:29:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:43.715 02:29:11 -- common/autotest_common.sh@10 -- # set +x 00:26:43.715 02:29:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:43.715 02:29:11 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:43.715 02:29:11 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:44.287 nvme0n1 00:26:44.287 02:29:11 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:26:44.287 02:29:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:44.287 02:29:11 -- common/autotest_common.sh@10 -- # set +x 00:26:44.287 02:29:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:44.287 02:29:11 -- host/digest.sh@69 -- # bperf_py perform_tests 00:26:44.287 02:29:11 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:44.287 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:44.287 Zero copy mechanism will not be used. 00:26:44.287 Running I/O for 2 seconds... 00:26:44.287 [2024-12-08 02:29:11.952999] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.287 [2024-12-08 02:29:11.953056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.287 [2024-12-08 02:29:11.953092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:44.287 [2024-12-08 02:29:11.958058] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.287 [2024-12-08 02:29:11.958091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.287 [2024-12-08 02:29:11.958125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:44.287 [2024-12-08 02:29:11.962746] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.287 [2024-12-08 02:29:11.962776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.287 [2024-12-08 02:29:11.962793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:44.287 [2024-12-08 02:29:11.967463] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.287 [2024-12-08 02:29:11.967493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.287 [2024-12-08 02:29:11.967510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:44.287 [2024-12-08 02:29:11.972195] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.287 [2024-12-08 02:29:11.972223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.287 [2024-12-08 02:29:11.972256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:44.287 [2024-12-08 02:29:11.977416] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.287 [2024-12-08 02:29:11.977445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.287 [2024-12-08 02:29:11.977477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:44.287 [2024-12-08 02:29:11.982140] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.287 [2024-12-08 02:29:11.982170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.287 [2024-12-08 02:29:11.982203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:44.287 [2024-12-08 02:29:11.987292] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.287 [2024-12-08 02:29:11.987336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.287 [2024-12-08 02:29:11.987353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:44.287 [2024-12-08 02:29:11.992906] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.287 [2024-12-08 02:29:11.992935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.287 [2024-12-08 02:29:11.992967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:44.287 [2024-12-08 02:29:11.998455] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.287 [2024-12-08 02:29:11.998492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.287 [2024-12-08 02:29:11.998511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:44.287 [2024-12-08 02:29:12.003828] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.287 [2024-12-08 02:29:12.003858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.287 [2024-12-08 02:29:12.003876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:44.287 [2024-12-08 02:29:12.008582] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.287 [2024-12-08 02:29:12.008612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.287 [2024-12-08 02:29:12.008630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:44.287 [2024-12-08 02:29:12.012984] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.287 [2024-12-08 02:29:12.013014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.287 [2024-12-08 02:29:12.013031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:44.287 [2024-12-08 02:29:12.017013] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.287 [2024-12-08 02:29:12.017043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.287 [2024-12-08 02:29:12.017060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:44.287 [2024-12-08 02:29:12.021994] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.287 [2024-12-08 02:29:12.022024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.287 [2024-12-08 02:29:12.022056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:44.287 [2024-12-08 02:29:12.027322] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.287 [2024-12-08 02:29:12.027366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.287 [2024-12-08 02:29:12.027383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:44.287 [2024-12-08 02:29:12.032763] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.287 [2024-12-08 02:29:12.032793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.287 [2024-12-08 02:29:12.032825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:44.287 [2024-12-08 02:29:12.037928] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.287 [2024-12-08 02:29:12.037973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.287 [2024-12-08 02:29:12.037989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:44.287 [2024-12-08 02:29:12.043318] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.287 [2024-12-08 02:29:12.043362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.287 [2024-12-08 02:29:12.043378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:44.287 [2024-12-08 02:29:12.048732] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.287 [2024-12-08 02:29:12.048761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.287 [2024-12-08 02:29:12.048792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:44.288 [2024-12-08 02:29:12.054169] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.288 [2024-12-08 02:29:12.054198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.288 [2024-12-08 02:29:12.054228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:44.288 [2024-12-08 02:29:12.059309] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.288 [2024-12-08 02:29:12.059338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.288 [2024-12-08 02:29:12.059369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:44.288 [2024-12-08 02:29:12.064247] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.288 [2024-12-08 02:29:12.064292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.288 [2024-12-08 02:29:12.064308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:44.550 [2024-12-08 02:29:12.070256] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.550 [2024-12-08 02:29:12.070287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.550 [2024-12-08 02:29:12.070320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:44.550 [2024-12-08 02:29:12.076305] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.550 [2024-12-08 02:29:12.076339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.550 [2024-12-08 02:29:12.076359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:44.550 [2024-12-08 02:29:12.081755] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.550 [2024-12-08 02:29:12.081785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.550 [2024-12-08 02:29:12.081817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:44.550 [2024-12-08 02:29:12.086346] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.550 [2024-12-08 02:29:12.086375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.550 [2024-12-08 02:29:12.086414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:44.550 [2024-12-08 02:29:12.091010] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.550 [2024-12-08 02:29:12.091043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.550 [2024-12-08 02:29:12.091061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:44.550 [2024-12-08 02:29:12.095419] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.550 [2024-12-08 02:29:12.095448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.550 [2024-12-08 02:29:12.095464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:44.550 [2024-12-08 02:29:12.099959] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.550 [2024-12-08 02:29:12.099988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.550 [2024-12-08 02:29:12.100004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:44.550 [2024-12-08 02:29:12.104646] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.550 [2024-12-08 02:29:12.104691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.550 [2024-12-08 02:29:12.104708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:44.550 [2024-12-08 02:29:12.108214] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.550 [2024-12-08 02:29:12.108243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.550 [2024-12-08 02:29:12.108259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:44.550 [2024-12-08 02:29:12.112897] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.550 [2024-12-08 02:29:12.112930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.550 [2024-12-08 02:29:12.112948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:44.550 [2024-12-08 02:29:12.118239] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.550 [2024-12-08 02:29:12.118283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.550 [2024-12-08 02:29:12.118299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:44.550 [2024-12-08 02:29:12.123315] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.550 [2024-12-08 02:29:12.123345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.550 [2024-12-08 02:29:12.123362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:44.550 [2024-12-08 02:29:12.129552] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.550 [2024-12-08 02:29:12.129587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.550 [2024-12-08 02:29:12.129604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:44.550 [2024-12-08 02:29:12.134661] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.550 [2024-12-08 02:29:12.134692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.550 [2024-12-08 02:29:12.134709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:44.550 [2024-12-08 02:29:12.139356] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.550 [2024-12-08 02:29:12.139387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.550 [2024-12-08 02:29:12.139404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:44.550 [2024-12-08 02:29:12.144948] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.550 [2024-12-08 02:29:12.144979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.550 [2024-12-08 02:29:12.144996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:44.550 [2024-12-08 02:29:12.151500] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.550 [2024-12-08 02:29:12.151531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.550 [2024-12-08 02:29:12.151574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:44.550 [2024-12-08 02:29:12.158063] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.550 [2024-12-08 02:29:12.158092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.550 [2024-12-08 02:29:12.158123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:44.550 [2024-12-08 02:29:12.164073] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.550 [2024-12-08 02:29:12.164118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.550 [2024-12-08 02:29:12.164134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:44.550 [2024-12-08 02:29:12.169719] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.550 [2024-12-08 02:29:12.169750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.551 [2024-12-08 02:29:12.169768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:44.551 [2024-12-08 02:29:12.175186] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.551 [2024-12-08 02:29:12.175218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.551 [2024-12-08 02:29:12.175235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:44.551 [2024-12-08 02:29:12.180667] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.551 [2024-12-08 02:29:12.180697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.551 [2024-12-08 02:29:12.180730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:44.551 [2024-12-08 02:29:12.186228] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.551 [2024-12-08 02:29:12.186258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.551 [2024-12-08 02:29:12.186275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:44.551 [2024-12-08 02:29:12.191987] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.551 [2024-12-08 02:29:12.192032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.551 [2024-12-08 02:29:12.192049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:44.551 [2024-12-08 02:29:12.198252] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.551 [2024-12-08 02:29:12.198297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.551 [2024-12-08 02:29:12.198314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:44.551 [2024-12-08 02:29:12.204056] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.551 [2024-12-08 02:29:12.204085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.551 [2024-12-08 02:29:12.204117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:44.551 [2024-12-08 02:29:12.209715] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.551 [2024-12-08 02:29:12.209745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.551 [2024-12-08 02:29:12.209762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:44.551 [2024-12-08 02:29:12.215327] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.551 [2024-12-08 02:29:12.215370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.551 [2024-12-08 02:29:12.215385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:44.551 [2024-12-08 02:29:12.221022] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.551 [2024-12-08 02:29:12.221053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.551 [2024-12-08 02:29:12.221070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:44.551 [2024-12-08 02:29:12.225637] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.551 [2024-12-08 02:29:12.225668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.551 [2024-12-08 02:29:12.225691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:44.551 [2024-12-08 02:29:12.230089] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.551 [2024-12-08 02:29:12.230119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.551 [2024-12-08 02:29:12.230136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:44.551 [2024-12-08 02:29:12.235016] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.551 [2024-12-08 02:29:12.235047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.551 [2024-12-08 02:29:12.235063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:44.551 [2024-12-08 02:29:12.239933] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.551 [2024-12-08 02:29:12.239963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.551 [2024-12-08 02:29:12.239980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:44.551 [2024-12-08 02:29:12.245056] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.551 [2024-12-08 02:29:12.245103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.551 [2024-12-08 02:29:12.245120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:44.551 [2024-12-08 02:29:12.250572] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.551 [2024-12-08 02:29:12.250607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.551 [2024-12-08 02:29:12.250624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:44.551 [2024-12-08 02:29:12.256335] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.551 [2024-12-08 02:29:12.256368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.551 [2024-12-08 02:29:12.256386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:44.551 [2024-12-08 02:29:12.261732] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.551 [2024-12-08 02:29:12.261763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.551 [2024-12-08 02:29:12.261780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:44.551 [2024-12-08 02:29:12.266854] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.551 [2024-12-08 02:29:12.266884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.551 [2024-12-08 02:29:12.266901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:44.551 [2024-12-08 02:29:12.271953] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.551 [2024-12-08 02:29:12.272006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.551 [2024-12-08 02:29:12.272024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:44.551 [2024-12-08 02:29:12.276877] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.551 [2024-12-08 02:29:12.276908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.551 [2024-12-08 02:29:12.276926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:44.551 [2024-12-08 02:29:12.280422] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.551 [2024-12-08 02:29:12.280452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.551 [2024-12-08 02:29:12.280469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:44.551 [2024-12-08 02:29:12.285650] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.551 [2024-12-08 02:29:12.285681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.551 [2024-12-08 02:29:12.285698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:44.551 [2024-12-08 02:29:12.290951] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.551 [2024-12-08 02:29:12.290981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.551 [2024-12-08 02:29:12.290997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:44.551 [2024-12-08 02:29:12.295516] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.551 [2024-12-08 02:29:12.295554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.551 [2024-12-08 02:29:12.295572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:44.551 [2024-12-08 02:29:12.300269] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.551 [2024-12-08 02:29:12.300299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.551 [2024-12-08 02:29:12.300316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:44.551 [2024-12-08 02:29:12.305291] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.551 [2024-12-08 02:29:12.305321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.551 [2024-12-08 02:29:12.305339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:44.551 [2024-12-08 02:29:12.310209] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.551 [2024-12-08 02:29:12.310240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.552 [2024-12-08 02:29:12.310256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:44.552 [2024-12-08 02:29:12.315728] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.552 [2024-12-08 02:29:12.315758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.552 [2024-12-08 02:29:12.315775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:44.552 [2024-12-08 02:29:12.319975] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.552 [2024-12-08 02:29:12.320005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.552 [2024-12-08 02:29:12.320021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:44.552 [2024-12-08 02:29:12.327259] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.552 [2024-12-08 02:29:12.327304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.552 [2024-12-08 02:29:12.327320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:44.812 [2024-12-08 02:29:12.333888] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.812 [2024-12-08 02:29:12.333935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.812 [2024-12-08 02:29:12.333952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:44.812 [2024-12-08 02:29:12.340525] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.812 [2024-12-08 02:29:12.340565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.812 [2024-12-08 02:29:12.340585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:44.812 [2024-12-08 02:29:12.345202] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.812 [2024-12-08 02:29:12.345234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.812 [2024-12-08 02:29:12.345251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:44.812 [2024-12-08 02:29:12.349802] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.812 [2024-12-08 02:29:12.349833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.812 [2024-12-08 02:29:12.349865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:44.812 [2024-12-08 02:29:12.354263] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.812 [2024-12-08 02:29:12.354294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.812 [2024-12-08 02:29:12.354312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:44.812 [2024-12-08 02:29:12.358677] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.812 [2024-12-08 02:29:12.358708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.812 [2024-12-08 02:29:12.358731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:44.812 [2024-12-08 02:29:12.363526] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.812 [2024-12-08 02:29:12.363567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.812 [2024-12-08 02:29:12.363595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:44.812 [2024-12-08 02:29:12.368227] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.812 [2024-12-08 02:29:12.368257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.812 [2024-12-08 02:29:12.368273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:44.812 [2024-12-08 02:29:12.373712] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.812 [2024-12-08 02:29:12.373757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.812 [2024-12-08 02:29:12.373773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:44.812 [2024-12-08 02:29:12.379270] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.812 [2024-12-08 02:29:12.379299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.812 [2024-12-08 02:29:12.379315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:44.812 [2024-12-08 02:29:12.384772] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.812 [2024-12-08 02:29:12.384817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.812 [2024-12-08 02:29:12.384834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:44.812 [2024-12-08 02:29:12.389824] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.813 [2024-12-08 02:29:12.389855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.813 [2024-12-08 02:29:12.389872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:44.813 [2024-12-08 02:29:12.395224] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.813 [2024-12-08 02:29:12.395269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.813 [2024-12-08 02:29:12.395286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:44.813 [2024-12-08 02:29:12.400298] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.813 [2024-12-08 02:29:12.400328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:4512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.813 [2024-12-08 02:29:12.400346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:44.813 [2024-12-08 02:29:12.406519] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.813 [2024-12-08 02:29:12.406557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.813 [2024-12-08 02:29:12.406575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:44.813 [2024-12-08 02:29:12.413015] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.813 [2024-12-08 02:29:12.413047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.813 [2024-12-08 02:29:12.413064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:44.813 [2024-12-08 02:29:12.419142] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.813 [2024-12-08 02:29:12.419172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.813 [2024-12-08 02:29:12.419190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:44.813 [2024-12-08 02:29:12.425236] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.813 [2024-12-08 02:29:12.425264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.813 [2024-12-08 02:29:12.425295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:44.813 [2024-12-08 02:29:12.429616] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.813 [2024-12-08 02:29:12.429645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.813 [2024-12-08 02:29:12.429663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:44.813 [2024-12-08 02:29:12.433484] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.813 [2024-12-08 02:29:12.433514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.813 [2024-12-08 02:29:12.433530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:44.813 [2024-12-08 02:29:12.437303] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.813 [2024-12-08 02:29:12.437333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.813 [2024-12-08 02:29:12.437351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:44.813 [2024-12-08 02:29:12.441492] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.813 [2024-12-08 02:29:12.441522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.813 [2024-12-08 02:29:12.441545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:44.813 [2024-12-08 02:29:12.446260] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.813 [2024-12-08 02:29:12.446290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.813 [2024-12-08 02:29:12.446312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:44.813 [2024-12-08 02:29:12.450747] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.813 [2024-12-08 02:29:12.450776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.813 [2024-12-08 02:29:12.450793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:44.813 [2024-12-08 02:29:12.455327] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.813 [2024-12-08 02:29:12.455370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:15424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.813 [2024-12-08 02:29:12.455385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:44.813 [2024-12-08 02:29:12.459939] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.813 [2024-12-08 02:29:12.459967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.813 [2024-12-08 02:29:12.459984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:44.813 [2024-12-08 02:29:12.464617] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.813 [2024-12-08 02:29:12.464645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.813 [2024-12-08 02:29:12.464676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:44.813 [2024-12-08 02:29:12.470066] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.813 [2024-12-08 02:29:12.470093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.813 [2024-12-08 02:29:12.470124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:44.813 [2024-12-08 02:29:12.475744] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.813 [2024-12-08 02:29:12.475774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.813 [2024-12-08 02:29:12.475791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:44.813 [2024-12-08 02:29:12.480431] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.813 [2024-12-08 02:29:12.480460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:15232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.813 [2024-12-08 02:29:12.480476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:44.813 [2024-12-08 02:29:12.485287] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.813 [2024-12-08 02:29:12.485317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.813 [2024-12-08 02:29:12.485335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:44.813 [2024-12-08 02:29:12.490058] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.813 [2024-12-08 02:29:12.490093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.813 [2024-12-08 02:29:12.490110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:44.813 [2024-12-08 02:29:12.494520] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.813 [2024-12-08 02:29:12.494559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.813 [2024-12-08 02:29:12.494591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:44.813 [2024-12-08 02:29:12.499075] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.813 [2024-12-08 02:29:12.499103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.813 [2024-12-08 02:29:12.499119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:44.813 [2024-12-08 02:29:12.503750] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.813 [2024-12-08 02:29:12.503778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.813 [2024-12-08 02:29:12.503794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:44.813 [2024-12-08 02:29:12.508436] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.813 [2024-12-08 02:29:12.508478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.813 [2024-12-08 02:29:12.508494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:44.813 [2024-12-08 02:29:12.514207] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.813 [2024-12-08 02:29:12.514236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.813 [2024-12-08 02:29:12.514270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:44.813 [2024-12-08 02:29:12.520182] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.813 [2024-12-08 02:29:12.520212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.813 [2024-12-08 02:29:12.520229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:44.813 [2024-12-08 02:29:12.525714] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.814 [2024-12-08 02:29:12.525743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:6656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.814 [2024-12-08 02:29:12.525759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:44.814 [2024-12-08 02:29:12.530528] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.814 [2024-12-08 02:29:12.530579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.814 [2024-12-08 02:29:12.530595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:44.814 [2024-12-08 02:29:12.535150] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.814 [2024-12-08 02:29:12.535178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.814 [2024-12-08 02:29:12.535194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:44.814 [2024-12-08 02:29:12.539865] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.814 [2024-12-08 02:29:12.539909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.814 [2024-12-08 02:29:12.539926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:44.814 [2024-12-08 02:29:12.544464] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.814 [2024-12-08 02:29:12.544509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.814 [2024-12-08 02:29:12.544526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:44.814 [2024-12-08 02:29:12.548919] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.814 [2024-12-08 02:29:12.548962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.814 [2024-12-08 02:29:12.548978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:44.814 [2024-12-08 02:29:12.553525] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.814 [2024-12-08 02:29:12.553575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.814 [2024-12-08 02:29:12.553591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:44.814 [2024-12-08 02:29:12.557900] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.814 [2024-12-08 02:29:12.557928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.814 [2024-12-08 02:29:12.557945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:44.814 [2024-12-08 02:29:12.562089] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.814 [2024-12-08 02:29:12.562118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:15296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.814 [2024-12-08 02:29:12.562134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:44.814 [2024-12-08 02:29:12.566449] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.814 [2024-12-08 02:29:12.566479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.814 [2024-12-08 02:29:12.566495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:44.814 [2024-12-08 02:29:12.571125] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.814 [2024-12-08 02:29:12.571155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.814 [2024-12-08 02:29:12.571181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:44.814 [2024-12-08 02:29:12.576291] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.814 [2024-12-08 02:29:12.576320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.814 [2024-12-08 02:29:12.576336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:44.814 [2024-12-08 02:29:12.582718] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.814 [2024-12-08 02:29:12.582749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:3584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.814 [2024-12-08 02:29:12.582766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:44.814 [2024-12-08 02:29:12.588175] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:44.814 [2024-12-08 02:29:12.588205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:44.814 [2024-12-08 02:29:12.588222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.074 [2024-12-08 02:29:12.592982] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.074 [2024-12-08 02:29:12.593012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.074 [2024-12-08 02:29:12.593028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.074 [2024-12-08 02:29:12.596319] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.074 [2024-12-08 02:29:12.596348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:23328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.074 [2024-12-08 02:29:12.596364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.074 [2024-12-08 02:29:12.600588] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.074 [2024-12-08 02:29:12.600618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.074 [2024-12-08 02:29:12.600635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.074 [2024-12-08 02:29:12.605804] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.074 [2024-12-08 02:29:12.605845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:4960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.074 [2024-12-08 02:29:12.605862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.074 [2024-12-08 02:29:12.611341] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.074 [2024-12-08 02:29:12.611379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.074 [2024-12-08 02:29:12.611396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.074 [2024-12-08 02:29:12.617479] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.074 [2024-12-08 02:29:12.617515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.074 [2024-12-08 02:29:12.617533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.074 [2024-12-08 02:29:12.623207] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.074 [2024-12-08 02:29:12.623238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.074 [2024-12-08 02:29:12.623255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.074 [2024-12-08 02:29:12.628120] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.074 [2024-12-08 02:29:12.628154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.074 [2024-12-08 02:29:12.628172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.074 [2024-12-08 02:29:12.634034] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.074 [2024-12-08 02:29:12.634065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.074 [2024-12-08 02:29:12.634097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.074 [2024-12-08 02:29:12.640124] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.074 [2024-12-08 02:29:12.640151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.074 [2024-12-08 02:29:12.640183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.074 [2024-12-08 02:29:12.646005] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.074 [2024-12-08 02:29:12.646050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.074 [2024-12-08 02:29:12.646066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.074 [2024-12-08 02:29:12.650950] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.074 [2024-12-08 02:29:12.650979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.074 [2024-12-08 02:29:12.650996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.074 [2024-12-08 02:29:12.655620] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.074 [2024-12-08 02:29:12.655650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.074 [2024-12-08 02:29:12.655666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.074 [2024-12-08 02:29:12.660274] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.074 [2024-12-08 02:29:12.660301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.074 [2024-12-08 02:29:12.660333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.074 [2024-12-08 02:29:12.664873] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.074 [2024-12-08 02:29:12.664899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.074 [2024-12-08 02:29:12.664929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.074 [2024-12-08 02:29:12.669911] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.075 [2024-12-08 02:29:12.669938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.075 [2024-12-08 02:29:12.669967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.075 [2024-12-08 02:29:12.674522] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.075 [2024-12-08 02:29:12.674558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.075 [2024-12-08 02:29:12.674575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.075 [2024-12-08 02:29:12.679048] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.075 [2024-12-08 02:29:12.679075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.075 [2024-12-08 02:29:12.679105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.075 [2024-12-08 02:29:12.683751] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.075 [2024-12-08 02:29:12.683780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.075 [2024-12-08 02:29:12.683796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.075 [2024-12-08 02:29:12.688447] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.075 [2024-12-08 02:29:12.688475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.075 [2024-12-08 02:29:12.688491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.075 [2024-12-08 02:29:12.692465] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.075 [2024-12-08 02:29:12.692496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.075 [2024-12-08 02:29:12.692513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.075 [2024-12-08 02:29:12.695947] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.075 [2024-12-08 02:29:12.695977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.075 [2024-12-08 02:29:12.695993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.075 [2024-12-08 02:29:12.701046] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.075 [2024-12-08 02:29:12.701091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.075 [2024-12-08 02:29:12.701113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.075 [2024-12-08 02:29:12.705775] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.075 [2024-12-08 02:29:12.705805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.075 [2024-12-08 02:29:12.705822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.075 [2024-12-08 02:29:12.711288] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.075 [2024-12-08 02:29:12.711319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.075 [2024-12-08 02:29:12.711336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.075 [2024-12-08 02:29:12.717178] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.075 [2024-12-08 02:29:12.717208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.075 [2024-12-08 02:29:12.717225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.075 [2024-12-08 02:29:12.724067] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.075 [2024-12-08 02:29:12.724097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.075 [2024-12-08 02:29:12.724130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.075 [2024-12-08 02:29:12.730138] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.075 [2024-12-08 02:29:12.730169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.075 [2024-12-08 02:29:12.730186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.075 [2024-12-08 02:29:12.735361] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.075 [2024-12-08 02:29:12.735390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.075 [2024-12-08 02:29:12.735406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.075 [2024-12-08 02:29:12.740080] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.075 [2024-12-08 02:29:12.740127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.075 [2024-12-08 02:29:12.740143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.075 [2024-12-08 02:29:12.744910] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.075 [2024-12-08 02:29:12.744942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.075 [2024-12-08 02:29:12.744960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.075 [2024-12-08 02:29:12.749801] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.075 [2024-12-08 02:29:12.749834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.075 [2024-12-08 02:29:12.749865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.075 [2024-12-08 02:29:12.754599] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.075 [2024-12-08 02:29:12.754628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.075 [2024-12-08 02:29:12.754644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.075 [2024-12-08 02:29:12.759832] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.075 [2024-12-08 02:29:12.759860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.075 [2024-12-08 02:29:12.759891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.075 [2024-12-08 02:29:12.764917] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.075 [2024-12-08 02:29:12.764945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.075 [2024-12-08 02:29:12.764961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.075 [2024-12-08 02:29:12.769669] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.075 [2024-12-08 02:29:12.769698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.075 [2024-12-08 02:29:12.769713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.075 [2024-12-08 02:29:12.774413] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.075 [2024-12-08 02:29:12.774457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.075 [2024-12-08 02:29:12.774472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.075 [2024-12-08 02:29:12.779017] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.075 [2024-12-08 02:29:12.779045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.075 [2024-12-08 02:29:12.779062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.075 [2024-12-08 02:29:12.784440] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.075 [2024-12-08 02:29:12.784469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.075 [2024-12-08 02:29:12.784499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.075 [2024-12-08 02:29:12.790834] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.075 [2024-12-08 02:29:12.790865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.075 [2024-12-08 02:29:12.790897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.075 [2024-12-08 02:29:12.796849] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.075 [2024-12-08 02:29:12.796894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.075 [2024-12-08 02:29:12.796911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.075 [2024-12-08 02:29:12.801577] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.075 [2024-12-08 02:29:12.801621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.075 [2024-12-08 02:29:12.801637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.075 [2024-12-08 02:29:12.806307] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.075 [2024-12-08 02:29:12.806336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.076 [2024-12-08 02:29:12.806352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.076 [2024-12-08 02:29:12.811002] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.076 [2024-12-08 02:29:12.811045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.076 [2024-12-08 02:29:12.811061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.076 [2024-12-08 02:29:12.816407] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.076 [2024-12-08 02:29:12.816438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.076 [2024-12-08 02:29:12.816455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.076 [2024-12-08 02:29:12.821184] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.076 [2024-12-08 02:29:12.821227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.076 [2024-12-08 02:29:12.821242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.076 [2024-12-08 02:29:12.826311] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.076 [2024-12-08 02:29:12.826355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:17760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.076 [2024-12-08 02:29:12.826371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.076 [2024-12-08 02:29:12.831154] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.076 [2024-12-08 02:29:12.831180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.076 [2024-12-08 02:29:12.831195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.076 [2024-12-08 02:29:12.836432] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.076 [2024-12-08 02:29:12.836462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.076 [2024-12-08 02:29:12.836485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.076 [2024-12-08 02:29:12.840259] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.076 [2024-12-08 02:29:12.840287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.076 [2024-12-08 02:29:12.840304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.076 [2024-12-08 02:29:12.843660] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.076 [2024-12-08 02:29:12.843689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.076 [2024-12-08 02:29:12.843706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.076 [2024-12-08 02:29:12.847189] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.076 [2024-12-08 02:29:12.847217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.076 [2024-12-08 02:29:12.847248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.076 [2024-12-08 02:29:12.850507] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.076 [2024-12-08 02:29:12.850544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.076 [2024-12-08 02:29:12.850562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.336 [2024-12-08 02:29:12.854378] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.336 [2024-12-08 02:29:12.854407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.336 [2024-12-08 02:29:12.854423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.336 [2024-12-08 02:29:12.858383] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.336 [2024-12-08 02:29:12.858411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.336 [2024-12-08 02:29:12.858427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.336 [2024-12-08 02:29:12.863066] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.336 [2024-12-08 02:29:12.863094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.336 [2024-12-08 02:29:12.863110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.336 [2024-12-08 02:29:12.867718] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.336 [2024-12-08 02:29:12.867762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.336 [2024-12-08 02:29:12.867777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.336 [2024-12-08 02:29:12.872571] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.336 [2024-12-08 02:29:12.872605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.336 [2024-12-08 02:29:12.872622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.336 [2024-12-08 02:29:12.877210] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.336 [2024-12-08 02:29:12.877239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:2176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.336 [2024-12-08 02:29:12.877256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.336 [2024-12-08 02:29:12.881853] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.336 [2024-12-08 02:29:12.881881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.336 [2024-12-08 02:29:12.881912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.336 [2024-12-08 02:29:12.886764] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.336 [2024-12-08 02:29:12.886794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.336 [2024-12-08 02:29:12.886811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.336 [2024-12-08 02:29:12.891845] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.336 [2024-12-08 02:29:12.891875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.336 [2024-12-08 02:29:12.891892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.336 [2024-12-08 02:29:12.897215] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.336 [2024-12-08 02:29:12.897245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.336 [2024-12-08 02:29:12.897262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.336 [2024-12-08 02:29:12.903770] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.336 [2024-12-08 02:29:12.903801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.336 [2024-12-08 02:29:12.903818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.336 [2024-12-08 02:29:12.909526] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.336 [2024-12-08 02:29:12.909565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.336 [2024-12-08 02:29:12.909583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.336 [2024-12-08 02:29:12.914830] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.336 [2024-12-08 02:29:12.914860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.336 [2024-12-08 02:29:12.914877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.336 [2024-12-08 02:29:12.920056] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.336 [2024-12-08 02:29:12.920087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.336 [2024-12-08 02:29:12.920103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.336 [2024-12-08 02:29:12.926055] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.336 [2024-12-08 02:29:12.926084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.336 [2024-12-08 02:29:12.926116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.336 [2024-12-08 02:29:12.931988] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.336 [2024-12-08 02:29:12.932019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.336 [2024-12-08 02:29:12.932036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.336 [2024-12-08 02:29:12.938200] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.336 [2024-12-08 02:29:12.938232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.336 [2024-12-08 02:29:12.938249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.336 [2024-12-08 02:29:12.944044] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.336 [2024-12-08 02:29:12.944075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.336 [2024-12-08 02:29:12.944092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.336 [2024-12-08 02:29:12.951258] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.336 [2024-12-08 02:29:12.951305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.336 [2024-12-08 02:29:12.951321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.336 [2024-12-08 02:29:12.959273] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.336 [2024-12-08 02:29:12.959305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.336 [2024-12-08 02:29:12.959322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.336 [2024-12-08 02:29:12.966007] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.336 [2024-12-08 02:29:12.966039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.336 [2024-12-08 02:29:12.966056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.336 [2024-12-08 02:29:12.970974] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.336 [2024-12-08 02:29:12.971005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.336 [2024-12-08 02:29:12.971028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.336 [2024-12-08 02:29:12.975688] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.336 [2024-12-08 02:29:12.975719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:8032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.336 [2024-12-08 02:29:12.975736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.336 [2024-12-08 02:29:12.980295] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.336 [2024-12-08 02:29:12.980324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.336 [2024-12-08 02:29:12.980340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.336 [2024-12-08 02:29:12.985056] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.336 [2024-12-08 02:29:12.985086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.336 [2024-12-08 02:29:12.985103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.336 [2024-12-08 02:29:12.989838] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.336 [2024-12-08 02:29:12.989881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.337 [2024-12-08 02:29:12.989896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.337 [2024-12-08 02:29:12.994625] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.337 [2024-12-08 02:29:12.994653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.337 [2024-12-08 02:29:12.994669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.337 [2024-12-08 02:29:12.999342] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.337 [2024-12-08 02:29:12.999388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.337 [2024-12-08 02:29:12.999403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.337 [2024-12-08 02:29:13.003943] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.337 [2024-12-08 02:29:13.003972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:2080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.337 [2024-12-08 02:29:13.003988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.337 [2024-12-08 02:29:13.008687] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.337 [2024-12-08 02:29:13.008717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.337 [2024-12-08 02:29:13.008733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.337 [2024-12-08 02:29:13.013593] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.337 [2024-12-08 02:29:13.013630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.337 [2024-12-08 02:29:13.013648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.337 [2024-12-08 02:29:13.018502] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.337 [2024-12-08 02:29:13.018550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.337 [2024-12-08 02:29:13.018568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.337 [2024-12-08 02:29:13.023947] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.337 [2024-12-08 02:29:13.023977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.337 [2024-12-08 02:29:13.023993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.337 [2024-12-08 02:29:13.029611] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.337 [2024-12-08 02:29:13.029642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.337 [2024-12-08 02:29:13.029659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.337 [2024-12-08 02:29:13.035885] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.337 [2024-12-08 02:29:13.035915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.337 [2024-12-08 02:29:13.035931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.337 [2024-12-08 02:29:13.043418] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.337 [2024-12-08 02:29:13.043448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.337 [2024-12-08 02:29:13.043465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.337 [2024-12-08 02:29:13.051543] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.337 [2024-12-08 02:29:13.051575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.337 [2024-12-08 02:29:13.051592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.337 [2024-12-08 02:29:13.058594] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.337 [2024-12-08 02:29:13.058625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.337 [2024-12-08 02:29:13.058642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.337 [2024-12-08 02:29:13.065952] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.337 [2024-12-08 02:29:13.065997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:20672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.337 [2024-12-08 02:29:13.066017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.337 [2024-12-08 02:29:13.073510] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.337 [2024-12-08 02:29:13.073554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.337 [2024-12-08 02:29:13.073589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.337 [2024-12-08 02:29:13.081687] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.337 [2024-12-08 02:29:13.081733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.337 [2024-12-08 02:29:13.081750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.337 [2024-12-08 02:29:13.087896] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.337 [2024-12-08 02:29:13.087927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:14144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.337 [2024-12-08 02:29:13.087943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.337 [2024-12-08 02:29:13.094284] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.337 [2024-12-08 02:29:13.094315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.337 [2024-12-08 02:29:13.094332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.337 [2024-12-08 02:29:13.101106] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.337 [2024-12-08 02:29:13.101137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.337 [2024-12-08 02:29:13.101169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.337 [2024-12-08 02:29:13.106965] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.337 [2024-12-08 02:29:13.106996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.337 [2024-12-08 02:29:13.107013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.337 [2024-12-08 02:29:13.113677] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.337 [2024-12-08 02:29:13.113708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.337 [2024-12-08 02:29:13.113725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.599 [2024-12-08 02:29:13.118719] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.599 [2024-12-08 02:29:13.118750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.599 [2024-12-08 02:29:13.118774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.599 [2024-12-08 02:29:13.123060] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.599 [2024-12-08 02:29:13.123089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.599 [2024-12-08 02:29:13.123111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.599 [2024-12-08 02:29:13.127604] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.599 [2024-12-08 02:29:13.127633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.599 [2024-12-08 02:29:13.127649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.599 [2024-12-08 02:29:13.132170] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.599 [2024-12-08 02:29:13.132199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.599 [2024-12-08 02:29:13.132216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.599 [2024-12-08 02:29:13.136777] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.599 [2024-12-08 02:29:13.136806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.599 [2024-12-08 02:29:13.136822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.599 [2024-12-08 02:29:13.142282] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.599 [2024-12-08 02:29:13.142312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:25568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.599 [2024-12-08 02:29:13.142328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.599 [2024-12-08 02:29:13.146835] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.599 [2024-12-08 02:29:13.146864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.599 [2024-12-08 02:29:13.146880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.599 [2024-12-08 02:29:13.151416] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.599 [2024-12-08 02:29:13.151445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:5024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.599 [2024-12-08 02:29:13.151461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.599 [2024-12-08 02:29:13.156921] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.599 [2024-12-08 02:29:13.156951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.599 [2024-12-08 02:29:13.156968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.599 [2024-12-08 02:29:13.161499] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.599 [2024-12-08 02:29:13.161528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.599 [2024-12-08 02:29:13.161567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.599 [2024-12-08 02:29:13.166226] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.599 [2024-12-08 02:29:13.166255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.599 [2024-12-08 02:29:13.166271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.599 [2024-12-08 02:29:13.170964] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.599 [2024-12-08 02:29:13.170993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.599 [2024-12-08 02:29:13.171009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.599 [2024-12-08 02:29:13.176041] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.599 [2024-12-08 02:29:13.176071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:1120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.599 [2024-12-08 02:29:13.176088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.599 [2024-12-08 02:29:13.181784] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.599 [2024-12-08 02:29:13.181814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.599 [2024-12-08 02:29:13.181831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.599 [2024-12-08 02:29:13.187182] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.599 [2024-12-08 02:29:13.187213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.599 [2024-12-08 02:29:13.187230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.599 [2024-12-08 02:29:13.194122] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.599 [2024-12-08 02:29:13.194152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.599 [2024-12-08 02:29:13.194169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.599 [2024-12-08 02:29:13.199066] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.599 [2024-12-08 02:29:13.199097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.599 [2024-12-08 02:29:13.199113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.599 [2024-12-08 02:29:13.203154] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.599 [2024-12-08 02:29:13.203184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.599 [2024-12-08 02:29:13.203200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.599 [2024-12-08 02:29:13.207727] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.599 [2024-12-08 02:29:13.207756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.599 [2024-12-08 02:29:13.207778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.599 [2024-12-08 02:29:13.212686] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.599 [2024-12-08 02:29:13.212714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.599 [2024-12-08 02:29:13.212747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.599 [2024-12-08 02:29:13.217936] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.599 [2024-12-08 02:29:13.217970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.599 [2024-12-08 02:29:13.217989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.599 [2024-12-08 02:29:13.223232] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.599 [2024-12-08 02:29:13.223261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:20448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.599 [2024-12-08 02:29:13.223293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.599 [2024-12-08 02:29:13.228678] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.599 [2024-12-08 02:29:13.228708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.599 [2024-12-08 02:29:13.228726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.599 [2024-12-08 02:29:13.233524] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.600 [2024-12-08 02:29:13.233563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:2240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.600 [2024-12-08 02:29:13.233595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.600 [2024-12-08 02:29:13.238911] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.600 [2024-12-08 02:29:13.238940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.600 [2024-12-08 02:29:13.238956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.600 [2024-12-08 02:29:13.244275] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.600 [2024-12-08 02:29:13.244318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.600 [2024-12-08 02:29:13.244335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.600 [2024-12-08 02:29:13.249767] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.600 [2024-12-08 02:29:13.249797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.600 [2024-12-08 02:29:13.249829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.600 [2024-12-08 02:29:13.255295] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.600 [2024-12-08 02:29:13.255347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.600 [2024-12-08 02:29:13.255364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.600 [2024-12-08 02:29:13.260679] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.600 [2024-12-08 02:29:13.260710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.600 [2024-12-08 02:29:13.260727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.600 [2024-12-08 02:29:13.265121] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.600 [2024-12-08 02:29:13.265153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.600 [2024-12-08 02:29:13.265169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.600 [2024-12-08 02:29:13.269056] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.600 [2024-12-08 02:29:13.269086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.600 [2024-12-08 02:29:13.269103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.600 [2024-12-08 02:29:13.272918] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.600 [2024-12-08 02:29:13.272952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:25184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.600 [2024-12-08 02:29:13.272971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.600 [2024-12-08 02:29:13.277015] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.600 [2024-12-08 02:29:13.277044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.600 [2024-12-08 02:29:13.277061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.600 [2024-12-08 02:29:13.280814] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.600 [2024-12-08 02:29:13.280844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:7296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.600 [2024-12-08 02:29:13.280860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.600 [2024-12-08 02:29:13.284900] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.600 [2024-12-08 02:29:13.284929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.600 [2024-12-08 02:29:13.284945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.600 [2024-12-08 02:29:13.289964] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.600 [2024-12-08 02:29:13.289994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.600 [2024-12-08 02:29:13.290011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.600 [2024-12-08 02:29:13.295952] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.600 [2024-12-08 02:29:13.295982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.600 [2024-12-08 02:29:13.295999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.600 [2024-12-08 02:29:13.300922] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.600 [2024-12-08 02:29:13.300950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.600 [2024-12-08 02:29:13.300981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.600 [2024-12-08 02:29:13.306475] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.600 [2024-12-08 02:29:13.306505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.600 [2024-12-08 02:29:13.306521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.600 [2024-12-08 02:29:13.311784] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.600 [2024-12-08 02:29:13.311828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.600 [2024-12-08 02:29:13.311844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.600 [2024-12-08 02:29:13.316396] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.600 [2024-12-08 02:29:13.316426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.600 [2024-12-08 02:29:13.316442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.600 [2024-12-08 02:29:13.321219] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.600 [2024-12-08 02:29:13.321248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.600 [2024-12-08 02:29:13.321280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.600 [2024-12-08 02:29:13.325895] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.600 [2024-12-08 02:29:13.325924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.600 [2024-12-08 02:29:13.325940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.600 [2024-12-08 02:29:13.330605] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.600 [2024-12-08 02:29:13.330633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.600 [2024-12-08 02:29:13.330650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.600 [2024-12-08 02:29:13.335920] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.600 [2024-12-08 02:29:13.335949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.600 [2024-12-08 02:29:13.335972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.600 [2024-12-08 02:29:13.341446] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.600 [2024-12-08 02:29:13.341496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.600 [2024-12-08 02:29:13.341515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.600 [2024-12-08 02:29:13.347203] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.600 [2024-12-08 02:29:13.347234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.600 [2024-12-08 02:29:13.347250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.600 [2024-12-08 02:29:13.353122] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.600 [2024-12-08 02:29:13.353169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.600 [2024-12-08 02:29:13.353188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.600 [2024-12-08 02:29:13.359123] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.600 [2024-12-08 02:29:13.359153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.600 [2024-12-08 02:29:13.359170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.600 [2024-12-08 02:29:13.365048] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.600 [2024-12-08 02:29:13.365078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.600 [2024-12-08 02:29:13.365094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.600 [2024-12-08 02:29:13.370137] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.601 [2024-12-08 02:29:13.370168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:96 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.601 [2024-12-08 02:29:13.370185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.601 [2024-12-08 02:29:13.374742] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.601 [2024-12-08 02:29:13.374771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.601 [2024-12-08 02:29:13.374788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.863 [2024-12-08 02:29:13.379279] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.863 [2024-12-08 02:29:13.379310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.863 [2024-12-08 02:29:13.379342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.863 [2024-12-08 02:29:13.384039] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.863 [2024-12-08 02:29:13.384088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.863 [2024-12-08 02:29:13.384104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.863 [2024-12-08 02:29:13.388797] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.863 [2024-12-08 02:29:13.388826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.863 [2024-12-08 02:29:13.388843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.863 [2024-12-08 02:29:13.393375] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.863 [2024-12-08 02:29:13.393403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.863 [2024-12-08 02:29:13.393419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.863 [2024-12-08 02:29:13.397972] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.863 [2024-12-08 02:29:13.398001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:11072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.863 [2024-12-08 02:29:13.398018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.863 [2024-12-08 02:29:13.402584] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.863 [2024-12-08 02:29:13.402627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.863 [2024-12-08 02:29:13.402643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.863 [2024-12-08 02:29:13.406696] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.863 [2024-12-08 02:29:13.406725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.863 [2024-12-08 02:29:13.406741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.863 [2024-12-08 02:29:13.410242] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.863 [2024-12-08 02:29:13.410271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:11424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.863 [2024-12-08 02:29:13.410287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.863 [2024-12-08 02:29:13.414124] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.863 [2024-12-08 02:29:13.414153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:15296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.863 [2024-12-08 02:29:13.414170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.863 [2024-12-08 02:29:13.417882] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.863 [2024-12-08 02:29:13.417911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.863 [2024-12-08 02:29:13.417927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.863 [2024-12-08 02:29:13.421608] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.863 [2024-12-08 02:29:13.421636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.863 [2024-12-08 02:29:13.421653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.863 [2024-12-08 02:29:13.425548] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.863 [2024-12-08 02:29:13.425576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.863 [2024-12-08 02:29:13.425591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.863 [2024-12-08 02:29:13.429343] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.863 [2024-12-08 02:29:13.429371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.863 [2024-12-08 02:29:13.429388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.863 [2024-12-08 02:29:13.434545] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.863 [2024-12-08 02:29:13.434575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:96 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.863 [2024-12-08 02:29:13.434591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.863 [2024-12-08 02:29:13.440378] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.864 [2024-12-08 02:29:13.440407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:9152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.864 [2024-12-08 02:29:13.440423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.864 [2024-12-08 02:29:13.447168] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.864 [2024-12-08 02:29:13.447198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.864 [2024-12-08 02:29:13.447215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.864 [2024-12-08 02:29:13.452960] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.864 [2024-12-08 02:29:13.452989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.864 [2024-12-08 02:29:13.453006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.864 [2024-12-08 02:29:13.457689] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.864 [2024-12-08 02:29:13.457718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.864 [2024-12-08 02:29:13.457735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.864 [2024-12-08 02:29:13.461688] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.864 [2024-12-08 02:29:13.461718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.864 [2024-12-08 02:29:13.461741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.864 [2024-12-08 02:29:13.465615] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.864 [2024-12-08 02:29:13.465644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:2944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.864 [2024-12-08 02:29:13.465661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.864 [2024-12-08 02:29:13.469444] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.864 [2024-12-08 02:29:13.469472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.864 [2024-12-08 02:29:13.469489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.864 [2024-12-08 02:29:13.473291] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.864 [2024-12-08 02:29:13.473319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.864 [2024-12-08 02:29:13.473335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.864 [2024-12-08 02:29:13.477382] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.864 [2024-12-08 02:29:13.477411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.864 [2024-12-08 02:29:13.477427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.864 [2024-12-08 02:29:13.482107] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.864 [2024-12-08 02:29:13.482151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.864 [2024-12-08 02:29:13.482167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.864 [2024-12-08 02:29:13.486986] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.864 [2024-12-08 02:29:13.487017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.864 [2024-12-08 02:29:13.487033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.864 [2024-12-08 02:29:13.491593] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.864 [2024-12-08 02:29:13.491622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.864 [2024-12-08 02:29:13.491638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.864 [2024-12-08 02:29:13.496147] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.864 [2024-12-08 02:29:13.496176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:5600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.864 [2024-12-08 02:29:13.496193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.864 [2024-12-08 02:29:13.500742] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.864 [2024-12-08 02:29:13.500777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.864 [2024-12-08 02:29:13.500794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.864 [2024-12-08 02:29:13.505528] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.864 [2024-12-08 02:29:13.505579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.864 [2024-12-08 02:29:13.505598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.864 [2024-12-08 02:29:13.510759] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.864 [2024-12-08 02:29:13.510788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.864 [2024-12-08 02:29:13.510804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.864 [2024-12-08 02:29:13.515509] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.864 [2024-12-08 02:29:13.515545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:21600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.864 [2024-12-08 02:29:13.515564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.864 [2024-12-08 02:29:13.522129] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.864 [2024-12-08 02:29:13.522159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.864 [2024-12-08 02:29:13.522176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.864 [2024-12-08 02:29:13.527690] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.864 [2024-12-08 02:29:13.527720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.864 [2024-12-08 02:29:13.527737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.864 [2024-12-08 02:29:13.533100] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.864 [2024-12-08 02:29:13.533130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.864 [2024-12-08 02:29:13.533147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.864 [2024-12-08 02:29:13.538031] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.864 [2024-12-08 02:29:13.538076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.864 [2024-12-08 02:29:13.538092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.864 [2024-12-08 02:29:13.542184] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.864 [2024-12-08 02:29:13.542214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.864 [2024-12-08 02:29:13.542230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.864 [2024-12-08 02:29:13.546415] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.864 [2024-12-08 02:29:13.546445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.864 [2024-12-08 02:29:13.546461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.864 [2024-12-08 02:29:13.551170] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.864 [2024-12-08 02:29:13.551200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.864 [2024-12-08 02:29:13.551217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.864 [2024-12-08 02:29:13.556069] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.864 [2024-12-08 02:29:13.556099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:15328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.864 [2024-12-08 02:29:13.556115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.864 [2024-12-08 02:29:13.561433] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.864 [2024-12-08 02:29:13.561463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.864 [2024-12-08 02:29:13.561480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.864 [2024-12-08 02:29:13.567176] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.864 [2024-12-08 02:29:13.567207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.864 [2024-12-08 02:29:13.567224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.864 [2024-12-08 02:29:13.572490] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.865 [2024-12-08 02:29:13.572521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.865 [2024-12-08 02:29:13.572563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.865 [2024-12-08 02:29:13.577423] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.865 [2024-12-08 02:29:13.577454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.865 [2024-12-08 02:29:13.577471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.865 [2024-12-08 02:29:13.582767] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.865 [2024-12-08 02:29:13.582797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.865 [2024-12-08 02:29:13.582813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.865 [2024-12-08 02:29:13.588248] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.865 [2024-12-08 02:29:13.588278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.865 [2024-12-08 02:29:13.588301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.865 [2024-12-08 02:29:13.593593] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.865 [2024-12-08 02:29:13.593637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:17024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.865 [2024-12-08 02:29:13.593654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.865 [2024-12-08 02:29:13.599098] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.865 [2024-12-08 02:29:13.599129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.865 [2024-12-08 02:29:13.599145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.865 [2024-12-08 02:29:13.604006] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.865 [2024-12-08 02:29:13.604036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.865 [2024-12-08 02:29:13.604053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.865 [2024-12-08 02:29:13.609009] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.865 [2024-12-08 02:29:13.609039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.865 [2024-12-08 02:29:13.609057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.865 [2024-12-08 02:29:13.613476] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.865 [2024-12-08 02:29:13.613506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.865 [2024-12-08 02:29:13.613523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.865 [2024-12-08 02:29:13.618082] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.865 [2024-12-08 02:29:13.618112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.865 [2024-12-08 02:29:13.618128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.865 [2024-12-08 02:29:13.623117] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.865 [2024-12-08 02:29:13.623147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:10560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.865 [2024-12-08 02:29:13.623164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.865 [2024-12-08 02:29:13.628424] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.865 [2024-12-08 02:29:13.628454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.865 [2024-12-08 02:29:13.628471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:45.865 [2024-12-08 02:29:13.632884] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.865 [2024-12-08 02:29:13.632920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.865 [2024-12-08 02:29:13.632937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:45.865 [2024-12-08 02:29:13.636162] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.865 [2024-12-08 02:29:13.636190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.865 [2024-12-08 02:29:13.636221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.865 [2024-12-08 02:29:13.640868] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:45.865 [2024-12-08 02:29:13.640914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:45.865 [2024-12-08 02:29:13.640931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:46.127 [2024-12-08 02:29:13.645297] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.127 [2024-12-08 02:29:13.645325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.127 [2024-12-08 02:29:13.645357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:46.127 [2024-12-08 02:29:13.649757] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.127 [2024-12-08 02:29:13.649786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:8928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.127 [2024-12-08 02:29:13.649802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:46.127 [2024-12-08 02:29:13.654198] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.127 [2024-12-08 02:29:13.654241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.127 [2024-12-08 02:29:13.654257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:46.127 [2024-12-08 02:29:13.658765] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.127 [2024-12-08 02:29:13.658793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.127 [2024-12-08 02:29:13.658824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:46.127 [2024-12-08 02:29:13.663340] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.127 [2024-12-08 02:29:13.663368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.127 [2024-12-08 02:29:13.663384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:46.127 [2024-12-08 02:29:13.667833] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.127 [2024-12-08 02:29:13.667875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.127 [2024-12-08 02:29:13.667892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:46.127 [2024-12-08 02:29:13.672623] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.127 [2024-12-08 02:29:13.672666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.127 [2024-12-08 02:29:13.672682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:46.127 [2024-12-08 02:29:13.677111] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.127 [2024-12-08 02:29:13.677139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.127 [2024-12-08 02:29:13.677154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:46.127 [2024-12-08 02:29:13.681588] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.127 [2024-12-08 02:29:13.681614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.127 [2024-12-08 02:29:13.681645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:46.127 [2024-12-08 02:29:13.686248] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.127 [2024-12-08 02:29:13.686276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.127 [2024-12-08 02:29:13.686307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:46.127 [2024-12-08 02:29:13.690875] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.127 [2024-12-08 02:29:13.690902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.127 [2024-12-08 02:29:13.690933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:46.127 [2024-12-08 02:29:13.696228] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.127 [2024-12-08 02:29:13.696257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.127 [2024-12-08 02:29:13.696290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:46.127 [2024-12-08 02:29:13.700869] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.127 [2024-12-08 02:29:13.700899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.127 [2024-12-08 02:29:13.700916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:46.127 [2024-12-08 02:29:13.706003] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.127 [2024-12-08 02:29:13.706032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.127 [2024-12-08 02:29:13.706048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:46.127 [2024-12-08 02:29:13.710607] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.127 [2024-12-08 02:29:13.710635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:12512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.127 [2024-12-08 02:29:13.710657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:46.127 [2024-12-08 02:29:13.715108] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.127 [2024-12-08 02:29:13.715135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.127 [2024-12-08 02:29:13.715167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:46.127 [2024-12-08 02:29:13.720455] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.127 [2024-12-08 02:29:13.720482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:7424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.127 [2024-12-08 02:29:13.720513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:46.127 [2024-12-08 02:29:13.726813] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.127 [2024-12-08 02:29:13.726843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.127 [2024-12-08 02:29:13.726860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:46.127 [2024-12-08 02:29:13.732179] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.127 [2024-12-08 02:29:13.732224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.127 [2024-12-08 02:29:13.732242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:46.127 [2024-12-08 02:29:13.737467] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.127 [2024-12-08 02:29:13.737495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.127 [2024-12-08 02:29:13.737527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:46.127 [2024-12-08 02:29:13.742069] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.127 [2024-12-08 02:29:13.742097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.127 [2024-12-08 02:29:13.742127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:46.127 [2024-12-08 02:29:13.746618] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.127 [2024-12-08 02:29:13.746661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.127 [2024-12-08 02:29:13.746677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:46.127 [2024-12-08 02:29:13.751187] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.127 [2024-12-08 02:29:13.751214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.127 [2024-12-08 02:29:13.751245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:46.127 [2024-12-08 02:29:13.755901] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.127 [2024-12-08 02:29:13.755929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.127 [2024-12-08 02:29:13.755960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:46.127 [2024-12-08 02:29:13.761302] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.127 [2024-12-08 02:29:13.761331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.127 [2024-12-08 02:29:13.761347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:46.127 [2024-12-08 02:29:13.765923] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.127 [2024-12-08 02:29:13.765951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.127 [2024-12-08 02:29:13.765983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:46.127 [2024-12-08 02:29:13.770557] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.127 [2024-12-08 02:29:13.770598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.127 [2024-12-08 02:29:13.770615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:46.127 [2024-12-08 02:29:13.775797] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.127 [2024-12-08 02:29:13.775840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.127 [2024-12-08 02:29:13.775855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:46.127 [2024-12-08 02:29:13.781399] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.127 [2024-12-08 02:29:13.781430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:11808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.127 [2024-12-08 02:29:13.781447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:46.127 [2024-12-08 02:29:13.785744] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.127 [2024-12-08 02:29:13.785789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.127 [2024-12-08 02:29:13.785805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:46.127 [2024-12-08 02:29:13.790074] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.127 [2024-12-08 02:29:13.790104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.127 [2024-12-08 02:29:13.790121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:46.127 [2024-12-08 02:29:13.794937] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.127 [2024-12-08 02:29:13.794967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.127 [2024-12-08 02:29:13.794984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:46.127 [2024-12-08 02:29:13.800880] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.127 [2024-12-08 02:29:13.800911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.127 [2024-12-08 02:29:13.800928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:46.127 [2024-12-08 02:29:13.807149] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.127 [2024-12-08 02:29:13.807180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.128 [2024-12-08 02:29:13.807197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:46.128 [2024-12-08 02:29:13.813325] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.128 [2024-12-08 02:29:13.813355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.128 [2024-12-08 02:29:13.813373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:46.128 [2024-12-08 02:29:13.819434] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.128 [2024-12-08 02:29:13.819465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.128 [2024-12-08 02:29:13.819482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:46.128 [2024-12-08 02:29:13.826904] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.128 [2024-12-08 02:29:13.826934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.128 [2024-12-08 02:29:13.826950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:46.128 [2024-12-08 02:29:13.834225] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.128 [2024-12-08 02:29:13.834272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.128 [2024-12-08 02:29:13.834289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:46.128 [2024-12-08 02:29:13.841652] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.128 [2024-12-08 02:29:13.841681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.128 [2024-12-08 02:29:13.841698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:46.128 [2024-12-08 02:29:13.847859] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.128 [2024-12-08 02:29:13.847890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:22496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.128 [2024-12-08 02:29:13.847907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:46.128 [2024-12-08 02:29:13.853982] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.128 [2024-12-08 02:29:13.854017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:15680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.128 [2024-12-08 02:29:13.854035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:46.128 [2024-12-08 02:29:13.859966] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.128 [2024-12-08 02:29:13.860012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.128 [2024-12-08 02:29:13.860029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:46.128 [2024-12-08 02:29:13.866302] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.128 [2024-12-08 02:29:13.866333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.128 [2024-12-08 02:29:13.866350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:46.128 [2024-12-08 02:29:13.873693] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.128 [2024-12-08 02:29:13.873723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.128 [2024-12-08 02:29:13.873739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:46.128 [2024-12-08 02:29:13.880982] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.128 [2024-12-08 02:29:13.881012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.128 [2024-12-08 02:29:13.881029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:46.128 [2024-12-08 02:29:13.887601] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.128 [2024-12-08 02:29:13.887632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:23904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.128 [2024-12-08 02:29:13.887649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:46.128 [2024-12-08 02:29:13.892476] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.128 [2024-12-08 02:29:13.892506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.128 [2024-12-08 02:29:13.892523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:46.128 [2024-12-08 02:29:13.897779] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.128 [2024-12-08 02:29:13.897822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.128 [2024-12-08 02:29:13.897838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:46.128 [2024-12-08 02:29:13.903205] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.128 [2024-12-08 02:29:13.903249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.128 [2024-12-08 02:29:13.903265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:46.387 [2024-12-08 02:29:13.908903] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.387 [2024-12-08 02:29:13.908934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.387 [2024-12-08 02:29:13.908951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:46.387 [2024-12-08 02:29:13.914724] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.387 [2024-12-08 02:29:13.914770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.387 [2024-12-08 02:29:13.914789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:46.387 [2024-12-08 02:29:13.920389] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.387 [2024-12-08 02:29:13.920418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.387 [2024-12-08 02:29:13.920435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:46.387 [2024-12-08 02:29:13.925775] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.387 [2024-12-08 02:29:13.925804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.387 [2024-12-08 02:29:13.925820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:46.387 [2024-12-08 02:29:13.931118] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.387 [2024-12-08 02:29:13.931147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:21504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.387 [2024-12-08 02:29:13.931163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:46.387 [2024-12-08 02:29:13.935764] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.387 [2024-12-08 02:29:13.935792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:23968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.387 [2024-12-08 02:29:13.935808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:46.387 [2024-12-08 02:29:13.940562] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.387 [2024-12-08 02:29:13.940593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.387 [2024-12-08 02:29:13.940610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:46.387 [2024-12-08 02:29:13.944959] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.387 [2024-12-08 02:29:13.944989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:11488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.387 [2024-12-08 02:29:13.945006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:46.387 [2024-12-08 02:29:13.950082] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa0ebb0) 00:26:46.387 [2024-12-08 02:29:13.950112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:46.387 [2024-12-08 02:29:13.950136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:46.387 00:26:46.387 Latency(us) 00:26:46.387 [2024-12-08T01:29:14.168Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:46.387 [2024-12-08T01:29:14.168Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:26:46.387 nvme0n1 : 2.00 6053.78 756.72 0.00 0.00 2639.13 600.75 8009.96 00:26:46.387 [2024-12-08T01:29:14.168Z] =================================================================================================================== 00:26:46.387 [2024-12-08T01:29:14.168Z] Total : 6053.78 756.72 0.00 0.00 2639.13 600.75 8009.96 00:26:46.387 0 00:26:46.387 02:29:13 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:26:46.387 02:29:13 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:26:46.387 02:29:13 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:26:46.387 | .driver_specific 00:26:46.387 | .nvme_error 00:26:46.387 | .status_code 00:26:46.387 | .command_transient_transport_error' 00:26:46.387 02:29:13 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:26:46.646 02:29:14 -- host/digest.sh@71 -- # (( 390 > 0 )) 00:26:46.647 02:29:14 -- host/digest.sh@73 -- # killprocess 2222356 00:26:46.647 02:29:14 -- common/autotest_common.sh@936 -- # '[' -z 2222356 ']' 00:26:46.647 02:29:14 -- common/autotest_common.sh@940 -- # kill -0 2222356 00:26:46.647 02:29:14 -- common/autotest_common.sh@941 -- # uname 00:26:46.647 02:29:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:46.647 02:29:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2222356 00:26:46.647 02:29:14 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:46.647 02:29:14 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:46.647 02:29:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2222356' 00:26:46.647 killing process with pid 2222356 00:26:46.647 02:29:14 -- common/autotest_common.sh@955 -- # kill 2222356 00:26:46.647 Received shutdown signal, test time was about 2.000000 seconds 00:26:46.647 00:26:46.647 Latency(us) 00:26:46.647 [2024-12-08T01:29:14.428Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:46.647 [2024-12-08T01:29:14.428Z] =================================================================================================================== 00:26:46.647 [2024-12-08T01:29:14.428Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:46.647 02:29:14 -- common/autotest_common.sh@960 -- # wait 2222356 00:26:46.905 02:29:14 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:26:46.905 02:29:14 -- host/digest.sh@54 -- # local rw bs qd 00:26:46.905 02:29:14 -- host/digest.sh@56 -- # rw=randwrite 00:26:46.905 02:29:14 -- host/digest.sh@56 -- # bs=4096 00:26:46.905 02:29:14 -- host/digest.sh@56 -- # qd=128 00:26:46.905 02:29:14 -- host/digest.sh@58 -- # bperfpid=2222917 00:26:46.905 02:29:14 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:26:46.905 02:29:14 -- host/digest.sh@60 -- # waitforlisten 2222917 /var/tmp/bperf.sock 00:26:46.905 02:29:14 -- common/autotest_common.sh@829 -- # '[' -z 2222917 ']' 00:26:46.905 02:29:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:46.905 02:29:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:46.905 02:29:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:46.905 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:46.905 02:29:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:46.905 02:29:14 -- common/autotest_common.sh@10 -- # set +x 00:26:46.905 [2024-12-08 02:29:14.592405] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:46.905 [2024-12-08 02:29:14.592481] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2222917 ] 00:26:46.905 EAL: No free 2048 kB hugepages reported on node 1 00:26:46.905 [2024-12-08 02:29:14.649652] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:47.164 [2024-12-08 02:29:14.755665] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:48.097 02:29:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:48.097 02:29:15 -- common/autotest_common.sh@862 -- # return 0 00:26:48.097 02:29:15 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:48.097 02:29:15 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:48.356 02:29:15 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:26:48.356 02:29:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:48.356 02:29:15 -- common/autotest_common.sh@10 -- # set +x 00:26:48.356 02:29:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:48.356 02:29:15 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:48.356 02:29:15 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:48.614 nvme0n1 00:26:48.614 02:29:16 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:26:48.614 02:29:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:48.614 02:29:16 -- common/autotest_common.sh@10 -- # set +x 00:26:48.614 02:29:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:48.614 02:29:16 -- host/digest.sh@69 -- # bperf_py perform_tests 00:26:48.614 02:29:16 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:48.873 Running I/O for 2 seconds... 00:26:48.873 [2024-12-08 02:29:16.514308] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190eea00 00:26:48.873 [2024-12-08 02:29:16.515905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:15078 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:48.873 [2024-12-08 02:29:16.515962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.873 [2024-12-08 02:29:16.526433] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190dece0 00:26:48.873 [2024-12-08 02:29:16.528225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:12738 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:48.873 [2024-12-08 02:29:16.528256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:48.873 [2024-12-08 02:29:16.537923] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f8618 00:26:48.873 [2024-12-08 02:29:16.539620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:316 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:48.873 [2024-12-08 02:29:16.539649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.873 [2024-12-08 02:29:16.549451] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e9168 00:26:48.873 [2024-12-08 02:29:16.551242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:13506 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:48.873 [2024-12-08 02:29:16.551271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:48.873 [2024-12-08 02:29:16.561408] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f31b8 00:26:48.873 [2024-12-08 02:29:16.563317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:23929 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:48.873 [2024-12-08 02:29:16.563347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:48.873 [2024-12-08 02:29:16.572782] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f20d8 00:26:48.873 [2024-12-08 02:29:16.574430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:17046 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:48.873 [2024-12-08 02:29:16.574458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:26:48.873 [2024-12-08 02:29:16.584082] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e84c0 00:26:48.873 [2024-12-08 02:29:16.585752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:2959 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:48.873 [2024-12-08 02:29:16.585795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:26:48.873 [2024-12-08 02:29:16.595425] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e5220 00:26:48.873 [2024-12-08 02:29:16.597295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:25263 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:48.873 [2024-12-08 02:29:16.597323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:26:48.873 [2024-12-08 02:29:16.606861] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190eaab8 00:26:48.873 [2024-12-08 02:29:16.608431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:9545 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:48.873 [2024-12-08 02:29:16.608460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:26:48.873 [2024-12-08 02:29:16.617988] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190fd208 00:26:48.873 [2024-12-08 02:29:16.618943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:15858 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:48.873 [2024-12-08 02:29:16.618971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:26:48.873 [2024-12-08 02:29:16.629299] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190ebb98 00:26:48.873 [2024-12-08 02:29:16.630969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5180 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:48.873 [2024-12-08 02:29:16.630997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:26:48.873 [2024-12-08 02:29:16.641453] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f7970 00:26:48.873 [2024-12-08 02:29:16.642344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:20515 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:48.873 [2024-12-08 02:29:16.642371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:26:48.873 [2024-12-08 02:29:16.651317] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190fc560 00:26:48.873 [2024-12-08 02:29:16.652565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:12987 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:48.873 [2024-12-08 02:29:16.652594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:26:49.133 [2024-12-08 02:29:16.662781] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190fc560 00:26:49.134 [2024-12-08 02:29:16.664109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:92 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.134 [2024-12-08 02:29:16.664141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:26:49.134 [2024-12-08 02:29:16.674050] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190fc560 00:26:49.134 [2024-12-08 02:29:16.675624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:11202 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.134 [2024-12-08 02:29:16.675651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:49.134 [2024-12-08 02:29:16.685393] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190efae0 00:26:49.134 [2024-12-08 02:29:16.687124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:120 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.134 [2024-12-08 02:29:16.687153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:49.134 [2024-12-08 02:29:16.696584] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f2510 00:26:49.134 [2024-12-08 02:29:16.698409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:14826 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.134 [2024-12-08 02:29:16.698436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:49.134 [2024-12-08 02:29:16.707851] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190edd58 00:26:49.134 [2024-12-08 02:29:16.709796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:21383 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.134 [2024-12-08 02:29:16.709839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.134 [2024-12-08 02:29:16.720067] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f2948 00:26:49.134 [2024-12-08 02:29:16.720958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:23890 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.134 [2024-12-08 02:29:16.721000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:49.134 [2024-12-08 02:29:16.730922] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e49b0 00:26:49.134 [2024-12-08 02:29:16.732740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:17209 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.134 [2024-12-08 02:29:16.732768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:49.134 [2024-12-08 02:29:16.741579] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e01f8 00:26:49.134 [2024-12-08 02:29:16.742677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:21658 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.134 [2024-12-08 02:29:16.742705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.134 [2024-12-08 02:29:16.753070] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e49b0 00:26:49.134 [2024-12-08 02:29:16.753998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:22613 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.134 [2024-12-08 02:29:16.754024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:26:49.134 [2024-12-08 02:29:16.765014] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190feb58 00:26:49.134 [2024-12-08 02:29:16.765704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:12490 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.134 [2024-12-08 02:29:16.765733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:26:49.134 [2024-12-08 02:29:16.776471] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190ddc00 00:26:49.134 [2024-12-08 02:29:16.777003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:16930 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.134 [2024-12-08 02:29:16.777032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:26:49.134 [2024-12-08 02:29:16.787648] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e3498 00:26:49.134 [2024-12-08 02:29:16.788174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:69 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.134 [2024-12-08 02:29:16.788202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:26:49.134 [2024-12-08 02:29:16.798796] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190df988 00:26:49.134 [2024-12-08 02:29:16.799349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:15579 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.134 [2024-12-08 02:29:16.799377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:26:49.134 [2024-12-08 02:29:16.809891] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190eaef0 00:26:49.134 [2024-12-08 02:29:16.810486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:9402 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.134 [2024-12-08 02:29:16.810514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:26:49.134 [2024-12-08 02:29:16.821411] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f1430 00:26:49.134 [2024-12-08 02:29:16.822025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:15135 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.134 [2024-12-08 02:29:16.822052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:26:49.134 [2024-12-08 02:29:16.832418] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190fc128 00:26:49.134 [2024-12-08 02:29:16.832999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:18450 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.134 [2024-12-08 02:29:16.833028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:26:49.134 [2024-12-08 02:29:16.843974] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f4298 00:26:49.134 [2024-12-08 02:29:16.844864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:25182 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.134 [2024-12-08 02:29:16.844892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:26:49.134 [2024-12-08 02:29:16.855162] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190de038 00:26:49.134 [2024-12-08 02:29:16.856846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:8290 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.134 [2024-12-08 02:29:16.856875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:26:49.134 [2024-12-08 02:29:16.865761] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e3060 00:26:49.134 [2024-12-08 02:29:16.866872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:24139 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.134 [2024-12-08 02:29:16.866901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.134 [2024-12-08 02:29:16.879407] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f9b30 00:26:49.134 [2024-12-08 02:29:16.880501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:25305 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.134 [2024-12-08 02:29:16.880551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:26:49.134 [2024-12-08 02:29:16.887801] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e27f0 00:26:49.134 [2024-12-08 02:29:16.887942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:17230 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.134 [2024-12-08 02:29:16.887968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0004 p:0 m:0 dnr:0 00:26:49.134 [2024-12-08 02:29:16.900303] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f7970 00:26:49.134 [2024-12-08 02:29:16.901096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:4529 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.134 [2024-12-08 02:29:16.901137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:26:49.134 [2024-12-08 02:29:16.912415] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e6b70 00:26:49.395 [2024-12-08 02:29:16.913335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:11249 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.395 [2024-12-08 02:29:16.913364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:26:49.395 [2024-12-08 02:29:16.923760] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e88f8 00:26:49.395 [2024-12-08 02:29:16.925228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:22816 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.395 [2024-12-08 02:29:16.925256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:26:49.395 [2024-12-08 02:29:16.936023] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e5220 00:26:49.395 [2024-12-08 02:29:16.936703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:2384 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.395 [2024-12-08 02:29:16.936731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:26:49.395 [2024-12-08 02:29:16.947438] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190dece0 00:26:49.395 [2024-12-08 02:29:16.948102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20295 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.395 [2024-12-08 02:29:16.948129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:26:49.395 [2024-12-08 02:29:16.958950] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f1868 00:26:49.395 [2024-12-08 02:29:16.959813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:1676 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.395 [2024-12-08 02:29:16.959849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:26:49.395 [2024-12-08 02:29:16.970421] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190df550 00:26:49.395 [2024-12-08 02:29:16.971199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:3872 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.395 [2024-12-08 02:29:16.971227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:26:49.395 [2024-12-08 02:29:16.981730] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f57b0 00:26:49.395 [2024-12-08 02:29:16.982426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10040 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.395 [2024-12-08 02:29:16.982453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:26:49.395 [2024-12-08 02:29:16.992996] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f0788 00:26:49.395 [2024-12-08 02:29:16.993666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:15986 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.395 [2024-12-08 02:29:16.993694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:26:49.395 [2024-12-08 02:29:17.004284] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f5378 00:26:49.395 [2024-12-08 02:29:17.004915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:14538 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.395 [2024-12-08 02:29:17.004958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:26:49.395 [2024-12-08 02:29:17.015675] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190df988 00:26:49.395 [2024-12-08 02:29:17.016248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:15039 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.395 [2024-12-08 02:29:17.016276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:26:49.396 [2024-12-08 02:29:17.026842] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190ef6a8 00:26:49.396 [2024-12-08 02:29:17.027411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:19209 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.396 [2024-12-08 02:29:17.027438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:26:49.396 [2024-12-08 02:29:17.037899] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190ec408 00:26:49.396 [2024-12-08 02:29:17.039433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:7475 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.396 [2024-12-08 02:29:17.039461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:26:49.396 [2024-12-08 02:29:17.049489] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190fe2e8 00:26:49.396 [2024-12-08 02:29:17.051000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:24452 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.396 [2024-12-08 02:29:17.051042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:26:49.396 [2024-12-08 02:29:17.060887] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190de470 00:26:49.396 [2024-12-08 02:29:17.062568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:22933 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.396 [2024-12-08 02:29:17.062597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:26:49.396 [2024-12-08 02:29:17.071912] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f7970 00:26:49.396 [2024-12-08 02:29:17.072854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:8184 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.396 [2024-12-08 02:29:17.072896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:003f p:0 m:0 dnr:0 00:26:49.396 [2024-12-08 02:29:17.083607] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e4140 00:26:49.396 [2024-12-08 02:29:17.084804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:1080 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.396 [2024-12-08 02:29:17.084833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:004f p:0 m:0 dnr:0 00:26:49.396 [2024-12-08 02:29:17.095937] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e1b48 00:26:49.396 [2024-12-08 02:29:17.097173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:24519 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.396 [2024-12-08 02:29:17.097201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:004e p:0 m:0 dnr:0 00:26:49.396 [2024-12-08 02:29:17.108277] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f81e0 00:26:49.396 [2024-12-08 02:29:17.109591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:746 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.396 [2024-12-08 02:29:17.109619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:26:49.396 [2024-12-08 02:29:17.121896] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e5a90 00:26:49.396 [2024-12-08 02:29:17.123790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:7269 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.396 [2024-12-08 02:29:17.123818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:26:49.396 [2024-12-08 02:29:17.134201] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e5a90 00:26:49.396 [2024-12-08 02:29:17.135342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:10468 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.396 [2024-12-08 02:29:17.135370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:26:49.396 [2024-12-08 02:29:17.146279] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e8d30 00:26:49.396 [2024-12-08 02:29:17.147209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:19661 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.396 [2024-12-08 02:29:17.147239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:26:49.396 [2024-12-08 02:29:17.157018] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e84c0 00:26:49.396 [2024-12-08 02:29:17.158416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:20919 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.396 [2024-12-08 02:29:17.158447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:26:49.396 [2024-12-08 02:29:17.169355] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e3d08 00:26:49.396 [2024-12-08 02:29:17.171186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:17383 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.396 [2024-12-08 02:29:17.171218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:26:49.655 [2024-12-08 02:29:17.181582] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190ecc78 00:26:49.655 [2024-12-08 02:29:17.182875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:19266 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.655 [2024-12-08 02:29:17.182906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:49.655 [2024-12-08 02:29:17.192842] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e84c0 00:26:49.655 [2024-12-08 02:29:17.193021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:6658 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.655 [2024-12-08 02:29:17.193051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0029 p:0 m:0 dnr:0 00:26:49.655 [2024-12-08 02:29:17.206097] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e7c50 00:26:49.655 [2024-12-08 02:29:17.207376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:7840 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.655 [2024-12-08 02:29:17.207407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:26:49.655 [2024-12-08 02:29:17.218138] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f0ff8 00:26:49.655 [2024-12-08 02:29:17.218781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:22848 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.655 [2024-12-08 02:29:17.218823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:26:49.655 [2024-12-08 02:29:17.230198] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190fc128 00:26:49.655 [2024-12-08 02:29:17.231676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:21524 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.655 [2024-12-08 02:29:17.231704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:26:49.655 [2024-12-08 02:29:17.243387] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190fb048 00:26:49.655 [2024-12-08 02:29:17.243915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:1284 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.655 [2024-12-08 02:29:17.243946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:26:49.655 [2024-12-08 02:29:17.255747] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190fc560 00:26:49.655 [2024-12-08 02:29:17.256473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:2559 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.655 [2024-12-08 02:29:17.256504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:26:49.655 [2024-12-08 02:29:17.267933] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190fc998 00:26:49.655 [2024-12-08 02:29:17.268641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:15460 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.655 [2024-12-08 02:29:17.268675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:26:49.655 [2024-12-08 02:29:17.280439] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190ed0b0 00:26:49.655 [2024-12-08 02:29:17.281070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:16073 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.655 [2024-12-08 02:29:17.281101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:26:49.655 [2024-12-08 02:29:17.292757] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e6b70 00:26:49.655 [2024-12-08 02:29:17.293377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:7067 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.655 [2024-12-08 02:29:17.293408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:26:49.655 [2024-12-08 02:29:17.304969] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f2d80 00:26:49.655 [2024-12-08 02:29:17.305520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:11738 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.655 [2024-12-08 02:29:17.305561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:26:49.655 [2024-12-08 02:29:17.317062] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190fe720 00:26:49.655 [2024-12-08 02:29:17.317600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:18549 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.655 [2024-12-08 02:29:17.317628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:26:49.655 [2024-12-08 02:29:17.329329] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f7970 00:26:49.655 [2024-12-08 02:29:17.329819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:2946 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.655 [2024-12-08 02:29:17.329862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:26:49.655 [2024-12-08 02:29:17.341433] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190ed0b0 00:26:49.655 [2024-12-08 02:29:17.341877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:22980 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.655 [2024-12-08 02:29:17.341921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:26:49.655 [2024-12-08 02:29:17.353586] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f7970 00:26:49.655 [2024-12-08 02:29:17.354117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:20458 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.655 [2024-12-08 02:29:17.354149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:26:49.655 [2024-12-08 02:29:17.365802] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f0350 00:26:49.655 [2024-12-08 02:29:17.366314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:15817 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.655 [2024-12-08 02:29:17.366344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:26:49.655 [2024-12-08 02:29:17.376392] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190fd640 00:26:49.655 [2024-12-08 02:29:17.376521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:18699 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.655 [2024-12-08 02:29:17.376559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0004 p:0 m:0 dnr:0 00:26:49.655 [2024-12-08 02:29:17.389793] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e84c0 00:26:49.655 [2024-12-08 02:29:17.390116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:1963 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.656 [2024-12-08 02:29:17.390146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0043 p:0 m:0 dnr:0 00:26:49.656 [2024-12-08 02:29:17.402113] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f6890 00:26:49.656 [2024-12-08 02:29:17.402640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:18326 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.656 [2024-12-08 02:29:17.402682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:26:49.656 [2024-12-08 02:29:17.416039] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190de8a8 00:26:49.656 [2024-12-08 02:29:17.417823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:2018 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.656 [2024-12-08 02:29:17.417851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:26:49.656 [2024-12-08 02:29:17.426457] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e1b48 00:26:49.656 [2024-12-08 02:29:17.426772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:8934 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.656 [2024-12-08 02:29:17.426800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0050 p:0 m:0 dnr:0 00:26:49.914 [2024-12-08 02:29:17.438702] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190fe720 00:26:49.914 [2024-12-08 02:29:17.438953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:1962 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.914 [2024-12-08 02:29:17.438985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:004f p:0 m:0 dnr:0 00:26:49.914 [2024-12-08 02:29:17.452946] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f35f0 00:26:49.914 [2024-12-08 02:29:17.454814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:24565 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.914 [2024-12-08 02:29:17.454842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:49.914 [2024-12-08 02:29:17.465249] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e4578 00:26:49.914 [2024-12-08 02:29:17.467259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:23411 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.914 [2024-12-08 02:29:17.467290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:49.914 [2024-12-08 02:29:17.477001] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e49b0 00:26:49.914 [2024-12-08 02:29:17.478079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:20291 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.914 [2024-12-08 02:29:17.478112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:26:49.914 [2024-12-08 02:29:17.489153] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190fc560 00:26:49.914 [2024-12-08 02:29:17.490932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:12366 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.914 [2024-12-08 02:29:17.490964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:49.914 [2024-12-08 02:29:17.501611] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f0ff8 00:26:49.914 [2024-12-08 02:29:17.503130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:17870 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.914 [2024-12-08 02:29:17.503162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:49.914 [2024-12-08 02:29:17.514733] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f7538 00:26:49.914 [2024-12-08 02:29:17.516901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:15456 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.914 [2024-12-08 02:29:17.516934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:49.914 [2024-12-08 02:29:17.526766] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190eaab8 00:26:49.914 [2024-12-08 02:29:17.527559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:22783 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.914 [2024-12-08 02:29:17.527604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:26:49.914 [2024-12-08 02:29:17.538857] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f2510 00:26:49.914 [2024-12-08 02:29:17.540759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:16977 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.914 [2024-12-08 02:29:17.540787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:26:49.914 [2024-12-08 02:29:17.551254] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e7c50 00:26:49.914 [2024-12-08 02:29:17.552815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:17818 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.914 [2024-12-08 02:29:17.552843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:26:49.914 [2024-12-08 02:29:17.563550] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e73e0 00:26:49.914 [2024-12-08 02:29:17.565056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:14270 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.914 [2024-12-08 02:29:17.565088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:26:49.914 [2024-12-08 02:29:17.575933] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190ddc00 00:26:49.914 [2024-12-08 02:29:17.577689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:20909 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.914 [2024-12-08 02:29:17.577718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:49.914 [2024-12-08 02:29:17.588405] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190ff3c8 00:26:49.915 [2024-12-08 02:29:17.589936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:23201 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.915 [2024-12-08 02:29:17.589973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:49.915 [2024-12-08 02:29:17.600639] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e2c28 00:26:49.915 [2024-12-08 02:29:17.602206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:2432 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.915 [2024-12-08 02:29:17.602237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:49.915 [2024-12-08 02:29:17.613645] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190ec840 00:26:49.915 [2024-12-08 02:29:17.615334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:8654 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.915 [2024-12-08 02:29:17.615366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:49.915 [2024-12-08 02:29:17.626134] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190fda78 00:26:49.915 [2024-12-08 02:29:17.627963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:13193 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.915 [2024-12-08 02:29:17.627995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:49.915 [2024-12-08 02:29:17.636634] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190ea248 00:26:49.915 [2024-12-08 02:29:17.637907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:3159 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.915 [2024-12-08 02:29:17.637950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:49.915 [2024-12-08 02:29:17.649141] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190ecc78 00:26:49.915 [2024-12-08 02:29:17.650663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:19288 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.915 [2024-12-08 02:29:17.650691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:49.915 [2024-12-08 02:29:17.661353] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190ecc78 00:26:49.915 [2024-12-08 02:29:17.662988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:17412 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.915 [2024-12-08 02:29:17.663018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:49.915 [2024-12-08 02:29:17.673627] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f6020 00:26:49.915 [2024-12-08 02:29:17.675174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:20357 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.915 [2024-12-08 02:29:17.675206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.915 [2024-12-08 02:29:17.684798] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190fa3a0 00:26:49.915 [2024-12-08 02:29:17.685969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:7872 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:49.915 [2024-12-08 02:29:17.686001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:26:50.174 [2024-12-08 02:29:17.696973] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190ff3c8 00:26:50.174 [2024-12-08 02:29:17.698399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:17063 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.174 [2024-12-08 02:29:17.698431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:26:50.174 [2024-12-08 02:29:17.709065] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190ff3c8 00:26:50.174 [2024-12-08 02:29:17.710269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:18181 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.174 [2024-12-08 02:29:17.710301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:26:50.174 [2024-12-08 02:29:17.721274] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190ff3c8 00:26:50.174 [2024-12-08 02:29:17.722465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:11070 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.174 [2024-12-08 02:29:17.722497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:26:50.174 [2024-12-08 02:29:17.733446] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190ff3c8 00:26:50.174 [2024-12-08 02:29:17.734653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:14166 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.174 [2024-12-08 02:29:17.734696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:26:50.174 [2024-12-08 02:29:17.745430] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e12d8 00:26:50.174 [2024-12-08 02:29:17.746270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:24231 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.174 [2024-12-08 02:29:17.746302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0033 p:0 m:0 dnr:0 00:26:50.174 [2024-12-08 02:29:17.757819] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f4b08 00:26:50.174 [2024-12-08 02:29:17.758942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:22692 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.174 [2024-12-08 02:29:17.758973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0043 p:0 m:0 dnr:0 00:26:50.174 [2024-12-08 02:29:17.769939] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e1b48 00:26:50.174 [2024-12-08 02:29:17.771024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:21255 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.174 [2024-12-08 02:29:17.771056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0042 p:0 m:0 dnr:0 00:26:50.174 [2024-12-08 02:29:17.781979] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190eaab8 00:26:50.174 [2024-12-08 02:29:17.783088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:17351 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.174 [2024-12-08 02:29:17.783120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.174 [2024-12-08 02:29:17.794248] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190ebfd0 00:26:50.174 [2024-12-08 02:29:17.795394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:10303 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.174 [2024-12-08 02:29:17.795425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0040 p:0 m:0 dnr:0 00:26:50.174 [2024-12-08 02:29:17.806486] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e38d0 00:26:50.174 [2024-12-08 02:29:17.806698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:10724 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.174 [2024-12-08 02:29:17.806726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0029 p:0 m:0 dnr:0 00:26:50.174 [2024-12-08 02:29:17.820023] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f6cc8 00:26:50.174 [2024-12-08 02:29:17.820555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:25565 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.174 [2024-12-08 02:29:17.820597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:26:50.174 [2024-12-08 02:29:17.832751] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e1f80 00:26:50.174 [2024-12-08 02:29:17.834043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:22507 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.174 [2024-12-08 02:29:17.834075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:26:50.174 [2024-12-08 02:29:17.845848] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f31b8 00:26:50.174 [2024-12-08 02:29:17.847757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:3078 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.174 [2024-12-08 02:29:17.847785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:26:50.174 [2024-12-08 02:29:17.858338] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f31b8 00:26:50.174 [2024-12-08 02:29:17.859708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:16633 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.174 [2024-12-08 02:29:17.859749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:50.174 [2024-12-08 02:29:17.868895] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f7100 00:26:50.174 [2024-12-08 02:29:17.869636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:19823 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.174 [2024-12-08 02:29:17.869663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:26:50.174 [2024-12-08 02:29:17.881210] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e7818 00:26:50.174 [2024-12-08 02:29:17.881914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:977 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.174 [2024-12-08 02:29:17.881946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:26:50.174 [2024-12-08 02:29:17.893244] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f1ca0 00:26:50.174 [2024-12-08 02:29:17.894021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:2117 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.175 [2024-12-08 02:29:17.894053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:26:50.175 [2024-12-08 02:29:17.905333] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190fe720 00:26:50.175 [2024-12-08 02:29:17.906059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:10054 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.175 [2024-12-08 02:29:17.906097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:26:50.175 [2024-12-08 02:29:17.917385] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f8e88 00:26:50.175 [2024-12-08 02:29:17.918108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:1054 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.175 [2024-12-08 02:29:17.918139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:26:50.175 [2024-12-08 02:29:17.931939] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190ecc78 00:26:50.175 [2024-12-08 02:29:17.933737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:5554 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.175 [2024-12-08 02:29:17.933765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.175 [2024-12-08 02:29:17.942670] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e88f8 00:26:50.175 [2024-12-08 02:29:17.943608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:12017 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.175 [2024-12-08 02:29:17.943649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:50.433 [2024-12-08 02:29:17.954787] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e6300 00:26:50.433 [2024-12-08 02:29:17.955764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4959 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.433 [2024-12-08 02:29:17.955791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:50.433 [2024-12-08 02:29:17.966972] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f5378 00:26:50.433 [2024-12-08 02:29:17.967940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:6906 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.433 [2024-12-08 02:29:17.967971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:50.433 [2024-12-08 02:29:17.979019] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190ecc78 00:26:50.433 [2024-12-08 02:29:17.979977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:20475 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.433 [2024-12-08 02:29:17.980019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:26:50.433 [2024-12-08 02:29:17.991050] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190feb58 00:26:50.433 [2024-12-08 02:29:17.992006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:5044 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.434 [2024-12-08 02:29:17.992037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:26:50.434 [2024-12-08 02:29:18.003057] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190fe720 00:26:50.434 [2024-12-08 02:29:18.004034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:21254 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.434 [2024-12-08 02:29:18.004065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:26:50.434 [2024-12-08 02:29:18.014852] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f7100 00:26:50.434 [2024-12-08 02:29:18.016279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:22977 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.434 [2024-12-08 02:29:18.016310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:26:50.434 [2024-12-08 02:29:18.027519] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e38d0 00:26:50.434 [2024-12-08 02:29:18.028947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:13127 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.434 [2024-12-08 02:29:18.028978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:26:50.434 [2024-12-08 02:29:18.042494] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190ed4e8 00:26:50.434 [2024-12-08 02:29:18.043861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:1506 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.434 [2024-12-08 02:29:18.043905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:50.434 [2024-12-08 02:29:18.051530] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f2948 00:26:50.434 [2024-12-08 02:29:18.051908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:15665 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.434 [2024-12-08 02:29:18.051938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:001c p:0 m:0 dnr:0 00:26:50.434 [2024-12-08 02:29:18.066438] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e1b48 00:26:50.434 [2024-12-08 02:29:18.068262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:18147 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.434 [2024-12-08 02:29:18.068295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:26:50.434 [2024-12-08 02:29:18.077405] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f96f8 00:26:50.434 [2024-12-08 02:29:18.078521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:9312 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.434 [2024-12-08 02:29:18.078561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:26:50.434 [2024-12-08 02:29:18.089492] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190fda78 00:26:50.434 [2024-12-08 02:29:18.091271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:4743 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.434 [2024-12-08 02:29:18.091303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:26:50.434 [2024-12-08 02:29:18.102367] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e0630 00:26:50.434 [2024-12-08 02:29:18.103922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:19458 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.434 [2024-12-08 02:29:18.103955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:50.434 [2024-12-08 02:29:18.114602] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190ff3c8 00:26:50.434 [2024-12-08 02:29:18.116147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:3455 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.434 [2024-12-08 02:29:18.116179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:50.434 [2024-12-08 02:29:18.126912] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190ff3c8 00:26:50.434 [2024-12-08 02:29:18.128072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:23108 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.434 [2024-12-08 02:29:18.128104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:50.434 [2024-12-08 02:29:18.139033] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190ff3c8 00:26:50.434 [2024-12-08 02:29:18.140231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:1623 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.434 [2024-12-08 02:29:18.140263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.434 [2024-12-08 02:29:18.150040] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190ee190 00:26:50.434 [2024-12-08 02:29:18.151336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:10956 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.434 [2024-12-08 02:29:18.151364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0049 p:0 m:0 dnr:0 00:26:50.434 [2024-12-08 02:29:18.162149] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190ebfd0 00:26:50.434 [2024-12-08 02:29:18.163300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:15206 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.434 [2024-12-08 02:29:18.163331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0048 p:0 m:0 dnr:0 00:26:50.434 [2024-12-08 02:29:18.174252] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e1b48 00:26:50.434 [2024-12-08 02:29:18.175414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:14365 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.434 [2024-12-08 02:29:18.175445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0047 p:0 m:0 dnr:0 00:26:50.434 [2024-12-08 02:29:18.186391] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190fdeb0 00:26:50.434 [2024-12-08 02:29:18.187762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:1980 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.434 [2024-12-08 02:29:18.187790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0046 p:0 m:0 dnr:0 00:26:50.434 [2024-12-08 02:29:18.198660] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e7c50 00:26:50.434 [2024-12-08 02:29:18.199895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:23571 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.434 [2024-12-08 02:29:18.199922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0045 p:0 m:0 dnr:0 00:26:50.434 [2024-12-08 02:29:18.210763] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190ee5c8 00:26:50.434 [2024-12-08 02:29:18.211933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:23318 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.434 [2024-12-08 02:29:18.211964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:002b p:0 m:0 dnr:0 00:26:50.693 [2024-12-08 02:29:18.224242] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e0a68 00:26:50.693 [2024-12-08 02:29:18.225616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:2888 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.693 [2024-12-08 02:29:18.225649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:26:50.693 [2024-12-08 02:29:18.236298] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f3e60 00:26:50.693 [2024-12-08 02:29:18.236968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:23756 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.693 [2024-12-08 02:29:18.236998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:26:50.693 [2024-12-08 02:29:18.248233] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e6b70 00:26:50.693 [2024-12-08 02:29:18.249732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:10123 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.693 [2024-12-08 02:29:18.249761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:26:50.693 [2024-12-08 02:29:18.261323] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f3a28 00:26:50.693 [2024-12-08 02:29:18.262793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:18879 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.693 [2024-12-08 02:29:18.262838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:26:50.693 [2024-12-08 02:29:18.273596] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190fc998 00:26:50.693 [2024-12-08 02:29:18.274134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:9551 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.693 [2024-12-08 02:29:18.274164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:26:50.693 [2024-12-08 02:29:18.286103] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e0630 00:26:50.693 [2024-12-08 02:29:18.286831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:13646 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.693 [2024-12-08 02:29:18.286863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:26:50.693 [2024-12-08 02:29:18.298657] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f9b30 00:26:50.693 [2024-12-08 02:29:18.299350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:8215 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.693 [2024-12-08 02:29:18.299383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:50.694 [2024-12-08 02:29:18.310998] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f6020 00:26:50.694 [2024-12-08 02:29:18.311666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:15681 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.694 [2024-12-08 02:29:18.311696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:26:50.694 [2024-12-08 02:29:18.324672] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190fe720 00:26:50.694 [2024-12-08 02:29:18.325996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:8685 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.694 [2024-12-08 02:29:18.326028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:26:50.694 [2024-12-08 02:29:18.335178] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190ff3c8 00:26:50.694 [2024-12-08 02:29:18.335685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:10427 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.694 [2024-12-08 02:29:18.335714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:26:50.694 [2024-12-08 02:29:18.347170] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e88f8 00:26:50.694 [2024-12-08 02:29:18.347946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:3531 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.694 [2024-12-08 02:29:18.347977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:26:50.694 [2024-12-08 02:29:18.359270] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f2510 00:26:50.694 [2024-12-08 02:29:18.360826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:21035 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.694 [2024-12-08 02:29:18.360854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:26:50.694 [2024-12-08 02:29:18.371805] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f7538 00:26:50.694 [2024-12-08 02:29:18.372585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:271 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.694 [2024-12-08 02:29:18.372613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:26:50.694 [2024-12-08 02:29:18.384055] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190e6300 00:26:50.694 [2024-12-08 02:29:18.384757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:6201 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.694 [2024-12-08 02:29:18.384785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:26:50.694 [2024-12-08 02:29:18.395909] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190ff3c8 00:26:50.694 [2024-12-08 02:29:18.397127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:5098 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.694 [2024-12-08 02:29:18.397160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:26:50.694 [2024-12-08 02:29:18.408604] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190ed4e8 00:26:50.694 [2024-12-08 02:29:18.410061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:444 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.694 [2024-12-08 02:29:18.410093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0046 p:0 m:0 dnr:0 00:26:50.694 [2024-12-08 02:29:18.421058] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f5be8 00:26:50.694 [2024-12-08 02:29:18.422031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:18640 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.694 [2024-12-08 02:29:18.422062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:26:50.694 [2024-12-08 02:29:18.433629] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f96f8 00:26:50.694 [2024-12-08 02:29:18.435059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:4258 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.694 [2024-12-08 02:29:18.435091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:26:50.694 [2024-12-08 02:29:18.446019] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190fdeb0 00:26:50.694 [2024-12-08 02:29:18.447459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:15080 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.694 [2024-12-08 02:29:18.447490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:26:50.694 [2024-12-08 02:29:18.458348] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f0bc0 00:26:50.694 [2024-12-08 02:29:18.459929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:4068 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.694 [2024-12-08 02:29:18.459961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:26:50.694 [2024-12-08 02:29:18.471499] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190f5378 00:26:50.694 [2024-12-08 02:29:18.472324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:19324 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.694 [2024-12-08 02:29:18.472355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:26:50.954 [2024-12-08 02:29:18.482356] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190ef270 00:26:50.954 [2024-12-08 02:29:18.483651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:6266 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.954 [2024-12-08 02:29:18.483677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:26:50.954 [2024-12-08 02:29:18.494500] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190ef270 00:26:50.954 [2024-12-08 02:29:18.495854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:22119 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.954 [2024-12-08 02:29:18.495900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:50.954 [2024-12-08 02:29:18.506748] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567ad0) with pdu=0x2000190ef270 00:26:50.954 [2024-12-08 02:29:18.507437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:9539 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:50.954 [2024-12-08 02:29:18.507469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:26:50.954 00:26:50.954 Latency(us) 00:26:50.954 [2024-12-08T01:29:18.735Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:50.954 [2024-12-08T01:29:18.735Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:26:50.954 nvme0n1 : 2.00 21272.57 83.10 0.00 0.00 6009.93 2390.85 16019.91 00:26:50.954 [2024-12-08T01:29:18.735Z] =================================================================================================================== 00:26:50.954 [2024-12-08T01:29:18.735Z] Total : 21272.57 83.10 0.00 0.00 6009.93 2390.85 16019.91 00:26:50.954 0 00:26:50.954 02:29:18 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:26:50.954 02:29:18 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:26:50.954 02:29:18 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:26:50.954 02:29:18 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:26:50.954 | .driver_specific 00:26:50.954 | .nvme_error 00:26:50.954 | .status_code 00:26:50.954 | .command_transient_transport_error' 00:26:51.213 02:29:18 -- host/digest.sh@71 -- # (( 167 > 0 )) 00:26:51.213 02:29:18 -- host/digest.sh@73 -- # killprocess 2222917 00:26:51.213 02:29:18 -- common/autotest_common.sh@936 -- # '[' -z 2222917 ']' 00:26:51.213 02:29:18 -- common/autotest_common.sh@940 -- # kill -0 2222917 00:26:51.213 02:29:18 -- common/autotest_common.sh@941 -- # uname 00:26:51.213 02:29:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:51.213 02:29:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2222917 00:26:51.213 02:29:18 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:51.213 02:29:18 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:51.213 02:29:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2222917' 00:26:51.213 killing process with pid 2222917 00:26:51.213 02:29:18 -- common/autotest_common.sh@955 -- # kill 2222917 00:26:51.213 Received shutdown signal, test time was about 2.000000 seconds 00:26:51.213 00:26:51.213 Latency(us) 00:26:51.213 [2024-12-08T01:29:18.994Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:51.213 [2024-12-08T01:29:18.994Z] =================================================================================================================== 00:26:51.213 [2024-12-08T01:29:18.994Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:51.213 02:29:18 -- common/autotest_common.sh@960 -- # wait 2222917 00:26:51.471 02:29:19 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:26:51.471 02:29:19 -- host/digest.sh@54 -- # local rw bs qd 00:26:51.471 02:29:19 -- host/digest.sh@56 -- # rw=randwrite 00:26:51.471 02:29:19 -- host/digest.sh@56 -- # bs=131072 00:26:51.471 02:29:19 -- host/digest.sh@56 -- # qd=16 00:26:51.471 02:29:19 -- host/digest.sh@58 -- # bperfpid=2223466 00:26:51.471 02:29:19 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:26:51.471 02:29:19 -- host/digest.sh@60 -- # waitforlisten 2223466 /var/tmp/bperf.sock 00:26:51.471 02:29:19 -- common/autotest_common.sh@829 -- # '[' -z 2223466 ']' 00:26:51.471 02:29:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:51.471 02:29:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:51.471 02:29:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:51.471 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:51.471 02:29:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:51.471 02:29:19 -- common/autotest_common.sh@10 -- # set +x 00:26:51.471 [2024-12-08 02:29:19.129040] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:51.471 [2024-12-08 02:29:19.129120] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2223466 ] 00:26:51.471 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:51.471 Zero copy mechanism will not be used. 00:26:51.471 EAL: No free 2048 kB hugepages reported on node 1 00:26:51.471 [2024-12-08 02:29:19.189923] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:51.730 [2024-12-08 02:29:19.301194] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:52.665 02:29:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:52.665 02:29:20 -- common/autotest_common.sh@862 -- # return 0 00:26:52.665 02:29:20 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:52.665 02:29:20 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:52.665 02:29:20 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:26:52.665 02:29:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:52.665 02:29:20 -- common/autotest_common.sh@10 -- # set +x 00:26:52.665 02:29:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:52.665 02:29:20 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:52.665 02:29:20 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:53.232 nvme0n1 00:26:53.232 02:29:20 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:26:53.232 02:29:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:53.232 02:29:20 -- common/autotest_common.sh@10 -- # set +x 00:26:53.232 02:29:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:53.232 02:29:20 -- host/digest.sh@69 -- # bperf_py perform_tests 00:26:53.232 02:29:20 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:53.232 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:53.232 Zero copy mechanism will not be used. 00:26:53.232 Running I/O for 2 seconds... 00:26:53.232 [2024-12-08 02:29:20.917240] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.232 [2024-12-08 02:29:20.917522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.232 [2024-12-08 02:29:20.917571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:53.232 [2024-12-08 02:29:20.924098] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.232 [2024-12-08 02:29:20.924337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.232 [2024-12-08 02:29:20.924370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:53.232 [2024-12-08 02:29:20.929396] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.232 [2024-12-08 02:29:20.929589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.232 [2024-12-08 02:29:20.929620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:53.232 [2024-12-08 02:29:20.933789] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.232 [2024-12-08 02:29:20.933935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.232 [2024-12-08 02:29:20.933968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:53.232 [2024-12-08 02:29:20.938475] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.232 [2024-12-08 02:29:20.938563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.232 [2024-12-08 02:29:20.938608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:53.232 [2024-12-08 02:29:20.944003] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.232 [2024-12-08 02:29:20.944165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.232 [2024-12-08 02:29:20.944197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:53.232 [2024-12-08 02:29:20.949606] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.232 [2024-12-08 02:29:20.949824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.232 [2024-12-08 02:29:20.949869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:53.232 [2024-12-08 02:29:20.955732] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.232 [2024-12-08 02:29:20.956062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.232 [2024-12-08 02:29:20.956100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:53.232 [2024-12-08 02:29:20.961525] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.232 [2024-12-08 02:29:20.961753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.232 [2024-12-08 02:29:20.961781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:53.232 [2024-12-08 02:29:20.967843] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.232 [2024-12-08 02:29:20.968041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.232 [2024-12-08 02:29:20.968072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:53.232 [2024-12-08 02:29:20.974269] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.232 [2024-12-08 02:29:20.974430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.232 [2024-12-08 02:29:20.974461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:53.232 [2024-12-08 02:29:20.980559] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.232 [2024-12-08 02:29:20.980747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.232 [2024-12-08 02:29:20.980775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:53.232 [2024-12-08 02:29:20.986733] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.232 [2024-12-08 02:29:20.986956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.232 [2024-12-08 02:29:20.986986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:53.232 [2024-12-08 02:29:20.993229] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.232 [2024-12-08 02:29:20.993426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.232 [2024-12-08 02:29:20.993456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:53.232 [2024-12-08 02:29:20.999719] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.232 [2024-12-08 02:29:20.999921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.232 [2024-12-08 02:29:20.999952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:53.232 [2024-12-08 02:29:21.005944] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.232 [2024-12-08 02:29:21.006093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.232 [2024-12-08 02:29:21.006128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:53.492 [2024-12-08 02:29:21.012158] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.492 [2024-12-08 02:29:21.012259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.492 [2024-12-08 02:29:21.012299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:53.492 [2024-12-08 02:29:21.018791] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.492 [2024-12-08 02:29:21.019084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.492 [2024-12-08 02:29:21.019116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:53.492 [2024-12-08 02:29:21.025328] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.492 [2024-12-08 02:29:21.025447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.492 [2024-12-08 02:29:21.025478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:53.492 [2024-12-08 02:29:21.031171] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.492 [2024-12-08 02:29:21.031321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.492 [2024-12-08 02:29:21.031353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:53.492 [2024-12-08 02:29:21.035901] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.492 [2024-12-08 02:29:21.036028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.492 [2024-12-08 02:29:21.036060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:53.492 [2024-12-08 02:29:21.040367] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.492 [2024-12-08 02:29:21.040473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.492 [2024-12-08 02:29:21.040504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:53.492 [2024-12-08 02:29:21.044863] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.492 [2024-12-08 02:29:21.044966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.492 [2024-12-08 02:29:21.044996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:53.492 [2024-12-08 02:29:21.049418] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.492 [2024-12-08 02:29:21.049598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.492 [2024-12-08 02:29:21.049627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:53.492 [2024-12-08 02:29:21.053984] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.492 [2024-12-08 02:29:21.054194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.492 [2024-12-08 02:29:21.054231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:53.492 [2024-12-08 02:29:21.058406] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.492 [2024-12-08 02:29:21.058586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.492 [2024-12-08 02:29:21.058632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:53.492 [2024-12-08 02:29:21.062935] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.492 [2024-12-08 02:29:21.063080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.492 [2024-12-08 02:29:21.063112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:53.492 [2024-12-08 02:29:21.067471] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.492 [2024-12-08 02:29:21.067651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.492 [2024-12-08 02:29:21.067680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:53.492 [2024-12-08 02:29:21.071948] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.492 [2024-12-08 02:29:21.072072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.492 [2024-12-08 02:29:21.072104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:53.492 [2024-12-08 02:29:21.076311] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.492 [2024-12-08 02:29:21.076424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.492 [2024-12-08 02:29:21.076454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:53.492 [2024-12-08 02:29:21.080785] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.492 [2024-12-08 02:29:21.080963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.492 [2024-12-08 02:29:21.080995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:53.492 [2024-12-08 02:29:21.085304] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.492 [2024-12-08 02:29:21.085465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.492 [2024-12-08 02:29:21.085497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:53.492 [2024-12-08 02:29:21.089764] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.492 [2024-12-08 02:29:21.089993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.492 [2024-12-08 02:29:21.090024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:53.492 [2024-12-08 02:29:21.094205] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.492 [2024-12-08 02:29:21.094360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.492 [2024-12-08 02:29:21.094391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:53.493 [2024-12-08 02:29:21.098702] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.493 [2024-12-08 02:29:21.098829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.493 [2024-12-08 02:29:21.098857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:53.493 [2024-12-08 02:29:21.103184] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.493 [2024-12-08 02:29:21.103355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.493 [2024-12-08 02:29:21.103387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:53.493 [2024-12-08 02:29:21.107609] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.493 [2024-12-08 02:29:21.107714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.493 [2024-12-08 02:29:21.107742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:53.493 [2024-12-08 02:29:21.111977] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.493 [2024-12-08 02:29:21.112097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.493 [2024-12-08 02:29:21.112128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:53.493 [2024-12-08 02:29:21.116409] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.493 [2024-12-08 02:29:21.116601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.493 [2024-12-08 02:29:21.116629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:53.493 [2024-12-08 02:29:21.120906] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.493 [2024-12-08 02:29:21.121047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.493 [2024-12-08 02:29:21.121078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:53.493 [2024-12-08 02:29:21.125350] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.493 [2024-12-08 02:29:21.125597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.493 [2024-12-08 02:29:21.125625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:53.493 [2024-12-08 02:29:21.129796] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.493 [2024-12-08 02:29:21.129981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.493 [2024-12-08 02:29:21.130011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:53.493 [2024-12-08 02:29:21.134287] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.493 [2024-12-08 02:29:21.134454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.493 [2024-12-08 02:29:21.134485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:53.493 [2024-12-08 02:29:21.139325] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.493 [2024-12-08 02:29:21.139624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.493 [2024-12-08 02:29:21.139653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:53.493 [2024-12-08 02:29:21.144269] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.493 [2024-12-08 02:29:21.144481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.493 [2024-12-08 02:29:21.144512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:53.493 [2024-12-08 02:29:21.150627] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.493 [2024-12-08 02:29:21.150766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.493 [2024-12-08 02:29:21.150793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:53.493 [2024-12-08 02:29:21.155978] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.493 [2024-12-08 02:29:21.156224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.493 [2024-12-08 02:29:21.156254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:53.493 [2024-12-08 02:29:21.161263] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.493 [2024-12-08 02:29:21.161510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.493 [2024-12-08 02:29:21.161548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:53.493 [2024-12-08 02:29:21.166568] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.493 [2024-12-08 02:29:21.166691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.493 [2024-12-08 02:29:21.166719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:53.493 [2024-12-08 02:29:21.171975] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.493 [2024-12-08 02:29:21.172211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.493 [2024-12-08 02:29:21.172242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:53.493 [2024-12-08 02:29:21.177326] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.493 [2024-12-08 02:29:21.177502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.493 [2024-12-08 02:29:21.177549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:53.493 [2024-12-08 02:29:21.182594] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.493 [2024-12-08 02:29:21.182833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.493 [2024-12-08 02:29:21.182877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:53.493 [2024-12-08 02:29:21.188073] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.493 [2024-12-08 02:29:21.188400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.493 [2024-12-08 02:29:21.188431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:53.493 [2024-12-08 02:29:21.193489] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.493 [2024-12-08 02:29:21.193754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.493 [2024-12-08 02:29:21.193783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:53.493 [2024-12-08 02:29:21.198810] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.493 [2024-12-08 02:29:21.198978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.493 [2024-12-08 02:29:21.199008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:53.493 [2024-12-08 02:29:21.204221] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.493 [2024-12-08 02:29:21.204457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.493 [2024-12-08 02:29:21.204489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:53.493 [2024-12-08 02:29:21.209551] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.493 [2024-12-08 02:29:21.209757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.493 [2024-12-08 02:29:21.209785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:53.493 [2024-12-08 02:29:21.215027] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.493 [2024-12-08 02:29:21.215255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.493 [2024-12-08 02:29:21.215286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:53.493 [2024-12-08 02:29:21.220515] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.493 [2024-12-08 02:29:21.220639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.493 [2024-12-08 02:29:21.220666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:53.493 [2024-12-08 02:29:21.225472] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.493 [2024-12-08 02:29:21.225663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.493 [2024-12-08 02:29:21.225692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:53.493 [2024-12-08 02:29:21.230801] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.493 [2024-12-08 02:29:21.230992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.493 [2024-12-08 02:29:21.231024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:53.494 [2024-12-08 02:29:21.236292] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.494 [2024-12-08 02:29:21.236555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.494 [2024-12-08 02:29:21.236600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:53.494 [2024-12-08 02:29:21.241749] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.494 [2024-12-08 02:29:21.242022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.494 [2024-12-08 02:29:21.242054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:53.494 [2024-12-08 02:29:21.246951] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.494 [2024-12-08 02:29:21.247131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.494 [2024-12-08 02:29:21.247162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:53.494 [2024-12-08 02:29:21.252151] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.494 [2024-12-08 02:29:21.252343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.494 [2024-12-08 02:29:21.252374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:53.494 [2024-12-08 02:29:21.257384] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.494 [2024-12-08 02:29:21.257518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.494 [2024-12-08 02:29:21.257559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:53.494 [2024-12-08 02:29:21.263613] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.494 [2024-12-08 02:29:21.263759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.494 [2024-12-08 02:29:21.263787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:53.494 [2024-12-08 02:29:21.268378] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.494 [2024-12-08 02:29:21.268487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.494 [2024-12-08 02:29:21.268517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:53.753 [2024-12-08 02:29:21.272979] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.753 [2024-12-08 02:29:21.273142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.753 [2024-12-08 02:29:21.273173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:53.753 [2024-12-08 02:29:21.277618] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.753 [2024-12-08 02:29:21.277785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.753 [2024-12-08 02:29:21.277814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:53.753 [2024-12-08 02:29:21.282253] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.753 [2024-12-08 02:29:21.282436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.753 [2024-12-08 02:29:21.282468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:53.753 [2024-12-08 02:29:21.286741] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.753 [2024-12-08 02:29:21.286969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.753 [2024-12-08 02:29:21.287000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:53.753 [2024-12-08 02:29:21.291340] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.753 [2024-12-08 02:29:21.291501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.753 [2024-12-08 02:29:21.291532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:53.754 [2024-12-08 02:29:21.295946] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.754 [2024-12-08 02:29:21.296135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.754 [2024-12-08 02:29:21.296166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:53.754 [2024-12-08 02:29:21.300946] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.754 [2024-12-08 02:29:21.301134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.754 [2024-12-08 02:29:21.301164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:53.754 [2024-12-08 02:29:21.305661] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.754 [2024-12-08 02:29:21.305847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.754 [2024-12-08 02:29:21.305878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:53.754 [2024-12-08 02:29:21.310250] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.754 [2024-12-08 02:29:21.310427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.754 [2024-12-08 02:29:21.310465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:53.754 [2024-12-08 02:29:21.315306] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.754 [2024-12-08 02:29:21.315583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.754 [2024-12-08 02:29:21.315612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:53.754 [2024-12-08 02:29:21.320596] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.754 [2024-12-08 02:29:21.320838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.754 [2024-12-08 02:29:21.320881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:53.754 [2024-12-08 02:29:21.325636] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.754 [2024-12-08 02:29:21.325768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.754 [2024-12-08 02:29:21.325796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:53.754 [2024-12-08 02:29:21.330380] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.754 [2024-12-08 02:29:21.330533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.754 [2024-12-08 02:29:21.330588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:53.754 [2024-12-08 02:29:21.335675] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.754 [2024-12-08 02:29:21.335847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.754 [2024-12-08 02:29:21.335878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:53.754 [2024-12-08 02:29:21.340514] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.754 [2024-12-08 02:29:21.340703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.754 [2024-12-08 02:29:21.340731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:53.754 [2024-12-08 02:29:21.345929] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.754 [2024-12-08 02:29:21.346100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.754 [2024-12-08 02:29:21.346130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:53.754 [2024-12-08 02:29:21.351590] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.754 [2024-12-08 02:29:21.351724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.754 [2024-12-08 02:29:21.351752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:53.754 [2024-12-08 02:29:21.356759] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.754 [2024-12-08 02:29:21.357018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.754 [2024-12-08 02:29:21.357050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:53.754 [2024-12-08 02:29:21.362097] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.754 [2024-12-08 02:29:21.362268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.754 [2024-12-08 02:29:21.362299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:53.754 [2024-12-08 02:29:21.367533] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.754 [2024-12-08 02:29:21.367711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.754 [2024-12-08 02:29:21.367739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:53.754 [2024-12-08 02:29:21.372981] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.754 [2024-12-08 02:29:21.373156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.754 [2024-12-08 02:29:21.373187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:53.754 [2024-12-08 02:29:21.378250] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.754 [2024-12-08 02:29:21.378409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.754 [2024-12-08 02:29:21.378440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:53.754 [2024-12-08 02:29:21.384496] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.754 [2024-12-08 02:29:21.384702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.754 [2024-12-08 02:29:21.384729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:53.754 [2024-12-08 02:29:21.389886] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.754 [2024-12-08 02:29:21.390003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.754 [2024-12-08 02:29:21.390033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:53.754 [2024-12-08 02:29:21.394511] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.754 [2024-12-08 02:29:21.394683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.754 [2024-12-08 02:29:21.394711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:53.754 [2024-12-08 02:29:21.398940] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.754 [2024-12-08 02:29:21.399054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.754 [2024-12-08 02:29:21.399091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:53.754 [2024-12-08 02:29:21.403864] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.754 [2024-12-08 02:29:21.403986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.754 [2024-12-08 02:29:21.404016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:53.754 [2024-12-08 02:29:21.409557] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.754 [2024-12-08 02:29:21.409706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.754 [2024-12-08 02:29:21.409734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:53.754 [2024-12-08 02:29:21.415526] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.754 [2024-12-08 02:29:21.415636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.754 [2024-12-08 02:29:21.415663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:53.754 [2024-12-08 02:29:21.420783] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.754 [2024-12-08 02:29:21.420933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.754 [2024-12-08 02:29:21.420965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:53.754 [2024-12-08 02:29:21.425382] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.754 [2024-12-08 02:29:21.425495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.754 [2024-12-08 02:29:21.425525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:53.754 [2024-12-08 02:29:21.429991] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.754 [2024-12-08 02:29:21.430198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.754 [2024-12-08 02:29:21.430230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:53.755 [2024-12-08 02:29:21.434552] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.755 [2024-12-08 02:29:21.434760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.755 [2024-12-08 02:29:21.434789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:53.755 [2024-12-08 02:29:21.439022] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.755 [2024-12-08 02:29:21.439216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.755 [2024-12-08 02:29:21.439247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:53.755 [2024-12-08 02:29:21.443476] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.755 [2024-12-08 02:29:21.443640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.755 [2024-12-08 02:29:21.443668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:53.755 [2024-12-08 02:29:21.447875] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.755 [2024-12-08 02:29:21.447986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.755 [2024-12-08 02:29:21.448017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:53.755 [2024-12-08 02:29:21.452340] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.755 [2024-12-08 02:29:21.452490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.755 [2024-12-08 02:29:21.452522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:53.755 [2024-12-08 02:29:21.456753] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.755 [2024-12-08 02:29:21.456914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.755 [2024-12-08 02:29:21.456945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:53.755 [2024-12-08 02:29:21.461153] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.755 [2024-12-08 02:29:21.461273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.755 [2024-12-08 02:29:21.461305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:53.755 [2024-12-08 02:29:21.465655] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.755 [2024-12-08 02:29:21.465862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.755 [2024-12-08 02:29:21.465893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:53.755 [2024-12-08 02:29:21.470076] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.755 [2024-12-08 02:29:21.470256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.755 [2024-12-08 02:29:21.470287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:53.755 [2024-12-08 02:29:21.474522] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.755 [2024-12-08 02:29:21.474731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.755 [2024-12-08 02:29:21.474760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:53.755 [2024-12-08 02:29:21.478948] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.755 [2024-12-08 02:29:21.479121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.755 [2024-12-08 02:29:21.479152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:53.755 [2024-12-08 02:29:21.483342] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.755 [2024-12-08 02:29:21.483457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.755 [2024-12-08 02:29:21.483489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:53.755 [2024-12-08 02:29:21.487773] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.755 [2024-12-08 02:29:21.487955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.755 [2024-12-08 02:29:21.487986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:53.755 [2024-12-08 02:29:21.492267] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.755 [2024-12-08 02:29:21.492413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.755 [2024-12-08 02:29:21.492443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:53.755 [2024-12-08 02:29:21.496634] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.755 [2024-12-08 02:29:21.496729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.755 [2024-12-08 02:29:21.496760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:53.755 [2024-12-08 02:29:21.501104] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.755 [2024-12-08 02:29:21.501307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.755 [2024-12-08 02:29:21.501338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:53.755 [2024-12-08 02:29:21.505534] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.755 [2024-12-08 02:29:21.505725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.755 [2024-12-08 02:29:21.505753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:53.755 [2024-12-08 02:29:21.509989] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.755 [2024-12-08 02:29:21.510185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.755 [2024-12-08 02:29:21.510216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:53.755 [2024-12-08 02:29:21.514386] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.755 [2024-12-08 02:29:21.514530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.755 [2024-12-08 02:29:21.514585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:53.755 [2024-12-08 02:29:21.518718] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.755 [2024-12-08 02:29:21.518852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.755 [2024-12-08 02:29:21.518889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:53.755 [2024-12-08 02:29:21.523113] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.755 [2024-12-08 02:29:21.523271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.755 [2024-12-08 02:29:21.523301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:53.755 [2024-12-08 02:29:21.527581] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.755 [2024-12-08 02:29:21.527723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.755 [2024-12-08 02:29:21.527751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:53.755 [2024-12-08 02:29:21.531945] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:53.755 [2024-12-08 02:29:21.532079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:53.755 [2024-12-08 02:29:21.532109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.015 [2024-12-08 02:29:21.536408] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.015 [2024-12-08 02:29:21.536635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.015 [2024-12-08 02:29:21.536664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.015 [2024-12-08 02:29:21.540806] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.015 [2024-12-08 02:29:21.541010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.015 [2024-12-08 02:29:21.541041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.015 [2024-12-08 02:29:21.545235] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.015 [2024-12-08 02:29:21.545423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.015 [2024-12-08 02:29:21.545455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.015 [2024-12-08 02:29:21.549640] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.015 [2024-12-08 02:29:21.549750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.015 [2024-12-08 02:29:21.549778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.015 [2024-12-08 02:29:21.554014] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.015 [2024-12-08 02:29:21.554132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.015 [2024-12-08 02:29:21.554163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.015 [2024-12-08 02:29:21.558438] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.015 [2024-12-08 02:29:21.558619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.015 [2024-12-08 02:29:21.558648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.015 [2024-12-08 02:29:21.562786] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.015 [2024-12-08 02:29:21.562951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.015 [2024-12-08 02:29:21.562982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.015 [2024-12-08 02:29:21.567192] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.015 [2024-12-08 02:29:21.567311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.015 [2024-12-08 02:29:21.567341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.015 [2024-12-08 02:29:21.571665] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.015 [2024-12-08 02:29:21.571870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.015 [2024-12-08 02:29:21.571901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.015 [2024-12-08 02:29:21.576061] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.015 [2024-12-08 02:29:21.576275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.015 [2024-12-08 02:29:21.576306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.015 [2024-12-08 02:29:21.580446] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.015 [2024-12-08 02:29:21.580653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.015 [2024-12-08 02:29:21.580682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.015 [2024-12-08 02:29:21.584845] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.015 [2024-12-08 02:29:21.584973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.015 [2024-12-08 02:29:21.585004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.015 [2024-12-08 02:29:21.589180] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.015 [2024-12-08 02:29:21.589290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.015 [2024-12-08 02:29:21.589321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.015 [2024-12-08 02:29:21.593580] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.015 [2024-12-08 02:29:21.593720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.015 [2024-12-08 02:29:21.593748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.015 [2024-12-08 02:29:21.597987] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.015 [2024-12-08 02:29:21.598140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.015 [2024-12-08 02:29:21.598171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.015 [2024-12-08 02:29:21.602352] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.015 [2024-12-08 02:29:21.602472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.015 [2024-12-08 02:29:21.602503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.015 [2024-12-08 02:29:21.606806] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.015 [2024-12-08 02:29:21.607020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.015 [2024-12-08 02:29:21.607051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.015 [2024-12-08 02:29:21.611188] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.015 [2024-12-08 02:29:21.611379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.015 [2024-12-08 02:29:21.611410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.015 [2024-12-08 02:29:21.615693] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.015 [2024-12-08 02:29:21.615880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.015 [2024-12-08 02:29:21.615911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.015 [2024-12-08 02:29:21.620052] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.015 [2024-12-08 02:29:21.620175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.015 [2024-12-08 02:29:21.620206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.015 [2024-12-08 02:29:21.624423] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.015 [2024-12-08 02:29:21.624554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.015 [2024-12-08 02:29:21.624599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.015 [2024-12-08 02:29:21.628799] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.015 [2024-12-08 02:29:21.628988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.015 [2024-12-08 02:29:21.629019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.015 [2024-12-08 02:29:21.633477] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.015 [2024-12-08 02:29:21.633702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.015 [2024-12-08 02:29:21.633735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.015 [2024-12-08 02:29:21.638645] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.015 [2024-12-08 02:29:21.638900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.015 [2024-12-08 02:29:21.638931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.015 [2024-12-08 02:29:21.644408] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.016 [2024-12-08 02:29:21.644624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.016 [2024-12-08 02:29:21.644652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.016 [2024-12-08 02:29:21.650252] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.016 [2024-12-08 02:29:21.650414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.016 [2024-12-08 02:29:21.650445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.016 [2024-12-08 02:29:21.654829] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.016 [2024-12-08 02:29:21.654975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.016 [2024-12-08 02:29:21.655006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.016 [2024-12-08 02:29:21.659425] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.016 [2024-12-08 02:29:21.659627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.016 [2024-12-08 02:29:21.659656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.016 [2024-12-08 02:29:21.663883] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.016 [2024-12-08 02:29:21.663994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.016 [2024-12-08 02:29:21.664024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.016 [2024-12-08 02:29:21.668465] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.016 [2024-12-08 02:29:21.668626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.016 [2024-12-08 02:29:21.668654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.016 [2024-12-08 02:29:21.673785] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.016 [2024-12-08 02:29:21.673969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.016 [2024-12-08 02:29:21.674001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.016 [2024-12-08 02:29:21.678430] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.016 [2024-12-08 02:29:21.678679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.016 [2024-12-08 02:29:21.678708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.016 [2024-12-08 02:29:21.683810] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.016 [2024-12-08 02:29:21.684072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.016 [2024-12-08 02:29:21.684104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.016 [2024-12-08 02:29:21.689064] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.016 [2024-12-08 02:29:21.689346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.016 [2024-12-08 02:29:21.689377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.016 [2024-12-08 02:29:21.694172] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.016 [2024-12-08 02:29:21.694404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.016 [2024-12-08 02:29:21.694435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.016 [2024-12-08 02:29:21.699200] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.016 [2024-12-08 02:29:21.699413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.016 [2024-12-08 02:29:21.699443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.016 [2024-12-08 02:29:21.704260] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.016 [2024-12-08 02:29:21.704458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.016 [2024-12-08 02:29:21.704488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.016 [2024-12-08 02:29:21.709367] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.016 [2024-12-08 02:29:21.709522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.016 [2024-12-08 02:29:21.709563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.016 [2024-12-08 02:29:21.714484] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.016 [2024-12-08 02:29:21.714692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.016 [2024-12-08 02:29:21.714721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.016 [2024-12-08 02:29:21.719491] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.016 [2024-12-08 02:29:21.719676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.016 [2024-12-08 02:29:21.719709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.016 [2024-12-08 02:29:21.725162] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.016 [2024-12-08 02:29:21.725424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.016 [2024-12-08 02:29:21.725455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.016 [2024-12-08 02:29:21.731098] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.016 [2024-12-08 02:29:21.731302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.016 [2024-12-08 02:29:21.731332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.016 [2024-12-08 02:29:21.737639] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.016 [2024-12-08 02:29:21.737824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.016 [2024-12-08 02:29:21.737855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.016 [2024-12-08 02:29:21.743406] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.016 [2024-12-08 02:29:21.743484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.016 [2024-12-08 02:29:21.743512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.016 [2024-12-08 02:29:21.748351] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.016 [2024-12-08 02:29:21.748458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.016 [2024-12-08 02:29:21.748489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.016 [2024-12-08 02:29:21.752872] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.016 [2024-12-08 02:29:21.752985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.016 [2024-12-08 02:29:21.753017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.016 [2024-12-08 02:29:21.757431] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.016 [2024-12-08 02:29:21.757530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.016 [2024-12-08 02:29:21.757583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.016 [2024-12-08 02:29:21.762767] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.016 [2024-12-08 02:29:21.762995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.016 [2024-12-08 02:29:21.763036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.016 [2024-12-08 02:29:21.768142] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.016 [2024-12-08 02:29:21.768288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.016 [2024-12-08 02:29:21.768319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.016 [2024-12-08 02:29:21.774392] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.016 [2024-12-08 02:29:21.774644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.016 [2024-12-08 02:29:21.774672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.016 [2024-12-08 02:29:21.779834] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.016 [2024-12-08 02:29:21.780091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.016 [2024-12-08 02:29:21.780123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.016 [2024-12-08 02:29:21.785171] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.017 [2024-12-08 02:29:21.785318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.017 [2024-12-08 02:29:21.785349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.017 [2024-12-08 02:29:21.790753] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.017 [2024-12-08 02:29:21.790981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.017 [2024-12-08 02:29:21.791012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.276 [2024-12-08 02:29:21.796088] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.276 [2024-12-08 02:29:21.796238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.276 [2024-12-08 02:29:21.796269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.276 [2024-12-08 02:29:21.801355] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.276 [2024-12-08 02:29:21.801501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.276 [2024-12-08 02:29:21.801531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.276 [2024-12-08 02:29:21.806839] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.276 [2024-12-08 02:29:21.807033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.276 [2024-12-08 02:29:21.807064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.276 [2024-12-08 02:29:21.812202] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.276 [2024-12-08 02:29:21.812347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.276 [2024-12-08 02:29:21.812376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.276 [2024-12-08 02:29:21.817441] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.276 [2024-12-08 02:29:21.817704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.276 [2024-12-08 02:29:21.817733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.276 [2024-12-08 02:29:21.822943] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.276 [2024-12-08 02:29:21.823200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.276 [2024-12-08 02:29:21.823232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.276 [2024-12-08 02:29:21.828643] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.276 [2024-12-08 02:29:21.828798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.276 [2024-12-08 02:29:21.828826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.276 [2024-12-08 02:29:21.834091] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.276 [2024-12-08 02:29:21.834271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.276 [2024-12-08 02:29:21.834301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.276 [2024-12-08 02:29:21.839454] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.276 [2024-12-08 02:29:21.839682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.277 [2024-12-08 02:29:21.839711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.277 [2024-12-08 02:29:21.843964] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.277 [2024-12-08 02:29:21.844133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.277 [2024-12-08 02:29:21.844166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.277 [2024-12-08 02:29:21.848412] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.277 [2024-12-08 02:29:21.848547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.277 [2024-12-08 02:29:21.848579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.277 [2024-12-08 02:29:21.854180] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.277 [2024-12-08 02:29:21.854312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.277 [2024-12-08 02:29:21.854343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.277 [2024-12-08 02:29:21.858644] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.277 [2024-12-08 02:29:21.858817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.277 [2024-12-08 02:29:21.858862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.277 [2024-12-08 02:29:21.862879] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.277 [2024-12-08 02:29:21.863046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.277 [2024-12-08 02:29:21.863078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.277 [2024-12-08 02:29:21.867267] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.277 [2024-12-08 02:29:21.867389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.277 [2024-12-08 02:29:21.867420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.277 [2024-12-08 02:29:21.871661] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.277 [2024-12-08 02:29:21.871771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.277 [2024-12-08 02:29:21.871799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.277 [2024-12-08 02:29:21.876034] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.277 [2024-12-08 02:29:21.876184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.277 [2024-12-08 02:29:21.876215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.277 [2024-12-08 02:29:21.880414] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.277 [2024-12-08 02:29:21.880534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.277 [2024-12-08 02:29:21.880588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.277 [2024-12-08 02:29:21.884869] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.277 [2024-12-08 02:29:21.884983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.277 [2024-12-08 02:29:21.885013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.277 [2024-12-08 02:29:21.889369] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.277 [2024-12-08 02:29:21.889597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.277 [2024-12-08 02:29:21.889625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.277 [2024-12-08 02:29:21.893779] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.277 [2024-12-08 02:29:21.893971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.277 [2024-12-08 02:29:21.894002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.277 [2024-12-08 02:29:21.898216] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.277 [2024-12-08 02:29:21.898410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.277 [2024-12-08 02:29:21.898442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.277 [2024-12-08 02:29:21.902547] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.277 [2024-12-08 02:29:21.902721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.277 [2024-12-08 02:29:21.902749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.277 [2024-12-08 02:29:21.907257] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.277 [2024-12-08 02:29:21.907388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.277 [2024-12-08 02:29:21.907419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.277 [2024-12-08 02:29:21.912588] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.277 [2024-12-08 02:29:21.912758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.277 [2024-12-08 02:29:21.912786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.277 [2024-12-08 02:29:21.917077] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.277 [2024-12-08 02:29:21.917234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.277 [2024-12-08 02:29:21.917265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.277 [2024-12-08 02:29:21.921482] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.277 [2024-12-08 02:29:21.921622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.277 [2024-12-08 02:29:21.921649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.277 [2024-12-08 02:29:21.925990] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.277 [2024-12-08 02:29:21.926198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.277 [2024-12-08 02:29:21.926230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.277 [2024-12-08 02:29:21.930490] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.277 [2024-12-08 02:29:21.930709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.277 [2024-12-08 02:29:21.930738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.277 [2024-12-08 02:29:21.936025] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.277 [2024-12-08 02:29:21.936279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.277 [2024-12-08 02:29:21.936312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.277 [2024-12-08 02:29:21.940886] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.277 [2024-12-08 02:29:21.941066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.277 [2024-12-08 02:29:21.941097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.277 [2024-12-08 02:29:21.945303] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.277 [2024-12-08 02:29:21.945436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.277 [2024-12-08 02:29:21.945467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.277 [2024-12-08 02:29:21.949956] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.277 [2024-12-08 02:29:21.950086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.277 [2024-12-08 02:29:21.950116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.277 [2024-12-08 02:29:21.955522] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.277 [2024-12-08 02:29:21.955729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.277 [2024-12-08 02:29:21.955755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.277 [2024-12-08 02:29:21.961139] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.277 [2024-12-08 02:29:21.961278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.277 [2024-12-08 02:29:21.961309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.277 [2024-12-08 02:29:21.965636] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.277 [2024-12-08 02:29:21.965752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.277 [2024-12-08 02:29:21.965780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.278 [2024-12-08 02:29:21.970398] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.278 [2024-12-08 02:29:21.970615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.278 [2024-12-08 02:29:21.970644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.278 [2024-12-08 02:29:21.974852] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.278 [2024-12-08 02:29:21.975077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.278 [2024-12-08 02:29:21.975108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.278 [2024-12-08 02:29:21.979881] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.278 [2024-12-08 02:29:21.980131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.278 [2024-12-08 02:29:21.980167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.278 [2024-12-08 02:29:21.984670] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.278 [2024-12-08 02:29:21.984818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.278 [2024-12-08 02:29:21.984846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.278 [2024-12-08 02:29:21.989125] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.278 [2024-12-08 02:29:21.989243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.278 [2024-12-08 02:29:21.989275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.278 [2024-12-08 02:29:21.993680] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.278 [2024-12-08 02:29:21.993917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.278 [2024-12-08 02:29:21.993948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.278 [2024-12-08 02:29:21.999353] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.278 [2024-12-08 02:29:21.999621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.278 [2024-12-08 02:29:21.999649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.278 [2024-12-08 02:29:22.005031] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.278 [2024-12-08 02:29:22.005231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.278 [2024-12-08 02:29:22.005262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.278 [2024-12-08 02:29:22.009764] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.278 [2024-12-08 02:29:22.009942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.278 [2024-12-08 02:29:22.009973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.278 [2024-12-08 02:29:22.014375] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.278 [2024-12-08 02:29:22.014524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.278 [2024-12-08 02:29:22.014578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.278 [2024-12-08 02:29:22.018973] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.278 [2024-12-08 02:29:22.019100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.278 [2024-12-08 02:29:22.019130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.278 [2024-12-08 02:29:22.023436] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.278 [2024-12-08 02:29:22.023622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.278 [2024-12-08 02:29:22.023649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.278 [2024-12-08 02:29:22.028532] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.278 [2024-12-08 02:29:22.028655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.278 [2024-12-08 02:29:22.028681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.278 [2024-12-08 02:29:22.033965] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.278 [2024-12-08 02:29:22.034155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.278 [2024-12-08 02:29:22.034186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.278 [2024-12-08 02:29:22.038590] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.278 [2024-12-08 02:29:22.038751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.278 [2024-12-08 02:29:22.038780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.278 [2024-12-08 02:29:22.043029] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.278 [2024-12-08 02:29:22.043256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.278 [2024-12-08 02:29:22.043288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.278 [2024-12-08 02:29:22.047455] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.278 [2024-12-08 02:29:22.047644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.278 [2024-12-08 02:29:22.047672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.278 [2024-12-08 02:29:22.051806] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.278 [2024-12-08 02:29:22.051950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.278 [2024-12-08 02:29:22.051983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.538 [2024-12-08 02:29:22.056154] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.538 [2024-12-08 02:29:22.056317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.538 [2024-12-08 02:29:22.056348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.538 [2024-12-08 02:29:22.060389] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.538 [2024-12-08 02:29:22.060512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.538 [2024-12-08 02:29:22.060552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.538 [2024-12-08 02:29:22.064829] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.538 [2024-12-08 02:29:22.064948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.538 [2024-12-08 02:29:22.064979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.538 [2024-12-08 02:29:22.069839] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.538 [2024-12-08 02:29:22.070032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.538 [2024-12-08 02:29:22.070063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.538 [2024-12-08 02:29:22.075147] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.538 [2024-12-08 02:29:22.075371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.538 [2024-12-08 02:29:22.075403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.538 [2024-12-08 02:29:22.080852] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.538 [2024-12-08 02:29:22.081125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.538 [2024-12-08 02:29:22.081156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.538 [2024-12-08 02:29:22.086996] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.538 [2024-12-08 02:29:22.087180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.538 [2024-12-08 02:29:22.087211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.538 [2024-12-08 02:29:22.092462] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.538 [2024-12-08 02:29:22.092629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.538 [2024-12-08 02:29:22.092657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.538 [2024-12-08 02:29:22.098025] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.538 [2024-12-08 02:29:22.098303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.538 [2024-12-08 02:29:22.098333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.538 [2024-12-08 02:29:22.103440] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.538 [2024-12-08 02:29:22.103638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.538 [2024-12-08 02:29:22.103666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.538 [2024-12-08 02:29:22.108972] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.538 [2024-12-08 02:29:22.109087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.538 [2024-12-08 02:29:22.109125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.538 [2024-12-08 02:29:22.114373] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.538 [2024-12-08 02:29:22.114535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.538 [2024-12-08 02:29:22.114593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.538 [2024-12-08 02:29:22.119760] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.538 [2024-12-08 02:29:22.119987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.538 [2024-12-08 02:29:22.120019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.538 [2024-12-08 02:29:22.125300] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.538 [2024-12-08 02:29:22.125600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.538 [2024-12-08 02:29:22.125629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.538 [2024-12-08 02:29:22.130768] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.538 [2024-12-08 02:29:22.131027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.538 [2024-12-08 02:29:22.131058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.538 [2024-12-08 02:29:22.136115] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.538 [2024-12-08 02:29:22.136345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.538 [2024-12-08 02:29:22.136376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.538 [2024-12-08 02:29:22.141489] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.538 [2024-12-08 02:29:22.141662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.538 [2024-12-08 02:29:22.141690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.538 [2024-12-08 02:29:22.146643] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.538 [2024-12-08 02:29:22.146811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.538 [2024-12-08 02:29:22.146857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.538 [2024-12-08 02:29:22.151125] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.538 [2024-12-08 02:29:22.151275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.538 [2024-12-08 02:29:22.151306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.539 [2024-12-08 02:29:22.156066] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.539 [2024-12-08 02:29:22.156204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.539 [2024-12-08 02:29:22.156234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.539 [2024-12-08 02:29:22.161489] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.539 [2024-12-08 02:29:22.161663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.539 [2024-12-08 02:29:22.161691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.539 [2024-12-08 02:29:22.165865] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.539 [2024-12-08 02:29:22.165979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.539 [2024-12-08 02:29:22.166009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.539 [2024-12-08 02:29:22.170220] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.539 [2024-12-08 02:29:22.170342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.539 [2024-12-08 02:29:22.170372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.539 [2024-12-08 02:29:22.174718] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.539 [2024-12-08 02:29:22.174835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.539 [2024-12-08 02:29:22.174878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.539 [2024-12-08 02:29:22.179118] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.539 [2024-12-08 02:29:22.179217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.539 [2024-12-08 02:29:22.179246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.539 [2024-12-08 02:29:22.183665] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.539 [2024-12-08 02:29:22.183865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.539 [2024-12-08 02:29:22.183897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.539 [2024-12-08 02:29:22.188353] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.539 [2024-12-08 02:29:22.188560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.539 [2024-12-08 02:29:22.188606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.539 [2024-12-08 02:29:22.193201] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.539 [2024-12-08 02:29:22.193429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.539 [2024-12-08 02:29:22.193465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.539 [2024-12-08 02:29:22.197701] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.539 [2024-12-08 02:29:22.197926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.539 [2024-12-08 02:29:22.197957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.539 [2024-12-08 02:29:22.202302] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.539 [2024-12-08 02:29:22.202379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.539 [2024-12-08 02:29:22.202408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.539 [2024-12-08 02:29:22.206995] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.539 [2024-12-08 02:29:22.207218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.539 [2024-12-08 02:29:22.207248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.539 [2024-12-08 02:29:22.211508] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.539 [2024-12-08 02:29:22.211692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.539 [2024-12-08 02:29:22.211720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.539 [2024-12-08 02:29:22.216096] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.539 [2024-12-08 02:29:22.216276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.539 [2024-12-08 02:29:22.216306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.539 [2024-12-08 02:29:22.220880] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.539 [2024-12-08 02:29:22.221127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.539 [2024-12-08 02:29:22.221157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.539 [2024-12-08 02:29:22.225440] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.539 [2024-12-08 02:29:22.225551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.539 [2024-12-08 02:29:22.225581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.539 [2024-12-08 02:29:22.229903] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.539 [2024-12-08 02:29:22.230043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.539 [2024-12-08 02:29:22.230074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.539 [2024-12-08 02:29:22.235229] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.539 [2024-12-08 02:29:22.235481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.539 [2024-12-08 02:29:22.235511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.539 [2024-12-08 02:29:22.240375] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.539 [2024-12-08 02:29:22.240554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.539 [2024-12-08 02:29:22.240600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.539 [2024-12-08 02:29:22.246936] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.539 [2024-12-08 02:29:22.247145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.539 [2024-12-08 02:29:22.247176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.539 [2024-12-08 02:29:22.251663] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.539 [2024-12-08 02:29:22.251778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.539 [2024-12-08 02:29:22.251805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.539 [2024-12-08 02:29:22.256130] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.539 [2024-12-08 02:29:22.256222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.539 [2024-12-08 02:29:22.256250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.539 [2024-12-08 02:29:22.260677] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.539 [2024-12-08 02:29:22.260800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.539 [2024-12-08 02:29:22.260828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.539 [2024-12-08 02:29:22.265216] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.539 [2024-12-08 02:29:22.265428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.539 [2024-12-08 02:29:22.265459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.539 [2024-12-08 02:29:22.269525] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.539 [2024-12-08 02:29:22.269669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.539 [2024-12-08 02:29:22.269697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.539 [2024-12-08 02:29:22.274044] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.539 [2024-12-08 02:29:22.274221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.539 [2024-12-08 02:29:22.274252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.539 [2024-12-08 02:29:22.278409] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.539 [2024-12-08 02:29:22.278511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.539 [2024-12-08 02:29:22.278548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.539 [2024-12-08 02:29:22.282868] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.540 [2024-12-08 02:29:22.283059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.540 [2024-12-08 02:29:22.283089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.540 [2024-12-08 02:29:22.287183] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.540 [2024-12-08 02:29:22.287322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.540 [2024-12-08 02:29:22.287353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.540 [2024-12-08 02:29:22.291517] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.540 [2024-12-08 02:29:22.291665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.540 [2024-12-08 02:29:22.291692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.540 [2024-12-08 02:29:22.296260] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.540 [2024-12-08 02:29:22.296531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.540 [2024-12-08 02:29:22.296585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.540 [2024-12-08 02:29:22.301479] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.540 [2024-12-08 02:29:22.301658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.540 [2024-12-08 02:29:22.301687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.540 [2024-12-08 02:29:22.306000] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.540 [2024-12-08 02:29:22.306295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.540 [2024-12-08 02:29:22.306326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.540 [2024-12-08 02:29:22.310447] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.540 [2024-12-08 02:29:22.310620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.540 [2024-12-08 02:29:22.310648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.540 [2024-12-08 02:29:22.314940] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.540 [2024-12-08 02:29:22.315097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.540 [2024-12-08 02:29:22.315134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.800 [2024-12-08 02:29:22.320648] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.800 [2024-12-08 02:29:22.320794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.800 [2024-12-08 02:29:22.320822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.800 [2024-12-08 02:29:22.325162] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.800 [2024-12-08 02:29:22.325293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.800 [2024-12-08 02:29:22.325323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.800 [2024-12-08 02:29:22.329510] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.800 [2024-12-08 02:29:22.329651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.800 [2024-12-08 02:29:22.329679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.800 [2024-12-08 02:29:22.334094] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.800 [2024-12-08 02:29:22.334273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.800 [2024-12-08 02:29:22.334304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.800 [2024-12-08 02:29:22.338995] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.800 [2024-12-08 02:29:22.339212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.800 [2024-12-08 02:29:22.339243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.800 [2024-12-08 02:29:22.344614] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.800 [2024-12-08 02:29:22.344918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.800 [2024-12-08 02:29:22.344948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.800 [2024-12-08 02:29:22.349630] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.800 [2024-12-08 02:29:22.349809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.800 [2024-12-08 02:29:22.349855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.800 [2024-12-08 02:29:22.354035] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.800 [2024-12-08 02:29:22.354158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.800 [2024-12-08 02:29:22.354189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.800 [2024-12-08 02:29:22.358680] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.800 [2024-12-08 02:29:22.358882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.800 [2024-12-08 02:29:22.358914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.800 [2024-12-08 02:29:22.363194] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.800 [2024-12-08 02:29:22.363312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.800 [2024-12-08 02:29:22.363342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.800 [2024-12-08 02:29:22.367765] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.800 [2024-12-08 02:29:22.367961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.800 [2024-12-08 02:29:22.367990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.800 [2024-12-08 02:29:22.373868] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.800 [2024-12-08 02:29:22.374098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.800 [2024-12-08 02:29:22.374129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.800 [2024-12-08 02:29:22.378623] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.800 [2024-12-08 02:29:22.378846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.800 [2024-12-08 02:29:22.378877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.800 [2024-12-08 02:29:22.383344] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.800 [2024-12-08 02:29:22.383608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.800 [2024-12-08 02:29:22.383636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.800 [2024-12-08 02:29:22.387888] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.800 [2024-12-08 02:29:22.388067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.800 [2024-12-08 02:29:22.388098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.800 [2024-12-08 02:29:22.392630] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.800 [2024-12-08 02:29:22.392732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.800 [2024-12-08 02:29:22.392759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.800 [2024-12-08 02:29:22.397096] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.800 [2024-12-08 02:29:22.397209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.800 [2024-12-08 02:29:22.397239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.800 [2024-12-08 02:29:22.402591] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.800 [2024-12-08 02:29:22.402757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.800 [2024-12-08 02:29:22.402785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.800 [2024-12-08 02:29:22.406990] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.800 [2024-12-08 02:29:22.407145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.800 [2024-12-08 02:29:22.407175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.800 [2024-12-08 02:29:22.411556] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.800 [2024-12-08 02:29:22.411793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.800 [2024-12-08 02:29:22.411828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.800 [2024-12-08 02:29:22.416288] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.800 [2024-12-08 02:29:22.416469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.800 [2024-12-08 02:29:22.416500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.800 [2024-12-08 02:29:22.421330] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.800 [2024-12-08 02:29:22.421565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.800 [2024-12-08 02:29:22.421610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.800 [2024-12-08 02:29:22.426154] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.800 [2024-12-08 02:29:22.426325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.800 [2024-12-08 02:29:22.426356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.800 [2024-12-08 02:29:22.431195] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.800 [2024-12-08 02:29:22.431396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.800 [2024-12-08 02:29:22.431426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.800 [2024-12-08 02:29:22.436315] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.800 [2024-12-08 02:29:22.436406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.800 [2024-12-08 02:29:22.436434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.800 [2024-12-08 02:29:22.441564] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.801 [2024-12-08 02:29:22.441868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.801 [2024-12-08 02:29:22.441905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.801 [2024-12-08 02:29:22.448123] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.801 [2024-12-08 02:29:22.448375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.801 [2024-12-08 02:29:22.448406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.801 [2024-12-08 02:29:22.453766] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.801 [2024-12-08 02:29:22.453975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.801 [2024-12-08 02:29:22.454005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.801 [2024-12-08 02:29:22.459468] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.801 [2024-12-08 02:29:22.459679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.801 [2024-12-08 02:29:22.459707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.801 [2024-12-08 02:29:22.464975] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.801 [2024-12-08 02:29:22.465053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.801 [2024-12-08 02:29:22.465081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.801 [2024-12-08 02:29:22.469974] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.801 [2024-12-08 02:29:22.470125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.801 [2024-12-08 02:29:22.470156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.801 [2024-12-08 02:29:22.475023] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.801 [2024-12-08 02:29:22.475140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.801 [2024-12-08 02:29:22.475172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.801 [2024-12-08 02:29:22.480076] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.801 [2024-12-08 02:29:22.480186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.801 [2024-12-08 02:29:22.480217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.801 [2024-12-08 02:29:22.485800] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.801 [2024-12-08 02:29:22.486009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.801 [2024-12-08 02:29:22.486041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.801 [2024-12-08 02:29:22.491676] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.801 [2024-12-08 02:29:22.491831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.801 [2024-12-08 02:29:22.491877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.801 [2024-12-08 02:29:22.497269] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.801 [2024-12-08 02:29:22.497524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.801 [2024-12-08 02:29:22.497583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.801 [2024-12-08 02:29:22.502940] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.801 [2024-12-08 02:29:22.503055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.801 [2024-12-08 02:29:22.503087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.801 [2024-12-08 02:29:22.508329] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.801 [2024-12-08 02:29:22.508462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.801 [2024-12-08 02:29:22.508492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.801 [2024-12-08 02:29:22.513053] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.801 [2024-12-08 02:29:22.513234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.801 [2024-12-08 02:29:22.513265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.801 [2024-12-08 02:29:22.517612] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.801 [2024-12-08 02:29:22.517749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.801 [2024-12-08 02:29:22.517777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.801 [2024-12-08 02:29:22.522658] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.801 [2024-12-08 02:29:22.522811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.801 [2024-12-08 02:29:22.522837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.801 [2024-12-08 02:29:22.527559] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.801 [2024-12-08 02:29:22.527784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.801 [2024-12-08 02:29:22.527827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.801 [2024-12-08 02:29:22.532020] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.801 [2024-12-08 02:29:22.532230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.801 [2024-12-08 02:29:22.532261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.801 [2024-12-08 02:29:22.537187] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.801 [2024-12-08 02:29:22.537484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.801 [2024-12-08 02:29:22.537515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.801 [2024-12-08 02:29:22.541964] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.801 [2024-12-08 02:29:22.542103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.801 [2024-12-08 02:29:22.542135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.801 [2024-12-08 02:29:22.546511] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.801 [2024-12-08 02:29:22.546664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.801 [2024-12-08 02:29:22.546692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.801 [2024-12-08 02:29:22.551563] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.801 [2024-12-08 02:29:22.551714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.801 [2024-12-08 02:29:22.551741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.801 [2024-12-08 02:29:22.556608] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.801 [2024-12-08 02:29:22.556814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.801 [2024-12-08 02:29:22.556860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:54.801 [2024-12-08 02:29:22.561617] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.801 [2024-12-08 02:29:22.561775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.801 [2024-12-08 02:29:22.561802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:54.801 [2024-12-08 02:29:22.566818] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.801 [2024-12-08 02:29:22.567091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.801 [2024-12-08 02:29:22.567122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:54.801 [2024-12-08 02:29:22.571859] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.801 [2024-12-08 02:29:22.572053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.801 [2024-12-08 02:29:22.572084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:54.801 [2024-12-08 02:29:22.577076] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:54.801 [2024-12-08 02:29:22.577322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:54.801 [2024-12-08 02:29:22.577359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:55.061 [2024-12-08 02:29:22.582150] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.061 [2024-12-08 02:29:22.582404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.061 [2024-12-08 02:29:22.582435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:55.061 [2024-12-08 02:29:22.587151] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.061 [2024-12-08 02:29:22.587364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.061 [2024-12-08 02:29:22.587395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:55.061 [2024-12-08 02:29:22.592115] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.061 [2024-12-08 02:29:22.592309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.061 [2024-12-08 02:29:22.592340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:55.061 [2024-12-08 02:29:22.596676] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.061 [2024-12-08 02:29:22.596835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.061 [2024-12-08 02:29:22.596878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:55.061 [2024-12-08 02:29:22.601701] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.061 [2024-12-08 02:29:22.601876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.061 [2024-12-08 02:29:22.601906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:55.061 [2024-12-08 02:29:22.606766] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.061 [2024-12-08 02:29:22.607010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.061 [2024-12-08 02:29:22.607041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:55.061 [2024-12-08 02:29:22.611285] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.061 [2024-12-08 02:29:22.611438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.061 [2024-12-08 02:29:22.611470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:55.061 [2024-12-08 02:29:22.616015] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.061 [2024-12-08 02:29:22.616155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.061 [2024-12-08 02:29:22.616187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:55.061 [2024-12-08 02:29:22.620567] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.061 [2024-12-08 02:29:22.620778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.061 [2024-12-08 02:29:22.620807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:55.061 [2024-12-08 02:29:22.625129] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.061 [2024-12-08 02:29:22.625408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.061 [2024-12-08 02:29:22.625439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:55.062 [2024-12-08 02:29:22.629742] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.062 [2024-12-08 02:29:22.629975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.062 [2024-12-08 02:29:22.630007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:55.062 [2024-12-08 02:29:22.634405] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.062 [2024-12-08 02:29:22.634630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.062 [2024-12-08 02:29:22.634658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:55.062 [2024-12-08 02:29:22.639710] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.062 [2024-12-08 02:29:22.639901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.062 [2024-12-08 02:29:22.639932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:55.062 [2024-12-08 02:29:22.645705] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.062 [2024-12-08 02:29:22.645902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.062 [2024-12-08 02:29:22.645933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:55.062 [2024-12-08 02:29:22.650260] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.062 [2024-12-08 02:29:22.650399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.062 [2024-12-08 02:29:22.650430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:55.062 [2024-12-08 02:29:22.654761] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.062 [2024-12-08 02:29:22.654887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.062 [2024-12-08 02:29:22.654916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:55.062 [2024-12-08 02:29:22.659529] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.062 [2024-12-08 02:29:22.659731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.062 [2024-12-08 02:29:22.659759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:55.062 [2024-12-08 02:29:22.663915] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.062 [2024-12-08 02:29:22.664108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.062 [2024-12-08 02:29:22.664139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:55.062 [2024-12-08 02:29:22.668416] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.062 [2024-12-08 02:29:22.668655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.062 [2024-12-08 02:29:22.668683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:55.062 [2024-12-08 02:29:22.672750] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.062 [2024-12-08 02:29:22.672937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.062 [2024-12-08 02:29:22.672968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:55.062 [2024-12-08 02:29:22.677129] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.062 [2024-12-08 02:29:22.677257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.062 [2024-12-08 02:29:22.677288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:55.062 [2024-12-08 02:29:22.681552] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.062 [2024-12-08 02:29:22.681780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.062 [2024-12-08 02:29:22.681808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:55.062 [2024-12-08 02:29:22.686102] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.062 [2024-12-08 02:29:22.686258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.062 [2024-12-08 02:29:22.686288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:55.062 [2024-12-08 02:29:22.690724] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.062 [2024-12-08 02:29:22.690836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.062 [2024-12-08 02:29:22.690878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:55.062 [2024-12-08 02:29:22.695574] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.062 [2024-12-08 02:29:22.695757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.062 [2024-12-08 02:29:22.695784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:55.062 [2024-12-08 02:29:22.700182] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.062 [2024-12-08 02:29:22.700356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.062 [2024-12-08 02:29:22.700396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:55.062 [2024-12-08 02:29:22.704783] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.062 [2024-12-08 02:29:22.705024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.062 [2024-12-08 02:29:22.705055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:55.062 [2024-12-08 02:29:22.709310] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.062 [2024-12-08 02:29:22.709440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.062 [2024-12-08 02:29:22.709471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:55.062 [2024-12-08 02:29:22.713825] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.062 [2024-12-08 02:29:22.713983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.062 [2024-12-08 02:29:22.714014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:55.062 [2024-12-08 02:29:22.718603] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.062 [2024-12-08 02:29:22.718776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.062 [2024-12-08 02:29:22.718803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:55.062 [2024-12-08 02:29:22.723308] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.062 [2024-12-08 02:29:22.723411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.062 [2024-12-08 02:29:22.723441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:55.062 [2024-12-08 02:29:22.727762] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.062 [2024-12-08 02:29:22.727904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.062 [2024-12-08 02:29:22.727935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:55.062 [2024-12-08 02:29:22.732913] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.062 [2024-12-08 02:29:22.733216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.062 [2024-12-08 02:29:22.733247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:55.062 [2024-12-08 02:29:22.738104] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.062 [2024-12-08 02:29:22.738313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.062 [2024-12-08 02:29:22.738344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:55.062 [2024-12-08 02:29:22.744028] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.062 [2024-12-08 02:29:22.744283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.062 [2024-12-08 02:29:22.744314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:55.062 [2024-12-08 02:29:22.749344] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.062 [2024-12-08 02:29:22.749529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.062 [2024-12-08 02:29:22.749585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:55.062 [2024-12-08 02:29:22.753777] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.062 [2024-12-08 02:29:22.753927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.062 [2024-12-08 02:29:22.753958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:55.063 [2024-12-08 02:29:22.758562] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.063 [2024-12-08 02:29:22.758668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.063 [2024-12-08 02:29:22.758694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:55.063 [2024-12-08 02:29:22.763167] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.063 [2024-12-08 02:29:22.763312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.063 [2024-12-08 02:29:22.763342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:55.063 [2024-12-08 02:29:22.767740] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.063 [2024-12-08 02:29:22.767927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.063 [2024-12-08 02:29:22.767957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:55.063 [2024-12-08 02:29:22.772690] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.063 [2024-12-08 02:29:22.772980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.063 [2024-12-08 02:29:22.773012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:55.063 [2024-12-08 02:29:22.777427] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.063 [2024-12-08 02:29:22.777651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.063 [2024-12-08 02:29:22.777679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:55.063 [2024-12-08 02:29:22.782068] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.063 [2024-12-08 02:29:22.782181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.063 [2024-12-08 02:29:22.782213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:55.063 [2024-12-08 02:29:22.787143] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.063 [2024-12-08 02:29:22.787328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.063 [2024-12-08 02:29:22.787358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:55.063 [2024-12-08 02:29:22.792864] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.063 [2024-12-08 02:29:22.793037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.063 [2024-12-08 02:29:22.793068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:55.063 [2024-12-08 02:29:22.798410] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.063 [2024-12-08 02:29:22.798528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.063 [2024-12-08 02:29:22.798566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:55.063 [2024-12-08 02:29:22.803499] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.063 [2024-12-08 02:29:22.803684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.063 [2024-12-08 02:29:22.803713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:55.063 [2024-12-08 02:29:22.808841] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.063 [2024-12-08 02:29:22.809007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.063 [2024-12-08 02:29:22.809037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:55.063 [2024-12-08 02:29:22.814777] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.063 [2024-12-08 02:29:22.815015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.063 [2024-12-08 02:29:22.815046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:55.063 [2024-12-08 02:29:22.820244] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.063 [2024-12-08 02:29:22.820501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.063 [2024-12-08 02:29:22.820533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:55.063 [2024-12-08 02:29:22.825519] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.063 [2024-12-08 02:29:22.825729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.063 [2024-12-08 02:29:22.825757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:55.063 [2024-12-08 02:29:22.830442] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.063 [2024-12-08 02:29:22.830710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.063 [2024-12-08 02:29:22.830744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:55.063 [2024-12-08 02:29:22.835355] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.063 [2024-12-08 02:29:22.835530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.063 [2024-12-08 02:29:22.835584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:55.063 [2024-12-08 02:29:22.840321] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.322 [2024-12-08 02:29:22.840471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.322 [2024-12-08 02:29:22.840499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:55.322 [2024-12-08 02:29:22.845140] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.322 [2024-12-08 02:29:22.845358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.322 [2024-12-08 02:29:22.845390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:55.322 [2024-12-08 02:29:22.849998] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.322 [2024-12-08 02:29:22.850133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.322 [2024-12-08 02:29:22.850164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:55.322 [2024-12-08 02:29:22.854410] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.322 [2024-12-08 02:29:22.854557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.322 [2024-12-08 02:29:22.854601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:55.322 [2024-12-08 02:29:22.858890] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.322 [2024-12-08 02:29:22.859079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.322 [2024-12-08 02:29:22.859110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:55.322 [2024-12-08 02:29:22.863609] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.323 [2024-12-08 02:29:22.863801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.323 [2024-12-08 02:29:22.863845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:55.323 [2024-12-08 02:29:22.868507] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.323 [2024-12-08 02:29:22.868694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.323 [2024-12-08 02:29:22.868722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:55.323 [2024-12-08 02:29:22.873459] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.323 [2024-12-08 02:29:22.873694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.323 [2024-12-08 02:29:22.873722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:55.323 [2024-12-08 02:29:22.878499] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.323 [2024-12-08 02:29:22.878674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.323 [2024-12-08 02:29:22.878701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:55.323 [2024-12-08 02:29:22.883700] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.323 [2024-12-08 02:29:22.883821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.323 [2024-12-08 02:29:22.883867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:55.323 [2024-12-08 02:29:22.889671] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.323 [2024-12-08 02:29:22.889793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.323 [2024-12-08 02:29:22.889821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:55.323 [2024-12-08 02:29:22.894174] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.323 [2024-12-08 02:29:22.894311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.323 [2024-12-08 02:29:22.894342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:55.323 [2024-12-08 02:29:22.898923] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.323 [2024-12-08 02:29:22.899128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.323 [2024-12-08 02:29:22.899159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:55.323 [2024-12-08 02:29:22.903620] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.323 [2024-12-08 02:29:22.903797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.323 [2024-12-08 02:29:22.903825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:55.323 [2024-12-08 02:29:22.908865] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.323 [2024-12-08 02:29:22.909005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.323 [2024-12-08 02:29:22.909035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:55.323 [2024-12-08 02:29:22.914092] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1567fb0) with pdu=0x2000190fef90 00:26:55.323 [2024-12-08 02:29:22.914209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:55.323 [2024-12-08 02:29:22.914239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:55.323 00:26:55.323 Latency(us) 00:26:55.323 [2024-12-08T01:29:23.104Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:55.323 [2024-12-08T01:29:23.104Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:26:55.323 nvme0n1 : 2.00 6270.38 783.80 0.00 0.00 2543.82 1881.13 6747.78 00:26:55.323 [2024-12-08T01:29:23.104Z] =================================================================================================================== 00:26:55.323 [2024-12-08T01:29:23.104Z] Total : 6270.38 783.80 0.00 0.00 2543.82 1881.13 6747.78 00:26:55.323 0 00:26:55.323 02:29:22 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:26:55.323 02:29:22 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:26:55.323 02:29:22 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:26:55.323 | .driver_specific 00:26:55.323 | .nvme_error 00:26:55.323 | .status_code 00:26:55.323 | .command_transient_transport_error' 00:26:55.323 02:29:22 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:26:55.584 02:29:23 -- host/digest.sh@71 -- # (( 405 > 0 )) 00:26:55.584 02:29:23 -- host/digest.sh@73 -- # killprocess 2223466 00:26:55.584 02:29:23 -- common/autotest_common.sh@936 -- # '[' -z 2223466 ']' 00:26:55.584 02:29:23 -- common/autotest_common.sh@940 -- # kill -0 2223466 00:26:55.584 02:29:23 -- common/autotest_common.sh@941 -- # uname 00:26:55.584 02:29:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:55.584 02:29:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2223466 00:26:55.584 02:29:23 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:55.584 02:29:23 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:55.584 02:29:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2223466' 00:26:55.584 killing process with pid 2223466 00:26:55.584 02:29:23 -- common/autotest_common.sh@955 -- # kill 2223466 00:26:55.584 Received shutdown signal, test time was about 2.000000 seconds 00:26:55.584 00:26:55.584 Latency(us) 00:26:55.584 [2024-12-08T01:29:23.365Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:55.584 [2024-12-08T01:29:23.365Z] =================================================================================================================== 00:26:55.584 [2024-12-08T01:29:23.365Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:55.584 02:29:23 -- common/autotest_common.sh@960 -- # wait 2223466 00:26:55.881 02:29:23 -- host/digest.sh@115 -- # killprocess 2221785 00:26:55.881 02:29:23 -- common/autotest_common.sh@936 -- # '[' -z 2221785 ']' 00:26:55.881 02:29:23 -- common/autotest_common.sh@940 -- # kill -0 2221785 00:26:55.881 02:29:23 -- common/autotest_common.sh@941 -- # uname 00:26:55.881 02:29:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:55.881 02:29:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2221785 00:26:55.881 02:29:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:55.881 02:29:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:55.881 02:29:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2221785' 00:26:55.881 killing process with pid 2221785 00:26:55.881 02:29:23 -- common/autotest_common.sh@955 -- # kill 2221785 00:26:55.881 02:29:23 -- common/autotest_common.sh@960 -- # wait 2221785 00:26:56.166 00:26:56.166 real 0m18.637s 00:26:56.166 user 0m37.994s 00:26:56.166 sys 0m4.551s 00:26:56.166 02:29:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:56.166 02:29:23 -- common/autotest_common.sh@10 -- # set +x 00:26:56.167 ************************************ 00:26:56.167 END TEST nvmf_digest_error 00:26:56.167 ************************************ 00:26:56.167 02:29:23 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:26:56.167 02:29:23 -- host/digest.sh@139 -- # nvmftestfini 00:26:56.167 02:29:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:56.167 02:29:23 -- nvmf/common.sh@116 -- # sync 00:26:56.167 02:29:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:56.167 02:29:23 -- nvmf/common.sh@119 -- # set +e 00:26:56.167 02:29:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:56.167 02:29:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:56.167 rmmod nvme_tcp 00:26:56.167 rmmod nvme_fabrics 00:26:56.167 rmmod nvme_keyring 00:26:56.167 02:29:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:56.167 02:29:23 -- nvmf/common.sh@123 -- # set -e 00:26:56.167 02:29:23 -- nvmf/common.sh@124 -- # return 0 00:26:56.167 02:29:23 -- nvmf/common.sh@477 -- # '[' -n 2221785 ']' 00:26:56.167 02:29:23 -- nvmf/common.sh@478 -- # killprocess 2221785 00:26:56.167 02:29:23 -- common/autotest_common.sh@936 -- # '[' -z 2221785 ']' 00:26:56.167 02:29:23 -- common/autotest_common.sh@940 -- # kill -0 2221785 00:26:56.167 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2221785) - No such process 00:26:56.167 02:29:23 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2221785 is not found' 00:26:56.167 Process with pid 2221785 is not found 00:26:56.167 02:29:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:56.167 02:29:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:56.167 02:29:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:56.167 02:29:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:56.167 02:29:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:56.167 02:29:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:56.167 02:29:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:56.167 02:29:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:58.700 02:29:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:58.700 00:26:58.700 real 0m39.337s 00:26:58.700 user 1m10.815s 00:26:58.700 sys 0m10.621s 00:26:58.700 02:29:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:58.700 02:29:25 -- common/autotest_common.sh@10 -- # set +x 00:26:58.700 ************************************ 00:26:58.700 END TEST nvmf_digest 00:26:58.700 ************************************ 00:26:58.700 02:29:25 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:26:58.700 02:29:25 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:26:58.700 02:29:25 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:26:58.700 02:29:25 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:26:58.700 02:29:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:58.700 02:29:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:58.700 02:29:25 -- common/autotest_common.sh@10 -- # set +x 00:26:58.700 ************************************ 00:26:58.700 START TEST nvmf_bdevperf 00:26:58.700 ************************************ 00:26:58.700 02:29:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:26:58.700 * Looking for test storage... 00:26:58.700 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:58.700 02:29:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:58.700 02:29:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:58.700 02:29:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:58.700 02:29:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:58.700 02:29:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:58.700 02:29:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:58.700 02:29:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:58.700 02:29:26 -- scripts/common.sh@335 -- # IFS=.-: 00:26:58.700 02:29:26 -- scripts/common.sh@335 -- # read -ra ver1 00:26:58.700 02:29:26 -- scripts/common.sh@336 -- # IFS=.-: 00:26:58.700 02:29:26 -- scripts/common.sh@336 -- # read -ra ver2 00:26:58.700 02:29:26 -- scripts/common.sh@337 -- # local 'op=<' 00:26:58.700 02:29:26 -- scripts/common.sh@339 -- # ver1_l=2 00:26:58.701 02:29:26 -- scripts/common.sh@340 -- # ver2_l=1 00:26:58.701 02:29:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:58.701 02:29:26 -- scripts/common.sh@343 -- # case "$op" in 00:26:58.701 02:29:26 -- scripts/common.sh@344 -- # : 1 00:26:58.701 02:29:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:58.701 02:29:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:58.701 02:29:26 -- scripts/common.sh@364 -- # decimal 1 00:26:58.701 02:29:26 -- scripts/common.sh@352 -- # local d=1 00:26:58.701 02:29:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:58.701 02:29:26 -- scripts/common.sh@354 -- # echo 1 00:26:58.701 02:29:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:58.701 02:29:26 -- scripts/common.sh@365 -- # decimal 2 00:26:58.701 02:29:26 -- scripts/common.sh@352 -- # local d=2 00:26:58.701 02:29:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:58.701 02:29:26 -- scripts/common.sh@354 -- # echo 2 00:26:58.701 02:29:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:58.701 02:29:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:58.701 02:29:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:58.701 02:29:26 -- scripts/common.sh@367 -- # return 0 00:26:58.701 02:29:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:58.701 02:29:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:58.701 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:58.701 --rc genhtml_branch_coverage=1 00:26:58.701 --rc genhtml_function_coverage=1 00:26:58.701 --rc genhtml_legend=1 00:26:58.701 --rc geninfo_all_blocks=1 00:26:58.701 --rc geninfo_unexecuted_blocks=1 00:26:58.701 00:26:58.701 ' 00:26:58.701 02:29:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:58.701 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:58.701 --rc genhtml_branch_coverage=1 00:26:58.701 --rc genhtml_function_coverage=1 00:26:58.701 --rc genhtml_legend=1 00:26:58.701 --rc geninfo_all_blocks=1 00:26:58.701 --rc geninfo_unexecuted_blocks=1 00:26:58.701 00:26:58.701 ' 00:26:58.701 02:29:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:58.701 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:58.701 --rc genhtml_branch_coverage=1 00:26:58.701 --rc genhtml_function_coverage=1 00:26:58.701 --rc genhtml_legend=1 00:26:58.701 --rc geninfo_all_blocks=1 00:26:58.701 --rc geninfo_unexecuted_blocks=1 00:26:58.701 00:26:58.701 ' 00:26:58.701 02:29:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:58.701 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:58.701 --rc genhtml_branch_coverage=1 00:26:58.701 --rc genhtml_function_coverage=1 00:26:58.701 --rc genhtml_legend=1 00:26:58.701 --rc geninfo_all_blocks=1 00:26:58.701 --rc geninfo_unexecuted_blocks=1 00:26:58.701 00:26:58.701 ' 00:26:58.701 02:29:26 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:58.701 02:29:26 -- nvmf/common.sh@7 -- # uname -s 00:26:58.701 02:29:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:58.701 02:29:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:58.701 02:29:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:58.701 02:29:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:58.701 02:29:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:58.701 02:29:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:58.701 02:29:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:58.701 02:29:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:58.701 02:29:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:58.701 02:29:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:58.701 02:29:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:58.701 02:29:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:58.701 02:29:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:58.701 02:29:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:58.701 02:29:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:58.701 02:29:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:58.701 02:29:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:58.701 02:29:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:58.701 02:29:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:58.701 02:29:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:58.701 02:29:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:58.701 02:29:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:58.701 02:29:26 -- paths/export.sh@5 -- # export PATH 00:26:58.701 02:29:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:58.701 02:29:26 -- nvmf/common.sh@46 -- # : 0 00:26:58.701 02:29:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:58.701 02:29:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:58.701 02:29:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:58.701 02:29:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:58.701 02:29:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:58.701 02:29:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:58.701 02:29:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:58.701 02:29:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:58.701 02:29:26 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:26:58.701 02:29:26 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:26:58.701 02:29:26 -- host/bdevperf.sh@24 -- # nvmftestinit 00:26:58.701 02:29:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:58.701 02:29:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:58.701 02:29:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:58.701 02:29:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:58.701 02:29:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:58.701 02:29:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:58.701 02:29:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:58.701 02:29:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:58.701 02:29:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:58.701 02:29:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:58.701 02:29:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:58.701 02:29:26 -- common/autotest_common.sh@10 -- # set +x 00:27:00.600 02:29:28 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:00.600 02:29:28 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:00.600 02:29:28 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:00.600 02:29:28 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:00.600 02:29:28 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:00.600 02:29:28 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:00.600 02:29:28 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:00.600 02:29:28 -- nvmf/common.sh@294 -- # net_devs=() 00:27:00.600 02:29:28 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:00.600 02:29:28 -- nvmf/common.sh@295 -- # e810=() 00:27:00.600 02:29:28 -- nvmf/common.sh@295 -- # local -ga e810 00:27:00.600 02:29:28 -- nvmf/common.sh@296 -- # x722=() 00:27:00.600 02:29:28 -- nvmf/common.sh@296 -- # local -ga x722 00:27:00.600 02:29:28 -- nvmf/common.sh@297 -- # mlx=() 00:27:00.600 02:29:28 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:00.600 02:29:28 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:00.600 02:29:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:00.600 02:29:28 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:00.600 02:29:28 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:00.600 02:29:28 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:00.600 02:29:28 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:00.600 02:29:28 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:00.600 02:29:28 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:00.600 02:29:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:00.600 02:29:28 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:00.600 02:29:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:00.600 02:29:28 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:00.600 02:29:28 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:00.600 02:29:28 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:00.600 02:29:28 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:00.600 02:29:28 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:00.600 02:29:28 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:00.600 02:29:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:00.600 02:29:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:00.600 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:00.600 02:29:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:00.600 02:29:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:00.600 02:29:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:00.600 02:29:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:00.600 02:29:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:00.600 02:29:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:00.600 02:29:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:00.600 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:00.600 02:29:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:00.600 02:29:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:00.600 02:29:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:00.600 02:29:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:00.600 02:29:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:00.600 02:29:28 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:00.600 02:29:28 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:00.600 02:29:28 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:00.600 02:29:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:00.600 02:29:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:00.600 02:29:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:00.600 02:29:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:00.600 02:29:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:00.600 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:00.600 02:29:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:00.600 02:29:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:00.600 02:29:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:00.600 02:29:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:00.600 02:29:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:00.600 02:29:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:00.600 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:00.601 02:29:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:00.601 02:29:28 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:00.601 02:29:28 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:00.601 02:29:28 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:00.601 02:29:28 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:00.601 02:29:28 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:00.601 02:29:28 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:00.601 02:29:28 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:00.601 02:29:28 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:00.601 02:29:28 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:00.601 02:29:28 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:00.601 02:29:28 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:00.601 02:29:28 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:00.601 02:29:28 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:00.601 02:29:28 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:00.601 02:29:28 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:00.601 02:29:28 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:00.601 02:29:28 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:00.601 02:29:28 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:00.601 02:29:28 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:00.601 02:29:28 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:00.601 02:29:28 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:00.601 02:29:28 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:00.601 02:29:28 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:00.601 02:29:28 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:00.601 02:29:28 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:00.601 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:00.601 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.291 ms 00:27:00.601 00:27:00.601 --- 10.0.0.2 ping statistics --- 00:27:00.601 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:00.601 rtt min/avg/max/mdev = 0.291/0.291/0.291/0.000 ms 00:27:00.601 02:29:28 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:00.601 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:00.601 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.116 ms 00:27:00.601 00:27:00.601 --- 10.0.0.1 ping statistics --- 00:27:00.601 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:00.601 rtt min/avg/max/mdev = 0.116/0.116/0.116/0.000 ms 00:27:00.601 02:29:28 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:00.601 02:29:28 -- nvmf/common.sh@410 -- # return 0 00:27:00.601 02:29:28 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:00.601 02:29:28 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:00.601 02:29:28 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:00.601 02:29:28 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:00.601 02:29:28 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:00.601 02:29:28 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:00.601 02:29:28 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:00.601 02:29:28 -- host/bdevperf.sh@25 -- # tgt_init 00:27:00.601 02:29:28 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:27:00.601 02:29:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:00.601 02:29:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:00.601 02:29:28 -- common/autotest_common.sh@10 -- # set +x 00:27:00.601 02:29:28 -- nvmf/common.sh@469 -- # nvmfpid=2225984 00:27:00.601 02:29:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:00.601 02:29:28 -- nvmf/common.sh@470 -- # waitforlisten 2225984 00:27:00.858 02:29:28 -- common/autotest_common.sh@829 -- # '[' -z 2225984 ']' 00:27:00.858 02:29:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:00.858 02:29:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:00.858 02:29:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:00.858 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:00.858 02:29:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:00.858 02:29:28 -- common/autotest_common.sh@10 -- # set +x 00:27:00.858 [2024-12-08 02:29:28.423246] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:00.859 [2024-12-08 02:29:28.423326] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:00.859 EAL: No free 2048 kB hugepages reported on node 1 00:27:00.859 [2024-12-08 02:29:28.494676] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:00.859 [2024-12-08 02:29:28.609710] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:00.859 [2024-12-08 02:29:28.609876] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:00.859 [2024-12-08 02:29:28.609896] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:00.859 [2024-12-08 02:29:28.609910] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:00.859 [2024-12-08 02:29:28.610032] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:00.859 [2024-12-08 02:29:28.610114] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:00.859 [2024-12-08 02:29:28.610118] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:01.790 02:29:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:01.790 02:29:29 -- common/autotest_common.sh@862 -- # return 0 00:27:01.790 02:29:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:01.790 02:29:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:01.790 02:29:29 -- common/autotest_common.sh@10 -- # set +x 00:27:01.790 02:29:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:01.790 02:29:29 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:01.790 02:29:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:01.790 02:29:29 -- common/autotest_common.sh@10 -- # set +x 00:27:01.790 [2024-12-08 02:29:29.406703] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:01.790 02:29:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:01.790 02:29:29 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:01.790 02:29:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:01.790 02:29:29 -- common/autotest_common.sh@10 -- # set +x 00:27:01.790 Malloc0 00:27:01.790 02:29:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:01.790 02:29:29 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:01.790 02:29:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:01.790 02:29:29 -- common/autotest_common.sh@10 -- # set +x 00:27:01.790 02:29:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:01.790 02:29:29 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:01.790 02:29:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:01.790 02:29:29 -- common/autotest_common.sh@10 -- # set +x 00:27:01.790 02:29:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:01.790 02:29:29 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:01.790 02:29:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:01.790 02:29:29 -- common/autotest_common.sh@10 -- # set +x 00:27:01.790 [2024-12-08 02:29:29.473648] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:01.790 02:29:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:01.790 02:29:29 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:27:01.790 02:29:29 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:27:01.790 02:29:29 -- nvmf/common.sh@520 -- # config=() 00:27:01.790 02:29:29 -- nvmf/common.sh@520 -- # local subsystem config 00:27:01.790 02:29:29 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:01.790 02:29:29 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:01.790 { 00:27:01.790 "params": { 00:27:01.790 "name": "Nvme$subsystem", 00:27:01.790 "trtype": "$TEST_TRANSPORT", 00:27:01.790 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:01.790 "adrfam": "ipv4", 00:27:01.790 "trsvcid": "$NVMF_PORT", 00:27:01.790 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:01.790 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:01.790 "hdgst": ${hdgst:-false}, 00:27:01.790 "ddgst": ${ddgst:-false} 00:27:01.790 }, 00:27:01.790 "method": "bdev_nvme_attach_controller" 00:27:01.790 } 00:27:01.790 EOF 00:27:01.790 )") 00:27:01.790 02:29:29 -- nvmf/common.sh@542 -- # cat 00:27:01.790 02:29:29 -- nvmf/common.sh@544 -- # jq . 00:27:01.790 02:29:29 -- nvmf/common.sh@545 -- # IFS=, 00:27:01.790 02:29:29 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:01.790 "params": { 00:27:01.790 "name": "Nvme1", 00:27:01.790 "trtype": "tcp", 00:27:01.790 "traddr": "10.0.0.2", 00:27:01.790 "adrfam": "ipv4", 00:27:01.790 "trsvcid": "4420", 00:27:01.790 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:01.790 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:01.790 "hdgst": false, 00:27:01.790 "ddgst": false 00:27:01.790 }, 00:27:01.790 "method": "bdev_nvme_attach_controller" 00:27:01.790 }' 00:27:01.790 [2024-12-08 02:29:29.514404] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:01.790 [2024-12-08 02:29:29.514474] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2226145 ] 00:27:01.790 EAL: No free 2048 kB hugepages reported on node 1 00:27:02.048 [2024-12-08 02:29:29.574139] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:02.048 [2024-12-08 02:29:29.680332] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:02.306 Running I/O for 1 seconds... 00:27:03.241 00:27:03.241 Latency(us) 00:27:03.241 [2024-12-08T01:29:31.022Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:03.241 [2024-12-08T01:29:31.022Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:03.241 Verification LBA range: start 0x0 length 0x4000 00:27:03.241 Nvme1n1 : 1.01 12621.22 49.30 0.00 0.00 10093.05 1219.70 15631.55 00:27:03.241 [2024-12-08T01:29:31.022Z] =================================================================================================================== 00:27:03.241 [2024-12-08T01:29:31.022Z] Total : 12621.22 49.30 0.00 0.00 10093.05 1219.70 15631.55 00:27:03.499 02:29:31 -- host/bdevperf.sh@30 -- # bdevperfpid=2226296 00:27:03.499 02:29:31 -- host/bdevperf.sh@32 -- # sleep 3 00:27:03.499 02:29:31 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:27:03.499 02:29:31 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:27:03.499 02:29:31 -- nvmf/common.sh@520 -- # config=() 00:27:03.499 02:29:31 -- nvmf/common.sh@520 -- # local subsystem config 00:27:03.499 02:29:31 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:03.499 02:29:31 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:03.499 { 00:27:03.499 "params": { 00:27:03.499 "name": "Nvme$subsystem", 00:27:03.500 "trtype": "$TEST_TRANSPORT", 00:27:03.500 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:03.500 "adrfam": "ipv4", 00:27:03.500 "trsvcid": "$NVMF_PORT", 00:27:03.500 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:03.500 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:03.500 "hdgst": ${hdgst:-false}, 00:27:03.500 "ddgst": ${ddgst:-false} 00:27:03.500 }, 00:27:03.500 "method": "bdev_nvme_attach_controller" 00:27:03.500 } 00:27:03.500 EOF 00:27:03.500 )") 00:27:03.500 02:29:31 -- nvmf/common.sh@542 -- # cat 00:27:03.500 02:29:31 -- nvmf/common.sh@544 -- # jq . 00:27:03.500 02:29:31 -- nvmf/common.sh@545 -- # IFS=, 00:27:03.500 02:29:31 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:03.500 "params": { 00:27:03.500 "name": "Nvme1", 00:27:03.500 "trtype": "tcp", 00:27:03.500 "traddr": "10.0.0.2", 00:27:03.500 "adrfam": "ipv4", 00:27:03.500 "trsvcid": "4420", 00:27:03.500 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:03.500 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:03.500 "hdgst": false, 00:27:03.500 "ddgst": false 00:27:03.500 }, 00:27:03.500 "method": "bdev_nvme_attach_controller" 00:27:03.500 }' 00:27:03.500 [2024-12-08 02:29:31.151372] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:03.500 [2024-12-08 02:29:31.151448] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2226296 ] 00:27:03.500 EAL: No free 2048 kB hugepages reported on node 1 00:27:03.500 [2024-12-08 02:29:31.215028] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:03.759 [2024-12-08 02:29:31.322076] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:03.759 Running I/O for 15 seconds... 00:27:07.048 02:29:34 -- host/bdevperf.sh@33 -- # kill -9 2225984 00:27:07.048 02:29:34 -- host/bdevperf.sh@35 -- # sleep 3 00:27:07.048 [2024-12-08 02:29:34.127413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:5136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.048 [2024-12-08 02:29:34.127467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.048 [2024-12-08 02:29:34.127500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:5144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.048 [2024-12-08 02:29:34.127521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.048 [2024-12-08 02:29:34.127550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:5152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.048 [2024-12-08 02:29:34.127585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.048 [2024-12-08 02:29:34.127601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:5168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.048 [2024-12-08 02:29:34.127615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.048 [2024-12-08 02:29:34.127632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:5176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.048 [2024-12-08 02:29:34.127647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.048 [2024-12-08 02:29:34.127663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:4536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.048 [2024-12-08 02:29:34.127688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.048 [2024-12-08 02:29:34.127704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:4552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.048 [2024-12-08 02:29:34.127719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.048 [2024-12-08 02:29:34.127735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:4560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.048 [2024-12-08 02:29:34.127751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.048 [2024-12-08 02:29:34.127767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:4568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.048 [2024-12-08 02:29:34.127782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.048 [2024-12-08 02:29:34.127827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:4576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.048 [2024-12-08 02:29:34.127843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.048 [2024-12-08 02:29:34.127861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:4584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.127877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.127894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:4592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.127910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.127929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:4600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.127946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.127963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:5184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.127978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.127994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:5192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.128009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.128027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:5208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.128042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.128060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.128078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.128097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:5248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.128113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.128140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:5264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.128158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.128176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.128194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.128212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:5280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.128229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.128248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:5288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.128263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.128279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:5296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.128294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.128321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:4624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.128336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.128352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:4664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.128367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.128383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:4672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.128398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.128414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:4680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.128429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.128446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:4688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.128461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.128478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:4712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.128493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.128509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:4728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.128524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.128548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:4736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.128595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.128613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.128627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.128641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:5320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.128655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.128669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:4744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.128683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.128698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:4752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.128712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.128726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:4776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.128739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.128755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:4792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.128768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.128783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:4800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.128805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.128835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:4840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.128851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.128869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:4872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.128884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.128900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:4888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.128915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.128932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:5336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.128947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.128963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:5360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.128978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.128994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:5368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.129013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.129031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:5376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.129046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.129063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:5384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.049 [2024-12-08 02:29:34.129078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.129094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:5392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.129110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.129126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:5400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.049 [2024-12-08 02:29:34.129141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.129157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:5408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.129172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.049 [2024-12-08 02:29:34.129189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.049 [2024-12-08 02:29:34.129204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.129221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.050 [2024-12-08 02:29:34.129236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.129252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:5432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.050 [2024-12-08 02:29:34.129267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.129284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:5440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.050 [2024-12-08 02:29:34.129299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.129315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:4896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.050 [2024-12-08 02:29:34.129330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.129346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:4904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.050 [2024-12-08 02:29:34.129361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.129377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:4912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.050 [2024-12-08 02:29:34.129392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.129413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:4920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.050 [2024-12-08 02:29:34.129429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.129445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:4928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.050 [2024-12-08 02:29:34.129461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.129477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:4968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.050 [2024-12-08 02:29:34.129492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.129508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:4976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.050 [2024-12-08 02:29:34.129523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.129545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:4992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.050 [2024-12-08 02:29:34.129579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.129606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:5448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.050 [2024-12-08 02:29:34.129619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.129635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:5456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.050 [2024-12-08 02:29:34.129649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.129664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:5464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.050 [2024-12-08 02:29:34.129677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.129691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:5472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.050 [2024-12-08 02:29:34.129705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.129723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.050 [2024-12-08 02:29:34.129736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.129751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:5488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.050 [2024-12-08 02:29:34.129764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.129778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:5496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.050 [2024-12-08 02:29:34.129791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.129806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:5504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.050 [2024-12-08 02:29:34.129823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.129856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:5512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.050 [2024-12-08 02:29:34.129871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.129887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:5520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.050 [2024-12-08 02:29:34.129902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.129918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.050 [2024-12-08 02:29:34.129933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.129949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:5536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.050 [2024-12-08 02:29:34.129964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.129980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:5544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.050 [2024-12-08 02:29:34.129994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.130010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:5552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.050 [2024-12-08 02:29:34.130025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.130041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:5560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.050 [2024-12-08 02:29:34.130056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.130072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:5568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.050 [2024-12-08 02:29:34.130087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.130103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:5576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.050 [2024-12-08 02:29:34.130117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.130133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:5584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.050 [2024-12-08 02:29:34.130148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.130164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:5592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.050 [2024-12-08 02:29:34.130179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.130195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:5000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.050 [2024-12-08 02:29:34.130211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.130227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:5008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.050 [2024-12-08 02:29:34.130251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.130269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:5032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.050 [2024-12-08 02:29:34.130284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.130301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:5072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.050 [2024-12-08 02:29:34.130316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.130333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:5080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.050 [2024-12-08 02:29:34.130348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.130364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:5128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.050 [2024-12-08 02:29:34.130379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.130396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:5160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.050 [2024-12-08 02:29:34.130410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.130427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:5200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.050 [2024-12-08 02:29:34.130442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.130458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:5600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.050 [2024-12-08 02:29:34.130474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.050 [2024-12-08 02:29:34.130490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:5608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.051 [2024-12-08 02:29:34.130505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.130521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:5616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.051 [2024-12-08 02:29:34.130544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.130564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:5624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.051 [2024-12-08 02:29:34.130580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.130613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:5632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.051 [2024-12-08 02:29:34.130627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.130641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:5640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.051 [2024-12-08 02:29:34.130655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.130684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:5648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.051 [2024-12-08 02:29:34.130698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.130713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:5656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.051 [2024-12-08 02:29:34.130736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.130751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:5664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.051 [2024-12-08 02:29:34.130765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.130779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:5672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.051 [2024-12-08 02:29:34.130792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.130807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:5680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.051 [2024-12-08 02:29:34.130842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.130859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:5688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.051 [2024-12-08 02:29:34.130874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.130891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.051 [2024-12-08 02:29:34.130907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.130923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:5704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.051 [2024-12-08 02:29:34.130938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.130954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.051 [2024-12-08 02:29:34.130969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.130985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:5720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.051 [2024-12-08 02:29:34.131000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.131016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:5728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.051 [2024-12-08 02:29:34.131031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.131048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:5736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.051 [2024-12-08 02:29:34.131062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.131079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:5744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.051 [2024-12-08 02:29:34.131101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.131118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:5752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.051 [2024-12-08 02:29:34.131133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.131149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:5760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.051 [2024-12-08 02:29:34.131164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.131181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:5768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.051 [2024-12-08 02:29:34.131196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.131213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:5776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.051 [2024-12-08 02:29:34.131228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.131245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:5784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.051 [2024-12-08 02:29:34.131260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.131278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:5792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.051 [2024-12-08 02:29:34.131293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.131309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:5800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.051 [2024-12-08 02:29:34.131324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.131340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:5808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.051 [2024-12-08 02:29:34.131355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.131371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:5816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.051 [2024-12-08 02:29:34.131385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.131401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.051 [2024-12-08 02:29:34.131416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.131433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:5832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.051 [2024-12-08 02:29:34.131447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.131463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:5840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.051 [2024-12-08 02:29:34.131478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.131494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:5848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.051 [2024-12-08 02:29:34.131512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.131529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:5216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.051 [2024-12-08 02:29:34.131552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.131585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:5224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.051 [2024-12-08 02:29:34.131602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.131617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:5232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.051 [2024-12-08 02:29:34.131630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.131645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:5256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.051 [2024-12-08 02:29:34.131658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.131672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:5304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.051 [2024-12-08 02:29:34.131694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.131709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:5328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.051 [2024-12-08 02:29:34.131722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.131737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:5344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.051 [2024-12-08 02:29:34.131750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.131764] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d1f740 is same with the state(5) to be set 00:27:07.051 [2024-12-08 02:29:34.131780] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:07.051 [2024-12-08 02:29:34.131791] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:07.051 [2024-12-08 02:29:34.131802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5352 len:8 PRP1 0x0 PRP2 0x0 00:27:07.051 [2024-12-08 02:29:34.131829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.051 [2024-12-08 02:29:34.131898] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1d1f740 was disconnected and freed. reset controller. 00:27:07.052 [2024-12-08 02:29:34.134494] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.052 [2024-12-08 02:29:34.134600] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.052 [2024-12-08 02:29:34.135108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-12-08 02:29:34.135263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-12-08 02:29:34.135289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.052 [2024-12-08 02:29:34.135306] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.052 [2024-12-08 02:29:34.135452] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.052 [2024-12-08 02:29:34.135617] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.052 [2024-12-08 02:29:34.135639] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.052 [2024-12-08 02:29:34.135655] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.052 [2024-12-08 02:29:34.138075] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.052 [2024-12-08 02:29:34.147265] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.052 [2024-12-08 02:29:34.147551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-12-08 02:29:34.147668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-12-08 02:29:34.147694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.052 [2024-12-08 02:29:34.147710] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.052 [2024-12-08 02:29:34.147862] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.052 [2024-12-08 02:29:34.148050] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.052 [2024-12-08 02:29:34.148073] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.052 [2024-12-08 02:29:34.148088] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.052 [2024-12-08 02:29:34.150395] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.052 [2024-12-08 02:29:34.159754] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.052 [2024-12-08 02:29:34.160036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-12-08 02:29:34.160191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-12-08 02:29:34.160219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.052 [2024-12-08 02:29:34.160236] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.052 [2024-12-08 02:29:34.160402] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.052 [2024-12-08 02:29:34.160620] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.052 [2024-12-08 02:29:34.160644] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.052 [2024-12-08 02:29:34.160659] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.052 [2024-12-08 02:29:34.162912] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.052 [2024-12-08 02:29:34.172327] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.052 [2024-12-08 02:29:34.172665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-12-08 02:29:34.172823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-12-08 02:29:34.172851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.052 [2024-12-08 02:29:34.172868] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.052 [2024-12-08 02:29:34.173052] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.052 [2024-12-08 02:29:34.173174] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.052 [2024-12-08 02:29:34.173197] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.052 [2024-12-08 02:29:34.173213] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.052 [2024-12-08 02:29:34.175676] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.052 [2024-12-08 02:29:34.184833] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.052 [2024-12-08 02:29:34.185182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-12-08 02:29:34.185340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-12-08 02:29:34.185368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.052 [2024-12-08 02:29:34.185386] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.052 [2024-12-08 02:29:34.185618] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.052 [2024-12-08 02:29:34.185806] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.052 [2024-12-08 02:29:34.185829] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.052 [2024-12-08 02:29:34.185845] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.052 [2024-12-08 02:29:34.188186] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.052 [2024-12-08 02:29:34.197731] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.052 [2024-12-08 02:29:34.198065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-12-08 02:29:34.198207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-12-08 02:29:34.198235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.052 [2024-12-08 02:29:34.198252] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.052 [2024-12-08 02:29:34.198435] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.052 [2024-12-08 02:29:34.198616] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.052 [2024-12-08 02:29:34.198640] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.052 [2024-12-08 02:29:34.198656] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.052 [2024-12-08 02:29:34.200871] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.052 [2024-12-08 02:29:34.210389] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.052 [2024-12-08 02:29:34.210697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-12-08 02:29:34.210855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-12-08 02:29:34.210883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.052 [2024-12-08 02:29:34.210900] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.052 [2024-12-08 02:29:34.211065] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.052 [2024-12-08 02:29:34.211217] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.052 [2024-12-08 02:29:34.211246] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.052 [2024-12-08 02:29:34.211262] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.052 [2024-12-08 02:29:34.213390] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.052 [2024-12-08 02:29:34.222976] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.052 [2024-12-08 02:29:34.223233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-12-08 02:29:34.223371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-12-08 02:29:34.223399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.052 [2024-12-08 02:29:34.223416] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.052 [2024-12-08 02:29:34.223574] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.052 [2024-12-08 02:29:34.223744] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.052 [2024-12-08 02:29:34.223768] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.052 [2024-12-08 02:29:34.223783] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.052 [2024-12-08 02:29:34.225997] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.052 [2024-12-08 02:29:34.235706] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.052 [2024-12-08 02:29:34.235977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-12-08 02:29:34.236116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.052 [2024-12-08 02:29:34.236144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.052 [2024-12-08 02:29:34.236161] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.052 [2024-12-08 02:29:34.236344] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.052 [2024-12-08 02:29:34.236496] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.052 [2024-12-08 02:29:34.236519] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.052 [2024-12-08 02:29:34.236545] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.052 [2024-12-08 02:29:34.238857] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.053 [2024-12-08 02:29:34.248329] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.053 [2024-12-08 02:29:34.248634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-12-08 02:29:34.248772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-12-08 02:29:34.248797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.053 [2024-12-08 02:29:34.248813] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.053 [2024-12-08 02:29:34.249021] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.053 [2024-12-08 02:29:34.249263] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.053 [2024-12-08 02:29:34.249287] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.053 [2024-12-08 02:29:34.249308] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.053 [2024-12-08 02:29:34.251553] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.053 [2024-12-08 02:29:34.260998] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.053 [2024-12-08 02:29:34.261266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-12-08 02:29:34.261398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-12-08 02:29:34.261426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.053 [2024-12-08 02:29:34.261444] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.053 [2024-12-08 02:29:34.261585] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.053 [2024-12-08 02:29:34.261773] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.053 [2024-12-08 02:29:34.261797] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.053 [2024-12-08 02:29:34.261812] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.053 [2024-12-08 02:29:34.264172] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.053 [2024-12-08 02:29:34.273475] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.053 [2024-12-08 02:29:34.273761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-12-08 02:29:34.273900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-12-08 02:29:34.273925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.053 [2024-12-08 02:29:34.273940] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.053 [2024-12-08 02:29:34.274112] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.053 [2024-12-08 02:29:34.274292] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.053 [2024-12-08 02:29:34.274315] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.053 [2024-12-08 02:29:34.274331] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.053 [2024-12-08 02:29:34.276665] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.053 [2024-12-08 02:29:34.286050] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.053 [2024-12-08 02:29:34.286408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-12-08 02:29:34.286546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-12-08 02:29:34.286575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.053 [2024-12-08 02:29:34.286593] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.053 [2024-12-08 02:29:34.286758] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.053 [2024-12-08 02:29:34.286910] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.053 [2024-12-08 02:29:34.286933] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.053 [2024-12-08 02:29:34.286949] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.053 [2024-12-08 02:29:34.289169] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.053 [2024-12-08 02:29:34.298886] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.053 [2024-12-08 02:29:34.299241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-12-08 02:29:34.299393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-12-08 02:29:34.299422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.053 [2024-12-08 02:29:34.299439] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.053 [2024-12-08 02:29:34.299615] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.053 [2024-12-08 02:29:34.299769] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.053 [2024-12-08 02:29:34.299792] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.053 [2024-12-08 02:29:34.299807] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.053 [2024-12-08 02:29:34.302182] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.053 [2024-12-08 02:29:34.311637] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.053 [2024-12-08 02:29:34.311989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-12-08 02:29:34.312143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-12-08 02:29:34.312171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.053 [2024-12-08 02:29:34.312189] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.053 [2024-12-08 02:29:34.312354] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.053 [2024-12-08 02:29:34.312552] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.053 [2024-12-08 02:29:34.312576] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.053 [2024-12-08 02:29:34.312591] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.053 [2024-12-08 02:29:34.314987] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.053 [2024-12-08 02:29:34.324353] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.053 [2024-12-08 02:29:34.324715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-12-08 02:29:34.324932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.053 [2024-12-08 02:29:34.324983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.053 [2024-12-08 02:29:34.325000] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.053 [2024-12-08 02:29:34.325147] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.053 [2024-12-08 02:29:34.325299] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.053 [2024-12-08 02:29:34.325321] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.053 [2024-12-08 02:29:34.325336] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.053 [2024-12-08 02:29:34.327869] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.053 [2024-12-08 02:29:34.336969] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.053 [2024-12-08 02:29:34.337312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-12-08 02:29:34.337488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-12-08 02:29:34.337516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.054 [2024-12-08 02:29:34.337533] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.054 [2024-12-08 02:29:34.337694] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.054 [2024-12-08 02:29:34.337846] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.054 [2024-12-08 02:29:34.337869] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.054 [2024-12-08 02:29:34.337884] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.054 [2024-12-08 02:29:34.340298] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.054 [2024-12-08 02:29:34.349692] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.054 [2024-12-08 02:29:34.350049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-12-08 02:29:34.350227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-12-08 02:29:34.350282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.054 [2024-12-08 02:29:34.350299] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.054 [2024-12-08 02:29:34.350482] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.054 [2024-12-08 02:29:34.350681] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.054 [2024-12-08 02:29:34.350705] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.054 [2024-12-08 02:29:34.350721] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.054 [2024-12-08 02:29:34.353175] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.054 [2024-12-08 02:29:34.362288] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.054 [2024-12-08 02:29:34.362595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-12-08 02:29:34.362726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-12-08 02:29:34.362754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.054 [2024-12-08 02:29:34.362771] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.054 [2024-12-08 02:29:34.362973] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.054 [2024-12-08 02:29:34.363089] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.054 [2024-12-08 02:29:34.363112] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.054 [2024-12-08 02:29:34.363128] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.054 [2024-12-08 02:29:34.365627] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.054 [2024-12-08 02:29:34.374787] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.054 [2024-12-08 02:29:34.375133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-12-08 02:29:34.375256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-12-08 02:29:34.375284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.054 [2024-12-08 02:29:34.375302] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.054 [2024-12-08 02:29:34.375485] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.054 [2024-12-08 02:29:34.375685] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.054 [2024-12-08 02:29:34.375709] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.054 [2024-12-08 02:29:34.375724] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.054 [2024-12-08 02:29:34.378138] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.054 [2024-12-08 02:29:34.387512] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.054 [2024-12-08 02:29:34.387886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-12-08 02:29:34.388157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-12-08 02:29:34.388206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.054 [2024-12-08 02:29:34.388224] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.054 [2024-12-08 02:29:34.388408] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.054 [2024-12-08 02:29:34.388552] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.054 [2024-12-08 02:29:34.388576] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.054 [2024-12-08 02:29:34.388592] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.054 [2024-12-08 02:29:34.391004] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.054 [2024-12-08 02:29:34.400305] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.054 [2024-12-08 02:29:34.400620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-12-08 02:29:34.400720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-12-08 02:29:34.400746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.054 [2024-12-08 02:29:34.400762] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.054 [2024-12-08 02:29:34.400939] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.054 [2024-12-08 02:29:34.401091] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.054 [2024-12-08 02:29:34.401115] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.054 [2024-12-08 02:29:34.401130] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.054 [2024-12-08 02:29:34.403461] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.054 [2024-12-08 02:29:34.412759] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.054 [2024-12-08 02:29:34.413141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-12-08 02:29:34.413323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-12-08 02:29:34.413352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.054 [2024-12-08 02:29:34.413369] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.054 [2024-12-08 02:29:34.413546] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.054 [2024-12-08 02:29:34.413681] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.054 [2024-12-08 02:29:34.413705] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.054 [2024-12-08 02:29:34.413720] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.054 [2024-12-08 02:29:34.416044] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.054 [2024-12-08 02:29:34.425436] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.054 [2024-12-08 02:29:34.425753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-12-08 02:29:34.425938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-12-08 02:29:34.425991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.054 [2024-12-08 02:29:34.426008] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.054 [2024-12-08 02:29:34.426174] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.054 [2024-12-08 02:29:34.426308] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.054 [2024-12-08 02:29:34.426331] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.054 [2024-12-08 02:29:34.426347] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.054 [2024-12-08 02:29:34.428760] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.054 [2024-12-08 02:29:34.438095] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.054 [2024-12-08 02:29:34.438403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-12-08 02:29:34.438528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.054 [2024-12-08 02:29:34.438567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.054 [2024-12-08 02:29:34.438585] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.055 [2024-12-08 02:29:34.438751] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.055 [2024-12-08 02:29:34.438921] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.055 [2024-12-08 02:29:34.438944] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.055 [2024-12-08 02:29:34.438960] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.055 [2024-12-08 02:29:34.441233] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.055 [2024-12-08 02:29:34.450684] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.055 [2024-12-08 02:29:34.451007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-12-08 02:29:34.451165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-12-08 02:29:34.451193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.055 [2024-12-08 02:29:34.451216] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.055 [2024-12-08 02:29:34.451400] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.055 [2024-12-08 02:29:34.451589] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.055 [2024-12-08 02:29:34.451614] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.055 [2024-12-08 02:29:34.451630] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.055 [2024-12-08 02:29:34.453901] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.055 [2024-12-08 02:29:34.463145] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.055 [2024-12-08 02:29:34.463457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-12-08 02:29:34.463603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-12-08 02:29:34.463665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.055 [2024-12-08 02:29:34.463683] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.055 [2024-12-08 02:29:34.463830] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.055 [2024-12-08 02:29:34.463982] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.055 [2024-12-08 02:29:34.464004] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.055 [2024-12-08 02:29:34.464020] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.055 [2024-12-08 02:29:34.466482] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.055 [2024-12-08 02:29:34.475803] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.055 [2024-12-08 02:29:34.476069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-12-08 02:29:34.476237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-12-08 02:29:34.476263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.055 [2024-12-08 02:29:34.476278] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.055 [2024-12-08 02:29:34.476457] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.055 [2024-12-08 02:29:34.476641] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.055 [2024-12-08 02:29:34.476665] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.055 [2024-12-08 02:29:34.476700] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.055 [2024-12-08 02:29:34.479122] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.055 [2024-12-08 02:29:34.488533] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.055 [2024-12-08 02:29:34.488837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-12-08 02:29:34.489008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-12-08 02:29:34.489056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.055 [2024-12-08 02:29:34.489073] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.055 [2024-12-08 02:29:34.489194] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.055 [2024-12-08 02:29:34.489363] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.055 [2024-12-08 02:29:34.489387] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.055 [2024-12-08 02:29:34.489402] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.055 [2024-12-08 02:29:34.491737] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.055 [2024-12-08 02:29:34.501295] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.055 [2024-12-08 02:29:34.501617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-12-08 02:29:34.501772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-12-08 02:29:34.501800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.055 [2024-12-08 02:29:34.501817] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.055 [2024-12-08 02:29:34.502001] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.055 [2024-12-08 02:29:34.502188] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.055 [2024-12-08 02:29:34.502213] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.055 [2024-12-08 02:29:34.502229] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.055 [2024-12-08 02:29:34.504482] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.055 [2024-12-08 02:29:34.513958] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.055 [2024-12-08 02:29:34.514264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-12-08 02:29:34.514417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-12-08 02:29:34.514442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.055 [2024-12-08 02:29:34.514458] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.055 [2024-12-08 02:29:34.514669] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.055 [2024-12-08 02:29:34.514823] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.055 [2024-12-08 02:29:34.514846] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.055 [2024-12-08 02:29:34.514862] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.055 [2024-12-08 02:29:34.517302] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.055 [2024-12-08 02:29:34.526619] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.055 [2024-12-08 02:29:34.526982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-12-08 02:29:34.527167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-12-08 02:29:34.527192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.055 [2024-12-08 02:29:34.527208] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.055 [2024-12-08 02:29:34.527366] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.055 [2024-12-08 02:29:34.527521] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.055 [2024-12-08 02:29:34.527558] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.055 [2024-12-08 02:29:34.527574] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.055 [2024-12-08 02:29:34.529955] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.055 [2024-12-08 02:29:34.539114] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.055 [2024-12-08 02:29:34.539458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-12-08 02:29:34.539594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-12-08 02:29:34.539625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.055 [2024-12-08 02:29:34.539643] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.055 [2024-12-08 02:29:34.539792] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.055 [2024-12-08 02:29:34.539980] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.055 [2024-12-08 02:29:34.540004] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.055 [2024-12-08 02:29:34.540019] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.055 [2024-12-08 02:29:34.542326] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.055 [2024-12-08 02:29:34.551674] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.055 [2024-12-08 02:29:34.552075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-12-08 02:29:34.552170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.055 [2024-12-08 02:29:34.552214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.055 [2024-12-08 02:29:34.552232] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.055 [2024-12-08 02:29:34.552379] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.055 [2024-12-08 02:29:34.552560] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.056 [2024-12-08 02:29:34.552603] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.056 [2024-12-08 02:29:34.552617] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.056 [2024-12-08 02:29:34.554875] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.056 [2024-12-08 02:29:34.564227] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.056 [2024-12-08 02:29:34.564605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-12-08 02:29:34.564705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-12-08 02:29:34.564730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.056 [2024-12-08 02:29:34.564746] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.056 [2024-12-08 02:29:34.564920] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.056 [2024-12-08 02:29:34.565072] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.056 [2024-12-08 02:29:34.565101] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.056 [2024-12-08 02:29:34.565117] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.056 [2024-12-08 02:29:34.567535] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.056 [2024-12-08 02:29:34.576941] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.056 [2024-12-08 02:29:34.577231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-12-08 02:29:34.577398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-12-08 02:29:34.577426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.056 [2024-12-08 02:29:34.577443] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.056 [2024-12-08 02:29:34.577657] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.056 [2024-12-08 02:29:34.577779] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.056 [2024-12-08 02:29:34.577799] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.056 [2024-12-08 02:29:34.577813] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.056 [2024-12-08 02:29:34.580265] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.056 [2024-12-08 02:29:34.589399] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.056 [2024-12-08 02:29:34.589764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-12-08 02:29:34.589880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-12-08 02:29:34.589908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.056 [2024-12-08 02:29:34.589926] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.056 [2024-12-08 02:29:34.590037] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.056 [2024-12-08 02:29:34.590206] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.056 [2024-12-08 02:29:34.590229] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.056 [2024-12-08 02:29:34.590244] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.056 [2024-12-08 02:29:34.592528] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.056 [2024-12-08 02:29:34.601842] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.056 [2024-12-08 02:29:34.602191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-12-08 02:29:34.602313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-12-08 02:29:34.602340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.056 [2024-12-08 02:29:34.602357] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.056 [2024-12-08 02:29:34.602571] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.056 [2024-12-08 02:29:34.602719] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.056 [2024-12-08 02:29:34.602739] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.056 [2024-12-08 02:29:34.602757] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.056 [2024-12-08 02:29:34.605148] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.056 [2024-12-08 02:29:34.614351] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.056 [2024-12-08 02:29:34.614655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-12-08 02:29:34.614747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-12-08 02:29:34.614772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.056 [2024-12-08 02:29:34.614788] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.056 [2024-12-08 02:29:34.614952] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.056 [2024-12-08 02:29:34.615105] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.056 [2024-12-08 02:29:34.615126] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.056 [2024-12-08 02:29:34.615141] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.056 [2024-12-08 02:29:34.617441] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.056 [2024-12-08 02:29:34.626912] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.056 [2024-12-08 02:29:34.627239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-12-08 02:29:34.627361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-12-08 02:29:34.627391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.056 [2024-12-08 02:29:34.627423] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.056 [2024-12-08 02:29:34.627599] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.056 [2024-12-08 02:29:34.627769] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.056 [2024-12-08 02:29:34.627790] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.056 [2024-12-08 02:29:34.627804] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.056 [2024-12-08 02:29:34.629989] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.056 [2024-12-08 02:29:34.639687] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.056 [2024-12-08 02:29:34.640558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-12-08 02:29:34.640688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-12-08 02:29:34.640716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.056 [2024-12-08 02:29:34.640733] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.056 [2024-12-08 02:29:34.640890] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.056 [2024-12-08 02:29:34.641034] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.056 [2024-12-08 02:29:34.641059] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.056 [2024-12-08 02:29:34.641075] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.056 [2024-12-08 02:29:34.643569] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.056 [2024-12-08 02:29:34.652140] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.056 [2024-12-08 02:29:34.652491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-12-08 02:29:34.652645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.056 [2024-12-08 02:29:34.652672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.056 [2024-12-08 02:29:34.652688] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.056 [2024-12-08 02:29:34.652892] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.056 [2024-12-08 02:29:34.653045] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.056 [2024-12-08 02:29:34.653068] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.056 [2024-12-08 02:29:34.653083] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.057 [2024-12-08 02:29:34.655433] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.057 [2024-12-08 02:29:34.664662] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.057 [2024-12-08 02:29:34.664999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-12-08 02:29:34.665157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-12-08 02:29:34.665185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.057 [2024-12-08 02:29:34.665202] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.057 [2024-12-08 02:29:34.665367] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.057 [2024-12-08 02:29:34.665596] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.057 [2024-12-08 02:29:34.665617] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.057 [2024-12-08 02:29:34.665630] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.057 [2024-12-08 02:29:34.667891] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.057 [2024-12-08 02:29:34.677292] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.057 [2024-12-08 02:29:34.677589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-12-08 02:29:34.677685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-12-08 02:29:34.677711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.057 [2024-12-08 02:29:34.677726] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.057 [2024-12-08 02:29:34.677862] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.057 [2024-12-08 02:29:34.678032] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.057 [2024-12-08 02:29:34.678055] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.057 [2024-12-08 02:29:34.678070] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.057 [2024-12-08 02:29:34.680566] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.057 [2024-12-08 02:29:34.690048] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.057 [2024-12-08 02:29:34.690336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-12-08 02:29:34.690489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-12-08 02:29:34.690517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.057 [2024-12-08 02:29:34.690535] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.057 [2024-12-08 02:29:34.690693] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.057 [2024-12-08 02:29:34.690827] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.057 [2024-12-08 02:29:34.690850] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.057 [2024-12-08 02:29:34.690865] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.057 [2024-12-08 02:29:34.693262] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.057 [2024-12-08 02:29:34.702638] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.057 [2024-12-08 02:29:34.702981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-12-08 02:29:34.703106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-12-08 02:29:34.703131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.057 [2024-12-08 02:29:34.703147] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.057 [2024-12-08 02:29:34.703326] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.057 [2024-12-08 02:29:34.703514] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.057 [2024-12-08 02:29:34.703548] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.057 [2024-12-08 02:29:34.703566] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.057 [2024-12-08 02:29:34.705620] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.057 [2024-12-08 02:29:34.715282] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.057 [2024-12-08 02:29:34.715627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-12-08 02:29:34.715771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-12-08 02:29:34.715796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.057 [2024-12-08 02:29:34.715811] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.057 [2024-12-08 02:29:34.715951] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.057 [2024-12-08 02:29:34.716156] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.057 [2024-12-08 02:29:34.716179] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.057 [2024-12-08 02:29:34.716194] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.057 [2024-12-08 02:29:34.718580] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.057 [2024-12-08 02:29:34.727731] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.057 [2024-12-08 02:29:34.728089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-12-08 02:29:34.728212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-12-08 02:29:34.728237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.057 [2024-12-08 02:29:34.728252] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.057 [2024-12-08 02:29:34.728445] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.057 [2024-12-08 02:29:34.728627] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.057 [2024-12-08 02:29:34.728651] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.057 [2024-12-08 02:29:34.728666] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.057 [2024-12-08 02:29:34.731112] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.057 [2024-12-08 02:29:34.740299] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.057 [2024-12-08 02:29:34.740586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-12-08 02:29:34.740766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-12-08 02:29:34.740799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.057 [2024-12-08 02:29:34.740832] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.057 [2024-12-08 02:29:34.741033] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.057 [2024-12-08 02:29:34.741203] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.057 [2024-12-08 02:29:34.741226] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.057 [2024-12-08 02:29:34.741241] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.057 [2024-12-08 02:29:34.743513] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.057 [2024-12-08 02:29:34.752900] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.057 [2024-12-08 02:29:34.753242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-12-08 02:29:34.753366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-12-08 02:29:34.753394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.057 [2024-12-08 02:29:34.753412] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.057 [2024-12-08 02:29:34.753608] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.057 [2024-12-08 02:29:34.753796] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.057 [2024-12-08 02:29:34.753819] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.057 [2024-12-08 02:29:34.753834] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.057 [2024-12-08 02:29:34.756299] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.057 [2024-12-08 02:29:34.765488] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.057 [2024-12-08 02:29:34.765789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-12-08 02:29:34.765924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-12-08 02:29:34.765953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.057 [2024-12-08 02:29:34.765970] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.057 [2024-12-08 02:29:34.766136] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.057 [2024-12-08 02:29:34.766306] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.057 [2024-12-08 02:29:34.766329] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.057 [2024-12-08 02:29:34.766344] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.057 [2024-12-08 02:29:34.768621] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.057 [2024-12-08 02:29:34.778090] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.057 [2024-12-08 02:29:34.778325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.057 [2024-12-08 02:29:34.778496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-12-08 02:29:34.778521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.058 [2024-12-08 02:29:34.778544] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.058 [2024-12-08 02:29:34.778726] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.058 [2024-12-08 02:29:34.778908] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.058 [2024-12-08 02:29:34.778932] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.058 [2024-12-08 02:29:34.778947] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.058 [2024-12-08 02:29:34.781178] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.058 [2024-12-08 02:29:34.790774] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.058 [2024-12-08 02:29:34.791112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-12-08 02:29:34.791270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-12-08 02:29:34.791298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.058 [2024-12-08 02:29:34.791316] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.058 [2024-12-08 02:29:34.791481] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.058 [2024-12-08 02:29:34.791679] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.058 [2024-12-08 02:29:34.791703] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.058 [2024-12-08 02:29:34.791719] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.058 [2024-12-08 02:29:34.793936] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.058 [2024-12-08 02:29:34.803458] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.058 [2024-12-08 02:29:34.803816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-12-08 02:29:34.803948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-12-08 02:29:34.803976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.058 [2024-12-08 02:29:34.803999] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.058 [2024-12-08 02:29:34.804129] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.058 [2024-12-08 02:29:34.804281] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.058 [2024-12-08 02:29:34.804304] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.058 [2024-12-08 02:29:34.804319] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.058 [2024-12-08 02:29:34.806501] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.058 [2024-12-08 02:29:34.816051] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.058 [2024-12-08 02:29:34.816324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-12-08 02:29:34.816474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.058 [2024-12-08 02:29:34.816502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.058 [2024-12-08 02:29:34.816520] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.058 [2024-12-08 02:29:34.816676] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.058 [2024-12-08 02:29:34.816864] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.058 [2024-12-08 02:29:34.816887] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.058 [2024-12-08 02:29:34.816903] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.058 [2024-12-08 02:29:34.819242] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.317 [2024-12-08 02:29:34.828509] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.317 [2024-12-08 02:29:34.828834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.317 [2024-12-08 02:29:34.829015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.317 [2024-12-08 02:29:34.829041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.317 [2024-12-08 02:29:34.829056] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.317 [2024-12-08 02:29:34.829156] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.317 [2024-12-08 02:29:34.829285] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.317 [2024-12-08 02:29:34.829321] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.317 [2024-12-08 02:29:34.829337] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.317 [2024-12-08 02:29:34.831602] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.317 [2024-12-08 02:29:34.841364] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.317 [2024-12-08 02:29:34.841717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.317 [2024-12-08 02:29:34.841888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.317 [2024-12-08 02:29:34.841913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.317 [2024-12-08 02:29:34.841928] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.317 [2024-12-08 02:29:34.842093] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.318 [2024-12-08 02:29:34.842296] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.318 [2024-12-08 02:29:34.842319] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.318 [2024-12-08 02:29:34.842334] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.318 [2024-12-08 02:29:34.844579] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.318 [2024-12-08 02:29:34.853886] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.318 [2024-12-08 02:29:34.854388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.318 [2024-12-08 02:29:34.854549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.318 [2024-12-08 02:29:34.854591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.318 [2024-12-08 02:29:34.854607] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.318 [2024-12-08 02:29:34.854770] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.318 [2024-12-08 02:29:34.854950] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.318 [2024-12-08 02:29:34.854973] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.318 [2024-12-08 02:29:34.854988] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.318 [2024-12-08 02:29:34.857118] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.318 [2024-12-08 02:29:34.866598] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.318 [2024-12-08 02:29:34.866893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.318 [2024-12-08 02:29:34.867046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.318 [2024-12-08 02:29:34.867074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.318 [2024-12-08 02:29:34.867091] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.318 [2024-12-08 02:29:34.867292] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.318 [2024-12-08 02:29:34.867443] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.318 [2024-12-08 02:29:34.867465] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.318 [2024-12-08 02:29:34.867481] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.318 [2024-12-08 02:29:34.869761] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.318 [2024-12-08 02:29:34.879087] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.318 [2024-12-08 02:29:34.879381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.318 [2024-12-08 02:29:34.879516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.318 [2024-12-08 02:29:34.879547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.318 [2024-12-08 02:29:34.879579] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.318 [2024-12-08 02:29:34.879726] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.318 [2024-12-08 02:29:34.879947] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.318 [2024-12-08 02:29:34.879971] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.318 [2024-12-08 02:29:34.879987] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.318 [2024-12-08 02:29:34.882222] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.318 [2024-12-08 02:29:34.891834] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.318 [2024-12-08 02:29:34.892158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.318 [2024-12-08 02:29:34.892259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.318 [2024-12-08 02:29:34.892287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.318 [2024-12-08 02:29:34.892304] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.318 [2024-12-08 02:29:34.892470] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.318 [2024-12-08 02:29:34.892595] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.318 [2024-12-08 02:29:34.892619] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.318 [2024-12-08 02:29:34.892635] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.318 [2024-12-08 02:29:34.895011] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.318 [2024-12-08 02:29:34.904498] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.318 [2024-12-08 02:29:34.904793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.318 [2024-12-08 02:29:34.904946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.318 [2024-12-08 02:29:34.904974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.318 [2024-12-08 02:29:34.904991] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.318 [2024-12-08 02:29:34.905174] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.318 [2024-12-08 02:29:34.905307] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.318 [2024-12-08 02:29:34.905330] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.318 [2024-12-08 02:29:34.905346] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.318 [2024-12-08 02:29:34.907714] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.318 [2024-12-08 02:29:34.917038] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.318 [2024-12-08 02:29:34.917307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.318 [2024-12-08 02:29:34.917438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.318 [2024-12-08 02:29:34.917465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.318 [2024-12-08 02:29:34.917483] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.318 [2024-12-08 02:29:34.917640] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.318 [2024-12-08 02:29:34.917828] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.318 [2024-12-08 02:29:34.917857] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.318 [2024-12-08 02:29:34.917873] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.318 [2024-12-08 02:29:34.920071] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.318 [2024-12-08 02:29:34.929512] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.318 [2024-12-08 02:29:34.929885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.318 [2024-12-08 02:29:34.930006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.318 [2024-12-08 02:29:34.930032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.318 [2024-12-08 02:29:34.930047] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.318 [2024-12-08 02:29:34.930241] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.318 [2024-12-08 02:29:34.930420] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.318 [2024-12-08 02:29:34.930444] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.318 [2024-12-08 02:29:34.930459] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.318 [2024-12-08 02:29:34.932757] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.318 [2024-12-08 02:29:34.942210] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.318 [2024-12-08 02:29:34.942486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.318 [2024-12-08 02:29:34.942642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.318 [2024-12-08 02:29:34.942669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.318 [2024-12-08 02:29:34.942685] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.318 [2024-12-08 02:29:34.942879] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.318 [2024-12-08 02:29:34.943083] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.318 [2024-12-08 02:29:34.943107] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.318 [2024-12-08 02:29:34.943122] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.318 [2024-12-08 02:29:34.945517] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.318 [2024-12-08 02:29:34.954839] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.318 [2024-12-08 02:29:34.955123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.318 [2024-12-08 02:29:34.955286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.318 [2024-12-08 02:29:34.955312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.318 [2024-12-08 02:29:34.955327] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.318 [2024-12-08 02:29:34.955518] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.318 [2024-12-08 02:29:34.955659] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.318 [2024-12-08 02:29:34.955683] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.319 [2024-12-08 02:29:34.955703] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.319 [2024-12-08 02:29:34.958026] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.319 [2024-12-08 02:29:34.967294] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.319 [2024-12-08 02:29:34.967598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.319 [2024-12-08 02:29:34.967765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.319 [2024-12-08 02:29:34.967791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.319 [2024-12-08 02:29:34.967807] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.319 [2024-12-08 02:29:34.967967] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.319 [2024-12-08 02:29:34.968166] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.319 [2024-12-08 02:29:34.968190] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.319 [2024-12-08 02:29:34.968206] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.319 [2024-12-08 02:29:34.970493] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.319 [2024-12-08 02:29:34.980041] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.319 [2024-12-08 02:29:34.980352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.319 [2024-12-08 02:29:34.980502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.319 [2024-12-08 02:29:34.980530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.319 [2024-12-08 02:29:34.980557] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.319 [2024-12-08 02:29:34.980742] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.319 [2024-12-08 02:29:34.980930] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.319 [2024-12-08 02:29:34.980954] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.319 [2024-12-08 02:29:34.980969] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.319 [2024-12-08 02:29:34.983328] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.319 [2024-12-08 02:29:34.992645] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.319 [2024-12-08 02:29:34.992963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.319 [2024-12-08 02:29:34.993089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.319 [2024-12-08 02:29:34.993117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.319 [2024-12-08 02:29:34.993134] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.319 [2024-12-08 02:29:34.993299] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.319 [2024-12-08 02:29:34.993487] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.319 [2024-12-08 02:29:34.993510] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.319 [2024-12-08 02:29:34.993525] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.319 [2024-12-08 02:29:34.995884] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.319 [2024-12-08 02:29:35.005223] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.319 [2024-12-08 02:29:35.005552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.319 [2024-12-08 02:29:35.005681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.319 [2024-12-08 02:29:35.005711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.319 [2024-12-08 02:29:35.005728] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.319 [2024-12-08 02:29:35.005840] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.319 [2024-12-08 02:29:35.006028] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.319 [2024-12-08 02:29:35.006051] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.319 [2024-12-08 02:29:35.006067] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.319 [2024-12-08 02:29:35.008465] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.319 [2024-12-08 02:29:35.017805] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.319 [2024-12-08 02:29:35.018123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.319 [2024-12-08 02:29:35.018261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.319 [2024-12-08 02:29:35.018287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.319 [2024-12-08 02:29:35.018302] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.319 [2024-12-08 02:29:35.018552] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.319 [2024-12-08 02:29:35.018741] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.319 [2024-12-08 02:29:35.018764] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.319 [2024-12-08 02:29:35.018779] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.319 [2024-12-08 02:29:35.021139] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.319 [2024-12-08 02:29:35.030424] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.319 [2024-12-08 02:29:35.030723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.319 [2024-12-08 02:29:35.030878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.319 [2024-12-08 02:29:35.030907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.319 [2024-12-08 02:29:35.030925] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.319 [2024-12-08 02:29:35.031090] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.319 [2024-12-08 02:29:35.031242] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.319 [2024-12-08 02:29:35.031265] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.319 [2024-12-08 02:29:35.031280] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.319 [2024-12-08 02:29:35.033722] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.319 [2024-12-08 02:29:35.042771] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.319 [2024-12-08 02:29:35.043092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.319 [2024-12-08 02:29:35.043185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.319 [2024-12-08 02:29:35.043214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.319 [2024-12-08 02:29:35.043231] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.319 [2024-12-08 02:29:35.043415] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.319 [2024-12-08 02:29:35.043650] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.319 [2024-12-08 02:29:35.043674] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.319 [2024-12-08 02:29:35.043690] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.319 [2024-12-08 02:29:35.045851] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.319 [2024-12-08 02:29:35.055285] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.319 [2024-12-08 02:29:35.055602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.319 [2024-12-08 02:29:35.055720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.319 [2024-12-08 02:29:35.055768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.319 [2024-12-08 02:29:35.055786] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.319 [2024-12-08 02:29:35.055915] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.319 [2024-12-08 02:29:35.056085] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.319 [2024-12-08 02:29:35.056108] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.319 [2024-12-08 02:29:35.056123] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.319 [2024-12-08 02:29:35.058446] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.319 [2024-12-08 02:29:35.068040] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.319 [2024-12-08 02:29:35.068359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.319 [2024-12-08 02:29:35.068494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.319 [2024-12-08 02:29:35.068543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.319 [2024-12-08 02:29:35.068562] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.319 [2024-12-08 02:29:35.068711] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.319 [2024-12-08 02:29:35.068913] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.319 [2024-12-08 02:29:35.068937] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.319 [2024-12-08 02:29:35.068952] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.319 [2024-12-08 02:29:35.071348] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.319 [2024-12-08 02:29:35.080733] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.319 [2024-12-08 02:29:35.081025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.319 [2024-12-08 02:29:35.081156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.320 [2024-12-08 02:29:35.081184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.320 [2024-12-08 02:29:35.081202] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.320 [2024-12-08 02:29:35.081421] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.320 [2024-12-08 02:29:35.081619] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.320 [2024-12-08 02:29:35.081643] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.320 [2024-12-08 02:29:35.081659] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.320 [2024-12-08 02:29:35.084127] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.320 [2024-12-08 02:29:35.093373] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.320 [2024-12-08 02:29:35.093679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.320 [2024-12-08 02:29:35.093806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.320 [2024-12-08 02:29:35.093834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.320 [2024-12-08 02:29:35.093851] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.320 [2024-12-08 02:29:35.094017] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.320 [2024-12-08 02:29:35.094186] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.320 [2024-12-08 02:29:35.094209] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.320 [2024-12-08 02:29:35.094225] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.580 [2024-12-08 02:29:35.096408] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.580 [2024-12-08 02:29:35.105935] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.580 [2024-12-08 02:29:35.106215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.580 [2024-12-08 02:29:35.106340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.580 [2024-12-08 02:29:35.106368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.580 [2024-12-08 02:29:35.106385] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.580 [2024-12-08 02:29:35.106562] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.580 [2024-12-08 02:29:35.106695] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.580 [2024-12-08 02:29:35.106718] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.580 [2024-12-08 02:29:35.106733] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.580 [2024-12-08 02:29:35.108966] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.580 [2024-12-08 02:29:35.118560] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.580 [2024-12-08 02:29:35.118877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.580 [2024-12-08 02:29:35.119034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.580 [2024-12-08 02:29:35.119062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.580 [2024-12-08 02:29:35.119079] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.580 [2024-12-08 02:29:35.119226] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.580 [2024-12-08 02:29:35.119396] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.580 [2024-12-08 02:29:35.119419] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.580 [2024-12-08 02:29:35.119434] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.580 [2024-12-08 02:29:35.121873] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.580 [2024-12-08 02:29:35.130938] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.580 [2024-12-08 02:29:35.131255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.580 [2024-12-08 02:29:35.131387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.580 [2024-12-08 02:29:35.131415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.580 [2024-12-08 02:29:35.131432] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.580 [2024-12-08 02:29:35.131602] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.580 [2024-12-08 02:29:35.131793] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.580 [2024-12-08 02:29:35.131816] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.580 [2024-12-08 02:29:35.131832] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.580 [2024-12-08 02:29:35.134155] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.580 [2024-12-08 02:29:35.143752] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.580 [2024-12-08 02:29:35.144053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.580 [2024-12-08 02:29:35.144172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.580 [2024-12-08 02:29:35.144197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.580 [2024-12-08 02:29:35.144213] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.580 [2024-12-08 02:29:35.144403] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.580 [2024-12-08 02:29:35.144564] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.580 [2024-12-08 02:29:35.144602] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.580 [2024-12-08 02:29:35.144617] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.580 [2024-12-08 02:29:35.146692] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.580 [2024-12-08 02:29:35.156241] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.580 [2024-12-08 02:29:35.156492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.580 [2024-12-08 02:29:35.156654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.581 [2024-12-08 02:29:35.156683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.581 [2024-12-08 02:29:35.156706] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.581 [2024-12-08 02:29:35.156854] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.581 [2024-12-08 02:29:35.157060] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.581 [2024-12-08 02:29:35.157084] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.581 [2024-12-08 02:29:35.157099] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.581 [2024-12-08 02:29:35.159517] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.581 [2024-12-08 02:29:35.168826] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.581 [2024-12-08 02:29:35.169123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.581 [2024-12-08 02:29:35.169256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.581 [2024-12-08 02:29:35.169284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.581 [2024-12-08 02:29:35.169302] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.581 [2024-12-08 02:29:35.169485] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.581 [2024-12-08 02:29:35.169647] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.581 [2024-12-08 02:29:35.169671] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.581 [2024-12-08 02:29:35.169687] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.581 [2024-12-08 02:29:35.171922] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.581 [2024-12-08 02:29:35.181417] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.581 [2024-12-08 02:29:35.181712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.581 [2024-12-08 02:29:35.181842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.581 [2024-12-08 02:29:35.181871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.581 [2024-12-08 02:29:35.181888] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.581 [2024-12-08 02:29:35.182072] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.581 [2024-12-08 02:29:35.182241] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.581 [2024-12-08 02:29:35.182265] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.581 [2024-12-08 02:29:35.182280] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.581 [2024-12-08 02:29:35.184578] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.581 [2024-12-08 02:29:35.194033] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.581 [2024-12-08 02:29:35.194352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.581 [2024-12-08 02:29:35.194519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.581 [2024-12-08 02:29:35.194552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.581 [2024-12-08 02:29:35.194569] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.581 [2024-12-08 02:29:35.194710] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.581 [2024-12-08 02:29:35.194888] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.581 [2024-12-08 02:29:35.194912] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.581 [2024-12-08 02:29:35.194928] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.581 [2024-12-08 02:29:35.197215] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.581 [2024-12-08 02:29:35.206633] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.581 [2024-12-08 02:29:35.206920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.581 [2024-12-08 02:29:35.207074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.581 [2024-12-08 02:29:35.207103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.581 [2024-12-08 02:29:35.207120] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.581 [2024-12-08 02:29:35.207321] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.581 [2024-12-08 02:29:35.207491] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.581 [2024-12-08 02:29:35.207514] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.581 [2024-12-08 02:29:35.207529] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.581 [2024-12-08 02:29:35.209775] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.581 [2024-12-08 02:29:35.219345] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.581 [2024-12-08 02:29:35.219598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.581 [2024-12-08 02:29:35.219742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.581 [2024-12-08 02:29:35.219768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.581 [2024-12-08 02:29:35.219784] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.581 [2024-12-08 02:29:35.220018] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.581 [2024-12-08 02:29:35.220145] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.581 [2024-12-08 02:29:35.220168] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.581 [2024-12-08 02:29:35.220184] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.581 [2024-12-08 02:29:35.222291] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.581 [2024-12-08 02:29:35.231933] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.581 [2024-12-08 02:29:35.232266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.581 [2024-12-08 02:29:35.232389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.581 [2024-12-08 02:29:35.232418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.581 [2024-12-08 02:29:35.232435] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.581 [2024-12-08 02:29:35.232605] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.581 [2024-12-08 02:29:35.232812] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.581 [2024-12-08 02:29:35.232835] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.581 [2024-12-08 02:29:35.232850] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.581 [2024-12-08 02:29:35.235280] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.581 [2024-12-08 02:29:35.244420] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.581 [2024-12-08 02:29:35.244712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.581 [2024-12-08 02:29:35.244807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.581 [2024-12-08 02:29:35.244836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.581 [2024-12-08 02:29:35.244853] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.581 [2024-12-08 02:29:35.245037] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.582 [2024-12-08 02:29:35.245189] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.582 [2024-12-08 02:29:35.245212] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.582 [2024-12-08 02:29:35.245227] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.582 [2024-12-08 02:29:35.247498] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.582 [2024-12-08 02:29:35.257008] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.582 [2024-12-08 02:29:35.257309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.582 [2024-12-08 02:29:35.257450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.582 [2024-12-08 02:29:35.257475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.582 [2024-12-08 02:29:35.257490] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.582 [2024-12-08 02:29:35.257698] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.582 [2024-12-08 02:29:35.257870] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.582 [2024-12-08 02:29:35.257893] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.582 [2024-12-08 02:29:35.257909] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.582 [2024-12-08 02:29:35.260216] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.582 [2024-12-08 02:29:35.269712] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.582 [2024-12-08 02:29:35.269963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.582 [2024-12-08 02:29:35.270064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.582 [2024-12-08 02:29:35.270092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.582 [2024-12-08 02:29:35.270110] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.582 [2024-12-08 02:29:35.270256] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.582 [2024-12-08 02:29:35.270468] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.582 [2024-12-08 02:29:35.270492] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.582 [2024-12-08 02:29:35.270507] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.582 [2024-12-08 02:29:35.272858] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.582 [2024-12-08 02:29:35.282183] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.582 [2024-12-08 02:29:35.282498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.582 [2024-12-08 02:29:35.282669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.582 [2024-12-08 02:29:35.282695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.582 [2024-12-08 02:29:35.282711] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.582 [2024-12-08 02:29:35.282875] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.582 [2024-12-08 02:29:35.283089] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.582 [2024-12-08 02:29:35.283113] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.582 [2024-12-08 02:29:35.283128] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.582 [2024-12-08 02:29:35.285435] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.582 [2024-12-08 02:29:35.294727] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.582 [2024-12-08 02:29:35.295037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.582 [2024-12-08 02:29:35.295191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.582 [2024-12-08 02:29:35.295219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.582 [2024-12-08 02:29:35.295236] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.582 [2024-12-08 02:29:35.295384] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.582 [2024-12-08 02:29:35.295534] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.582 [2024-12-08 02:29:35.295568] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.582 [2024-12-08 02:29:35.295584] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.582 [2024-12-08 02:29:35.298051] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.582 [2024-12-08 02:29:35.307395] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.582 [2024-12-08 02:29:35.307766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.582 [2024-12-08 02:29:35.307950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.582 [2024-12-08 02:29:35.307977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.582 [2024-12-08 02:29:35.307994] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.582 [2024-12-08 02:29:35.308177] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.582 [2024-12-08 02:29:35.308292] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.582 [2024-12-08 02:29:35.308315] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.582 [2024-12-08 02:29:35.308335] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.582 [2024-12-08 02:29:35.310650] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.583 [2024-12-08 02:29:35.320061] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.583 [2024-12-08 02:29:35.320433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.583 [2024-12-08 02:29:35.320597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.583 [2024-12-08 02:29:35.320626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.583 [2024-12-08 02:29:35.320644] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.583 [2024-12-08 02:29:35.320791] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.583 [2024-12-08 02:29:35.320979] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.583 [2024-12-08 02:29:35.321002] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.583 [2024-12-08 02:29:35.321017] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.583 [2024-12-08 02:29:35.323376] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.583 [2024-12-08 02:29:35.332482] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.583 [2024-12-08 02:29:35.332841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.583 [2024-12-08 02:29:35.333066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.583 [2024-12-08 02:29:35.333126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.583 [2024-12-08 02:29:35.333143] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.583 [2024-12-08 02:29:35.333327] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.583 [2024-12-08 02:29:35.333532] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.583 [2024-12-08 02:29:35.333566] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.583 [2024-12-08 02:29:35.333582] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.583 [2024-12-08 02:29:35.335959] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.583 [2024-12-08 02:29:35.345039] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.583 [2024-12-08 02:29:35.345289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.583 [2024-12-08 02:29:35.345441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.583 [2024-12-08 02:29:35.345470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.583 [2024-12-08 02:29:35.345488] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.583 [2024-12-08 02:29:35.345649] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.583 [2024-12-08 02:29:35.345837] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.583 [2024-12-08 02:29:35.345861] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.583 [2024-12-08 02:29:35.345881] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.583 [2024-12-08 02:29:35.348214] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.583 [2024-12-08 02:29:35.357750] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.583 [2024-12-08 02:29:35.358099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.583 [2024-12-08 02:29:35.358193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.583 [2024-12-08 02:29:35.358221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.583 [2024-12-08 02:29:35.358239] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.583 [2024-12-08 02:29:35.358369] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.583 [2024-12-08 02:29:35.358552] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.583 [2024-12-08 02:29:35.358584] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.583 [2024-12-08 02:29:35.358599] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.844 [2024-12-08 02:29:35.360836] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.844 [2024-12-08 02:29:35.370303] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.844 [2024-12-08 02:29:35.370611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.844 [2024-12-08 02:29:35.370802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.844 [2024-12-08 02:29:35.370863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.844 [2024-12-08 02:29:35.370880] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.844 [2024-12-08 02:29:35.371046] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.844 [2024-12-08 02:29:35.371234] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.844 [2024-12-08 02:29:35.371257] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.844 [2024-12-08 02:29:35.371272] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.844 [2024-12-08 02:29:35.373680] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.844 [2024-12-08 02:29:35.382792] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.844 [2024-12-08 02:29:35.383084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.844 [2024-12-08 02:29:35.383213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.844 [2024-12-08 02:29:35.383241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.844 [2024-12-08 02:29:35.383258] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.844 [2024-12-08 02:29:35.383405] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.844 [2024-12-08 02:29:35.383602] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.844 [2024-12-08 02:29:35.383626] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.844 [2024-12-08 02:29:35.383642] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.844 [2024-12-08 02:29:35.385875] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.844 [2024-12-08 02:29:35.395341] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.844 [2024-12-08 02:29:35.395626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.844 [2024-12-08 02:29:35.395760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.844 [2024-12-08 02:29:35.395789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.844 [2024-12-08 02:29:35.395807] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.844 [2024-12-08 02:29:35.395982] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.844 [2024-12-08 02:29:35.396137] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.844 [2024-12-08 02:29:35.396167] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.844 [2024-12-08 02:29:35.396186] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.844 [2024-12-08 02:29:35.398663] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.844 [2024-12-08 02:29:35.408028] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.844 [2024-12-08 02:29:35.408322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.844 [2024-12-08 02:29:35.408442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.844 [2024-12-08 02:29:35.408470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.844 [2024-12-08 02:29:35.408488] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.844 [2024-12-08 02:29:35.408663] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.844 [2024-12-08 02:29:35.408816] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.844 [2024-12-08 02:29:35.408840] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.844 [2024-12-08 02:29:35.408855] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.844 [2024-12-08 02:29:35.411287] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.844 [2024-12-08 02:29:35.420695] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.844 [2024-12-08 02:29:35.420996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.844 [2024-12-08 02:29:35.421129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.844 [2024-12-08 02:29:35.421157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.844 [2024-12-08 02:29:35.421175] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.844 [2024-12-08 02:29:35.421340] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.844 [2024-12-08 02:29:35.421492] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.844 [2024-12-08 02:29:35.421515] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.844 [2024-12-08 02:29:35.421530] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.844 [2024-12-08 02:29:35.423845] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.844 [2024-12-08 02:29:35.433432] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.844 [2024-12-08 02:29:35.433742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.844 [2024-12-08 02:29:35.433905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.844 [2024-12-08 02:29:35.433930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.844 [2024-12-08 02:29:35.433946] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.844 [2024-12-08 02:29:35.434122] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.844 [2024-12-08 02:29:35.434287] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.844 [2024-12-08 02:29:35.434310] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.844 [2024-12-08 02:29:35.434326] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.844 [2024-12-08 02:29:35.436805] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.844 [2024-12-08 02:29:35.446034] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.844 [2024-12-08 02:29:35.446313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.844 [2024-12-08 02:29:35.446441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.844 [2024-12-08 02:29:35.446469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.844 [2024-12-08 02:29:35.446486] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.844 [2024-12-08 02:29:35.446699] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.844 [2024-12-08 02:29:35.446870] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.844 [2024-12-08 02:29:35.446893] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.844 [2024-12-08 02:29:35.446909] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.844 [2024-12-08 02:29:35.449162] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.844 [2024-12-08 02:29:35.458563] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.844 [2024-12-08 02:29:35.458869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.844 [2024-12-08 02:29:35.458998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.844 [2024-12-08 02:29:35.459026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.844 [2024-12-08 02:29:35.459043] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.844 [2024-12-08 02:29:35.459190] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.844 [2024-12-08 02:29:35.459359] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.844 [2024-12-08 02:29:35.459383] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.844 [2024-12-08 02:29:35.459398] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.844 [2024-12-08 02:29:35.461773] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.844 [2024-12-08 02:29:35.471365] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.844 [2024-12-08 02:29:35.471729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.844 [2024-12-08 02:29:35.471894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.844 [2024-12-08 02:29:35.471922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.844 [2024-12-08 02:29:35.471940] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.844 [2024-12-08 02:29:35.472123] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.844 [2024-12-08 02:29:35.472275] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.844 [2024-12-08 02:29:35.472298] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.844 [2024-12-08 02:29:35.472313] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.844 [2024-12-08 02:29:35.474558] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.844 [2024-12-08 02:29:35.484004] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.844 [2024-12-08 02:29:35.484418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.844 [2024-12-08 02:29:35.484519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.844 [2024-12-08 02:29:35.484559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.844 [2024-12-08 02:29:35.484578] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.844 [2024-12-08 02:29:35.484726] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.844 [2024-12-08 02:29:35.484877] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.844 [2024-12-08 02:29:35.484901] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.844 [2024-12-08 02:29:35.484917] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.844 [2024-12-08 02:29:35.487206] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.844 [2024-12-08 02:29:35.496492] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.844 [2024-12-08 02:29:35.496776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.844 [2024-12-08 02:29:35.496906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.844 [2024-12-08 02:29:35.496937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.844 [2024-12-08 02:29:35.496954] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.844 [2024-12-08 02:29:35.497138] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.844 [2024-12-08 02:29:35.497326] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.844 [2024-12-08 02:29:35.497349] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.844 [2024-12-08 02:29:35.497364] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.844 [2024-12-08 02:29:35.499578] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.844 [2024-12-08 02:29:35.509091] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.844 [2024-12-08 02:29:35.509380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.844 [2024-12-08 02:29:35.509529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.844 [2024-12-08 02:29:35.509564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.844 [2024-12-08 02:29:35.509585] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.844 [2024-12-08 02:29:35.509799] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.844 [2024-12-08 02:29:35.509970] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.844 [2024-12-08 02:29:35.509994] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.844 [2024-12-08 02:29:35.510009] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.844 [2024-12-08 02:29:35.512441] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.844 [2024-12-08 02:29:35.521710] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.844 [2024-12-08 02:29:35.522102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.845 [2024-12-08 02:29:35.522254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.845 [2024-12-08 02:29:35.522282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.845 [2024-12-08 02:29:35.522300] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.845 [2024-12-08 02:29:35.522483] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.845 [2024-12-08 02:29:35.522608] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.845 [2024-12-08 02:29:35.522632] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.845 [2024-12-08 02:29:35.522648] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.845 [2024-12-08 02:29:35.524902] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.845 [2024-12-08 02:29:35.534337] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.845 [2024-12-08 02:29:35.534653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.845 [2024-12-08 02:29:35.534775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.845 [2024-12-08 02:29:35.534803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.845 [2024-12-08 02:29:35.534821] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.845 [2024-12-08 02:29:35.535022] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.845 [2024-12-08 02:29:35.535191] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.845 [2024-12-08 02:29:35.535215] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.845 [2024-12-08 02:29:35.535230] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.845 [2024-12-08 02:29:35.537471] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.845 [2024-12-08 02:29:35.547033] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.845 [2024-12-08 02:29:35.547384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.845 [2024-12-08 02:29:35.547507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.845 [2024-12-08 02:29:35.547533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.845 [2024-12-08 02:29:35.547564] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.845 [2024-12-08 02:29:35.547749] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.845 [2024-12-08 02:29:35.547955] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.845 [2024-12-08 02:29:35.547978] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.845 [2024-12-08 02:29:35.547994] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.845 [2024-12-08 02:29:35.550322] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.845 [2024-12-08 02:29:35.559613] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.845 [2024-12-08 02:29:35.559890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.845 [2024-12-08 02:29:35.560030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.845 [2024-12-08 02:29:35.560058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.845 [2024-12-08 02:29:35.560076] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.845 [2024-12-08 02:29:35.560259] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.845 [2024-12-08 02:29:35.560484] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.845 [2024-12-08 02:29:35.560508] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.845 [2024-12-08 02:29:35.560523] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.845 [2024-12-08 02:29:35.562876] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.845 [2024-12-08 02:29:35.572343] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.845 [2024-12-08 02:29:35.572704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.845 [2024-12-08 02:29:35.572863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.845 [2024-12-08 02:29:35.572890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.845 [2024-12-08 02:29:35.572908] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.845 [2024-12-08 02:29:35.573054] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.845 [2024-12-08 02:29:35.573224] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.845 [2024-12-08 02:29:35.573247] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.845 [2024-12-08 02:29:35.573262] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.845 [2024-12-08 02:29:35.575722] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.845 [2024-12-08 02:29:35.585032] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.845 [2024-12-08 02:29:35.585344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.845 [2024-12-08 02:29:35.585512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.845 [2024-12-08 02:29:35.585545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.845 [2024-12-08 02:29:35.585563] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.845 [2024-12-08 02:29:35.585736] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.845 [2024-12-08 02:29:35.585918] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.845 [2024-12-08 02:29:35.585941] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.845 [2024-12-08 02:29:35.585957] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.845 [2024-12-08 02:29:35.588084] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.845 [2024-12-08 02:29:35.597534] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.845 [2024-12-08 02:29:35.597895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.845 [2024-12-08 02:29:35.598133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.845 [2024-12-08 02:29:35.598160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.845 [2024-12-08 02:29:35.598178] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.845 [2024-12-08 02:29:35.598343] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.845 [2024-12-08 02:29:35.598494] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.845 [2024-12-08 02:29:35.598518] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.845 [2024-12-08 02:29:35.598533] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.845 [2024-12-08 02:29:35.600816] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:07.845 [2024-12-08 02:29:35.610400] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.845 [2024-12-08 02:29:35.610678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.845 [2024-12-08 02:29:35.610798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:07.845 [2024-12-08 02:29:35.610823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:07.845 [2024-12-08 02:29:35.610839] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:07.845 [2024-12-08 02:29:35.610977] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:07.845 [2024-12-08 02:29:35.611130] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:07.845 [2024-12-08 02:29:35.611153] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:07.845 [2024-12-08 02:29:35.611168] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.845 [2024-12-08 02:29:35.613634] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.106 [2024-12-08 02:29:35.622880] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.106 [2024-12-08 02:29:35.623320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.106 [2024-12-08 02:29:35.623469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.106 [2024-12-08 02:29:35.623497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.106 [2024-12-08 02:29:35.623514] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.106 [2024-12-08 02:29:35.623692] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.106 [2024-12-08 02:29:35.623850] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.106 [2024-12-08 02:29:35.623874] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.106 [2024-12-08 02:29:35.623889] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.106 [2024-12-08 02:29:35.626367] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.106 [2024-12-08 02:29:35.635426] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.106 [2024-12-08 02:29:35.635761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.106 [2024-12-08 02:29:35.635890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.106 [2024-12-08 02:29:35.635932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.106 [2024-12-08 02:29:35.635948] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.106 [2024-12-08 02:29:35.636136] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.106 [2024-12-08 02:29:35.636351] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.106 [2024-12-08 02:29:35.636375] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.106 [2024-12-08 02:29:35.636390] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.106 [2024-12-08 02:29:35.638687] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.106 [2024-12-08 02:29:35.648113] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.106 [2024-12-08 02:29:35.648383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.106 [2024-12-08 02:29:35.648506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.106 [2024-12-08 02:29:35.648532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.106 [2024-12-08 02:29:35.648558] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.106 [2024-12-08 02:29:35.648717] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.106 [2024-12-08 02:29:35.648905] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.107 [2024-12-08 02:29:35.648929] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.107 [2024-12-08 02:29:35.648944] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.107 [2024-12-08 02:29:35.651288] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.107 [2024-12-08 02:29:35.660675] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.107 [2024-12-08 02:29:35.660986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.107 [2024-12-08 02:29:35.661158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.107 [2024-12-08 02:29:35.661185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.107 [2024-12-08 02:29:35.661201] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.107 [2024-12-08 02:29:35.661376] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.107 [2024-12-08 02:29:35.661511] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.107 [2024-12-08 02:29:35.661553] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.107 [2024-12-08 02:29:35.661572] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.107 [2024-12-08 02:29:35.663666] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.107 [2024-12-08 02:29:35.673438] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.107 [2024-12-08 02:29:35.673761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.107 [2024-12-08 02:29:35.673895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.107 [2024-12-08 02:29:35.673923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.107 [2024-12-08 02:29:35.673941] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.107 [2024-12-08 02:29:35.674105] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.107 [2024-12-08 02:29:35.674240] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.107 [2024-12-08 02:29:35.674263] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.107 [2024-12-08 02:29:35.674280] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.107 [2024-12-08 02:29:35.676391] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.107 [2024-12-08 02:29:35.685716] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.107 [2024-12-08 02:29:35.685981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.107 [2024-12-08 02:29:35.686134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.107 [2024-12-08 02:29:35.686163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.107 [2024-12-08 02:29:35.686180] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.107 [2024-12-08 02:29:35.686328] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.107 [2024-12-08 02:29:35.686498] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.107 [2024-12-08 02:29:35.686521] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.107 [2024-12-08 02:29:35.686546] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.107 [2024-12-08 02:29:35.688806] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.107 [2024-12-08 02:29:35.698274] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.107 [2024-12-08 02:29:35.698569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.107 [2024-12-08 02:29:35.698703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.107 [2024-12-08 02:29:35.698731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.107 [2024-12-08 02:29:35.698748] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.107 [2024-12-08 02:29:35.698895] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.107 [2024-12-08 02:29:35.699083] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.107 [2024-12-08 02:29:35.699106] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.107 [2024-12-08 02:29:35.699128] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.107 [2024-12-08 02:29:35.701527] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.107 [2024-12-08 02:29:35.710800] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.107 [2024-12-08 02:29:35.711096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.107 [2024-12-08 02:29:35.711268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.107 [2024-12-08 02:29:35.711293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.107 [2024-12-08 02:29:35.711309] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.107 [2024-12-08 02:29:35.711522] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.107 [2024-12-08 02:29:35.711727] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.107 [2024-12-08 02:29:35.711751] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.107 [2024-12-08 02:29:35.711766] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.107 [2024-12-08 02:29:35.713988] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.107 [2024-12-08 02:29:35.723500] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.107 [2024-12-08 02:29:35.723825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.107 [2024-12-08 02:29:35.724012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.107 [2024-12-08 02:29:35.724078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.107 [2024-12-08 02:29:35.724094] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.107 [2024-12-08 02:29:35.724318] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.107 [2024-12-08 02:29:35.724453] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.107 [2024-12-08 02:29:35.724476] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.107 [2024-12-08 02:29:35.724491] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.107 [2024-12-08 02:29:35.726825] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.107 [2024-12-08 02:29:35.736386] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.107 [2024-12-08 02:29:35.736702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.107 [2024-12-08 02:29:35.736813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.107 [2024-12-08 02:29:35.736841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.107 [2024-12-08 02:29:35.736859] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.107 [2024-12-08 02:29:35.737006] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.107 [2024-12-08 02:29:35.737230] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.107 [2024-12-08 02:29:35.737253] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.107 [2024-12-08 02:29:35.737268] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.107 [2024-12-08 02:29:35.739500] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.107 [2024-12-08 02:29:35.749053] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.107 [2024-12-08 02:29:35.749385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.107 [2024-12-08 02:29:35.749528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.107 [2024-12-08 02:29:35.749567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.107 [2024-12-08 02:29:35.749584] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.107 [2024-12-08 02:29:35.749786] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.107 [2024-12-08 02:29:35.749938] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.107 [2024-12-08 02:29:35.749961] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.107 [2024-12-08 02:29:35.749977] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.107 [2024-12-08 02:29:35.752434] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.107 [2024-12-08 02:29:35.761466] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.107 [2024-12-08 02:29:35.761771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.107 [2024-12-08 02:29:35.761909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.107 [2024-12-08 02:29:35.761956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.107 [2024-12-08 02:29:35.761974] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.107 [2024-12-08 02:29:35.762157] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.107 [2024-12-08 02:29:35.762344] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.107 [2024-12-08 02:29:35.762368] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.107 [2024-12-08 02:29:35.762384] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.107 [2024-12-08 02:29:35.764860] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.107 [2024-12-08 02:29:35.774034] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.108 [2024-12-08 02:29:35.774340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.108 [2024-12-08 02:29:35.774471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.108 [2024-12-08 02:29:35.774499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.108 [2024-12-08 02:29:35.774517] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.108 [2024-12-08 02:29:35.774674] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.108 [2024-12-08 02:29:35.774845] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.108 [2024-12-08 02:29:35.774869] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.108 [2024-12-08 02:29:35.774885] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.108 [2024-12-08 02:29:35.777087] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.108 [2024-12-08 02:29:35.786721] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.108 [2024-12-08 02:29:35.787061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.108 [2024-12-08 02:29:35.787192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.108 [2024-12-08 02:29:35.787220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.108 [2024-12-08 02:29:35.787237] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.108 [2024-12-08 02:29:35.787420] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.108 [2024-12-08 02:29:35.787600] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.108 [2024-12-08 02:29:35.787625] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.108 [2024-12-08 02:29:35.787641] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.108 [2024-12-08 02:29:35.790077] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.108 [2024-12-08 02:29:35.799218] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.108 [2024-12-08 02:29:35.799634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.108 [2024-12-08 02:29:35.799824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.108 [2024-12-08 02:29:35.799853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.108 [2024-12-08 02:29:35.799870] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.108 [2024-12-08 02:29:35.800036] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.108 [2024-12-08 02:29:35.800151] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.108 [2024-12-08 02:29:35.800173] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.108 [2024-12-08 02:29:35.800189] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.108 [2024-12-08 02:29:35.802614] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.108 [2024-12-08 02:29:35.811982] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.108 [2024-12-08 02:29:35.812262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.108 [2024-12-08 02:29:35.812427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.108 [2024-12-08 02:29:35.812455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.108 [2024-12-08 02:29:35.812472] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.108 [2024-12-08 02:29:35.812649] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.108 [2024-12-08 02:29:35.812819] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.108 [2024-12-08 02:29:35.812842] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.108 [2024-12-08 02:29:35.812857] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.108 [2024-12-08 02:29:35.815164] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.108 [2024-12-08 02:29:35.824628] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.108 [2024-12-08 02:29:35.824993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.108 [2024-12-08 02:29:35.825128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.108 [2024-12-08 02:29:35.825156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.108 [2024-12-08 02:29:35.825173] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.108 [2024-12-08 02:29:35.825320] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.108 [2024-12-08 02:29:35.825507] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.108 [2024-12-08 02:29:35.825530] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.108 [2024-12-08 02:29:35.825558] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.108 [2024-12-08 02:29:35.827842] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.108 [2024-12-08 02:29:35.837159] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.108 [2024-12-08 02:29:35.837472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.108 [2024-12-08 02:29:35.837601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.108 [2024-12-08 02:29:35.837632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.108 [2024-12-08 02:29:35.837649] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.108 [2024-12-08 02:29:35.837850] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.108 [2024-12-08 02:29:35.838074] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.108 [2024-12-08 02:29:35.838097] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.108 [2024-12-08 02:29:35.838113] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.108 [2024-12-08 02:29:35.840526] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.108 [2024-12-08 02:29:35.849574] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.108 [2024-12-08 02:29:35.849792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.108 [2024-12-08 02:29:35.849913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.108 [2024-12-08 02:29:35.849941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.108 [2024-12-08 02:29:35.849958] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.108 [2024-12-08 02:29:35.850104] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.108 [2024-12-08 02:29:35.850274] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.108 [2024-12-08 02:29:35.850297] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.108 [2024-12-08 02:29:35.850313] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.108 [2024-12-08 02:29:35.852407] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.108 [2024-12-08 02:29:35.862090] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.108 [2024-12-08 02:29:35.862464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.108 [2024-12-08 02:29:35.862588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.108 [2024-12-08 02:29:35.862619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.108 [2024-12-08 02:29:35.862636] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.108 [2024-12-08 02:29:35.862810] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.108 [2024-12-08 02:29:35.862945] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.108 [2024-12-08 02:29:35.862968] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.108 [2024-12-08 02:29:35.862984] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.108 [2024-12-08 02:29:35.865240] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.108 [2024-12-08 02:29:35.874595] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.108 [2024-12-08 02:29:35.874938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.108 [2024-12-08 02:29:35.875042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.108 [2024-12-08 02:29:35.875070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.108 [2024-12-08 02:29:35.875087] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.108 [2024-12-08 02:29:35.875289] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.108 [2024-12-08 02:29:35.875458] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.108 [2024-12-08 02:29:35.875481] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.108 [2024-12-08 02:29:35.875497] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.108 [2024-12-08 02:29:35.877887] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.370 [2024-12-08 02:29:35.887143] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.370 [2024-12-08 02:29:35.887430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-12-08 02:29:35.887589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-12-08 02:29:35.887618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.370 [2024-12-08 02:29:35.887636] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.370 [2024-12-08 02:29:35.887783] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.370 [2024-12-08 02:29:35.887917] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.370 [2024-12-08 02:29:35.887940] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.370 [2024-12-08 02:29:35.887956] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.370 [2024-12-08 02:29:35.890399] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.370 [2024-12-08 02:29:35.899609] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.370 [2024-12-08 02:29:35.899918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-12-08 02:29:35.900057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.370 [2024-12-08 02:29:35.900082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.370 [2024-12-08 02:29:35.900104] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.370 [2024-12-08 02:29:35.900350] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.370 [2024-12-08 02:29:35.900567] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.370 [2024-12-08 02:29:35.900591] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.370 [2024-12-08 02:29:35.900607] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.371 [2024-12-08 02:29:35.902951] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.371 [2024-12-08 02:29:35.912225] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.371 [2024-12-08 02:29:35.912521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-12-08 02:29:35.912668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-12-08 02:29:35.912721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.371 [2024-12-08 02:29:35.912738] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.371 [2024-12-08 02:29:35.912939] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.371 [2024-12-08 02:29:35.913090] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.371 [2024-12-08 02:29:35.913114] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.371 [2024-12-08 02:29:35.913129] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.371 [2024-12-08 02:29:35.915490] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.371 [2024-12-08 02:29:35.924754] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.371 [2024-12-08 02:29:35.925067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-12-08 02:29:35.925172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-12-08 02:29:35.925199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.371 [2024-12-08 02:29:35.925216] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.371 [2024-12-08 02:29:35.925399] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.371 [2024-12-08 02:29:35.925563] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.371 [2024-12-08 02:29:35.925587] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.371 [2024-12-08 02:29:35.925602] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.371 [2024-12-08 02:29:35.927782] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.371 [2024-12-08 02:29:35.937403] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.371 [2024-12-08 02:29:35.937684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-12-08 02:29:35.937843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-12-08 02:29:35.937870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.371 [2024-12-08 02:29:35.937887] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.371 [2024-12-08 02:29:35.938022] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.371 [2024-12-08 02:29:35.938210] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.371 [2024-12-08 02:29:35.938233] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.371 [2024-12-08 02:29:35.938249] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.371 [2024-12-08 02:29:35.940712] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.371 [2024-12-08 02:29:35.950080] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.371 [2024-12-08 02:29:35.950448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-12-08 02:29:35.950604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-12-08 02:29:35.950632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.371 [2024-12-08 02:29:35.950650] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.371 [2024-12-08 02:29:35.950815] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.371 [2024-12-08 02:29:35.951003] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.371 [2024-12-08 02:29:35.951026] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.371 [2024-12-08 02:29:35.951042] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.371 [2024-12-08 02:29:35.953386] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.371 [2024-12-08 02:29:35.962542] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.371 [2024-12-08 02:29:35.962880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-12-08 02:29:35.963069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-12-08 02:29:35.963117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.371 [2024-12-08 02:29:35.963135] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.371 [2024-12-08 02:29:35.963282] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.371 [2024-12-08 02:29:35.963487] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.371 [2024-12-08 02:29:35.963510] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.371 [2024-12-08 02:29:35.963526] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.371 [2024-12-08 02:29:35.965865] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.371 [2024-12-08 02:29:35.975172] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.371 [2024-12-08 02:29:35.975508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-12-08 02:29:35.975641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-12-08 02:29:35.975669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.371 [2024-12-08 02:29:35.975686] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.371 [2024-12-08 02:29:35.975852] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.371 [2024-12-08 02:29:35.976064] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.371 [2024-12-08 02:29:35.976088] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.371 [2024-12-08 02:29:35.976104] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.371 [2024-12-08 02:29:35.978304] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.371 [2024-12-08 02:29:35.987726] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.371 [2024-12-08 02:29:35.988021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-12-08 02:29:35.988145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-12-08 02:29:35.988173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.371 [2024-12-08 02:29:35.988191] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.371 [2024-12-08 02:29:35.988356] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.371 [2024-12-08 02:29:35.988508] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.371 [2024-12-08 02:29:35.988531] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.371 [2024-12-08 02:29:35.988557] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.371 [2024-12-08 02:29:35.990866] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.371 [2024-12-08 02:29:36.000456] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.371 [2024-12-08 02:29:36.000757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-12-08 02:29:36.000886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-12-08 02:29:36.000913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.371 [2024-12-08 02:29:36.000930] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.371 [2024-12-08 02:29:36.001095] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.371 [2024-12-08 02:29:36.001229] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.371 [2024-12-08 02:29:36.001252] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.371 [2024-12-08 02:29:36.001268] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.371 [2024-12-08 02:29:36.003549] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.371 [2024-12-08 02:29:36.012995] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.371 [2024-12-08 02:29:36.013276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-12-08 02:29:36.013429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.371 [2024-12-08 02:29:36.013457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.371 [2024-12-08 02:29:36.013474] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.371 [2024-12-08 02:29:36.013613] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.371 [2024-12-08 02:29:36.013748] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.371 [2024-12-08 02:29:36.013777] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.371 [2024-12-08 02:29:36.013794] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.371 [2024-12-08 02:29:36.016083] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.371 [2024-12-08 02:29:36.025691] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.371 [2024-12-08 02:29:36.025985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-12-08 02:29:36.026152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-12-08 02:29:36.026177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.372 [2024-12-08 02:29:36.026193] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.372 [2024-12-08 02:29:36.026353] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.372 [2024-12-08 02:29:36.026516] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.372 [2024-12-08 02:29:36.026550] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.372 [2024-12-08 02:29:36.026569] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.372 [2024-12-08 02:29:36.028839] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.372 [2024-12-08 02:29:36.038521] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.372 [2024-12-08 02:29:36.038836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-12-08 02:29:36.038964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-12-08 02:29:36.038993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.372 [2024-12-08 02:29:36.039010] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.372 [2024-12-08 02:29:36.039157] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.372 [2024-12-08 02:29:36.039327] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.372 [2024-12-08 02:29:36.039350] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.372 [2024-12-08 02:29:36.039365] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.372 [2024-12-08 02:29:36.041826] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.372 [2024-12-08 02:29:36.050887] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.372 [2024-12-08 02:29:36.051209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-12-08 02:29:36.051332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-12-08 02:29:36.051357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.372 [2024-12-08 02:29:36.051373] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.372 [2024-12-08 02:29:36.051746] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.372 [2024-12-08 02:29:36.051919] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.372 [2024-12-08 02:29:36.051943] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.372 [2024-12-08 02:29:36.051964] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.372 [2024-12-08 02:29:36.054254] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.372 [2024-12-08 02:29:36.063438] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.372 [2024-12-08 02:29:36.063711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-12-08 02:29:36.063841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-12-08 02:29:36.063870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.372 [2024-12-08 02:29:36.063887] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.372 [2024-12-08 02:29:36.064070] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.372 [2024-12-08 02:29:36.064258] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.372 [2024-12-08 02:29:36.064282] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.372 [2024-12-08 02:29:36.064297] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.372 [2024-12-08 02:29:36.066669] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.372 [2024-12-08 02:29:36.076120] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.372 [2024-12-08 02:29:36.076489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-12-08 02:29:36.076599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-12-08 02:29:36.076628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.372 [2024-12-08 02:29:36.076645] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.372 [2024-12-08 02:29:36.076756] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.372 [2024-12-08 02:29:36.076945] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.372 [2024-12-08 02:29:36.076968] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.372 [2024-12-08 02:29:36.076984] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.372 [2024-12-08 02:29:36.079219] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.372 [2024-12-08 02:29:36.088778] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.372 [2024-12-08 02:29:36.089089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-12-08 02:29:36.089217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-12-08 02:29:36.089245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.372 [2024-12-08 02:29:36.089262] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.372 [2024-12-08 02:29:36.089464] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.372 [2024-12-08 02:29:36.089682] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.372 [2024-12-08 02:29:36.089706] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.372 [2024-12-08 02:29:36.089722] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.372 [2024-12-08 02:29:36.091964] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.372 [2024-12-08 02:29:36.101410] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.372 [2024-12-08 02:29:36.101703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-12-08 02:29:36.101836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-12-08 02:29:36.101864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.372 [2024-12-08 02:29:36.101881] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.372 [2024-12-08 02:29:36.102047] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.372 [2024-12-08 02:29:36.102235] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.372 [2024-12-08 02:29:36.102257] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.372 [2024-12-08 02:29:36.102272] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.372 [2024-12-08 02:29:36.104608] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.372 [2024-12-08 02:29:36.114128] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.372 [2024-12-08 02:29:36.114452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-12-08 02:29:36.114587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-12-08 02:29:36.114616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.372 [2024-12-08 02:29:36.114634] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.372 [2024-12-08 02:29:36.114781] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.372 [2024-12-08 02:29:36.114897] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.372 [2024-12-08 02:29:36.114920] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.372 [2024-12-08 02:29:36.114935] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.372 [2024-12-08 02:29:36.117259] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.372 [2024-12-08 02:29:36.126919] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.372 [2024-12-08 02:29:36.127237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-12-08 02:29:36.127367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-12-08 02:29:36.127395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.372 [2024-12-08 02:29:36.127412] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.372 [2024-12-08 02:29:36.127607] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.372 [2024-12-08 02:29:36.127742] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.372 [2024-12-08 02:29:36.127765] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.372 [2024-12-08 02:29:36.127780] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.372 [2024-12-08 02:29:36.130067] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.372 [2024-12-08 02:29:36.139520] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.372 [2024-12-08 02:29:36.139870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-12-08 02:29:36.139973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.372 [2024-12-08 02:29:36.140001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.372 [2024-12-08 02:29:36.140019] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.372 [2024-12-08 02:29:36.140149] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.373 [2024-12-08 02:29:36.140318] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.373 [2024-12-08 02:29:36.140341] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.373 [2024-12-08 02:29:36.140357] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.373 [2024-12-08 02:29:36.142683] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.632 [2024-12-08 02:29:36.152147] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.632 [2024-12-08 02:29:36.152458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.632 [2024-12-08 02:29:36.152618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.632 [2024-12-08 02:29:36.152645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.632 [2024-12-08 02:29:36.152661] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.632 [2024-12-08 02:29:36.152811] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.632 [2024-12-08 02:29:36.153011] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.632 [2024-12-08 02:29:36.153035] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.632 [2024-12-08 02:29:36.153050] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.632 [2024-12-08 02:29:36.155179] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.632 [2024-12-08 02:29:36.164820] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.632 [2024-12-08 02:29:36.165109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.632 [2024-12-08 02:29:36.165238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.632 [2024-12-08 02:29:36.165266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.632 [2024-12-08 02:29:36.165283] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.632 [2024-12-08 02:29:36.165466] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.632 [2024-12-08 02:29:36.165647] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.632 [2024-12-08 02:29:36.165672] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.632 [2024-12-08 02:29:36.165687] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.632 [2024-12-08 02:29:36.167937] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.632 [2024-12-08 02:29:36.177203] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.632 [2024-12-08 02:29:36.177613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.632 [2024-12-08 02:29:36.177811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.632 [2024-12-08 02:29:36.177840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.632 [2024-12-08 02:29:36.177858] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.632 [2024-12-08 02:29:36.178023] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.632 [2024-12-08 02:29:36.178194] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.632 [2024-12-08 02:29:36.178217] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.632 [2024-12-08 02:29:36.178232] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.632 [2024-12-08 02:29:36.180555] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.632 [2024-12-08 02:29:36.189699] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.632 [2024-12-08 02:29:36.190037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.632 [2024-12-08 02:29:36.190181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.632 [2024-12-08 02:29:36.190207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.633 [2024-12-08 02:29:36.190222] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.633 [2024-12-08 02:29:36.190383] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.633 [2024-12-08 02:29:36.190607] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.633 [2024-12-08 02:29:36.190632] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.633 [2024-12-08 02:29:36.190647] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.633 [2024-12-08 02:29:36.192847] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.633 [2024-12-08 02:29:36.202288] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.633 [2024-12-08 02:29:36.202602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.633 [2024-12-08 02:29:36.202709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.633 [2024-12-08 02:29:36.202737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.633 [2024-12-08 02:29:36.202754] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.633 [2024-12-08 02:29:36.202919] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.633 [2024-12-08 02:29:36.203107] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.633 [2024-12-08 02:29:36.203130] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.633 [2024-12-08 02:29:36.203145] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.633 [2024-12-08 02:29:36.205308] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.633 [2024-12-08 02:29:36.214806] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.633 [2024-12-08 02:29:36.215126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.633 [2024-12-08 02:29:36.215338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.633 [2024-12-08 02:29:36.215368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.633 [2024-12-08 02:29:36.215385] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.633 [2024-12-08 02:29:36.215593] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.633 [2024-12-08 02:29:36.215764] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.633 [2024-12-08 02:29:36.215787] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.633 [2024-12-08 02:29:36.215802] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.633 [2024-12-08 02:29:36.218269] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.633 [2024-12-08 02:29:36.227481] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.633 [2024-12-08 02:29:36.227785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.633 [2024-12-08 02:29:36.227910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.633 [2024-12-08 02:29:36.227938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.633 [2024-12-08 02:29:36.227955] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.633 [2024-12-08 02:29:36.228120] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.633 [2024-12-08 02:29:36.228271] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.633 [2024-12-08 02:29:36.228294] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.633 [2024-12-08 02:29:36.228310] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.633 [2024-12-08 02:29:36.230773] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.633 [2024-12-08 02:29:36.240241] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.633 [2024-12-08 02:29:36.240528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.633 [2024-12-08 02:29:36.240693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.633 [2024-12-08 02:29:36.240718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.633 [2024-12-08 02:29:36.240733] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.633 [2024-12-08 02:29:36.240909] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.633 [2024-12-08 02:29:36.241089] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.633 [2024-12-08 02:29:36.241113] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.633 [2024-12-08 02:29:36.241128] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.633 [2024-12-08 02:29:36.243417] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.633 [2024-12-08 02:29:36.252779] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.633 [2024-12-08 02:29:36.253050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.633 [2024-12-08 02:29:36.253161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.633 [2024-12-08 02:29:36.253190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.633 [2024-12-08 02:29:36.253212] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.633 [2024-12-08 02:29:36.253432] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.633 [2024-12-08 02:29:36.253631] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.633 [2024-12-08 02:29:36.253656] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.633 [2024-12-08 02:29:36.253672] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.633 [2024-12-08 02:29:36.255958] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.633 [2024-12-08 02:29:36.265086] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.633 [2024-12-08 02:29:36.265399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.633 [2024-12-08 02:29:36.265547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.633 [2024-12-08 02:29:36.265572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.633 [2024-12-08 02:29:36.265588] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.633 [2024-12-08 02:29:36.265762] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.633 [2024-12-08 02:29:36.265967] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.633 [2024-12-08 02:29:36.265991] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.633 [2024-12-08 02:29:36.266006] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.633 [2024-12-08 02:29:36.268437] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.633 [2024-12-08 02:29:36.277654] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.633 [2024-12-08 02:29:36.277975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.633 [2024-12-08 02:29:36.278107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.633 [2024-12-08 02:29:36.278135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.633 [2024-12-08 02:29:36.278152] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.633 [2024-12-08 02:29:36.278335] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.633 [2024-12-08 02:29:36.278504] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.633 [2024-12-08 02:29:36.278528] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.633 [2024-12-08 02:29:36.278556] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.633 [2024-12-08 02:29:36.280918] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.633 [2024-12-08 02:29:36.290360] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.633 [2024-12-08 02:29:36.290732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.633 [2024-12-08 02:29:36.290875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.633 [2024-12-08 02:29:36.290904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.633 [2024-12-08 02:29:36.290921] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.633 [2024-12-08 02:29:36.291091] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.633 [2024-12-08 02:29:36.291261] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.633 [2024-12-08 02:29:36.291285] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.633 [2024-12-08 02:29:36.291301] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.633 [2024-12-08 02:29:36.293598] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.633 [2024-12-08 02:29:36.303112] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.633 [2024-12-08 02:29:36.303435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.633 [2024-12-08 02:29:36.303552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.633 [2024-12-08 02:29:36.303578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.633 [2024-12-08 02:29:36.303594] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.633 [2024-12-08 02:29:36.303725] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.633 [2024-12-08 02:29:36.303915] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.634 [2024-12-08 02:29:36.303938] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.634 [2024-12-08 02:29:36.303953] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.634 [2024-12-08 02:29:36.306296] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.634 [2024-12-08 02:29:36.315531] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.634 [2024-12-08 02:29:36.315892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.634 [2024-12-08 02:29:36.315987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.634 [2024-12-08 02:29:36.316015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.634 [2024-12-08 02:29:36.316032] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.634 [2024-12-08 02:29:36.316197] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.634 [2024-12-08 02:29:36.316367] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.634 [2024-12-08 02:29:36.316390] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.634 [2024-12-08 02:29:36.316405] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.634 [2024-12-08 02:29:36.318742] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.634 [2024-12-08 02:29:36.328009] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.634 [2024-12-08 02:29:36.328307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.634 [2024-12-08 02:29:36.328462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.634 [2024-12-08 02:29:36.328490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.634 [2024-12-08 02:29:36.328507] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.634 [2024-12-08 02:29:36.328665] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.634 [2024-12-08 02:29:36.328823] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.634 [2024-12-08 02:29:36.328847] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.634 [2024-12-08 02:29:36.328862] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.634 [2024-12-08 02:29:36.331206] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.634 [2024-12-08 02:29:36.340603] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.634 [2024-12-08 02:29:36.340926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.634 [2024-12-08 02:29:36.341061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.634 [2024-12-08 02:29:36.341086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.634 [2024-12-08 02:29:36.341100] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.634 [2024-12-08 02:29:36.341287] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.634 [2024-12-08 02:29:36.341421] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.634 [2024-12-08 02:29:36.341444] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.634 [2024-12-08 02:29:36.341459] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.634 [2024-12-08 02:29:36.343777] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.634 [2024-12-08 02:29:36.353417] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.634 [2024-12-08 02:29:36.353773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.634 [2024-12-08 02:29:36.353956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.634 [2024-12-08 02:29:36.353981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.634 [2024-12-08 02:29:36.353996] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.634 [2024-12-08 02:29:36.354166] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.634 [2024-12-08 02:29:36.354373] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.634 [2024-12-08 02:29:36.354397] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.634 [2024-12-08 02:29:36.354412] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.634 [2024-12-08 02:29:36.356947] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.634 [2024-12-08 02:29:36.365992] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.634 [2024-12-08 02:29:36.366308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.634 [2024-12-08 02:29:36.366432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.634 [2024-12-08 02:29:36.366459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.634 [2024-12-08 02:29:36.366477] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.634 [2024-12-08 02:29:36.366653] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.634 [2024-12-08 02:29:36.366859] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.634 [2024-12-08 02:29:36.366892] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.634 [2024-12-08 02:29:36.366909] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.634 [2024-12-08 02:29:36.369289] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.634 [2024-12-08 02:29:36.378716] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.634 [2024-12-08 02:29:36.379066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.634 [2024-12-08 02:29:36.379185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.634 [2024-12-08 02:29:36.379213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.634 [2024-12-08 02:29:36.379230] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.634 [2024-12-08 02:29:36.379377] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.634 [2024-12-08 02:29:36.379559] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.634 [2024-12-08 02:29:36.379583] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.634 [2024-12-08 02:29:36.379599] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.634 [2024-12-08 02:29:36.382068] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.634 [2024-12-08 02:29:36.391551] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.634 [2024-12-08 02:29:36.391890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.634 [2024-12-08 02:29:36.392020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.634 [2024-12-08 02:29:36.392048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.634 [2024-12-08 02:29:36.392066] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.634 [2024-12-08 02:29:36.392231] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.634 [2024-12-08 02:29:36.392437] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.634 [2024-12-08 02:29:36.392460] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.634 [2024-12-08 02:29:36.392476] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.634 [2024-12-08 02:29:36.394934] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.634 [2024-12-08 02:29:36.404157] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.634 [2024-12-08 02:29:36.404456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.634 [2024-12-08 02:29:36.404560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.634 [2024-12-08 02:29:36.404590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.634 [2024-12-08 02:29:36.404607] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.634 [2024-12-08 02:29:36.404773] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.634 [2024-12-08 02:29:36.404961] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.634 [2024-12-08 02:29:36.404985] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.634 [2024-12-08 02:29:36.405006] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.634 [2024-12-08 02:29:36.407386] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.894 [2024-12-08 02:29:36.416733] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.894 [2024-12-08 02:29:36.417053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.894 [2024-12-08 02:29:36.417204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.894 [2024-12-08 02:29:36.417231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.894 [2024-12-08 02:29:36.417248] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.894 [2024-12-08 02:29:36.417431] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.894 [2024-12-08 02:29:36.417598] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.894 [2024-12-08 02:29:36.417622] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.894 [2024-12-08 02:29:36.417637] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.894 [2024-12-08 02:29:36.420159] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.894 [2024-12-08 02:29:36.429260] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.894 [2024-12-08 02:29:36.429546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.894 [2024-12-08 02:29:36.429720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.894 [2024-12-08 02:29:36.429745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.894 [2024-12-08 02:29:36.429761] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.894 [2024-12-08 02:29:36.429938] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.894 [2024-12-08 02:29:36.430108] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.894 [2024-12-08 02:29:36.430131] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.894 [2024-12-08 02:29:36.430146] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.894 [2024-12-08 02:29:36.432556] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.894 [2024-12-08 02:29:36.441824] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.894 [2024-12-08 02:29:36.442122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.894 [2024-12-08 02:29:36.442280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.894 [2024-12-08 02:29:36.442308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.894 [2024-12-08 02:29:36.442326] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.894 [2024-12-08 02:29:36.442491] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.894 [2024-12-08 02:29:36.442655] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.894 [2024-12-08 02:29:36.442679] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.894 [2024-12-08 02:29:36.442694] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.894 [2024-12-08 02:29:36.444919] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.894 [2024-12-08 02:29:36.454488] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.894 [2024-12-08 02:29:36.454897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.894 [2024-12-08 02:29:36.455101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.894 [2024-12-08 02:29:36.455160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.894 [2024-12-08 02:29:36.455178] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.894 [2024-12-08 02:29:36.455325] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.894 [2024-12-08 02:29:36.455459] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.894 [2024-12-08 02:29:36.455481] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.894 [2024-12-08 02:29:36.455496] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.894 [2024-12-08 02:29:36.457959] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.894 [2024-12-08 02:29:36.467084] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.894 [2024-12-08 02:29:36.467395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.894 [2024-12-08 02:29:36.467497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.894 [2024-12-08 02:29:36.467525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.894 [2024-12-08 02:29:36.467552] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.894 [2024-12-08 02:29:36.467665] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.894 [2024-12-08 02:29:36.467816] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.894 [2024-12-08 02:29:36.467839] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.894 [2024-12-08 02:29:36.467854] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.894 [2024-12-08 02:29:36.470216] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.894 [2024-12-08 02:29:36.479513] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.894 [2024-12-08 02:29:36.479828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.894 [2024-12-08 02:29:36.480002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.894 [2024-12-08 02:29:36.480050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.894 [2024-12-08 02:29:36.480068] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.894 [2024-12-08 02:29:36.480214] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.894 [2024-12-08 02:29:36.480384] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.894 [2024-12-08 02:29:36.480407] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.894 [2024-12-08 02:29:36.480423] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.894 [2024-12-08 02:29:36.482812] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.894 [2024-12-08 02:29:36.492280] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.894 [2024-12-08 02:29:36.492578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.894 [2024-12-08 02:29:36.492707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.894 [2024-12-08 02:29:36.492732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.894 [2024-12-08 02:29:36.492748] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.894 [2024-12-08 02:29:36.492903] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.894 [2024-12-08 02:29:36.493091] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.894 [2024-12-08 02:29:36.493114] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.894 [2024-12-08 02:29:36.493130] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.894 [2024-12-08 02:29:36.495492] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.894 [2024-12-08 02:29:36.504773] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.894 [2024-12-08 02:29:36.505132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.894 [2024-12-08 02:29:36.505261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.894 [2024-12-08 02:29:36.505288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.894 [2024-12-08 02:29:36.505306] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.895 [2024-12-08 02:29:36.505507] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.895 [2024-12-08 02:29:36.505686] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.895 [2024-12-08 02:29:36.505710] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.895 [2024-12-08 02:29:36.505726] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.895 [2024-12-08 02:29:36.508173] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.895 [2024-12-08 02:29:36.517547] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.895 [2024-12-08 02:29:36.517835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.895 [2024-12-08 02:29:36.517942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.895 [2024-12-08 02:29:36.517970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.895 [2024-12-08 02:29:36.517986] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.895 [2024-12-08 02:29:36.518151] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.895 [2024-12-08 02:29:36.518303] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.895 [2024-12-08 02:29:36.518326] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.895 [2024-12-08 02:29:36.518342] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.895 [2024-12-08 02:29:36.520765] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.895 [2024-12-08 02:29:36.530115] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.895 [2024-12-08 02:29:36.530423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.895 [2024-12-08 02:29:36.530559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.895 [2024-12-08 02:29:36.530588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.895 [2024-12-08 02:29:36.530605] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.895 [2024-12-08 02:29:36.530788] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.895 [2024-12-08 02:29:36.530922] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.895 [2024-12-08 02:29:36.530945] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.895 [2024-12-08 02:29:36.530960] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.895 [2024-12-08 02:29:36.533337] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.895 [2024-12-08 02:29:36.542718] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.895 [2024-12-08 02:29:36.543005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.895 [2024-12-08 02:29:36.543228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.895 [2024-12-08 02:29:36.543252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.895 [2024-12-08 02:29:36.543268] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.895 [2024-12-08 02:29:36.543445] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.895 [2024-12-08 02:29:36.543625] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.895 [2024-12-08 02:29:36.543650] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.895 [2024-12-08 02:29:36.543665] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.895 [2024-12-08 02:29:36.545896] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.895 [2024-12-08 02:29:36.555364] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.895 [2024-12-08 02:29:36.555790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.895 [2024-12-08 02:29:36.555961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.895 [2024-12-08 02:29:36.555989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.895 [2024-12-08 02:29:36.556006] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.895 [2024-12-08 02:29:36.556171] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.895 [2024-12-08 02:29:36.556304] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.895 [2024-12-08 02:29:36.556328] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.895 [2024-12-08 02:29:36.556343] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.895 [2024-12-08 02:29:36.558567] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.895 [2024-12-08 02:29:36.568103] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.895 [2024-12-08 02:29:36.568393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.895 [2024-12-08 02:29:36.568522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.895 [2024-12-08 02:29:36.568566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.895 [2024-12-08 02:29:36.568585] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.895 [2024-12-08 02:29:36.568769] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.895 [2024-12-08 02:29:36.568957] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.895 [2024-12-08 02:29:36.568980] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.895 [2024-12-08 02:29:36.568995] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.895 [2024-12-08 02:29:36.571263] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.895 [2024-12-08 02:29:36.580771] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.895 [2024-12-08 02:29:36.581038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.895 [2024-12-08 02:29:36.581191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.895 [2024-12-08 02:29:36.581220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.895 [2024-12-08 02:29:36.581237] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.895 [2024-12-08 02:29:36.581366] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.895 [2024-12-08 02:29:36.581518] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.895 [2024-12-08 02:29:36.581550] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.895 [2024-12-08 02:29:36.581567] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.895 [2024-12-08 02:29:36.583760] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.895 [2024-12-08 02:29:36.593471] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.895 [2024-12-08 02:29:36.593784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.895 [2024-12-08 02:29:36.593976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.895 [2024-12-08 02:29:36.594018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.895 [2024-12-08 02:29:36.594035] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.895 [2024-12-08 02:29:36.594164] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.895 [2024-12-08 02:29:36.594315] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.895 [2024-12-08 02:29:36.594338] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.895 [2024-12-08 02:29:36.594354] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.895 [2024-12-08 02:29:36.596699] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.895 [2024-12-08 02:29:36.606027] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.895 [2024-12-08 02:29:36.606336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.895 [2024-12-08 02:29:36.606490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.895 [2024-12-08 02:29:36.606517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.895 [2024-12-08 02:29:36.606549] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.895 [2024-12-08 02:29:36.606702] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.895 [2024-12-08 02:29:36.606909] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.895 [2024-12-08 02:29:36.606933] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.895 [2024-12-08 02:29:36.606948] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.895 [2024-12-08 02:29:36.609357] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.895 [2024-12-08 02:29:36.618590] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.895 [2024-12-08 02:29:36.618936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.895 [2024-12-08 02:29:36.619066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.895 [2024-12-08 02:29:36.619094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.895 [2024-12-08 02:29:36.619111] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.895 [2024-12-08 02:29:36.619259] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.895 [2024-12-08 02:29:36.619410] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.895 [2024-12-08 02:29:36.619433] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.896 [2024-12-08 02:29:36.619448] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.896 [2024-12-08 02:29:36.621654] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.896 [2024-12-08 02:29:36.630920] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.896 [2024-12-08 02:29:36.631234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.896 [2024-12-08 02:29:36.631365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.896 [2024-12-08 02:29:36.631393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.896 [2024-12-08 02:29:36.631410] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.896 [2024-12-08 02:29:36.631586] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.896 [2024-12-08 02:29:36.631738] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.896 [2024-12-08 02:29:36.631761] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.896 [2024-12-08 02:29:36.631776] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.896 [2024-12-08 02:29:36.633990] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.896 [2024-12-08 02:29:36.643099] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.896 [2024-12-08 02:29:36.643428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.896 [2024-12-08 02:29:36.643561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.896 [2024-12-08 02:29:36.643591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.896 [2024-12-08 02:29:36.643609] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.896 [2024-12-08 02:29:36.643762] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.896 [2024-12-08 02:29:36.643932] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.896 [2024-12-08 02:29:36.643955] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.896 [2024-12-08 02:29:36.643970] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.896 [2024-12-08 02:29:36.646325] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.896 [2024-12-08 02:29:36.655775] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.896 [2024-12-08 02:29:36.656082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.896 [2024-12-08 02:29:36.656276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.896 [2024-12-08 02:29:36.656302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.896 [2024-12-08 02:29:36.656318] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.896 [2024-12-08 02:29:36.656467] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.896 [2024-12-08 02:29:36.656655] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.896 [2024-12-08 02:29:36.656693] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.896 [2024-12-08 02:29:36.656710] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.896 [2024-12-08 02:29:36.659179] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:08.896 [2024-12-08 02:29:36.668324] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:08.896 [2024-12-08 02:29:36.668607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.896 [2024-12-08 02:29:36.668717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:08.896 [2024-12-08 02:29:36.668745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:08.896 [2024-12-08 02:29:36.668761] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:08.896 [2024-12-08 02:29:36.668903] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:08.896 [2024-12-08 02:29:36.669032] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:08.896 [2024-12-08 02:29:36.669054] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:08.896 [2024-12-08 02:29:36.669068] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:08.896 [2024-12-08 02:29:36.671281] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.156 [2024-12-08 02:29:36.680668] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.156 [2024-12-08 02:29:36.680952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.156 [2024-12-08 02:29:36.681046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.156 [2024-12-08 02:29:36.681070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.156 [2024-12-08 02:29:36.681086] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.156 [2024-12-08 02:29:36.681276] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.156 [2024-12-08 02:29:36.681428] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.156 [2024-12-08 02:29:36.681449] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.156 [2024-12-08 02:29:36.681462] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.156 [2024-12-08 02:29:36.683574] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.156 [2024-12-08 02:29:36.693283] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.156 [2024-12-08 02:29:36.693564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.156 [2024-12-08 02:29:36.693724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.156 [2024-12-08 02:29:36.693750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.156 [2024-12-08 02:29:36.693766] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.156 [2024-12-08 02:29:36.693940] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.156 [2024-12-08 02:29:36.694182] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.156 [2024-12-08 02:29:36.694216] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.156 [2024-12-08 02:29:36.694229] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.156 [2024-12-08 02:29:36.696466] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.156 [2024-12-08 02:29:36.705936] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.156 [2024-12-08 02:29:36.706219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.156 [2024-12-08 02:29:36.706391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.156 [2024-12-08 02:29:36.706416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.156 [2024-12-08 02:29:36.706432] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.156 [2024-12-08 02:29:36.706622] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.156 [2024-12-08 02:29:36.706811] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.156 [2024-12-08 02:29:36.706834] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.156 [2024-12-08 02:29:36.706850] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.156 [2024-12-08 02:29:36.709119] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.156 [2024-12-08 02:29:36.718452] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.156 [2024-12-08 02:29:36.718744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.156 [2024-12-08 02:29:36.718863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.156 [2024-12-08 02:29:36.718892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.156 [2024-12-08 02:29:36.718909] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.156 [2024-12-08 02:29:36.719074] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.156 [2024-12-08 02:29:36.719262] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.156 [2024-12-08 02:29:36.719291] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.156 [2024-12-08 02:29:36.719307] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.156 [2024-12-08 02:29:36.721585] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.156 [2024-12-08 02:29:36.730939] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.156 [2024-12-08 02:29:36.731222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.156 [2024-12-08 02:29:36.731350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.156 [2024-12-08 02:29:36.731378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.156 [2024-12-08 02:29:36.731395] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.156 [2024-12-08 02:29:36.731551] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.156 [2024-12-08 02:29:36.731721] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.156 [2024-12-08 02:29:36.731745] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.156 [2024-12-08 02:29:36.731761] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.156 [2024-12-08 02:29:36.734160] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.156 [2024-12-08 02:29:36.743370] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.156 [2024-12-08 02:29:36.743667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.156 [2024-12-08 02:29:36.743775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.157 [2024-12-08 02:29:36.743803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.157 [2024-12-08 02:29:36.743820] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.157 [2024-12-08 02:29:36.743986] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.157 [2024-12-08 02:29:36.744138] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.157 [2024-12-08 02:29:36.744161] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.157 [2024-12-08 02:29:36.744176] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.157 [2024-12-08 02:29:36.746499] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.157 [2024-12-08 02:29:36.756010] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.157 [2024-12-08 02:29:36.756328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.157 [2024-12-08 02:29:36.756449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.157 [2024-12-08 02:29:36.756476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.157 [2024-12-08 02:29:36.756493] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.157 [2024-12-08 02:29:36.756614] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.157 [2024-12-08 02:29:36.756802] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.157 [2024-12-08 02:29:36.756826] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.157 [2024-12-08 02:29:36.756847] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.157 [2024-12-08 02:29:36.759371] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.157 [2024-12-08 02:29:36.768362] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.157 [2024-12-08 02:29:36.768671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.157 [2024-12-08 02:29:36.768797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.157 [2024-12-08 02:29:36.768826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.157 [2024-12-08 02:29:36.768843] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.157 [2024-12-08 02:29:36.769008] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.157 [2024-12-08 02:29:36.769160] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.157 [2024-12-08 02:29:36.769183] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.157 [2024-12-08 02:29:36.769198] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.157 [2024-12-08 02:29:36.771601] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.157 [2024-12-08 02:29:36.780999] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.157 [2024-12-08 02:29:36.781310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.157 [2024-12-08 02:29:36.781439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.157 [2024-12-08 02:29:36.781467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.157 [2024-12-08 02:29:36.781485] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.157 [2024-12-08 02:29:36.781640] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.157 [2024-12-08 02:29:36.781811] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.157 [2024-12-08 02:29:36.781835] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.157 [2024-12-08 02:29:36.781850] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.157 [2024-12-08 02:29:36.784299] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.157 [2024-12-08 02:29:36.793499] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.157 [2024-12-08 02:29:36.793773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.157 [2024-12-08 02:29:36.793934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.157 [2024-12-08 02:29:36.793963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.157 [2024-12-08 02:29:36.793980] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.157 [2024-12-08 02:29:36.794180] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.157 [2024-12-08 02:29:36.794332] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.157 [2024-12-08 02:29:36.794356] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.157 [2024-12-08 02:29:36.794371] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.157 [2024-12-08 02:29:36.796662] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.157 [2024-12-08 02:29:36.806021] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.157 [2024-12-08 02:29:36.806344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.157 [2024-12-08 02:29:36.806479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.157 [2024-12-08 02:29:36.806507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.157 [2024-12-08 02:29:36.806525] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.157 [2024-12-08 02:29:36.806721] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.157 [2024-12-08 02:29:36.806903] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.157 [2024-12-08 02:29:36.806927] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.157 [2024-12-08 02:29:36.806942] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.157 [2024-12-08 02:29:36.809257] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.157 [2024-12-08 02:29:36.818644] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.157 [2024-12-08 02:29:36.818962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.157 [2024-12-08 02:29:36.819066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.157 [2024-12-08 02:29:36.819094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.157 [2024-12-08 02:29:36.819112] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.157 [2024-12-08 02:29:36.819312] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.157 [2024-12-08 02:29:36.819465] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.157 [2024-12-08 02:29:36.819488] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.157 [2024-12-08 02:29:36.819503] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.157 [2024-12-08 02:29:36.821837] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.157 [2024-12-08 02:29:36.831364] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.157 [2024-12-08 02:29:36.831695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.157 [2024-12-08 02:29:36.831790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.157 [2024-12-08 02:29:36.831816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.157 [2024-12-08 02:29:36.831831] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.157 [2024-12-08 02:29:36.831994] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.157 [2024-12-08 02:29:36.832169] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.157 [2024-12-08 02:29:36.832205] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.157 [2024-12-08 02:29:36.832218] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.157 [2024-12-08 02:29:36.834375] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.157 [2024-12-08 02:29:36.844183] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.157 [2024-12-08 02:29:36.844454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.157 [2024-12-08 02:29:36.844590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.157 [2024-12-08 02:29:36.844633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.157 [2024-12-08 02:29:36.844649] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.157 [2024-12-08 02:29:36.844798] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.157 [2024-12-08 02:29:36.844981] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.157 [2024-12-08 02:29:36.845004] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.157 [2024-12-08 02:29:36.845020] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.157 [2024-12-08 02:29:36.847373] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.157 [2024-12-08 02:29:36.856747] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.157 [2024-12-08 02:29:36.857131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.157 [2024-12-08 02:29:36.857270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.157 [2024-12-08 02:29:36.857313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.157 [2024-12-08 02:29:36.857331] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.157 [2024-12-08 02:29:36.857477] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.158 [2024-12-08 02:29:36.857638] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.158 [2024-12-08 02:29:36.857662] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.158 [2024-12-08 02:29:36.857678] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.158 [2024-12-08 02:29:36.859984] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.158 [2024-12-08 02:29:36.869550] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.158 [2024-12-08 02:29:36.869781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.158 [2024-12-08 02:29:36.869927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.158 [2024-12-08 02:29:36.869955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.158 [2024-12-08 02:29:36.869972] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.158 [2024-12-08 02:29:36.870137] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.158 [2024-12-08 02:29:36.870324] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.158 [2024-12-08 02:29:36.870347] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.158 [2024-12-08 02:29:36.870363] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.158 [2024-12-08 02:29:36.872661] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.158 [2024-12-08 02:29:36.882366] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.158 [2024-12-08 02:29:36.882697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.158 [2024-12-08 02:29:36.882800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.158 [2024-12-08 02:29:36.882825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.158 [2024-12-08 02:29:36.882841] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.158 [2024-12-08 02:29:36.882996] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.158 [2024-12-08 02:29:36.883184] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.158 [2024-12-08 02:29:36.883209] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.158 [2024-12-08 02:29:36.883225] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.158 [2024-12-08 02:29:36.885505] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.158 [2024-12-08 02:29:36.894980] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.158 [2024-12-08 02:29:36.895264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.158 [2024-12-08 02:29:36.895400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.158 [2024-12-08 02:29:36.895429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.158 [2024-12-08 02:29:36.895446] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.158 [2024-12-08 02:29:36.895622] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.158 [2024-12-08 02:29:36.895811] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.158 [2024-12-08 02:29:36.895843] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.158 [2024-12-08 02:29:36.895859] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.158 [2024-12-08 02:29:36.898332] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.158 [2024-12-08 02:29:36.907709] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.158 [2024-12-08 02:29:36.907966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.158 [2024-12-08 02:29:36.908144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.158 [2024-12-08 02:29:36.908173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.158 [2024-12-08 02:29:36.908190] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.158 [2024-12-08 02:29:36.908374] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.158 [2024-12-08 02:29:36.908526] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.158 [2024-12-08 02:29:36.908561] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.158 [2024-12-08 02:29:36.908578] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.158 [2024-12-08 02:29:36.910916] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.158 [2024-12-08 02:29:36.920223] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.158 [2024-12-08 02:29:36.920500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.158 [2024-12-08 02:29:36.920626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.158 [2024-12-08 02:29:36.920658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.158 [2024-12-08 02:29:36.920674] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.158 [2024-12-08 02:29:36.920823] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.158 [2024-12-08 02:29:36.921038] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.158 [2024-12-08 02:29:36.921063] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.158 [2024-12-08 02:29:36.921078] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.158 [2024-12-08 02:29:36.923565] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.158 [2024-12-08 02:29:36.932776] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.158 [2024-12-08 02:29:36.933059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.158 [2024-12-08 02:29:36.933251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.158 [2024-12-08 02:29:36.933277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.158 [2024-12-08 02:29:36.933292] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.158 [2024-12-08 02:29:36.933487] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.158 [2024-12-08 02:29:36.933685] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.158 [2024-12-08 02:29:36.933709] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.158 [2024-12-08 02:29:36.933724] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.418 [2024-12-08 02:29:36.936098] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.418 [2024-12-08 02:29:36.945453] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.418 [2024-12-08 02:29:36.945794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.418 [2024-12-08 02:29:36.945920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.418 [2024-12-08 02:29:36.945949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.418 [2024-12-08 02:29:36.945966] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.418 [2024-12-08 02:29:36.946076] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.418 [2024-12-08 02:29:36.946282] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.418 [2024-12-08 02:29:36.946306] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.418 [2024-12-08 02:29:36.946321] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.418 [2024-12-08 02:29:36.948623] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.418 [2024-12-08 02:29:36.958001] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.418 [2024-12-08 02:29:36.958302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.418 [2024-12-08 02:29:36.958430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.418 [2024-12-08 02:29:36.958454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.418 [2024-12-08 02:29:36.958478] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.418 [2024-12-08 02:29:36.958736] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.418 [2024-12-08 02:29:36.958943] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.418 [2024-12-08 02:29:36.958966] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.418 [2024-12-08 02:29:36.958981] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.418 [2024-12-08 02:29:36.961330] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.418 [2024-12-08 02:29:36.970606] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.418 [2024-12-08 02:29:36.970912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.418 [2024-12-08 02:29:36.971041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.418 [2024-12-08 02:29:36.971069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.418 [2024-12-08 02:29:36.971086] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.418 [2024-12-08 02:29:36.971287] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.418 [2024-12-08 02:29:36.971475] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.418 [2024-12-08 02:29:36.971498] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.418 [2024-12-08 02:29:36.971514] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.418 [2024-12-08 02:29:36.973828] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.418 [2024-12-08 02:29:36.983112] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.418 [2024-12-08 02:29:36.983383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.418 [2024-12-08 02:29:36.983511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.418 [2024-12-08 02:29:36.983547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.418 [2024-12-08 02:29:36.983568] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.418 [2024-12-08 02:29:36.983751] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.418 [2024-12-08 02:29:36.983938] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.418 [2024-12-08 02:29:36.983962] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.418 [2024-12-08 02:29:36.983977] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.418 [2024-12-08 02:29:36.986426] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.418 [2024-12-08 02:29:36.995568] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.418 [2024-12-08 02:29:36.995880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.418 [2024-12-08 02:29:36.996002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.418 [2024-12-08 02:29:36.996030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.418 [2024-12-08 02:29:36.996047] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.418 [2024-12-08 02:29:36.996200] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.418 [2024-12-08 02:29:36.996370] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.418 [2024-12-08 02:29:36.996393] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.418 [2024-12-08 02:29:36.996408] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.418 [2024-12-08 02:29:36.998670] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.418 [2024-12-08 02:29:37.008337] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.418 [2024-12-08 02:29:37.008620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.418 [2024-12-08 02:29:37.008745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.418 [2024-12-08 02:29:37.008773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.419 [2024-12-08 02:29:37.008791] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.419 [2024-12-08 02:29:37.008956] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.419 [2024-12-08 02:29:37.009126] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.419 [2024-12-08 02:29:37.009149] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.419 [2024-12-08 02:29:37.009165] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.419 [2024-12-08 02:29:37.011623] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.419 [2024-12-08 02:29:37.020754] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.419 [2024-12-08 02:29:37.021085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.419 [2024-12-08 02:29:37.021215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.419 [2024-12-08 02:29:37.021244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.419 [2024-12-08 02:29:37.021261] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.419 [2024-12-08 02:29:37.021445] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.419 [2024-12-08 02:29:37.021625] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.419 [2024-12-08 02:29:37.021650] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.419 [2024-12-08 02:29:37.021666] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.419 [2024-12-08 02:29:37.023988] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.419 [2024-12-08 02:29:37.033391] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.419 [2024-12-08 02:29:37.033693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.419 [2024-12-08 02:29:37.033830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.419 [2024-12-08 02:29:37.033858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.419 [2024-12-08 02:29:37.033875] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.419 [2024-12-08 02:29:37.034004] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.419 [2024-12-08 02:29:37.034198] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.419 [2024-12-08 02:29:37.034223] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.419 [2024-12-08 02:29:37.034238] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.419 [2024-12-08 02:29:37.036695] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.419 [2024-12-08 02:29:37.045786] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.419 [2024-12-08 02:29:37.046120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.419 [2024-12-08 02:29:37.046284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.419 [2024-12-08 02:29:37.046310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.419 [2024-12-08 02:29:37.046326] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.419 [2024-12-08 02:29:37.046501] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.419 [2024-12-08 02:29:37.046677] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.419 [2024-12-08 02:29:37.046701] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.419 [2024-12-08 02:29:37.046717] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.419 [2024-12-08 02:29:37.049004] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.419 [2024-12-08 02:29:37.058502] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.419 [2024-12-08 02:29:37.058741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.419 [2024-12-08 02:29:37.058885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.419 [2024-12-08 02:29:37.058911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.419 [2024-12-08 02:29:37.058926] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.419 [2024-12-08 02:29:37.059137] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.419 [2024-12-08 02:29:37.059307] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.419 [2024-12-08 02:29:37.059331] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.419 [2024-12-08 02:29:37.059347] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.419 [2024-12-08 02:29:37.061755] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.419 [2024-12-08 02:29:37.071157] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.419 [2024-12-08 02:29:37.071478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.419 [2024-12-08 02:29:37.071628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.419 [2024-12-08 02:29:37.071655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.419 [2024-12-08 02:29:37.071670] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.419 [2024-12-08 02:29:37.071866] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.419 [2024-12-08 02:29:37.072055] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.419 [2024-12-08 02:29:37.072084] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.419 [2024-12-08 02:29:37.072100] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.419 [2024-12-08 02:29:37.074459] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.419 [2024-12-08 02:29:37.083926] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.419 [2024-12-08 02:29:37.084265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.419 [2024-12-08 02:29:37.084392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.419 [2024-12-08 02:29:37.084434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.419 [2024-12-08 02:29:37.084450] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.419 [2024-12-08 02:29:37.084533] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.419 [2024-12-08 02:29:37.084753] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.419 [2024-12-08 02:29:37.084777] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.419 [2024-12-08 02:29:37.084792] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.419 [2024-12-08 02:29:37.087131] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.419 [2024-12-08 02:29:37.096559] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.419 [2024-12-08 02:29:37.096881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.419 [2024-12-08 02:29:37.097009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.419 [2024-12-08 02:29:37.097039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.419 [2024-12-08 02:29:37.097057] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.419 [2024-12-08 02:29:37.097222] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.419 [2024-12-08 02:29:37.097393] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.419 [2024-12-08 02:29:37.097416] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.419 [2024-12-08 02:29:37.097431] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.419 [2024-12-08 02:29:37.099725] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.420 [2024-12-08 02:29:37.109174] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.420 [2024-12-08 02:29:37.109421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.420 [2024-12-08 02:29:37.109560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.420 [2024-12-08 02:29:37.109590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.420 [2024-12-08 02:29:37.109607] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.420 [2024-12-08 02:29:37.109808] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.420 [2024-12-08 02:29:37.109996] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.420 [2024-12-08 02:29:37.110019] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.420 [2024-12-08 02:29:37.110040] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.420 [2024-12-08 02:29:37.112311] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.420 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 2225984 Killed "${NVMF_APP[@]}" "$@" 00:27:09.420 02:29:37 -- host/bdevperf.sh@36 -- # tgt_init 00:27:09.420 02:29:37 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:27:09.420 02:29:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:09.420 02:29:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:09.420 02:29:37 -- common/autotest_common.sh@10 -- # set +x 00:27:09.420 [2024-12-08 02:29:37.121622] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.420 [2024-12-08 02:29:37.121952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.420 [2024-12-08 02:29:37.122101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.420 [2024-12-08 02:29:37.122127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.420 [2024-12-08 02:29:37.122142] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.420 [2024-12-08 02:29:37.122289] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.420 [2024-12-08 02:29:37.122477] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.420 [2024-12-08 02:29:37.122500] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.420 [2024-12-08 02:29:37.122516] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.420 02:29:37 -- nvmf/common.sh@469 -- # nvmfpid=2227102 00:27:09.420 02:29:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:09.420 02:29:37 -- nvmf/common.sh@470 -- # waitforlisten 2227102 00:27:09.420 02:29:37 -- common/autotest_common.sh@829 -- # '[' -z 2227102 ']' 00:27:09.420 02:29:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:09.420 02:29:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:09.420 02:29:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:09.420 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:09.420 02:29:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:09.420 02:29:37 -- common/autotest_common.sh@10 -- # set +x 00:27:09.420 [2024-12-08 02:29:37.124862] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.420 [2024-12-08 02:29:37.134274] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.420 [2024-12-08 02:29:37.134553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.420 [2024-12-08 02:29:37.134697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.420 [2024-12-08 02:29:37.134725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.420 [2024-12-08 02:29:37.134742] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.420 [2024-12-08 02:29:37.134872] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.420 [2024-12-08 02:29:37.135042] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.420 [2024-12-08 02:29:37.135065] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.420 [2024-12-08 02:29:37.135080] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.420 [2024-12-08 02:29:37.137420] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.420 [2024-12-08 02:29:37.146728] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.420 [2024-12-08 02:29:37.146971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.420 [2024-12-08 02:29:37.147113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.420 [2024-12-08 02:29:37.147137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.420 [2024-12-08 02:29:37.147152] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.420 [2024-12-08 02:29:37.147352] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.420 [2024-12-08 02:29:37.147505] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.420 [2024-12-08 02:29:37.147526] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.420 [2024-12-08 02:29:37.147549] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.420 [2024-12-08 02:29:37.149564] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.420 [2024-12-08 02:29:37.159116] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.420 [2024-12-08 02:29:37.159506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.420 [2024-12-08 02:29:37.159642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.420 [2024-12-08 02:29:37.159668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.420 [2024-12-08 02:29:37.159684] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.420 [2024-12-08 02:29:37.159850] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.420 [2024-12-08 02:29:37.160069] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.420 [2024-12-08 02:29:37.160089] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.420 [2024-12-08 02:29:37.160102] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.420 [2024-12-08 02:29:37.162214] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.420 [2024-12-08 02:29:37.164969] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:09.420 [2024-12-08 02:29:37.165022] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:09.420 [2024-12-08 02:29:37.171387] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.420 [2024-12-08 02:29:37.171666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.420 [2024-12-08 02:29:37.171761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.420 [2024-12-08 02:29:37.171787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.420 [2024-12-08 02:29:37.171802] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.420 [2024-12-08 02:29:37.172005] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.420 [2024-12-08 02:29:37.172191] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.420 [2024-12-08 02:29:37.172211] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.420 [2024-12-08 02:29:37.172229] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.420 [2024-12-08 02:29:37.174365] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.420 [2024-12-08 02:29:37.183411] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.420 [2024-12-08 02:29:37.183746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.420 [2024-12-08 02:29:37.183846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.421 [2024-12-08 02:29:37.183885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.421 [2024-12-08 02:29:37.183900] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.421 [2024-12-08 02:29:37.184044] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.421 [2024-12-08 02:29:37.184231] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.421 [2024-12-08 02:29:37.184251] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.421 [2024-12-08 02:29:37.184263] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.421 [2024-12-08 02:29:37.186210] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.421 [2024-12-08 02:29:37.195564] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.421 [2024-12-08 02:29:37.195881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.421 [2024-12-08 02:29:37.195977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.421 [2024-12-08 02:29:37.196003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.421 [2024-12-08 02:29:37.196018] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.421 [2024-12-08 02:29:37.196196] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.421 [2024-12-08 02:29:37.196408] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.421 [2024-12-08 02:29:37.196438] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.421 [2024-12-08 02:29:37.196452] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.683 [2024-12-08 02:29:37.198511] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.683 EAL: No free 2048 kB hugepages reported on node 1 00:27:09.683 [2024-12-08 02:29:37.208138] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.683 [2024-12-08 02:29:37.208528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.683 [2024-12-08 02:29:37.208694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.683 [2024-12-08 02:29:37.208719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.683 [2024-12-08 02:29:37.208737] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.683 [2024-12-08 02:29:37.208853] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.683 [2024-12-08 02:29:37.209035] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.683 [2024-12-08 02:29:37.209059] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.683 [2024-12-08 02:29:37.209075] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.683 [2024-12-08 02:29:37.211417] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.683 [2024-12-08 02:29:37.220695] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.683 [2024-12-08 02:29:37.221055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.683 [2024-12-08 02:29:37.221164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.683 [2024-12-08 02:29:37.221189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.683 [2024-12-08 02:29:37.221205] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.683 [2024-12-08 02:29:37.221369] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.683 [2024-12-08 02:29:37.221646] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.683 [2024-12-08 02:29:37.221667] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.683 [2024-12-08 02:29:37.221680] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.683 [2024-12-08 02:29:37.223987] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.683 [2024-12-08 02:29:37.233193] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.683 [2024-12-08 02:29:37.233534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.683 [2024-12-08 02:29:37.233675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.683 [2024-12-08 02:29:37.233700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.683 [2024-12-08 02:29:37.233716] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.683 [2024-12-08 02:29:37.233901] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.683 [2024-12-08 02:29:37.234071] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.683 [2024-12-08 02:29:37.234094] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.683 [2024-12-08 02:29:37.234110] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.683 [2024-12-08 02:29:37.234302] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:09.683 [2024-12-08 02:29:37.236526] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.683 [2024-12-08 02:29:37.245631] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.683 [2024-12-08 02:29:37.246128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.683 [2024-12-08 02:29:37.246273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.683 [2024-12-08 02:29:37.246302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.683 [2024-12-08 02:29:37.246322] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.683 [2024-12-08 02:29:37.246514] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.683 [2024-12-08 02:29:37.246702] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.683 [2024-12-08 02:29:37.246725] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.683 [2024-12-08 02:29:37.246742] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.683 [2024-12-08 02:29:37.249097] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.683 [2024-12-08 02:29:37.258136] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.683 [2024-12-08 02:29:37.258492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.683 [2024-12-08 02:29:37.258650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.683 [2024-12-08 02:29:37.258676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.683 [2024-12-08 02:29:37.258693] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.683 [2024-12-08 02:29:37.258826] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.683 [2024-12-08 02:29:37.258995] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.683 [2024-12-08 02:29:37.259019] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.683 [2024-12-08 02:29:37.259035] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.683 [2024-12-08 02:29:37.261401] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.683 [2024-12-08 02:29:37.270604] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.683 [2024-12-08 02:29:37.270949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.683 [2024-12-08 02:29:37.271088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.684 [2024-12-08 02:29:37.271114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.684 [2024-12-08 02:29:37.271130] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.684 [2024-12-08 02:29:37.271295] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.684 [2024-12-08 02:29:37.271487] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.684 [2024-12-08 02:29:37.271512] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.684 [2024-12-08 02:29:37.271527] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.684 [2024-12-08 02:29:37.273799] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.684 [2024-12-08 02:29:37.283064] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.684 [2024-12-08 02:29:37.283353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.684 [2024-12-08 02:29:37.283447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.684 [2024-12-08 02:29:37.283471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.684 [2024-12-08 02:29:37.283486] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.684 [2024-12-08 02:29:37.283660] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.684 [2024-12-08 02:29:37.283862] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.684 [2024-12-08 02:29:37.283886] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.684 [2024-12-08 02:29:37.283902] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.684 [2024-12-08 02:29:37.286190] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.684 [2024-12-08 02:29:37.295627] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.684 [2024-12-08 02:29:37.295961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.684 [2024-12-08 02:29:37.296099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.684 [2024-12-08 02:29:37.296125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.684 [2024-12-08 02:29:37.296141] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.684 [2024-12-08 02:29:37.296323] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.684 [2024-12-08 02:29:37.296528] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.684 [2024-12-08 02:29:37.296564] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.684 [2024-12-08 02:29:37.296595] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.684 [2024-12-08 02:29:37.298837] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.684 [2024-12-08 02:29:37.308404] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.684 [2024-12-08 02:29:37.308871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.684 [2024-12-08 02:29:37.309054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.684 [2024-12-08 02:29:37.309080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.684 [2024-12-08 02:29:37.309098] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.684 [2024-12-08 02:29:37.309204] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.684 [2024-12-08 02:29:37.309433] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.684 [2024-12-08 02:29:37.309457] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.684 [2024-12-08 02:29:37.309475] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.684 [2024-12-08 02:29:37.311848] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.684 [2024-12-08 02:29:37.320858] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.684 [2024-12-08 02:29:37.321145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.684 [2024-12-08 02:29:37.321288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.684 [2024-12-08 02:29:37.321316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.684 [2024-12-08 02:29:37.321334] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.684 [2024-12-08 02:29:37.321446] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.684 [2024-12-08 02:29:37.321637] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.684 [2024-12-08 02:29:37.321659] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.684 [2024-12-08 02:29:37.321673] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.684 [2024-12-08 02:29:37.324012] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.684 [2024-12-08 02:29:37.333184] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.684 [2024-12-08 02:29:37.333519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.684 [2024-12-08 02:29:37.333695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.684 [2024-12-08 02:29:37.333721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.684 [2024-12-08 02:29:37.333738] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.684 [2024-12-08 02:29:37.333913] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.684 [2024-12-08 02:29:37.334066] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.684 [2024-12-08 02:29:37.334089] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.684 [2024-12-08 02:29:37.334105] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.684 [2024-12-08 02:29:37.336385] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.684 [2024-12-08 02:29:37.345645] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.684 [2024-12-08 02:29:37.345998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.684 [2024-12-08 02:29:37.346132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.684 [2024-12-08 02:29:37.346158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.684 [2024-12-08 02:29:37.346173] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.684 [2024-12-08 02:29:37.346381] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.684 [2024-12-08 02:29:37.346516] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.684 [2024-12-08 02:29:37.346549] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.684 [2024-12-08 02:29:37.346567] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.684 [2024-12-08 02:29:37.348850] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.684 [2024-12-08 02:29:37.349388] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:09.684 [2024-12-08 02:29:37.349502] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:09.684 [2024-12-08 02:29:37.349520] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:09.684 [2024-12-08 02:29:37.349533] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:09.684 [2024-12-08 02:29:37.349596] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:09.684 [2024-12-08 02:29:37.349656] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:09.684 [2024-12-08 02:29:37.349660] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:09.684 [2024-12-08 02:29:37.358060] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.684 [2024-12-08 02:29:37.358476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.684 [2024-12-08 02:29:37.358623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.684 [2024-12-08 02:29:37.358650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.684 [2024-12-08 02:29:37.358669] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.684 [2024-12-08 02:29:37.358874] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.684 [2024-12-08 02:29:37.359012] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.685 [2024-12-08 02:29:37.359041] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.685 [2024-12-08 02:29:37.359058] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.685 [2024-12-08 02:29:37.361225] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.685 [2024-12-08 02:29:37.370361] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.685 [2024-12-08 02:29:37.370874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.685 [2024-12-08 02:29:37.371017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.685 [2024-12-08 02:29:37.371044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.685 [2024-12-08 02:29:37.371063] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.685 [2024-12-08 02:29:37.371252] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.685 [2024-12-08 02:29:37.371422] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.685 [2024-12-08 02:29:37.371443] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.685 [2024-12-08 02:29:37.371458] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.685 [2024-12-08 02:29:37.373464] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.685 [2024-12-08 02:29:37.382731] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.685 [2024-12-08 02:29:37.383123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.685 [2024-12-08 02:29:37.383249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.685 [2024-12-08 02:29:37.383275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.685 [2024-12-08 02:29:37.383294] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.685 [2024-12-08 02:29:37.383436] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.685 [2024-12-08 02:29:37.383635] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.685 [2024-12-08 02:29:37.383658] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.685 [2024-12-08 02:29:37.383674] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.685 [2024-12-08 02:29:37.385681] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.685 [2024-12-08 02:29:37.395331] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.685 [2024-12-08 02:29:37.395784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.685 [2024-12-08 02:29:37.395889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.685 [2024-12-08 02:29:37.395916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.685 [2024-12-08 02:29:37.395935] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.685 [2024-12-08 02:29:37.396079] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.685 [2024-12-08 02:29:37.396233] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.685 [2024-12-08 02:29:37.396254] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.685 [2024-12-08 02:29:37.396283] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.685 [2024-12-08 02:29:37.398335] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.685 [2024-12-08 02:29:37.407879] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.685 [2024-12-08 02:29:37.408238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.685 [2024-12-08 02:29:37.408374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.685 [2024-12-08 02:29:37.408401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.685 [2024-12-08 02:29:37.408419] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.685 [2024-12-08 02:29:37.408578] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.685 [2024-12-08 02:29:37.408726] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.685 [2024-12-08 02:29:37.408750] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.685 [2024-12-08 02:29:37.408767] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.685 [2024-12-08 02:29:37.410811] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.685 [2024-12-08 02:29:37.420459] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.685 [2024-12-08 02:29:37.420876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.685 [2024-12-08 02:29:37.421014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.685 [2024-12-08 02:29:37.421043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.685 [2024-12-08 02:29:37.421062] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.685 [2024-12-08 02:29:37.421239] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.685 [2024-12-08 02:29:37.421407] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.685 [2024-12-08 02:29:37.421427] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.685 [2024-12-08 02:29:37.421443] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.685 [2024-12-08 02:29:37.423646] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.685 [2024-12-08 02:29:37.432678] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.685 [2024-12-08 02:29:37.433103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.685 [2024-12-08 02:29:37.433240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.685 [2024-12-08 02:29:37.433266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.685 [2024-12-08 02:29:37.433285] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.685 [2024-12-08 02:29:37.433475] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.685 [2024-12-08 02:29:37.433654] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.685 [2024-12-08 02:29:37.433677] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.685 [2024-12-08 02:29:37.433694] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.685 [2024-12-08 02:29:37.435894] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.685 [2024-12-08 02:29:37.445052] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.685 [2024-12-08 02:29:37.445372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.685 [2024-12-08 02:29:37.445511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.685 [2024-12-08 02:29:37.445544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.685 [2024-12-08 02:29:37.445561] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.685 [2024-12-08 02:29:37.445711] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.685 [2024-12-08 02:29:37.445880] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.685 [2024-12-08 02:29:37.445902] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.685 [2024-12-08 02:29:37.445916] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.685 [2024-12-08 02:29:37.448041] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.685 [2024-12-08 02:29:37.457431] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.685 [2024-12-08 02:29:37.457771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.686 [2024-12-08 02:29:37.457870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.686 [2024-12-08 02:29:37.457895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.686 [2024-12-08 02:29:37.457912] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.686 [2024-12-08 02:29:37.458110] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.686 [2024-12-08 02:29:37.458246] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.686 [2024-12-08 02:29:37.458267] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.686 [2024-12-08 02:29:37.458281] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.686 [2024-12-08 02:29:37.460467] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.948 [2024-12-08 02:29:37.469590] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.948 [2024-12-08 02:29:37.469830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.948 [2024-12-08 02:29:37.469976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.948 [2024-12-08 02:29:37.470002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.948 [2024-12-08 02:29:37.470018] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.948 [2024-12-08 02:29:37.470151] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.948 [2024-12-08 02:29:37.470333] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.948 [2024-12-08 02:29:37.470355] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.948 [2024-12-08 02:29:37.470368] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.948 [2024-12-08 02:29:37.472366] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.948 [2024-12-08 02:29:37.481778] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.948 [2024-12-08 02:29:37.482055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.948 [2024-12-08 02:29:37.482197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.948 [2024-12-08 02:29:37.482223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.948 [2024-12-08 02:29:37.482239] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.948 [2024-12-08 02:29:37.482419] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.948 [2024-12-08 02:29:37.482628] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.948 [2024-12-08 02:29:37.482650] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.948 [2024-12-08 02:29:37.482664] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.948 [2024-12-08 02:29:37.484763] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.948 [2024-12-08 02:29:37.493965] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.948 [2024-12-08 02:29:37.494273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.948 [2024-12-08 02:29:37.494398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.949 [2024-12-08 02:29:37.494423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.949 [2024-12-08 02:29:37.494439] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.949 [2024-12-08 02:29:37.494580] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.949 [2024-12-08 02:29:37.494734] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.949 [2024-12-08 02:29:37.494756] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.949 [2024-12-08 02:29:37.494770] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.949 [2024-12-08 02:29:37.497081] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.949 [2024-12-08 02:29:37.506325] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.949 [2024-12-08 02:29:37.506624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.949 [2024-12-08 02:29:37.506742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.949 [2024-12-08 02:29:37.506767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.949 [2024-12-08 02:29:37.506783] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.949 [2024-12-08 02:29:37.506915] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.949 [2024-12-08 02:29:37.507066] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.949 [2024-12-08 02:29:37.507087] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.949 [2024-12-08 02:29:37.507100] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.949 [2024-12-08 02:29:37.509048] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.949 [2024-12-08 02:29:37.518510] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.949 [2024-12-08 02:29:37.518783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.949 [2024-12-08 02:29:37.518929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.949 [2024-12-08 02:29:37.518954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.949 [2024-12-08 02:29:37.518970] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.949 [2024-12-08 02:29:37.519102] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.949 [2024-12-08 02:29:37.519269] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.949 [2024-12-08 02:29:37.519289] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.949 [2024-12-08 02:29:37.519303] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.949 [2024-12-08 02:29:37.521605] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.949 [2024-12-08 02:29:37.530669] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.949 [2024-12-08 02:29:37.531012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.949 [2024-12-08 02:29:37.531108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.949 [2024-12-08 02:29:37.531134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.949 [2024-12-08 02:29:37.531149] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.949 [2024-12-08 02:29:37.531297] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.949 [2024-12-08 02:29:37.531496] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.949 [2024-12-08 02:29:37.531517] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.949 [2024-12-08 02:29:37.531530] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.949 [2024-12-08 02:29:37.533707] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.949 [2024-12-08 02:29:37.542764] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.949 [2024-12-08 02:29:37.543085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.949 [2024-12-08 02:29:37.543201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.949 [2024-12-08 02:29:37.543226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.949 [2024-12-08 02:29:37.543242] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.949 [2024-12-08 02:29:37.543374] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.949 [2024-12-08 02:29:37.543615] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.949 [2024-12-08 02:29:37.543637] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.949 [2024-12-08 02:29:37.543651] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.949 [2024-12-08 02:29:37.545723] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.949 [2024-12-08 02:29:37.555045] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.949 [2024-12-08 02:29:37.555324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.949 [2024-12-08 02:29:37.555420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.949 [2024-12-08 02:29:37.555445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.949 [2024-12-08 02:29:37.555461] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.949 [2024-12-08 02:29:37.555586] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.949 [2024-12-08 02:29:37.555721] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.949 [2024-12-08 02:29:37.555742] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.949 [2024-12-08 02:29:37.555755] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.949 [2024-12-08 02:29:37.557882] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.949 [2024-12-08 02:29:37.567239] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.949 [2024-12-08 02:29:37.567516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.949 [2024-12-08 02:29:37.567622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.949 [2024-12-08 02:29:37.567649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.949 [2024-12-08 02:29:37.567665] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.949 [2024-12-08 02:29:37.567847] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.949 [2024-12-08 02:29:37.568028] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.949 [2024-12-08 02:29:37.568049] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.949 [2024-12-08 02:29:37.568062] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.949 [2024-12-08 02:29:37.570220] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.949 [2024-12-08 02:29:37.579896] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.949 [2024-12-08 02:29:37.580194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.949 [2024-12-08 02:29:37.580319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.949 [2024-12-08 02:29:37.580344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.949 [2024-12-08 02:29:37.580360] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.949 [2024-12-08 02:29:37.580509] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.949 [2024-12-08 02:29:37.580671] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.949 [2024-12-08 02:29:37.580693] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.949 [2024-12-08 02:29:37.580707] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.949 [2024-12-08 02:29:37.582796] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.950 [2024-12-08 02:29:37.592161] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.950 [2024-12-08 02:29:37.592470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.950 [2024-12-08 02:29:37.592583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.950 [2024-12-08 02:29:37.592610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.950 [2024-12-08 02:29:37.592632] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.950 [2024-12-08 02:29:37.592805] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.950 [2024-12-08 02:29:37.592988] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.950 [2024-12-08 02:29:37.593009] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.950 [2024-12-08 02:29:37.593023] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.950 [2024-12-08 02:29:37.595121] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.950 [2024-12-08 02:29:37.604531] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.950 [2024-12-08 02:29:37.604773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.950 [2024-12-08 02:29:37.604893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.950 [2024-12-08 02:29:37.604918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.950 [2024-12-08 02:29:37.604934] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.950 [2024-12-08 02:29:37.605132] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.950 [2024-12-08 02:29:37.605328] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.950 [2024-12-08 02:29:37.605348] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.950 [2024-12-08 02:29:37.605362] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.950 [2024-12-08 02:29:37.607393] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.950 [2024-12-08 02:29:37.616791] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.950 [2024-12-08 02:29:37.617092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.950 [2024-12-08 02:29:37.617177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.950 [2024-12-08 02:29:37.617203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.950 [2024-12-08 02:29:37.617219] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.950 [2024-12-08 02:29:37.617384] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.950 [2024-12-08 02:29:37.617591] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.950 [2024-12-08 02:29:37.617614] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.950 [2024-12-08 02:29:37.617628] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.950 [2024-12-08 02:29:37.619715] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.950 [2024-12-08 02:29:37.629028] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.950 [2024-12-08 02:29:37.629353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.950 [2024-12-08 02:29:37.629455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.950 [2024-12-08 02:29:37.629480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.950 [2024-12-08 02:29:37.629496] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.950 [2024-12-08 02:29:37.629675] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.950 [2024-12-08 02:29:37.629845] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.950 [2024-12-08 02:29:37.629866] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.950 [2024-12-08 02:29:37.629879] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.950 [2024-12-08 02:29:37.631952] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.950 [2024-12-08 02:29:37.641356] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.950 [2024-12-08 02:29:37.641642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.950 [2024-12-08 02:29:37.641734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.950 [2024-12-08 02:29:37.641760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.950 [2024-12-08 02:29:37.641775] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.950 [2024-12-08 02:29:37.641940] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.950 [2024-12-08 02:29:37.642091] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.950 [2024-12-08 02:29:37.642112] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.950 [2024-12-08 02:29:37.642125] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.950 [2024-12-08 02:29:37.644216] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.950 [2024-12-08 02:29:37.653555] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.950 [2024-12-08 02:29:37.653827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.950 [2024-12-08 02:29:37.653940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.950 [2024-12-08 02:29:37.653965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.950 [2024-12-08 02:29:37.653981] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.950 [2024-12-08 02:29:37.654097] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.950 [2024-12-08 02:29:37.654248] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.950 [2024-12-08 02:29:37.654269] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.950 [2024-12-08 02:29:37.654283] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.950 [2024-12-08 02:29:37.656398] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.950 [2024-12-08 02:29:37.665967] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.950 [2024-12-08 02:29:37.666264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.950 [2024-12-08 02:29:37.666356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.950 [2024-12-08 02:29:37.666381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.950 [2024-12-08 02:29:37.666397] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.950 [2024-12-08 02:29:37.666590] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.950 [2024-12-08 02:29:37.666749] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.950 [2024-12-08 02:29:37.666771] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.950 [2024-12-08 02:29:37.666785] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.950 [2024-12-08 02:29:37.669065] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.950 [2024-12-08 02:29:37.678265] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.950 [2024-12-08 02:29:37.678605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.950 [2024-12-08 02:29:37.678698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.950 [2024-12-08 02:29:37.678724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.950 [2024-12-08 02:29:37.678739] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.950 [2024-12-08 02:29:37.678888] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.950 [2024-12-08 02:29:37.679054] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.950 [2024-12-08 02:29:37.679075] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.950 [2024-12-08 02:29:37.679089] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.950 [2024-12-08 02:29:37.681182] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.950 [2024-12-08 02:29:37.690454] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.951 [2024-12-08 02:29:37.690738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.951 [2024-12-08 02:29:37.690854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.951 [2024-12-08 02:29:37.690879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.951 [2024-12-08 02:29:37.690895] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.951 [2024-12-08 02:29:37.691075] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.951 [2024-12-08 02:29:37.691240] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.951 [2024-12-08 02:29:37.691260] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.951 [2024-12-08 02:29:37.691274] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.951 [2024-12-08 02:29:37.693213] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.951 [2024-12-08 02:29:37.702626] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.951 [2024-12-08 02:29:37.702986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.951 [2024-12-08 02:29:37.703106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.951 [2024-12-08 02:29:37.703131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.951 [2024-12-08 02:29:37.703147] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.951 [2024-12-08 02:29:37.703295] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.951 [2024-12-08 02:29:37.703430] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.951 [2024-12-08 02:29:37.703455] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.951 [2024-12-08 02:29:37.703470] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.951 [2024-12-08 02:29:37.705478] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:09.951 [2024-12-08 02:29:37.714774] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:09.951 [2024-12-08 02:29:37.715067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.951 [2024-12-08 02:29:37.715181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:09.951 [2024-12-08 02:29:37.715206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:09.951 [2024-12-08 02:29:37.715221] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:09.951 [2024-12-08 02:29:37.715354] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:09.951 [2024-12-08 02:29:37.715565] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:09.951 [2024-12-08 02:29:37.715589] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:09.951 [2024-12-08 02:29:37.715602] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:09.951 [2024-12-08 02:29:37.717767] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.212 [2024-12-08 02:29:37.727153] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.212 [2024-12-08 02:29:37.727436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.212 [2024-12-08 02:29:37.727555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.212 [2024-12-08 02:29:37.727582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.212 [2024-12-08 02:29:37.727598] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.212 [2024-12-08 02:29:37.727779] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.212 [2024-12-08 02:29:37.727948] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.212 [2024-12-08 02:29:37.727970] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.212 [2024-12-08 02:29:37.727984] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.212 [2024-12-08 02:29:37.730159] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.212 [2024-12-08 02:29:37.739561] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.212 [2024-12-08 02:29:37.739864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.212 [2024-12-08 02:29:37.740009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.212 [2024-12-08 02:29:37.740035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.212 [2024-12-08 02:29:37.740050] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.212 [2024-12-08 02:29:37.740232] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.212 [2024-12-08 02:29:37.740397] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.212 [2024-12-08 02:29:37.740418] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.212 [2024-12-08 02:29:37.740437] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.212 [2024-12-08 02:29:37.742486] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.212 [2024-12-08 02:29:37.751946] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.212 [2024-12-08 02:29:37.752254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.212 [2024-12-08 02:29:37.752366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.212 [2024-12-08 02:29:37.752391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.212 [2024-12-08 02:29:37.752407] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.212 [2024-12-08 02:29:37.752563] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.212 [2024-12-08 02:29:37.752717] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.212 [2024-12-08 02:29:37.752738] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.212 [2024-12-08 02:29:37.752751] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.212 [2024-12-08 02:29:37.754938] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.212 [2024-12-08 02:29:37.764170] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.212 [2024-12-08 02:29:37.764476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.212 [2024-12-08 02:29:37.764576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.212 [2024-12-08 02:29:37.764602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.212 [2024-12-08 02:29:37.764618] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.212 [2024-12-08 02:29:37.764767] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.212 [2024-12-08 02:29:37.764902] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.212 [2024-12-08 02:29:37.764922] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.212 [2024-12-08 02:29:37.764936] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.212 [2024-12-08 02:29:37.767032] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.212 [2024-12-08 02:29:37.776477] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.212 [2024-12-08 02:29:37.776740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.212 [2024-12-08 02:29:37.776834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.212 [2024-12-08 02:29:37.776860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.212 [2024-12-08 02:29:37.776875] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.212 [2024-12-08 02:29:37.777008] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.212 [2024-12-08 02:29:37.777128] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.212 [2024-12-08 02:29:37.777148] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.212 [2024-12-08 02:29:37.777161] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.212 [2024-12-08 02:29:37.779248] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.212 [2024-12-08 02:29:37.788746] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.212 [2024-12-08 02:29:37.789085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.212 [2024-12-08 02:29:37.789202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.212 [2024-12-08 02:29:37.789227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.213 [2024-12-08 02:29:37.789243] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.213 [2024-12-08 02:29:37.789408] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.213 [2024-12-08 02:29:37.789599] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.213 [2024-12-08 02:29:37.789622] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.213 [2024-12-08 02:29:37.789636] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.213 [2024-12-08 02:29:37.791783] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.213 [2024-12-08 02:29:37.801134] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.213 [2024-12-08 02:29:37.801425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.213 [2024-12-08 02:29:37.801509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.213 [2024-12-08 02:29:37.801534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.213 [2024-12-08 02:29:37.801560] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.213 [2024-12-08 02:29:37.801693] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.213 [2024-12-08 02:29:37.801845] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.213 [2024-12-08 02:29:37.801866] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.213 [2024-12-08 02:29:37.801880] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.213 [2024-12-08 02:29:37.803962] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.213 [2024-12-08 02:29:37.813317] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.213 [2024-12-08 02:29:37.813565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.213 [2024-12-08 02:29:37.813656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.213 [2024-12-08 02:29:37.813682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.213 [2024-12-08 02:29:37.813698] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.213 [2024-12-08 02:29:37.813864] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.213 [2024-12-08 02:29:37.814029] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.213 [2024-12-08 02:29:37.814051] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.213 [2024-12-08 02:29:37.814064] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.213 [2024-12-08 02:29:37.816211] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.213 [2024-12-08 02:29:37.825781] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.213 [2024-12-08 02:29:37.826033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.213 [2024-12-08 02:29:37.826172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.213 [2024-12-08 02:29:37.826197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.213 [2024-12-08 02:29:37.826213] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.213 [2024-12-08 02:29:37.826362] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.213 [2024-12-08 02:29:37.826568] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.213 [2024-12-08 02:29:37.826591] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.213 [2024-12-08 02:29:37.826605] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.213 [2024-12-08 02:29:37.828629] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.213 [2024-12-08 02:29:37.838226] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.213 [2024-12-08 02:29:37.838531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.213 [2024-12-08 02:29:37.838673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.213 [2024-12-08 02:29:37.838699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.213 [2024-12-08 02:29:37.838714] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.213 [2024-12-08 02:29:37.838863] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.213 [2024-12-08 02:29:37.839029] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.213 [2024-12-08 02:29:37.839051] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.213 [2024-12-08 02:29:37.839064] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.213 [2024-12-08 02:29:37.841374] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.213 [2024-12-08 02:29:37.850563] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.213 [2024-12-08 02:29:37.850835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.213 [2024-12-08 02:29:37.850954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.213 [2024-12-08 02:29:37.850980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.213 [2024-12-08 02:29:37.850995] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.213 [2024-12-08 02:29:37.851129] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.213 [2024-12-08 02:29:37.851328] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.213 [2024-12-08 02:29:37.851349] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.213 [2024-12-08 02:29:37.851362] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.213 [2024-12-08 02:29:37.853470] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.213 [2024-12-08 02:29:37.863001] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.213 [2024-12-08 02:29:37.863352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.213 [2024-12-08 02:29:37.863445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.213 [2024-12-08 02:29:37.863471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.213 [2024-12-08 02:29:37.863487] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.213 [2024-12-08 02:29:37.863676] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.213 [2024-12-08 02:29:37.863893] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.213 [2024-12-08 02:29:37.863915] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.213 [2024-12-08 02:29:37.863928] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.213 [2024-12-08 02:29:37.866123] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.213 [2024-12-08 02:29:37.875379] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.213 [2024-12-08 02:29:37.875657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.213 [2024-12-08 02:29:37.875780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.213 [2024-12-08 02:29:37.875806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.213 [2024-12-08 02:29:37.875822] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.214 [2024-12-08 02:29:37.875971] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.214 [2024-12-08 02:29:37.876122] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.214 [2024-12-08 02:29:37.876143] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.214 [2024-12-08 02:29:37.876156] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.214 [2024-12-08 02:29:37.878063] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.214 [2024-12-08 02:29:37.887736] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.214 [2024-12-08 02:29:37.888029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.214 [2024-12-08 02:29:37.888105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.214 [2024-12-08 02:29:37.888130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.214 [2024-12-08 02:29:37.888146] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.214 [2024-12-08 02:29:37.888311] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.214 [2024-12-08 02:29:37.888493] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.214 [2024-12-08 02:29:37.888529] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.214 [2024-12-08 02:29:37.888553] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.214 [2024-12-08 02:29:37.890561] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.214 [2024-12-08 02:29:37.899873] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.214 [2024-12-08 02:29:37.900129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.214 [2024-12-08 02:29:37.900251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.214 [2024-12-08 02:29:37.900277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.214 [2024-12-08 02:29:37.900293] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.214 [2024-12-08 02:29:37.900409] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.214 [2024-12-08 02:29:37.900600] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.214 [2024-12-08 02:29:37.900622] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.214 [2024-12-08 02:29:37.900636] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.214 [2024-12-08 02:29:37.902734] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.214 [2024-12-08 02:29:37.912092] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.214 [2024-12-08 02:29:37.912361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.214 [2024-12-08 02:29:37.912452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.214 [2024-12-08 02:29:37.912478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.214 [2024-12-08 02:29:37.912494] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.214 [2024-12-08 02:29:37.912684] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.214 [2024-12-08 02:29:37.912822] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.214 [2024-12-08 02:29:37.912857] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.214 [2024-12-08 02:29:37.912871] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.214 [2024-12-08 02:29:37.915075] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.214 [2024-12-08 02:29:37.924243] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.214 [2024-12-08 02:29:37.924483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.214 [2024-12-08 02:29:37.924586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.214 [2024-12-08 02:29:37.924612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.214 [2024-12-08 02:29:37.924628] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.214 [2024-12-08 02:29:37.924760] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.214 [2024-12-08 02:29:37.924879] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.214 [2024-12-08 02:29:37.924900] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.214 [2024-12-08 02:29:37.924913] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.214 [2024-12-08 02:29:37.927037] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.214 [2024-12-08 02:29:37.936621] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.214 [2024-12-08 02:29:37.936955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.214 [2024-12-08 02:29:37.937097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.214 [2024-12-08 02:29:37.937122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.214 [2024-12-08 02:29:37.937143] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.214 [2024-12-08 02:29:37.937276] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.214 [2024-12-08 02:29:37.937444] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.214 [2024-12-08 02:29:37.937465] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.214 [2024-12-08 02:29:37.937479] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.214 [2024-12-08 02:29:37.939686] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.214 [2024-12-08 02:29:37.949330] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.214 [2024-12-08 02:29:37.949682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.214 [2024-12-08 02:29:37.949775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.214 [2024-12-08 02:29:37.949801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.214 [2024-12-08 02:29:37.949816] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.214 [2024-12-08 02:29:37.949966] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.214 [2024-12-08 02:29:37.950116] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.214 [2024-12-08 02:29:37.950137] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.214 [2024-12-08 02:29:37.950150] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.214 [2024-12-08 02:29:37.952329] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.214 [2024-12-08 02:29:37.961821] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.214 [2024-12-08 02:29:37.962151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.214 [2024-12-08 02:29:37.962260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.214 [2024-12-08 02:29:37.962285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.214 [2024-12-08 02:29:37.962301] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.214 [2024-12-08 02:29:37.962450] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.214 [2024-12-08 02:29:37.962658] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.215 [2024-12-08 02:29:37.962681] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.215 [2024-12-08 02:29:37.962694] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.215 [2024-12-08 02:29:37.964792] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.215 [2024-12-08 02:29:37.973903] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.215 [2024-12-08 02:29:37.974197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.215 [2024-12-08 02:29:37.974277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.215 [2024-12-08 02:29:37.974303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.215 [2024-12-08 02:29:37.974318] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.215 [2024-12-08 02:29:37.974471] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.215 [2024-12-08 02:29:37.974648] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.215 [2024-12-08 02:29:37.974671] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.215 [2024-12-08 02:29:37.974684] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.215 [2024-12-08 02:29:37.977021] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.215 [2024-12-08 02:29:37.986128] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.215 [2024-12-08 02:29:37.986424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.215 [2024-12-08 02:29:37.986516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.215 [2024-12-08 02:29:37.986550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.215 [2024-12-08 02:29:37.986567] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.215 [2024-12-08 02:29:37.986716] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.215 [2024-12-08 02:29:37.986869] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.215 [2024-12-08 02:29:37.986890] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.215 [2024-12-08 02:29:37.986919] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.215 [2024-12-08 02:29:37.989160] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.475 [2024-12-08 02:29:37.998668] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.475 [2024-12-08 02:29:37.998916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.475 [2024-12-08 02:29:37.999069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.475 [2024-12-08 02:29:37.999095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.475 [2024-12-08 02:29:37.999111] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.475 [2024-12-08 02:29:37.999292] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.475 [2024-12-08 02:29:37.999505] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.475 [2024-12-08 02:29:37.999551] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.475 [2024-12-08 02:29:37.999567] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.475 [2024-12-08 02:29:38.001671] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.476 [2024-12-08 02:29:38.011011] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.476 [2024-12-08 02:29:38.011293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.476 [2024-12-08 02:29:38.011437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.476 [2024-12-08 02:29:38.011463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.476 [2024-12-08 02:29:38.011478] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.476 [2024-12-08 02:29:38.011620] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.476 [2024-12-08 02:29:38.011796] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.476 [2024-12-08 02:29:38.011818] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.476 [2024-12-08 02:29:38.011847] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.476 [2024-12-08 02:29:38.014054] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.476 [2024-12-08 02:29:38.023302] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.476 [2024-12-08 02:29:38.023573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.476 [2024-12-08 02:29:38.023664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.476 [2024-12-08 02:29:38.023690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.476 [2024-12-08 02:29:38.023705] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.476 [2024-12-08 02:29:38.023822] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.476 [2024-12-08 02:29:38.023957] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.476 [2024-12-08 02:29:38.023978] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.476 [2024-12-08 02:29:38.023991] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.476 [2024-12-08 02:29:38.026233] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.476 [2024-12-08 02:29:38.035837] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.476 [2024-12-08 02:29:38.036085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.476 [2024-12-08 02:29:38.036200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.476 [2024-12-08 02:29:38.036226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.476 [2024-12-08 02:29:38.036241] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.476 [2024-12-08 02:29:38.036439] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.476 [2024-12-08 02:29:38.036617] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.476 [2024-12-08 02:29:38.036639] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.476 [2024-12-08 02:29:38.036654] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.476 [2024-12-08 02:29:38.038721] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.476 [2024-12-08 02:29:38.048185] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.476 [2024-12-08 02:29:38.048428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.476 [2024-12-08 02:29:38.048551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.476 [2024-12-08 02:29:38.048577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.476 [2024-12-08 02:29:38.048593] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.476 [2024-12-08 02:29:38.048710] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.476 [2024-12-08 02:29:38.048831] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.476 [2024-12-08 02:29:38.048879] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.476 [2024-12-08 02:29:38.048894] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.476 [2024-12-08 02:29:38.050843] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.476 [2024-12-08 02:29:38.060467] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.476 [2024-12-08 02:29:38.060757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.476 [2024-12-08 02:29:38.060855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.476 [2024-12-08 02:29:38.060881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.476 [2024-12-08 02:29:38.060898] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.476 [2024-12-08 02:29:38.061015] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.476 [2024-12-08 02:29:38.061152] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.476 [2024-12-08 02:29:38.061173] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.476 [2024-12-08 02:29:38.061187] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.476 [2024-12-08 02:29:38.063297] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.476 [2024-12-08 02:29:38.072732] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.476 [2024-12-08 02:29:38.073010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.476 [2024-12-08 02:29:38.073129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.476 [2024-12-08 02:29:38.073155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.476 [2024-12-08 02:29:38.073171] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.476 [2024-12-08 02:29:38.073303] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.476 [2024-12-08 02:29:38.073454] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.476 [2024-12-08 02:29:38.073475] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.476 [2024-12-08 02:29:38.073488] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.476 [2024-12-08 02:29:38.075502] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.476 [2024-12-08 02:29:38.084761] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.476 [2024-12-08 02:29:38.085090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.476 [2024-12-08 02:29:38.085206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.476 [2024-12-08 02:29:38.085232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.476 [2024-12-08 02:29:38.085248] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.476 [2024-12-08 02:29:38.085397] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.476 [2024-12-08 02:29:38.085589] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.476 [2024-12-08 02:29:38.085611] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.476 [2024-12-08 02:29:38.085635] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.476 [2024-12-08 02:29:38.087793] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.476 [2024-12-08 02:29:38.097096] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.477 [2024-12-08 02:29:38.097397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.477 [2024-12-08 02:29:38.097513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.477 [2024-12-08 02:29:38.097544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.477 [2024-12-08 02:29:38.097562] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.477 [2024-12-08 02:29:38.097728] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.477 [2024-12-08 02:29:38.097927] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.477 [2024-12-08 02:29:38.097948] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.477 [2024-12-08 02:29:38.097962] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.477 [2024-12-08 02:29:38.099998] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.477 [2024-12-08 02:29:38.109593] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.477 [2024-12-08 02:29:38.109819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.477 [2024-12-08 02:29:38.109930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.477 [2024-12-08 02:29:38.109956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.477 [2024-12-08 02:29:38.109971] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.477 [2024-12-08 02:29:38.110119] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.477 [2024-12-08 02:29:38.110272] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.477 [2024-12-08 02:29:38.110293] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.477 [2024-12-08 02:29:38.110307] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.477 [2024-12-08 02:29:38.112732] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.477 [2024-12-08 02:29:38.122095] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.477 [2024-12-08 02:29:38.122405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.477 [2024-12-08 02:29:38.122486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.477 [2024-12-08 02:29:38.122512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.477 [2024-12-08 02:29:38.122528] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.477 [2024-12-08 02:29:38.122716] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.477 [2024-12-08 02:29:38.122869] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.477 [2024-12-08 02:29:38.122890] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.477 02:29:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:10.477 [2024-12-08 02:29:38.122908] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.477 02:29:38 -- common/autotest_common.sh@862 -- # return 0 00:27:10.477 02:29:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:10.477 02:29:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:10.477 02:29:38 -- common/autotest_common.sh@10 -- # set +x 00:27:10.477 [2024-12-08 02:29:38.124878] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.477 [2024-12-08 02:29:38.134193] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.477 [2024-12-08 02:29:38.134493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.477 [2024-12-08 02:29:38.134621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.477 [2024-12-08 02:29:38.134647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.477 [2024-12-08 02:29:38.134663] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.477 [2024-12-08 02:29:38.134812] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.477 [2024-12-08 02:29:38.134963] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.477 [2024-12-08 02:29:38.134984] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.477 [2024-12-08 02:29:38.134997] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.477 [2024-12-08 02:29:38.137228] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.477 [2024-12-08 02:29:38.146302] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.477 [2024-12-08 02:29:38.146561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.477 [2024-12-08 02:29:38.146701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.477 [2024-12-08 02:29:38.146728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.477 [2024-12-08 02:29:38.146743] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.477 [2024-12-08 02:29:38.146908] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.477 [2024-12-08 02:29:38.147043] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.477 [2024-12-08 02:29:38.147064] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.477 [2024-12-08 02:29:38.147076] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.477 02:29:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:10.477 02:29:38 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:10.477 02:29:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:10.477 02:29:38 -- common/autotest_common.sh@10 -- # set +x 00:27:10.477 [2024-12-08 02:29:38.149149] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.477 [2024-12-08 02:29:38.153137] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:10.477 [2024-12-08 02:29:38.158637] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.477 [2024-12-08 02:29:38.158866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.477 [2024-12-08 02:29:38.158986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.477 [2024-12-08 02:29:38.159012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.477 [2024-12-08 02:29:38.159027] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same 02:29:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:10.477 with the state(5) to be set 00:27:10.477 [2024-12-08 02:29:38.159217] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.477 02:29:38 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:10.477 [2024-12-08 02:29:38.159367] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.477 [2024-12-08 02:29:38.159387] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.477 [2024-12-08 02:29:38.159401] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.477 02:29:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:10.477 02:29:38 -- common/autotest_common.sh@10 -- # set +x 00:27:10.477 [2024-12-08 02:29:38.161531] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.477 [2024-12-08 02:29:38.170912] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.478 [2024-12-08 02:29:38.171216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.478 [2024-12-08 02:29:38.171329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.478 [2024-12-08 02:29:38.171355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.478 [2024-12-08 02:29:38.171371] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.478 [2024-12-08 02:29:38.171545] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.478 [2024-12-08 02:29:38.171683] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.478 [2024-12-08 02:29:38.171704] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.478 [2024-12-08 02:29:38.171717] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.478 [2024-12-08 02:29:38.174042] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.478 [2024-12-08 02:29:38.183383] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.478 [2024-12-08 02:29:38.183741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.478 [2024-12-08 02:29:38.183855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.478 [2024-12-08 02:29:38.183881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.478 [2024-12-08 02:29:38.183898] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.478 [2024-12-08 02:29:38.184049] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.478 [2024-12-08 02:29:38.184216] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.478 [2024-12-08 02:29:38.184238] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.478 [2024-12-08 02:29:38.184253] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.478 [2024-12-08 02:29:38.186514] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.478 [2024-12-08 02:29:38.195794] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.478 [2024-12-08 02:29:38.196184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.478 [2024-12-08 02:29:38.196318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.478 [2024-12-08 02:29:38.196344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.478 [2024-12-08 02:29:38.196372] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.478 [2024-12-08 02:29:38.196497] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.478 [2024-12-08 02:29:38.196663] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.478 [2024-12-08 02:29:38.196686] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.478 [2024-12-08 02:29:38.196703] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.478 [2024-12-08 02:29:38.198837] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.478 Malloc0 00:27:10.478 02:29:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:10.478 02:29:38 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:10.478 02:29:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:10.478 02:29:38 -- common/autotest_common.sh@10 -- # set +x 00:27:10.478 02:29:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:10.478 02:29:38 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:10.478 02:29:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:10.478 02:29:38 -- common/autotest_common.sh@10 -- # set +x 00:27:10.478 [2024-12-08 02:29:38.208270] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.478 [2024-12-08 02:29:38.208574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.478 [2024-12-08 02:29:38.208704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.478 [2024-12-08 02:29:38.208729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d00160 with addr=10.0.0.2, port=4420 00:27:10.478 [2024-12-08 02:29:38.208745] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d00160 is same with the state(5) to be set 00:27:10.478 [2024-12-08 02:29:38.208863] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d00160 (9): Bad file descriptor 00:27:10.478 [2024-12-08 02:29:38.209012] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:10.478 [2024-12-08 02:29:38.209033] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:10.478 [2024-12-08 02:29:38.209047] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:10.478 [2024-12-08 02:29:38.211070] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:10.478 02:29:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:10.478 02:29:38 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:10.478 02:29:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:10.478 02:29:38 -- common/autotest_common.sh@10 -- # set +x 00:27:10.478 [2024-12-08 02:29:38.219742] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:10.478 [2024-12-08 02:29:38.220603] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:10.478 02:29:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:10.478 02:29:38 -- host/bdevperf.sh@38 -- # wait 2226296 00:27:10.737 [2024-12-08 02:29:38.256047] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:27:18.876 00:27:18.876 Latency(us) 00:27:18.876 [2024-12-08T01:29:46.657Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:18.876 [2024-12-08T01:29:46.657Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:18.876 Verification LBA range: start 0x0 length 0x4000 00:27:18.876 Nvme1n1 : 15.01 9334.97 36.46 15733.00 0.00 5091.29 582.54 23010.42 00:27:18.876 [2024-12-08T01:29:46.657Z] =================================================================================================================== 00:27:18.876 [2024-12-08T01:29:46.657Z] Total : 9334.97 36.46 15733.00 0.00 5091.29 582.54 23010.42 00:27:19.136 02:29:46 -- host/bdevperf.sh@39 -- # sync 00:27:19.136 02:29:46 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:19.136 02:29:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.136 02:29:46 -- common/autotest_common.sh@10 -- # set +x 00:27:19.136 02:29:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.136 02:29:46 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:27:19.136 02:29:46 -- host/bdevperf.sh@44 -- # nvmftestfini 00:27:19.136 02:29:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:19.136 02:29:46 -- nvmf/common.sh@116 -- # sync 00:27:19.136 02:29:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:19.136 02:29:46 -- nvmf/common.sh@119 -- # set +e 00:27:19.136 02:29:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:19.136 02:29:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:19.136 rmmod nvme_tcp 00:27:19.136 rmmod nvme_fabrics 00:27:19.136 rmmod nvme_keyring 00:27:19.136 02:29:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:19.136 02:29:46 -- nvmf/common.sh@123 -- # set -e 00:27:19.136 02:29:46 -- nvmf/common.sh@124 -- # return 0 00:27:19.136 02:29:46 -- nvmf/common.sh@477 -- # '[' -n 2227102 ']' 00:27:19.136 02:29:46 -- nvmf/common.sh@478 -- # killprocess 2227102 00:27:19.136 02:29:46 -- common/autotest_common.sh@936 -- # '[' -z 2227102 ']' 00:27:19.136 02:29:46 -- common/autotest_common.sh@940 -- # kill -0 2227102 00:27:19.136 02:29:46 -- common/autotest_common.sh@941 -- # uname 00:27:19.136 02:29:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:19.136 02:29:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2227102 00:27:19.396 02:29:46 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:19.396 02:29:46 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:19.396 02:29:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2227102' 00:27:19.396 killing process with pid 2227102 00:27:19.396 02:29:46 -- common/autotest_common.sh@955 -- # kill 2227102 00:27:19.396 02:29:46 -- common/autotest_common.sh@960 -- # wait 2227102 00:27:19.666 02:29:47 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:19.666 02:29:47 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:19.666 02:29:47 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:19.666 02:29:47 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:19.666 02:29:47 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:19.666 02:29:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:19.666 02:29:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:19.666 02:29:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:21.565 02:29:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:21.565 00:27:21.565 real 0m23.298s 00:27:21.565 user 1m2.167s 00:27:21.565 sys 0m4.350s 00:27:21.565 02:29:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:21.565 02:29:49 -- common/autotest_common.sh@10 -- # set +x 00:27:21.565 ************************************ 00:27:21.565 END TEST nvmf_bdevperf 00:27:21.565 ************************************ 00:27:21.565 02:29:49 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:21.565 02:29:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:21.565 02:29:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:21.565 02:29:49 -- common/autotest_common.sh@10 -- # set +x 00:27:21.565 ************************************ 00:27:21.565 START TEST nvmf_target_disconnect 00:27:21.565 ************************************ 00:27:21.565 02:29:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:21.565 * Looking for test storage... 00:27:21.565 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:21.565 02:29:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:21.565 02:29:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:21.565 02:29:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:21.824 02:29:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:21.824 02:29:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:21.824 02:29:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:21.824 02:29:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:21.824 02:29:49 -- scripts/common.sh@335 -- # IFS=.-: 00:27:21.824 02:29:49 -- scripts/common.sh@335 -- # read -ra ver1 00:27:21.824 02:29:49 -- scripts/common.sh@336 -- # IFS=.-: 00:27:21.824 02:29:49 -- scripts/common.sh@336 -- # read -ra ver2 00:27:21.824 02:29:49 -- scripts/common.sh@337 -- # local 'op=<' 00:27:21.824 02:29:49 -- scripts/common.sh@339 -- # ver1_l=2 00:27:21.824 02:29:49 -- scripts/common.sh@340 -- # ver2_l=1 00:27:21.824 02:29:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:21.824 02:29:49 -- scripts/common.sh@343 -- # case "$op" in 00:27:21.824 02:29:49 -- scripts/common.sh@344 -- # : 1 00:27:21.824 02:29:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:21.824 02:29:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:21.824 02:29:49 -- scripts/common.sh@364 -- # decimal 1 00:27:21.824 02:29:49 -- scripts/common.sh@352 -- # local d=1 00:27:21.824 02:29:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:21.824 02:29:49 -- scripts/common.sh@354 -- # echo 1 00:27:21.824 02:29:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:21.824 02:29:49 -- scripts/common.sh@365 -- # decimal 2 00:27:21.824 02:29:49 -- scripts/common.sh@352 -- # local d=2 00:27:21.824 02:29:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:21.824 02:29:49 -- scripts/common.sh@354 -- # echo 2 00:27:21.824 02:29:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:21.824 02:29:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:21.824 02:29:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:21.824 02:29:49 -- scripts/common.sh@367 -- # return 0 00:27:21.824 02:29:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:21.824 02:29:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:21.824 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:21.824 --rc genhtml_branch_coverage=1 00:27:21.824 --rc genhtml_function_coverage=1 00:27:21.824 --rc genhtml_legend=1 00:27:21.824 --rc geninfo_all_blocks=1 00:27:21.824 --rc geninfo_unexecuted_blocks=1 00:27:21.824 00:27:21.824 ' 00:27:21.824 02:29:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:21.824 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:21.824 --rc genhtml_branch_coverage=1 00:27:21.824 --rc genhtml_function_coverage=1 00:27:21.824 --rc genhtml_legend=1 00:27:21.824 --rc geninfo_all_blocks=1 00:27:21.824 --rc geninfo_unexecuted_blocks=1 00:27:21.824 00:27:21.824 ' 00:27:21.825 02:29:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:21.825 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:21.825 --rc genhtml_branch_coverage=1 00:27:21.825 --rc genhtml_function_coverage=1 00:27:21.825 --rc genhtml_legend=1 00:27:21.825 --rc geninfo_all_blocks=1 00:27:21.825 --rc geninfo_unexecuted_blocks=1 00:27:21.825 00:27:21.825 ' 00:27:21.825 02:29:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:21.825 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:21.825 --rc genhtml_branch_coverage=1 00:27:21.825 --rc genhtml_function_coverage=1 00:27:21.825 --rc genhtml_legend=1 00:27:21.825 --rc geninfo_all_blocks=1 00:27:21.825 --rc geninfo_unexecuted_blocks=1 00:27:21.825 00:27:21.825 ' 00:27:21.825 02:29:49 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:21.825 02:29:49 -- nvmf/common.sh@7 -- # uname -s 00:27:21.825 02:29:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:21.825 02:29:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:21.825 02:29:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:21.825 02:29:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:21.825 02:29:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:21.825 02:29:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:21.825 02:29:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:21.825 02:29:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:21.825 02:29:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:21.825 02:29:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:21.825 02:29:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:21.825 02:29:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:21.825 02:29:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:21.825 02:29:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:21.825 02:29:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:21.825 02:29:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:21.825 02:29:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:21.825 02:29:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:21.825 02:29:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:21.825 02:29:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:21.825 02:29:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:21.825 02:29:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:21.825 02:29:49 -- paths/export.sh@5 -- # export PATH 00:27:21.825 02:29:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:21.825 02:29:49 -- nvmf/common.sh@46 -- # : 0 00:27:21.825 02:29:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:21.825 02:29:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:21.825 02:29:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:21.825 02:29:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:21.825 02:29:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:21.825 02:29:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:21.825 02:29:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:21.825 02:29:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:21.825 02:29:49 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:21.825 02:29:49 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:27:21.825 02:29:49 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:27:21.825 02:29:49 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:27:21.825 02:29:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:21.825 02:29:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:21.825 02:29:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:21.825 02:29:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:21.825 02:29:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:21.825 02:29:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:21.825 02:29:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:21.825 02:29:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:21.825 02:29:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:21.825 02:29:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:21.825 02:29:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:21.825 02:29:49 -- common/autotest_common.sh@10 -- # set +x 00:27:24.359 02:29:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:24.359 02:29:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:24.359 02:29:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:24.359 02:29:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:24.359 02:29:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:24.359 02:29:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:24.359 02:29:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:24.359 02:29:51 -- nvmf/common.sh@294 -- # net_devs=() 00:27:24.359 02:29:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:24.359 02:29:51 -- nvmf/common.sh@295 -- # e810=() 00:27:24.359 02:29:51 -- nvmf/common.sh@295 -- # local -ga e810 00:27:24.359 02:29:51 -- nvmf/common.sh@296 -- # x722=() 00:27:24.359 02:29:51 -- nvmf/common.sh@296 -- # local -ga x722 00:27:24.359 02:29:51 -- nvmf/common.sh@297 -- # mlx=() 00:27:24.359 02:29:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:24.359 02:29:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:24.359 02:29:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:24.359 02:29:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:24.359 02:29:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:24.359 02:29:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:24.359 02:29:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:24.359 02:29:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:24.359 02:29:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:24.359 02:29:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:24.359 02:29:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:24.359 02:29:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:24.359 02:29:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:24.359 02:29:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:24.359 02:29:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:24.359 02:29:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:24.359 02:29:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:24.359 02:29:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:24.359 02:29:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:24.359 02:29:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:24.359 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:24.359 02:29:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:24.359 02:29:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:24.359 02:29:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:24.359 02:29:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:24.359 02:29:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:24.359 02:29:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:24.359 02:29:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:24.359 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:24.359 02:29:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:24.359 02:29:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:24.359 02:29:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:24.359 02:29:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:24.359 02:29:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:24.359 02:29:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:24.359 02:29:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:24.359 02:29:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:24.359 02:29:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:24.359 02:29:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:24.359 02:29:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:24.359 02:29:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:24.359 02:29:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:24.359 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:24.359 02:29:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:24.359 02:29:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:24.359 02:29:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:24.359 02:29:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:24.359 02:29:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:24.359 02:29:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:24.359 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:24.359 02:29:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:24.359 02:29:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:24.359 02:29:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:24.359 02:29:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:24.359 02:29:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:24.359 02:29:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:24.359 02:29:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:24.359 02:29:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:24.359 02:29:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:24.359 02:29:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:24.359 02:29:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:24.359 02:29:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:24.359 02:29:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:24.359 02:29:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:24.359 02:29:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:24.359 02:29:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:24.359 02:29:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:24.359 02:29:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:24.359 02:29:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:24.359 02:29:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:24.359 02:29:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:24.359 02:29:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:24.359 02:29:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:24.359 02:29:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:24.359 02:29:51 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:24.359 02:29:51 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:24.359 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:24.359 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.294 ms 00:27:24.359 00:27:24.359 --- 10.0.0.2 ping statistics --- 00:27:24.359 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:24.359 rtt min/avg/max/mdev = 0.294/0.294/0.294/0.000 ms 00:27:24.359 02:29:51 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:24.359 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:24.359 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.220 ms 00:27:24.359 00:27:24.359 --- 10.0.0.1 ping statistics --- 00:27:24.359 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:24.359 rtt min/avg/max/mdev = 0.220/0.220/0.220/0.000 ms 00:27:24.359 02:29:51 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:24.359 02:29:51 -- nvmf/common.sh@410 -- # return 0 00:27:24.359 02:29:51 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:24.359 02:29:51 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:24.359 02:29:51 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:24.359 02:29:51 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:24.359 02:29:51 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:24.359 02:29:51 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:24.359 02:29:51 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:24.359 02:29:51 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:27:24.359 02:29:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:24.359 02:29:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:24.359 02:29:51 -- common/autotest_common.sh@10 -- # set +x 00:27:24.359 ************************************ 00:27:24.359 START TEST nvmf_target_disconnect_tc1 00:27:24.359 ************************************ 00:27:24.359 02:29:51 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc1 00:27:24.359 02:29:51 -- host/target_disconnect.sh@32 -- # set +e 00:27:24.360 02:29:51 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:24.360 EAL: No free 2048 kB hugepages reported on node 1 00:27:24.360 [2024-12-08 02:29:51.775852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.360 [2024-12-08 02:29:51.776048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.360 [2024-12-08 02:29:51.776077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1479b40 with addr=10.0.0.2, port=4420 00:27:24.360 [2024-12-08 02:29:51.776106] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:27:24.360 [2024-12-08 02:29:51.776139] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:27:24.360 [2024-12-08 02:29:51.776152] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:27:24.360 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:27:24.360 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:27:24.360 Initializing NVMe Controllers 00:27:24.360 02:29:51 -- host/target_disconnect.sh@33 -- # trap - ERR 00:27:24.360 02:29:51 -- host/target_disconnect.sh@33 -- # print_backtrace 00:27:24.360 02:29:51 -- common/autotest_common.sh@1142 -- # [[ hxBET =~ e ]] 00:27:24.360 02:29:51 -- common/autotest_common.sh@1142 -- # return 0 00:27:24.360 02:29:51 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:27:24.360 02:29:51 -- host/target_disconnect.sh@41 -- # set -e 00:27:24.360 00:27:24.360 real 0m0.088s 00:27:24.360 user 0m0.037s 00:27:24.360 sys 0m0.051s 00:27:24.360 02:29:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:24.360 02:29:51 -- common/autotest_common.sh@10 -- # set +x 00:27:24.360 ************************************ 00:27:24.360 END TEST nvmf_target_disconnect_tc1 00:27:24.360 ************************************ 00:27:24.360 02:29:51 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:27:24.360 02:29:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:24.360 02:29:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:24.360 02:29:51 -- common/autotest_common.sh@10 -- # set +x 00:27:24.360 ************************************ 00:27:24.360 START TEST nvmf_target_disconnect_tc2 00:27:24.360 ************************************ 00:27:24.360 02:29:51 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc2 00:27:24.360 02:29:51 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:27:24.360 02:29:51 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:24.360 02:29:51 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:24.360 02:29:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:24.360 02:29:51 -- common/autotest_common.sh@10 -- # set +x 00:27:24.360 02:29:51 -- nvmf/common.sh@469 -- # nvmfpid=2230311 00:27:24.360 02:29:51 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:24.360 02:29:51 -- nvmf/common.sh@470 -- # waitforlisten 2230311 00:27:24.360 02:29:51 -- common/autotest_common.sh@829 -- # '[' -z 2230311 ']' 00:27:24.360 02:29:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:24.360 02:29:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:24.360 02:29:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:24.360 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:24.360 02:29:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:24.360 02:29:51 -- common/autotest_common.sh@10 -- # set +x 00:27:24.360 [2024-12-08 02:29:51.856169] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:24.360 [2024-12-08 02:29:51.856244] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:24.360 EAL: No free 2048 kB hugepages reported on node 1 00:27:24.360 [2024-12-08 02:29:51.933790] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:24.360 [2024-12-08 02:29:52.064921] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:24.360 [2024-12-08 02:29:52.065107] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:24.360 [2024-12-08 02:29:52.065137] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:24.360 [2024-12-08 02:29:52.065160] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:24.360 [2024-12-08 02:29:52.065257] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:24.360 [2024-12-08 02:29:52.065325] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:24.360 [2024-12-08 02:29:52.065455] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:24.360 [2024-12-08 02:29:52.065467] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:24.621 02:29:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:24.621 02:29:52 -- common/autotest_common.sh@862 -- # return 0 00:27:24.621 02:29:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:24.621 02:29:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:24.621 02:29:52 -- common/autotest_common.sh@10 -- # set +x 00:27:24.621 02:29:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:24.621 02:29:52 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:24.621 02:29:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:24.621 02:29:52 -- common/autotest_common.sh@10 -- # set +x 00:27:24.621 Malloc0 00:27:24.621 02:29:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:24.621 02:29:52 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:24.621 02:29:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:24.621 02:29:52 -- common/autotest_common.sh@10 -- # set +x 00:27:24.621 [2024-12-08 02:29:52.261956] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:24.621 02:29:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:24.621 02:29:52 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:24.621 02:29:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:24.621 02:29:52 -- common/autotest_common.sh@10 -- # set +x 00:27:24.621 02:29:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:24.621 02:29:52 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:24.621 02:29:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:24.621 02:29:52 -- common/autotest_common.sh@10 -- # set +x 00:27:24.621 02:29:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:24.621 02:29:52 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:24.621 02:29:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:24.621 02:29:52 -- common/autotest_common.sh@10 -- # set +x 00:27:24.621 [2024-12-08 02:29:52.290210] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:24.621 02:29:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:24.621 02:29:52 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:24.621 02:29:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:24.621 02:29:52 -- common/autotest_common.sh@10 -- # set +x 00:27:24.621 02:29:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:24.621 02:29:52 -- host/target_disconnect.sh@50 -- # reconnectpid=2230335 00:27:24.621 02:29:52 -- host/target_disconnect.sh@52 -- # sleep 2 00:27:24.621 02:29:52 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:24.621 EAL: No free 2048 kB hugepages reported on node 1 00:27:26.527 02:29:54 -- host/target_disconnect.sh@53 -- # kill -9 2230311 00:27:26.527 02:29:54 -- host/target_disconnect.sh@55 -- # sleep 2 00:27:26.806 Read completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Read completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Read completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Read completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Read completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Write completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Write completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Read completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Write completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Read completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Write completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Write completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Read completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Read completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Write completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Read completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Read completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Read completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Write completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Write completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Read completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Write completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Read completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Write completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Write completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Read completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Read completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Read completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Read completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Read completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Read completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Read completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Read completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Read completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Read completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Read completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 [2024-12-08 02:29:54.315362] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:26.806 Read completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Read completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Read completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Read completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Read completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Read completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Read completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Read completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Read completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Write completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Write completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Write completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Write completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Write completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Write completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Write completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Write completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Read completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Write completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Write completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Write completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Write completed with error (sct=0, sc=8) 00:27:26.806 starting I/O failed 00:27:26.806 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Read completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 [2024-12-08 02:29:54.315689] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:26.807 Read completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Read completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Read completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Read completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Read completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Read completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Read completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Read completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Read completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Read completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Read completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Read completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Read completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Read completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Read completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Read completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Read completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 [2024-12-08 02:29:54.315991] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:26.807 Read completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Read completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Read completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Read completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Read completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Read completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Read completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Read completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Read completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Read completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Read completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Read completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Read completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Read completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Read completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 Write completed with error (sct=0, sc=8) 00:27:26.807 starting I/O failed 00:27:26.807 [2024-12-08 02:29:54.316267] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:26.807 [2024-12-08 02:29:54.316413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-12-08 02:29:54.316571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-12-08 02:29:54.316609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.807 qpair failed and we were unable to recover it. 00:27:26.807 [2024-12-08 02:29:54.316715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-12-08 02:29:54.316912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-12-08 02:29:54.316939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.807 qpair failed and we were unable to recover it. 00:27:26.807 [2024-12-08 02:29:54.317116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-12-08 02:29:54.317238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-12-08 02:29:54.317264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.807 qpair failed and we were unable to recover it. 00:27:26.807 [2024-12-08 02:29:54.317398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-12-08 02:29:54.317487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-12-08 02:29:54.317529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.807 qpair failed and we were unable to recover it. 00:27:26.807 [2024-12-08 02:29:54.317639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-12-08 02:29:54.317723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-12-08 02:29:54.317750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.807 qpair failed and we were unable to recover it. 00:27:26.807 [2024-12-08 02:29:54.317849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-12-08 02:29:54.318017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-12-08 02:29:54.318059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.807 qpair failed and we were unable to recover it. 00:27:26.807 [2024-12-08 02:29:54.318195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-12-08 02:29:54.318325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-12-08 02:29:54.318353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.807 qpair failed and we were unable to recover it. 00:27:26.807 [2024-12-08 02:29:54.318454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-12-08 02:29:54.318578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-12-08 02:29:54.318621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.807 qpair failed and we were unable to recover it. 00:27:26.807 [2024-12-08 02:29:54.318729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-12-08 02:29:54.318822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-12-08 02:29:54.318864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.807 qpair failed and we were unable to recover it. 00:27:26.807 [2024-12-08 02:29:54.318972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-12-08 02:29:54.319107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-12-08 02:29:54.319136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.807 qpair failed and we were unable to recover it. 00:27:26.807 [2024-12-08 02:29:54.319267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.807 [2024-12-08 02:29:54.319359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.319388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-12-08 02:29:54.319519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.319620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.319647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-12-08 02:29:54.319745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.319865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.319891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-12-08 02:29:54.320001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.320185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.320211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-12-08 02:29:54.320333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.320446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.320490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-12-08 02:29:54.320646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.320741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.320767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-12-08 02:29:54.320862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.320946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.320972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-12-08 02:29:54.321054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.321248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.321277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-12-08 02:29:54.321418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.321550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.321578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-12-08 02:29:54.321666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.321762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.321789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-12-08 02:29:54.321930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.322023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.322048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-12-08 02:29:54.322200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.322407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.322451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-12-08 02:29:54.322585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.322672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.322706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-12-08 02:29:54.322795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.322899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.322925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-12-08 02:29:54.323025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.323123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.323152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-12-08 02:29:54.323338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.323440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.323466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-12-08 02:29:54.323577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.323665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.323690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-12-08 02:29:54.323781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.323858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.323883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-12-08 02:29:54.323996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.324132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.324157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-12-08 02:29:54.324286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.324408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.324436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-12-08 02:29:54.324530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.324644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.324670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-12-08 02:29:54.324761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.324849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.324875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-12-08 02:29:54.325026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.325141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.325168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-12-08 02:29:54.325313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.325410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.325444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-12-08 02:29:54.325582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.325678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.325703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-12-08 02:29:54.325790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.325906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.325934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-12-08 02:29:54.326025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.326164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.326193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-12-08 02:29:54.326317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.326459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.326485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.808 qpair failed and we were unable to recover it. 00:27:26.808 [2024-12-08 02:29:54.326582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.808 [2024-12-08 02:29:54.326713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.326739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-12-08 02:29:54.326858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.327008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.327034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-12-08 02:29:54.327153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.327345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.327389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-12-08 02:29:54.327521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.327635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.327661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-12-08 02:29:54.327748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.327827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.327868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-12-08 02:29:54.327969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.328114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.328144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-12-08 02:29:54.328285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.328391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.328417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-12-08 02:29:54.328544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.328669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.328695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-12-08 02:29:54.328786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.328866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.328892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-12-08 02:29:54.328976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.329089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.329115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-12-08 02:29:54.329249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.329387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.329414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-12-08 02:29:54.329571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.329767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.329793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-12-08 02:29:54.329994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.330101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.330127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-12-08 02:29:54.330271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.330409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.330438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-12-08 02:29:54.330591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.330676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.330703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-12-08 02:29:54.330785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.330905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.330936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-12-08 02:29:54.331054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.331188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.331231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-12-08 02:29:54.331321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.331512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.331549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-12-08 02:29:54.331629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.331716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.331742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-12-08 02:29:54.331823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.331947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.331973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-12-08 02:29:54.332085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.332180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.332209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-12-08 02:29:54.332424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.332565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.332592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-12-08 02:29:54.332673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.332759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.332786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-12-08 02:29:54.333002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.333128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.333171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-12-08 02:29:54.333336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.333453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.333478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-12-08 02:29:54.333592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.333681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.333712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-12-08 02:29:54.333858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.333943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.333969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-12-08 02:29:54.334089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.334207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.334233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.809 [2024-12-08 02:29:54.334347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.334488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.809 [2024-12-08 02:29:54.334515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.809 qpair failed and we were unable to recover it. 00:27:26.810 [2024-12-08 02:29:54.334663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.335721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.335748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-12-08 02:29:54.335872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.335984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.336010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-12-08 02:29:54.336151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.336294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.336320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-12-08 02:29:54.336430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.336572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.336598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-12-08 02:29:54.336710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.336823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.336849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-12-08 02:29:54.336964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.337108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.337134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-12-08 02:29:54.337224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.337443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.337469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-12-08 02:29:54.337619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.337742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.337768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-12-08 02:29:54.337854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.337968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.337994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-12-08 02:29:54.338110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.338304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.338330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-12-08 02:29:54.338444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.338567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.338593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-12-08 02:29:54.338684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.338827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.338853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-12-08 02:29:54.338972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.339092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.339117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-12-08 02:29:54.339229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.339319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.339346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-12-08 02:29:54.339495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.339596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.339623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-12-08 02:29:54.339818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.339960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.339986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-12-08 02:29:54.340131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.340270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.340296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-12-08 02:29:54.340445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.340563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.340590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-12-08 02:29:54.340673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.340761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.340787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-12-08 02:29:54.340907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.341024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.341051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-12-08 02:29:54.341135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.341220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.341245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-12-08 02:29:54.341366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.341479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.341504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-12-08 02:29:54.341677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.341817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.341842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-12-08 02:29:54.341955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.342073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.342100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-12-08 02:29:54.342183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.342295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.342321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-12-08 02:29:54.342440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.342527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.342560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-12-08 02:29:54.342756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.342899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.342941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-12-08 02:29:54.343048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.343185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.343212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.810 qpair failed and we were unable to recover it. 00:27:26.810 [2024-12-08 02:29:54.343288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.810 [2024-12-08 02:29:54.343407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.343433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-12-08 02:29:54.343550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.343644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.343671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-12-08 02:29:54.343788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.343874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.343901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-12-08 02:29:54.344095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.344253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.344282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-12-08 02:29:54.344397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.344482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.344508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-12-08 02:29:54.344631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.344744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.344770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-12-08 02:29:54.344897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.344981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.345007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-12-08 02:29:54.345124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.345237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.345263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-12-08 02:29:54.345378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.345508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.345545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-12-08 02:29:54.345664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.345786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.345812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-12-08 02:29:54.345931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.346049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.346093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-12-08 02:29:54.346262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.346381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.346406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-12-08 02:29:54.346490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.346609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.346637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-12-08 02:29:54.346727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.346835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.346860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-12-08 02:29:54.347000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.347081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.347107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-12-08 02:29:54.347193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.347274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.347300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-12-08 02:29:54.347386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.347578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.347605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-12-08 02:29:54.347722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.347836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.347862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-12-08 02:29:54.347974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.348059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.348085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-12-08 02:29:54.348180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.348320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.348350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-12-08 02:29:54.348527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.348649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.348675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-12-08 02:29:54.348790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.348874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.348900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-12-08 02:29:54.348983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.349066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.349091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-12-08 02:29:54.349238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.349318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.349344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.811 qpair failed and we were unable to recover it. 00:27:26.811 [2024-12-08 02:29:54.349565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.349698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.811 [2024-12-08 02:29:54.349728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-12-08 02:29:54.349891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.350004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.350030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-12-08 02:29:54.350145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.350285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.350311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-12-08 02:29:54.350429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.350548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.350576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-12-08 02:29:54.350661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.350809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.350835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-12-08 02:29:54.350983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.351080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.351109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-12-08 02:29:54.351250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.351396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.351422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-12-08 02:29:54.351596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.351707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.351733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-12-08 02:29:54.351847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.351921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.351947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-12-08 02:29:54.352059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.352173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.352199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-12-08 02:29:54.352279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.352360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.352385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-12-08 02:29:54.352463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.352582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.352608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-12-08 02:29:54.352695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.352837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.352864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-12-08 02:29:54.352974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.353090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.353120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-12-08 02:29:54.353242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.353438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.353464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-12-08 02:29:54.353585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.353703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.353729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-12-08 02:29:54.353841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.353930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.353957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-12-08 02:29:54.354051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.354172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.354199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-12-08 02:29:54.354321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.354436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.354461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-12-08 02:29:54.354578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.354710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.354752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-12-08 02:29:54.354836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.354919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.354946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-12-08 02:29:54.355129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.355247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.355273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-12-08 02:29:54.355415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.355513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.355584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-12-08 02:29:54.355726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.355836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.355862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-12-08 02:29:54.355977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.356091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.356117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-12-08 02:29:54.356280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.356418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.356446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-12-08 02:29:54.356566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.356697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.356726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-12-08 02:29:54.356830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.356944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.356970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-12-08 02:29:54.357085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.357169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.357195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.812 qpair failed and we were unable to recover it. 00:27:26.812 [2024-12-08 02:29:54.357304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-12-08 02:29:54.357420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.357446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-12-08 02:29:54.357525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.357647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.357672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-12-08 02:29:54.357762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.357877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.357904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-12-08 02:29:54.358011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.358100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.358129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-12-08 02:29:54.358298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.358416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.358442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-12-08 02:29:54.358562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.358642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.358667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-12-08 02:29:54.358775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.358873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.358900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-12-08 02:29:54.358983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.359100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.359125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-12-08 02:29:54.359262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.359417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.359459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-12-08 02:29:54.359573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.359702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.359731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-12-08 02:29:54.359839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.359956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.359982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-12-08 02:29:54.360177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.360321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.360362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-12-08 02:29:54.360456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.360590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.360617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-12-08 02:29:54.360701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.360839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.360865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-12-08 02:29:54.360945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.361094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.361137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-12-08 02:29:54.361252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.361345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.361373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-12-08 02:29:54.361490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.361715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.361742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-12-08 02:29:54.361883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.361992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.362017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-12-08 02:29:54.362106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.362259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.362286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-12-08 02:29:54.362425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.362618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.362659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-12-08 02:29:54.362829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.362945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.362971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-12-08 02:29:54.363061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.363173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.363199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-12-08 02:29:54.363316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.363400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.363426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-12-08 02:29:54.363574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.363690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.363717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-12-08 02:29:54.363804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.363921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.363947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-12-08 02:29:54.364030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.364140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.364165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-12-08 02:29:54.364283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.364402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.364428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-12-08 02:29:54.364545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.364630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.364655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.813 [2024-12-08 02:29:54.364776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.364860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-12-08 02:29:54.364885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.813 qpair failed and we were unable to recover it. 00:27:26.814 [2024-12-08 02:29:54.364997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.365071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.365096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-12-08 02:29:54.365201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.365316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.365341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-12-08 02:29:54.365448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.365557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.365583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-12-08 02:29:54.365704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.365818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.365844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-12-08 02:29:54.365960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.366047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.366072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-12-08 02:29:54.366185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.366292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.366317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-12-08 02:29:54.366428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.366575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.366602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-12-08 02:29:54.366748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.366868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.366895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-12-08 02:29:54.367089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.367202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.367227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-12-08 02:29:54.367394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.367551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.367594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-12-08 02:29:54.367683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.367758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.367784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-12-08 02:29:54.367900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.368092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.368118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-12-08 02:29:54.368239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.368377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.368407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-12-08 02:29:54.368503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.368609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.368639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-12-08 02:29:54.368800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.368913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.368939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-12-08 02:29:54.369079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.369269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.369295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-12-08 02:29:54.369438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.369549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.369576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-12-08 02:29:54.369722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.369864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.369894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-12-08 02:29:54.370009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.370169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.370195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-12-08 02:29:54.370292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.370404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.370430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-12-08 02:29:54.370548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.370670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.370695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-12-08 02:29:54.370778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.370889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.370915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-12-08 02:29:54.371024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.371169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.371195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-12-08 02:29:54.371351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.371438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.371464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-12-08 02:29:54.371638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.371781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.371808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-12-08 02:29:54.371920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.372006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.372031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-12-08 02:29:54.372171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.372258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.372284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-12-08 02:29:54.372374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.372485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.372533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.814 qpair failed and we were unable to recover it. 00:27:26.814 [2024-12-08 02:29:54.372667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-12-08 02:29:54.372792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.372821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-12-08 02:29:54.372954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.373065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.373090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-12-08 02:29:54.373217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.373378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.373404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-12-08 02:29:54.373514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.373626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.373652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-12-08 02:29:54.373738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.373831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.373857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-12-08 02:29:54.373969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.374055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.374082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-12-08 02:29:54.374197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.374342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.374368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-12-08 02:29:54.374512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.374636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.374662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-12-08 02:29:54.374773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.374947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.374989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-12-08 02:29:54.375142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.375279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.375310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-12-08 02:29:54.375450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.375529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.375564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-12-08 02:29:54.375652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.375740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.375766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-12-08 02:29:54.375880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.375996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.376023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-12-08 02:29:54.376119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.376230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.376256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-12-08 02:29:54.376380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.376460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.376485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-12-08 02:29:54.376600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.376745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.376771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-12-08 02:29:54.376862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.376966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.376992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-12-08 02:29:54.377100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.377240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.377265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-12-08 02:29:54.377378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.377491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.377535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-12-08 02:29:54.377668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.377763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.377793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-12-08 02:29:54.377903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.378023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.378066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-12-08 02:29:54.378196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.378326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.378351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-12-08 02:29:54.378435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.378511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.378544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-12-08 02:29:54.378661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.378811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.378836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-12-08 02:29:54.378943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.379025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.815 [2024-12-08 02:29:54.379050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.815 qpair failed and we were unable to recover it. 00:27:26.815 [2024-12-08 02:29:54.379136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.379260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.379285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-12-08 02:29:54.379429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.379518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.379550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-12-08 02:29:54.379678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.379763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.379790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-12-08 02:29:54.379938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.380083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.380108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-12-08 02:29:54.380225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.380310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.380335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-12-08 02:29:54.380450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.380564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.380609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-12-08 02:29:54.380750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.380870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.380896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-12-08 02:29:54.380991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.381179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.381204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-12-08 02:29:54.381345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.381422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.381447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-12-08 02:29:54.381553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.381645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.381670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-12-08 02:29:54.381757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.381864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.381890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-12-08 02:29:54.382027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.382116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.382143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-12-08 02:29:54.382260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.382368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.382393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-12-08 02:29:54.382471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.382575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.382621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-12-08 02:29:54.382735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.382859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.382884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-12-08 02:29:54.383004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.383143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.383168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-12-08 02:29:54.383292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.383452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.383477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-12-08 02:29:54.383559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.383666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.383709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-12-08 02:29:54.383826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.383943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.383968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-12-08 02:29:54.384079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.384196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.384221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-12-08 02:29:54.384300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.384405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.384430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-12-08 02:29:54.384548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.384641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.384666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-12-08 02:29:54.384749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.384864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.384890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-12-08 02:29:54.384975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.385102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.385130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-12-08 02:29:54.385244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.385349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.385374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-12-08 02:29:54.385468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.385577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.385604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-12-08 02:29:54.385695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.385771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.385797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-12-08 02:29:54.385926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.386037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.816 [2024-12-08 02:29:54.386063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.816 qpair failed and we were unable to recover it. 00:27:26.816 [2024-12-08 02:29:54.386203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.386318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.386343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-12-08 02:29:54.386430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.386567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.386593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-12-08 02:29:54.386710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.386816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.386841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-12-08 02:29:54.386946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.387097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.387125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-12-08 02:29:54.387244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.387381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.387406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-12-08 02:29:54.387519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.387603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.387628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-12-08 02:29:54.387720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.387836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.387861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-12-08 02:29:54.387996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.388113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.388141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-12-08 02:29:54.388305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.388420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.388445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-12-08 02:29:54.388592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.388712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.388737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-12-08 02:29:54.388869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.388992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.389019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-12-08 02:29:54.389153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.389243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.389268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-12-08 02:29:54.389358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.389442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.389467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-12-08 02:29:54.389572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.389688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.389713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-12-08 02:29:54.389819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.389935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.389960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-12-08 02:29:54.390102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.390183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.390208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-12-08 02:29:54.390295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.390430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.390472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-12-08 02:29:54.390621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.390735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.390760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-12-08 02:29:54.390852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.390968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.390993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-12-08 02:29:54.391083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.391217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.391257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-12-08 02:29:54.391396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.391480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.391506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-12-08 02:29:54.391640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.391745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.391770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-12-08 02:29:54.391887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.392000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.392025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-12-08 02:29:54.392105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.392214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.392239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-12-08 02:29:54.392322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.392440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.392466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-12-08 02:29:54.392552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.392657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.392683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-12-08 02:29:54.392772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.392853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.392878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-12-08 02:29:54.392957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.393066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.393091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.817 [2024-12-08 02:29:54.393204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.393325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.817 [2024-12-08 02:29:54.393351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.817 qpair failed and we were unable to recover it. 00:27:26.818 [2024-12-08 02:29:54.393435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.393562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.393588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-12-08 02:29:54.393738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.393879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.393904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-12-08 02:29:54.394018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.394157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.394182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-12-08 02:29:54.394277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.394359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.394384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-12-08 02:29:54.394491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.394607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.394633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-12-08 02:29:54.394746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.394854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.394879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-12-08 02:29:54.394995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.395076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.395101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-12-08 02:29:54.395213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.395322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.395348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-12-08 02:29:54.395476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.395618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.395644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-12-08 02:29:54.395763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.395845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.395871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-12-08 02:29:54.395988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.396075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.396118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-12-08 02:29:54.396259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.396400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.396425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-12-08 02:29:54.396514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.396628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.396654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-12-08 02:29:54.396773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.396852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.396877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-12-08 02:29:54.397054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.397194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.397219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-12-08 02:29:54.397307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.397390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.397415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-12-08 02:29:54.397558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.397643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.397686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-12-08 02:29:54.397783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.397871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.397899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-12-08 02:29:54.398042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.398150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.398175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-12-08 02:29:54.398263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.398345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.398371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-12-08 02:29:54.398548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.398662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.398687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-12-08 02:29:54.398794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.398900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.398925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-12-08 02:29:54.399100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.399214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.399239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-12-08 02:29:54.399356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.399522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.399560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-12-08 02:29:54.399703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.399843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.399869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-12-08 02:29:54.399999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.400109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.400135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-12-08 02:29:54.400248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.400363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.400404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-12-08 02:29:54.400514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.400629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.400655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.818 qpair failed and we were unable to recover it. 00:27:26.818 [2024-12-08 02:29:54.400816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.818 [2024-12-08 02:29:54.400908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.400936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-12-08 02:29:54.401021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.401145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.401173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-12-08 02:29:54.401313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.401425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.401450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-12-08 02:29:54.401566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.401678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.401720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-12-08 02:29:54.401864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.401941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.401966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-12-08 02:29:54.402051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.402163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.402188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-12-08 02:29:54.402315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.402444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.402472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-12-08 02:29:54.402611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.402699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.402724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-12-08 02:29:54.402838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.402978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.403003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-12-08 02:29:54.403110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.403228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.403255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-12-08 02:29:54.403383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.403509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.403543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-12-08 02:29:54.403680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.403759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.403785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-12-08 02:29:54.403917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.404068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.404096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-12-08 02:29:54.404223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.404312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.404339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-12-08 02:29:54.404476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.404592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.404619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-12-08 02:29:54.404756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.404884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.404914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-12-08 02:29:54.405037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.405201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.405226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-12-08 02:29:54.405315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.405394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.405419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-12-08 02:29:54.405506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.405679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.405708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-12-08 02:29:54.405856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.405981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.406008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-12-08 02:29:54.406114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.406228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.406253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-12-08 02:29:54.406367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.406488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.406513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-12-08 02:29:54.406601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.406680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.406705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-12-08 02:29:54.406851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.406968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.406993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-12-08 02:29:54.407109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.407215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.407241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-12-08 02:29:54.407330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.407443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.407468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-12-08 02:29:54.407577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.407661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.407687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-12-08 02:29:54.407826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.407977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.408004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-12-08 02:29:54.408095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.408184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.819 [2024-12-08 02:29:54.408213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.819 qpair failed and we were unable to recover it. 00:27:26.819 [2024-12-08 02:29:54.408323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.408463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.408488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-12-08 02:29:54.408565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.408656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.408681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-12-08 02:29:54.408802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.408913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.408956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-12-08 02:29:54.409097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.409212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.409237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-12-08 02:29:54.409330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.409436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.409461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-12-08 02:29:54.409555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.409730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.409755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-12-08 02:29:54.409880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.409997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.410023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-12-08 02:29:54.410184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.410265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.410292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-12-08 02:29:54.410417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.410548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.410577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-12-08 02:29:54.410720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.410835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.410859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-12-08 02:29:54.410969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.411084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.411112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-12-08 02:29:54.411252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.411368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.411397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-12-08 02:29:54.411477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.411560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.411586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-12-08 02:29:54.411683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.411773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.411798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-12-08 02:29:54.411879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.411989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.412014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-12-08 02:29:54.412131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.412241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.412266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-12-08 02:29:54.412381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.412470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.412495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-12-08 02:29:54.412579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.412695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.412720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-12-08 02:29:54.412799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.412911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.412936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-12-08 02:29:54.413031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.413162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.413189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-12-08 02:29:54.413288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.413411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.413439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-12-08 02:29:54.413571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.413715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.413747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-12-08 02:29:54.413888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.414025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.414051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-12-08 02:29:54.414196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.414357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.414385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-12-08 02:29:54.414470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.414627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.820 [2024-12-08 02:29:54.414654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.820 qpair failed and we were unable to recover it. 00:27:26.820 [2024-12-08 02:29:54.414763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.414849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.414875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-12-08 02:29:54.415034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.415132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.415160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-12-08 02:29:54.415289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.415422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.415447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-12-08 02:29:54.415543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.415662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.415702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-12-08 02:29:54.415846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.415987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.416011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-12-08 02:29:54.416179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.416271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.416298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-12-08 02:29:54.416426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.416564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.416599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-12-08 02:29:54.416693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.416786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.416816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-12-08 02:29:54.416957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.417071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.417096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-12-08 02:29:54.417179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.417298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.417340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-12-08 02:29:54.417451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.417589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.417618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-12-08 02:29:54.417712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.417834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.417862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-12-08 02:29:54.418019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.418156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.418181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-12-08 02:29:54.418294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.418378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.418405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-12-08 02:29:54.418519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.418689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.418718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-12-08 02:29:54.418825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.418919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.418947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-12-08 02:29:54.419056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.419165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.419190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-12-08 02:29:54.419335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.419416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.419441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-12-08 02:29:54.419525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.419648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.419673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-12-08 02:29:54.419785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.419859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.419884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-12-08 02:29:54.420042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.420154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.420179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-12-08 02:29:54.420295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.420451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.420479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-12-08 02:29:54.420601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.420683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.420708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-12-08 02:29:54.420820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.420958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.420987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-12-08 02:29:54.421104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.421185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.421211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-12-08 02:29:54.421321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.421433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.421458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-12-08 02:29:54.421551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.421664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.421690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-12-08 02:29:54.421780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.421918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.421947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.821 qpair failed and we were unable to recover it. 00:27:26.821 [2024-12-08 02:29:54.422107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.422226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.821 [2024-12-08 02:29:54.422251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-12-08 02:29:54.422333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.422445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.422470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-12-08 02:29:54.422647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.422729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.422754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-12-08 02:29:54.422871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.423035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.423075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-12-08 02:29:54.423220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.423313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.423339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-12-08 02:29:54.423427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.423519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.423550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-12-08 02:29:54.423701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.423820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.423845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-12-08 02:29:54.423925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.424005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.424031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-12-08 02:29:54.424106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.424221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.424246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-12-08 02:29:54.424345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.424432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.424458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-12-08 02:29:54.424568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.424734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.424762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-12-08 02:29:54.424889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.425031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.425056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-12-08 02:29:54.425142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.425227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.425251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-12-08 02:29:54.425350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.425489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.425533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-12-08 02:29:54.425671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.425824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.425853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-12-08 02:29:54.425981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.426104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.426133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-12-08 02:29:54.426269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.426408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.426434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-12-08 02:29:54.426548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.426701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.426730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-12-08 02:29:54.426813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.426971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.426999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-12-08 02:29:54.427129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.427251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.427278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-12-08 02:29:54.427440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.427554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.427581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-12-08 02:29:54.427674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.427821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.427847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-12-08 02:29:54.427937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.428081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.428107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-12-08 02:29:54.428248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.428413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.428439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-12-08 02:29:54.428534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.428651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.428676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-12-08 02:29:54.428771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.428927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.428955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-12-08 02:29:54.429061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.429182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.429210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-12-08 02:29:54.429333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.429431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.429460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-12-08 02:29:54.429595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.429680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.429705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.822 qpair failed and we were unable to recover it. 00:27:26.822 [2024-12-08 02:29:54.429825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.822 [2024-12-08 02:29:54.429959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.429986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-12-08 02:29:54.430125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.430216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.430241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-12-08 02:29:54.430322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.430487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.430515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-12-08 02:29:54.430663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.430751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.430777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-12-08 02:29:54.430897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.431024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.431052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-12-08 02:29:54.431175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.431297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.431322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-12-08 02:29:54.431441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.431520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.431556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-12-08 02:29:54.431673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.431781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.431806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-12-08 02:29:54.431943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.432113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.432138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-12-08 02:29:54.432278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.432404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.432432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-12-08 02:29:54.432590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.432716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.432759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-12-08 02:29:54.432872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.433008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.433033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-12-08 02:29:54.433134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.433259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.433287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-12-08 02:29:54.433388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.433505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.433534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-12-08 02:29:54.433704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.433798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.433823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-12-08 02:29:54.433942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.434056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.434082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-12-08 02:29:54.434191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.434329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.434354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-12-08 02:29:54.434430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.434510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.434542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-12-08 02:29:54.434662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.434815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.434856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-12-08 02:29:54.434971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.435062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.435087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-12-08 02:29:54.435210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.435354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.435382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-12-08 02:29:54.435542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.435683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.435708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-12-08 02:29:54.435831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.435918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.435943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-12-08 02:29:54.436060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.436176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.436201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-12-08 02:29:54.436285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.436434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.436459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-12-08 02:29:54.436585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.436749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.436777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-12-08 02:29:54.436873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.436956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.436984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-12-08 02:29:54.437122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.437229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.437254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.823 [2024-12-08 02:29:54.437433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.437560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.823 [2024-12-08 02:29:54.437586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.823 qpair failed and we were unable to recover it. 00:27:26.824 [2024-12-08 02:29:54.437744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.437869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.437894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-12-08 02:29:54.437979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.438058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.438083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-12-08 02:29:54.438198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.438313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.438339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-12-08 02:29:54.438474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.438608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.438635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-12-08 02:29:54.438750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.438842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.438883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-12-08 02:29:54.439020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.439135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.439160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-12-08 02:29:54.439270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.439362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.439387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-12-08 02:29:54.439502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.439621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.439664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-12-08 02:29:54.439785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.439880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.439908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-12-08 02:29:54.440050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.440136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.440162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-12-08 02:29:54.440306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.440417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.440442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-12-08 02:29:54.440561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.440680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.440706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-12-08 02:29:54.440790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.440931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.440956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-12-08 02:29:54.441050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.441189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.441214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-12-08 02:29:54.441356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.441468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.441493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-12-08 02:29:54.441605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.441696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.441725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-12-08 02:29:54.441877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.442058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.442118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-12-08 02:29:54.442273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.442424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.442453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-12-08 02:29:54.442623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.442759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.442800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-12-08 02:29:54.442894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.442991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.443018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-12-08 02:29:54.443121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.443224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.443249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-12-08 02:29:54.443388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.443497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.443525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-12-08 02:29:54.443686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.443803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.443828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-12-08 02:29:54.443903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.444017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.444042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-12-08 02:29:54.444177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.444343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.824 [2024-12-08 02:29:54.444369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.824 qpair failed and we were unable to recover it. 00:27:26.824 [2024-12-08 02:29:54.444478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.444594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.444620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-12-08 02:29:54.444731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.444818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.444844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-12-08 02:29:54.444977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.445075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.445103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-12-08 02:29:54.445217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.445355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.445380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-12-08 02:29:54.445466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.445577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.445620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-12-08 02:29:54.445740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.445820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.445845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-12-08 02:29:54.445951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.446068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.446094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-12-08 02:29:54.446271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.446387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.446412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-12-08 02:29:54.446528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.446649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.446674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-12-08 02:29:54.446815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.446953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.446978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-12-08 02:29:54.447112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.447231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.447259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-12-08 02:29:54.447397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.447491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.447519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-12-08 02:29:54.447650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.447775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.447803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-12-08 02:29:54.447965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.448079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.448104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-12-08 02:29:54.448190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.448329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.448354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-12-08 02:29:54.448478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.448577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.448606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-12-08 02:29:54.448697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.448796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.448824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-12-08 02:29:54.448938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.449047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.449073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-12-08 02:29:54.449182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.449298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.449342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-12-08 02:29:54.449479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.449567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.449592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-12-08 02:29:54.449700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.449814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.449855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-12-08 02:29:54.449970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.450045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.450070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-12-08 02:29:54.450147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.450242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.450267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-12-08 02:29:54.450410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.450524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.450556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-12-08 02:29:54.450663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.450790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.450819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-12-08 02:29:54.450951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.451032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.451058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-12-08 02:29:54.451186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.451316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.451349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-12-08 02:29:54.451478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.451574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.451603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.825 qpair failed and we were unable to recover it. 00:27:26.825 [2024-12-08 02:29:54.451696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.451818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.825 [2024-12-08 02:29:54.451845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-12-08 02:29:54.451981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.452097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.452122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-12-08 02:29:54.452257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.452357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.452386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-12-08 02:29:54.452545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.452643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.452671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-12-08 02:29:54.452789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.452894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.452921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-12-08 02:29:54.453085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.453195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.453220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-12-08 02:29:54.453350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.453473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.453501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-12-08 02:29:54.453634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.453745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.453771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-12-08 02:29:54.453892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.454009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.454041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-12-08 02:29:54.454182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.454263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.454288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-12-08 02:29:54.454422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.454551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.454579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-12-08 02:29:54.454708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.454871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.454899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-12-08 02:29:54.455022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.455188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.455214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-12-08 02:29:54.455306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.455419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.455445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-12-08 02:29:54.455561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.455678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.455703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-12-08 02:29:54.455844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.455990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.456018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-12-08 02:29:54.456149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.456285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.456310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-12-08 02:29:54.456455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.456596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.456622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-12-08 02:29:54.456740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.456826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.456855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-12-08 02:29:54.456994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.457104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.457128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-12-08 02:29:54.457260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.457383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.457411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-12-08 02:29:54.457558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.457687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.457714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-12-08 02:29:54.457859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.457984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.458012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-12-08 02:29:54.458128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.458237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.458262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-12-08 02:29:54.458380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.458489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.458514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-12-08 02:29:54.458606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.458725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.458751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-12-08 02:29:54.458858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.459026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.459051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-12-08 02:29:54.459189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.459303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.459328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-12-08 02:29:54.459418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.459524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.459566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.826 qpair failed and we were unable to recover it. 00:27:26.826 [2024-12-08 02:29:54.459702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.826 [2024-12-08 02:29:54.459792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.459817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-12-08 02:29:54.459897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.460007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.460033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-12-08 02:29:54.460151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.460264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.460289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-12-08 02:29:54.460369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.460478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.460504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-12-08 02:29:54.460634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.460746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.460771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-12-08 02:29:54.460887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.460997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.461025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-12-08 02:29:54.461120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.461202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.461230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-12-08 02:29:54.461382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.461509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.461545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-12-08 02:29:54.461711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.461800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.461825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-12-08 02:29:54.461932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.462071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.462096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-12-08 02:29:54.462185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.462274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.462300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-12-08 02:29:54.462381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.462498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.462523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-12-08 02:29:54.462638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.462721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.462747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-12-08 02:29:54.462868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.462948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.462973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-12-08 02:29:54.463111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.463231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.463256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-12-08 02:29:54.463426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.463554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.463583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-12-08 02:29:54.463720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.463834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.463858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-12-08 02:29:54.463990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.464087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.464116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-12-08 02:29:54.464252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.464396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.464421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-12-08 02:29:54.464572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.464679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.464705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-12-08 02:29:54.464797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.464884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.464910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-12-08 02:29:54.464996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.465135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.465163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-12-08 02:29:54.465254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.465357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.465386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-12-08 02:29:54.465566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.465684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.465711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-12-08 02:29:54.465857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.465943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.465969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-12-08 02:29:54.466120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.466203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.466228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-12-08 02:29:54.466312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.466403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.466428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-12-08 02:29:54.466542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.466623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.466649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.827 [2024-12-08 02:29:54.466765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.466879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.827 [2024-12-08 02:29:54.466905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.827 qpair failed and we were unable to recover it. 00:27:26.828 [2024-12-08 02:29:54.467024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.467139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.467164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-12-08 02:29:54.467314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.467395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.467421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-12-08 02:29:54.467513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.467671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.467696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-12-08 02:29:54.467839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.467932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.467957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-12-08 02:29:54.468067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.468178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.468221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-12-08 02:29:54.468354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.468470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.468495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-12-08 02:29:54.468619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.468738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.468763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-12-08 02:29:54.468845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.468960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.468985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-12-08 02:29:54.469082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.469185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.469213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-12-08 02:29:54.469319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.469405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.469432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-12-08 02:29:54.469565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.469695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.469723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-12-08 02:29:54.469837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.469962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.469989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-12-08 02:29:54.470073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.470242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.470270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-12-08 02:29:54.470403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.470554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.470580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-12-08 02:29:54.470724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.470853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.470881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-12-08 02:29:54.470984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.471126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.471151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-12-08 02:29:54.471291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.471396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.471421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-12-08 02:29:54.471560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.471660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.471688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-12-08 02:29:54.471805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.471950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.471978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-12-08 02:29:54.472117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.472230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.472255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-12-08 02:29:54.472378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.472503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.472528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-12-08 02:29:54.472683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.472811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.472839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-12-08 02:29:54.472971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.473075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.473102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-12-08 02:29:54.473205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.473321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.473346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-12-08 02:29:54.473441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.473555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.473582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-12-08 02:29:54.473689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.473799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.473824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-12-08 02:29:54.473910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.474025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.474050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-12-08 02:29:54.474176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.474300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.474325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.828 qpair failed and we were unable to recover it. 00:27:26.828 [2024-12-08 02:29:54.474416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.828 [2024-12-08 02:29:54.474565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.474594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-12-08 02:29:54.474716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.474867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.474895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-12-08 02:29:54.475029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.475110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.475136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-12-08 02:29:54.475224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.475347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.475372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-12-08 02:29:54.475449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.475548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.475575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-12-08 02:29:54.475692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.475835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.475863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-12-08 02:29:54.475988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.476113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.476141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-12-08 02:29:54.476305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.476384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.476409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-12-08 02:29:54.476554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.476665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.476690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-12-08 02:29:54.476810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.476963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.476989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-12-08 02:29:54.477099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.477182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.477207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-12-08 02:29:54.477319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.477434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.477461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-12-08 02:29:54.477567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.477656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.477684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-12-08 02:29:54.477823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.477930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.477956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-12-08 02:29:54.478082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.478211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.478239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-12-08 02:29:54.478359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.478560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.478604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-12-08 02:29:54.478728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.478856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.478883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-12-08 02:29:54.479009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.479143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.479168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-12-08 02:29:54.479280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.479422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.479447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-12-08 02:29:54.479525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.479644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.479669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-12-08 02:29:54.479751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.479832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.479858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-12-08 02:29:54.479979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.480096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.480121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-12-08 02:29:54.480199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.480323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.480351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-12-08 02:29:54.480517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.480639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.480664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-12-08 02:29:54.480747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.480855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.480880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.829 qpair failed and we were unable to recover it. 00:27:26.829 [2024-12-08 02:29:54.481011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.481164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.829 [2024-12-08 02:29:54.481192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-12-08 02:29:54.481317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.481444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.481473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-12-08 02:29:54.481632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.481741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.481766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-12-08 02:29:54.481895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.482021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.482050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-12-08 02:29:54.482174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.482296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.482324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-12-08 02:29:54.482490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.482576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.482603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-12-08 02:29:54.482742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.482857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.482882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-12-08 02:29:54.483025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.483210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.483236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-12-08 02:29:54.483379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.483514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.483548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-12-08 02:29:54.483725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.483844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.483870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-12-08 02:29:54.483987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.484070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.484096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-12-08 02:29:54.484181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.484294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.484320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-12-08 02:29:54.484476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.484608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.484637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-12-08 02:29:54.484772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.484892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.484920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-12-08 02:29:54.485080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.485184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.485209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-12-08 02:29:54.485349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.485451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.485480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-12-08 02:29:54.485608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.485727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.485753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-12-08 02:29:54.485869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.485983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.486007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-12-08 02:29:54.486119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.486233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.486259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-12-08 02:29:54.486392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.486554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.486580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-12-08 02:29:54.486660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.486769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.486794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-12-08 02:29:54.486951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.487059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.487085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-12-08 02:29:54.487159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.487272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.487297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-12-08 02:29:54.487381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.487519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.487555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-12-08 02:29:54.487680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.487819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.487844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-12-08 02:29:54.487938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.488053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.488077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-12-08 02:29:54.488193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.488305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.488331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-12-08 02:29:54.488492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.488665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.488691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-12-08 02:29:54.488829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.488912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.488937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.830 qpair failed and we were unable to recover it. 00:27:26.830 [2024-12-08 02:29:54.489053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.830 [2024-12-08 02:29:54.489168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.489212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-12-08 02:29:54.489348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.489455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.489480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-12-08 02:29:54.489601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.489692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.489717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-12-08 02:29:54.489807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.489923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.489948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-12-08 02:29:54.490075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.490210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.490238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-12-08 02:29:54.490379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.490466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.490491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-12-08 02:29:54.490632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.490796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.490821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-12-08 02:29:54.490939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.491052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.491095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-12-08 02:29:54.491184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.491334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.491361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-12-08 02:29:54.491506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.491607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.491633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-12-08 02:29:54.491771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.491897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.491924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-12-08 02:29:54.492058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.492142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.492183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-12-08 02:29:54.492292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.492365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.492390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-12-08 02:29:54.492520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.492613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.492639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-12-08 02:29:54.492744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.492865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.492895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-12-08 02:29:54.493029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.493109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.493137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-12-08 02:29:54.493267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.493398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.493423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-12-08 02:29:54.493572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.493661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.493687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-12-08 02:29:54.493817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.493960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.493986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-12-08 02:29:54.494093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.494198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.494230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-12-08 02:29:54.494323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.494499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.494524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-12-08 02:29:54.494671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.494752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.494777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-12-08 02:29:54.494904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.494987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.495015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-12-08 02:29:54.495128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.495269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.495294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-12-08 02:29:54.495428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.495520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.495555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-12-08 02:29:54.495668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.495807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.495832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-12-08 02:29:54.495968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.496069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.496095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-12-08 02:29:54.496213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.496328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.496356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-12-08 02:29:54.496479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.496572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.831 [2024-12-08 02:29:54.496601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.831 qpair failed and we were unable to recover it. 00:27:26.831 [2024-12-08 02:29:54.496773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.496863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.496892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-12-08 02:29:54.497075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.497216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.497241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-12-08 02:29:54.497376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.497531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.497567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-12-08 02:29:54.497662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.497798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.497826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-12-08 02:29:54.497959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.498072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.498097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-12-08 02:29:54.498207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.498308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.498336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-12-08 02:29:54.498460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.498586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.498629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-12-08 02:29:54.498745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.498828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.498870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-12-08 02:29:54.499007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.499121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.499147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-12-08 02:29:54.499257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.499388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.499416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-12-08 02:29:54.499508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.499672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.499707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-12-08 02:29:54.499860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.499956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.499984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-12-08 02:29:54.500096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.500181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.500207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-12-08 02:29:54.500319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.500469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.500495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-12-08 02:29:54.500640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.500727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.500753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-12-08 02:29:54.500897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.501021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.501048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-12-08 02:29:54.501177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.501289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.501314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-12-08 02:29:54.501403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.501530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.501565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-12-08 02:29:54.501656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.501775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.501803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-12-08 02:29:54.501890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.501985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.502013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-12-08 02:29:54.502144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.502229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.502259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-12-08 02:29:54.502410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.502567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.502596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-12-08 02:29:54.502698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.502850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.502878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-12-08 02:29:54.502974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.503103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.503131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-12-08 02:29:54.503242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.503353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.503378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-12-08 02:29:54.503467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.503575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.503604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-12-08 02:29:54.503728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.503886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.503913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-12-08 02:29:54.504059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.504202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.504227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.832 qpair failed and we were unable to recover it. 00:27:26.832 [2024-12-08 02:29:54.504342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.504457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.832 [2024-12-08 02:29:54.504482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-12-08 02:29:54.504590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.504684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.504712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-12-08 02:29:54.504841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.504992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.505020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-12-08 02:29:54.505146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.505238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.505266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-12-08 02:29:54.505384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.505481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.505506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-12-08 02:29:54.505606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.505715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.505740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-12-08 02:29:54.505851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.506004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.506032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-12-08 02:29:54.506126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.506251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.506294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-12-08 02:29:54.506410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.506520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.506576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-12-08 02:29:54.506725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.506842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.506869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-12-08 02:29:54.506994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.507112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.507140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-12-08 02:29:54.507266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.507418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.507446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-12-08 02:29:54.507607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.507696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.507721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-12-08 02:29:54.507904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.508014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.508040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-12-08 02:29:54.508137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.508299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.508324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-12-08 02:29:54.508434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.508578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.508604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-12-08 02:29:54.508716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.508828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.508853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-12-08 02:29:54.508948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.509097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.509125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-12-08 02:29:54.509249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.509339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.509367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-12-08 02:29:54.509532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.509651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.509677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-12-08 02:29:54.509792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.509880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.509906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-12-08 02:29:54.510044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.510137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.510165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-12-08 02:29:54.510298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.510420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.510448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-12-08 02:29:54.510575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.510701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.510729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-12-08 02:29:54.510890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.510976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.511001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-12-08 02:29:54.511148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.511261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.511288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-12-08 02:29:54.511379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.511470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.511498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.833 qpair failed and we were unable to recover it. 00:27:26.833 [2024-12-08 02:29:54.511648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.511732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.833 [2024-12-08 02:29:54.511758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-12-08 02:29:54.511873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.511955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.511980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-12-08 02:29:54.512125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.512283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.512311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-12-08 02:29:54.512471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.512563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.512590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-12-08 02:29:54.512717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.512840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.512870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-12-08 02:29:54.513001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.513094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.513119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-12-08 02:29:54.513254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.513375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.513403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-12-08 02:29:54.513520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.513691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.513716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-12-08 02:29:54.513817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.513906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.513932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-12-08 02:29:54.514059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.514174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.514199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-12-08 02:29:54.514298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.514427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.514455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-12-08 02:29:54.514586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.514704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.514731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-12-08 02:29:54.514866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.514981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.515007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-12-08 02:29:54.515091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.515206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.515231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-12-08 02:29:54.515341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.515465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.515493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-12-08 02:29:54.515646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.515763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.515788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-12-08 02:29:54.515890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.516043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.516071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-12-08 02:29:54.516180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.516261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.516287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-12-08 02:29:54.516377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.516479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.516508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-12-08 02:29:54.516657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.516797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.516823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-12-08 02:29:54.516951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.517047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.517075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-12-08 02:29:54.517246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.517331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.517357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-12-08 02:29:54.517476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.517566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.517592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-12-08 02:29:54.517679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.517815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.517840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-12-08 02:29:54.517973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.518096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.518123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-12-08 02:29:54.518261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.518371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.518395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-12-08 02:29:54.518541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.518673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.518699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.834 qpair failed and we were unable to recover it. 00:27:26.834 [2024-12-08 02:29:54.518863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.834 [2024-12-08 02:29:54.519014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.519042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-12-08 02:29:54.519128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.519252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.519280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-12-08 02:29:54.519418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.519559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.519585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-12-08 02:29:54.519696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.519802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.519827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-12-08 02:29:54.519966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.520115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.520143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-12-08 02:29:54.520295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.520447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.520474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-12-08 02:29:54.520614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.520720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.520745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-12-08 02:29:54.520893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.521038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.521063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-12-08 02:29:54.521143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.521300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.521329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-12-08 02:29:54.521486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.521580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.521609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-12-08 02:29:54.521720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.521799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.521825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-12-08 02:29:54.521936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.522075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.522103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-12-08 02:29:54.522204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.522360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.522388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-12-08 02:29:54.522482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.522576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.522620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-12-08 02:29:54.522704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.522794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.522819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-12-08 02:29:54.522907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.523032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.523061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-12-08 02:29:54.523164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.523280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.523308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-12-08 02:29:54.523442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.523529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.523565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-12-08 02:29:54.523673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.523789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.523814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-12-08 02:29:54.523908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.524043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.524071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-12-08 02:29:54.524195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.524350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.524378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-12-08 02:29:54.524502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.524603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.524632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-12-08 02:29:54.524770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.524862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.524887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-12-08 02:29:54.524983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.525065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.525093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-12-08 02:29:54.525187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.525308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.525335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-12-08 02:29:54.525464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.525585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.525613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-12-08 02:29:54.525749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.525827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.525852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-12-08 02:29:54.525964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.526114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.526143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.835 [2024-12-08 02:29:54.526298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.526458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.835 [2024-12-08 02:29:54.526485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.835 qpair failed and we were unable to recover it. 00:27:26.836 [2024-12-08 02:29:54.526590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.526727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.526753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-12-08 02:29:54.526835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.526952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.526978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-12-08 02:29:54.527065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.527166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.527195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-12-08 02:29:54.527353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.527505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.527533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-12-08 02:29:54.527674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.527802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.527830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-12-08 02:29:54.527964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.528083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.528108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-12-08 02:29:54.528204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.528323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.528348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-12-08 02:29:54.528485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.528633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.528662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-12-08 02:29:54.528755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.528875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.528903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-12-08 02:29:54.529033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.529105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.529130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-12-08 02:29:54.529289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.529446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.529473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-12-08 02:29:54.529568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.529669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.529698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-12-08 02:29:54.529798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.529911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.529940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-12-08 02:29:54.530081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.530163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.530188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-12-08 02:29:54.530320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.530459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.530484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-12-08 02:29:54.530589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.530708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.530733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-12-08 02:29:54.530868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.531069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.531097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-12-08 02:29:54.531231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.531372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.531397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-12-08 02:29:54.531531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.531660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.531688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-12-08 02:29:54.531816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.531915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.531943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-12-08 02:29:54.532080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.532197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.532222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-12-08 02:29:54.532335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.532444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.532469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-12-08 02:29:54.532576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.532659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.532687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-12-08 02:29:54.532819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.532927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.532952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-12-08 02:29:54.533038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.533140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.533168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-12-08 02:29:54.533300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.533419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.533444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-12-08 02:29:54.533578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.533679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.533721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-12-08 02:29:54.533810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.533917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.533942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.836 qpair failed and we were unable to recover it. 00:27:26.836 [2024-12-08 02:29:54.534123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.836 [2024-12-08 02:29:54.534275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.534302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-12-08 02:29:54.534433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.534547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.534573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-12-08 02:29:54.534741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.534865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.534894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-12-08 02:29:54.534986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.535084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.535113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-12-08 02:29:54.535238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.535341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.535369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-12-08 02:29:54.535507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.535598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.535624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-12-08 02:29:54.535720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.535817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.535845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-12-08 02:29:54.535929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.536055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.536083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-12-08 02:29:54.536181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.536313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.536340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-12-08 02:29:54.536506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.536624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.536650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-12-08 02:29:54.536825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.536937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.536962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-12-08 02:29:54.537119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.537244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.537272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-12-08 02:29:54.537394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.537529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.537567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-12-08 02:29:54.537678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.537785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.537810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-12-08 02:29:54.537936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.538106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.538131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-12-08 02:29:54.538244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.538353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.538378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-12-08 02:29:54.538489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.538620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.538649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-12-08 02:29:54.538791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.538882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.538908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-12-08 02:29:54.539027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.539188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.539215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-12-08 02:29:54.539344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.539425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.539453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-12-08 02:29:54.539653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.539771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.539796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-12-08 02:29:54.539920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.540001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.540026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-12-08 02:29:54.540167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.540288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.540321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-12-08 02:29:54.540423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.540553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.540582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-12-08 02:29:54.540707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.540908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.540960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-12-08 02:29:54.541116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.541230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.541255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-12-08 02:29:54.541416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.541574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.541599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-12-08 02:29:54.541717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.541846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.541874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-12-08 02:29:54.542011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.542129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.837 [2024-12-08 02:29:54.542156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.837 qpair failed and we were unable to recover it. 00:27:26.837 [2024-12-08 02:29:54.542270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.542351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.542376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-12-08 02:29:54.542482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.542602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.542647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-12-08 02:29:54.542770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.542897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.542925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-12-08 02:29:54.543059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.543198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.543227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-12-08 02:29:54.543375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.543517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.543565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-12-08 02:29:54.543722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.543844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.543872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-12-08 02:29:54.543994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.544125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.544151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-12-08 02:29:54.544236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.544339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.544367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-12-08 02:29:54.544474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.544580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.544606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-12-08 02:29:54.544695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.544837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.544865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-12-08 02:29:54.544982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.545102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.545130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-12-08 02:29:54.545228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.545388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.545413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-12-08 02:29:54.545505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.545605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.545631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-12-08 02:29:54.545712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.545824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.545852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-12-08 02:29:54.545977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.546095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.546122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-12-08 02:29:54.546246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.546395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.546423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-12-08 02:29:54.546598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.546717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.546742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-12-08 02:29:54.546879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.547018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.547042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-12-08 02:29:54.547184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.547316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.547343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-12-08 02:29:54.547467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.547586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.547615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-12-08 02:29:54.547748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.547886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.547912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-12-08 02:29:54.548059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.548179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.548207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-12-08 02:29:54.548376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.548493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.548521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-12-08 02:29:54.548628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.548752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.548794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-12-08 02:29:54.548947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.549088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.838 [2024-12-08 02:29:54.549130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.838 qpair failed and we were unable to recover it. 00:27:26.838 [2024-12-08 02:29:54.549247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.549396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.549436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-12-08 02:29:54.549572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.549676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.549705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-12-08 02:29:54.549871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.550022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.550063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-12-08 02:29:54.550142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.550283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.550308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-12-08 02:29:54.550471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.550583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.550612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-12-08 02:29:54.550748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.550875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.550901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-12-08 02:29:54.550983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.551147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.551175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-12-08 02:29:54.551332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.551415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.551441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-12-08 02:29:54.551548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.551675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.551703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-12-08 02:29:54.551797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.551914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.551955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-12-08 02:29:54.552035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.552150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.552175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-12-08 02:29:54.552291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.552430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.552455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-12-08 02:29:54.552592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.552679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.552707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-12-08 02:29:54.552797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.552888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.552916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-12-08 02:29:54.553016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.553167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.553195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-12-08 02:29:54.553331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.553443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.553469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-12-08 02:29:54.553549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.553656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.553684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-12-08 02:29:54.553825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.553939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.553964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-12-08 02:29:54.554081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.554191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.554219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-12-08 02:29:54.554355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.554434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.554459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-12-08 02:29:54.554572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.554710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.554738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-12-08 02:29:54.554887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.555011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.555038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-12-08 02:29:54.555131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.555257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.555285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-12-08 02:29:54.555411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.555497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.555523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-12-08 02:29:54.555638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.555745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.555787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-12-08 02:29:54.555883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.556038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.556065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-12-08 02:29:54.556182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.556336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.556364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-12-08 02:29:54.556500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.556613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.556639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.839 qpair failed and we were unable to recover it. 00:27:26.839 [2024-12-08 02:29:54.556730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.556860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.839 [2024-12-08 02:29:54.556888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-12-08 02:29:54.557054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.557168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.557194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-12-08 02:29:54.557291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.557383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.557412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-12-08 02:29:54.557555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.557655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.557680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-12-08 02:29:54.557772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.557931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.557958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-12-08 02:29:54.558085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.558235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.558263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-12-08 02:29:54.558385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.558507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.558567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-12-08 02:29:54.558703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.558820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.558845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-12-08 02:29:54.558973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.559093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.559121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-12-08 02:29:54.559245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.559403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.559428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-12-08 02:29:54.559535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.559642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.559670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-12-08 02:29:54.559815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.559926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.559951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-12-08 02:29:54.560091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.560177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.560205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-12-08 02:29:54.560326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.560454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.560482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-12-08 02:29:54.560605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.560765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.560790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-12-08 02:29:54.560906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.561012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.561037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-12-08 02:29:54.561185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.561338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.561366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-12-08 02:29:54.561488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.561610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.561639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-12-08 02:29:54.561762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.561915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.561943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-12-08 02:29:54.562086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.562172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.562198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-12-08 02:29:54.562300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.562425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.562452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-12-08 02:29:54.562549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.562667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.562695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-12-08 02:29:54.562819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.562918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.562947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-12-08 02:29:54.563088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.563171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.563196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-12-08 02:29:54.563282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.563383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.563411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-12-08 02:29:54.563543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.563670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.563698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-12-08 02:29:54.563823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.563917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.563945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-12-08 02:29:54.564079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.564193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.564218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-12-08 02:29:54.564338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.564478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.564503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.840 qpair failed and we were unable to recover it. 00:27:26.840 [2024-12-08 02:29:54.564627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.840 [2024-12-08 02:29:54.564710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-12-08 02:29:54.564735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.841 qpair failed and we were unable to recover it. 00:27:26.841 [2024-12-08 02:29:54.564846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-12-08 02:29:54.564920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-12-08 02:29:54.564946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.841 qpair failed and we were unable to recover it. 00:27:26.841 [2024-12-08 02:29:54.565041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-12-08 02:29:54.565125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-12-08 02:29:54.565150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.841 qpair failed and we were unable to recover it. 00:27:26.841 [2024-12-08 02:29:54.565237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-12-08 02:29:54.565343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-12-08 02:29:54.565368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.841 qpair failed and we were unable to recover it. 00:27:26.841 [2024-12-08 02:29:54.565478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-12-08 02:29:54.565552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-12-08 02:29:54.565577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.841 qpair failed and we were unable to recover it. 00:27:26.841 [2024-12-08 02:29:54.565686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-12-08 02:29:54.565776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-12-08 02:29:54.565802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.841 qpair failed and we were unable to recover it. 00:27:26.841 [2024-12-08 02:29:54.565987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-12-08 02:29:54.566080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-12-08 02:29:54.566106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.841 qpair failed and we were unable to recover it. 00:27:26.841 [2024-12-08 02:29:54.566224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-12-08 02:29:54.566302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-12-08 02:29:54.566327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.841 qpair failed and we were unable to recover it. 00:27:26.841 [2024-12-08 02:29:54.566463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-12-08 02:29:54.566607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-12-08 02:29:54.566633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.841 qpair failed and we were unable to recover it. 00:27:26.841 [2024-12-08 02:29:54.566757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-12-08 02:29:54.566885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-12-08 02:29:54.566914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.841 qpair failed and we were unable to recover it. 00:27:26.841 [2024-12-08 02:29:54.567047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-12-08 02:29:54.567188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-12-08 02:29:54.567214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.841 qpair failed and we were unable to recover it. 00:27:26.841 [2024-12-08 02:29:54.567311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-12-08 02:29:54.567439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-12-08 02:29:54.567466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.841 qpair failed and we were unable to recover it. 00:27:26.841 [2024-12-08 02:29:54.567555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-12-08 02:29:54.567643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.841 [2024-12-08 02:29:54.567669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:26.841 qpair failed and we were unable to recover it. 00:27:26.841 [2024-12-08 02:29:54.567775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.152 [2024-12-08 02:29:54.567911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.152 [2024-12-08 02:29:54.567941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.152 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.568107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.568195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.568221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.568333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.568465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.568493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.568589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.568684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.568711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.568834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.568925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.568953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.569090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.569179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.569205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.569318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.569404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.569430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.569516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.569610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.569635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.569795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.569958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.569984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.570101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.570191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.570217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.570314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.570429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.570472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.570599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.570721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.570750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.570845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.570972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.571001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.571138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.571219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.571245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.571375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.571455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.571483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.571627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.571706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.571731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.571833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.571940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.571966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.572083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.572164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.572189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.572313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.572406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.572434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.572520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.572654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.572683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.572811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.572944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.572970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.573114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.573225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.573250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.573401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.573568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.573595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.573736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.573879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.573907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.574036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.574163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.574192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.574330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.574420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.574445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.574552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.574708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.574737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.574826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.574945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.574974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.575097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.575219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.575248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.575419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.575549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.575575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.575714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.575834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.575862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.576014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.576138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.576166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.576333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.576457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.576485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.576611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.576751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.576776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.576875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.577000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.577029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.577126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.577220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.577248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.577395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.577476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.577503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.577626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.577707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.577733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.577896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.578046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.578074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.578170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.578298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.578332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.578453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.578582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.153 [2024-12-08 02:29:54.578612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.153 qpair failed and we were unable to recover it. 00:27:27.153 [2024-12-08 02:29:54.578741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.578881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.578907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.579052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.579177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.579205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.579311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.579423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.579451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.579574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.579672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.579700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.579803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.579911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.579937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.580024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.580109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.580134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.580213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.580373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.580401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.580554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.580640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.580669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.580809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.580920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.580950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.581036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.581143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.581171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.581322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.581443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.581470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.581565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.581681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.581709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.581841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.581956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.581983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.582119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.582288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.582313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.582453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.582555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.582585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.582705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.582824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.582852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.582996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.583106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.583132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.583278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.583408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.583433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.583583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.583711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.583744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.583878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.584003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.584031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.584139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.584281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.584306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.584432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.584530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.584637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.584771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.584901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.584929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.585024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.585128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.585156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.585264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.585384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.585410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.585526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.585640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.585665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.585746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.585836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.585862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.585972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.586082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.586110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.586242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.586346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.586376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.586470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.586589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.586634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.586788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.586912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.586940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.587069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.587204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.587230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.587342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.587455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.587480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.587609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.587783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.587812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.587963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.588081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.588110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.588206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.588291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.588321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.588427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.588510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.588543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.588666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.588772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.588801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.588928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.589094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.589120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.589244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.589320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.589346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.154 qpair failed and we were unable to recover it. 00:27:27.154 [2024-12-08 02:29:54.589462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.154 [2024-12-08 02:29:54.589552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.589579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.589695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.589786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.589829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.589967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.590081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.590106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.590270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.590397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.590426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.590575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.590686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.590711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.590842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.590957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.590986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.591108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.591246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.591273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.591395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.591554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.591583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.591716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.591831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.591856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.592000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.592121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.592149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.592267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.592418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.592447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.592564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.592690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.592718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.592880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.592969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.592994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.593125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.593283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.593308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.593423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.593528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.593559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.593647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.593722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.593748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.593861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.593974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.594000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.594117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.594280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.594305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.594422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.594580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.594610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.594743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.594841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.594870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.595006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.595113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.595139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.595248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.595396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.595424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.595520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.595631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.595659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.595782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.595904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.595932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.596069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.596210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.596236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.596388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.596471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.596496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.596617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.596729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.596754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.596840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.596950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.596976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.597068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.597185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.597210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.597303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.597442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.597471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.597605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.597719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.597744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.597836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.597969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.597997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.598139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.598246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.598271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.598406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.598490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.598518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.598686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.598840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.598865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.599036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.599186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.599215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.599381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.599489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.599515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.599633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.599707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.599732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.599830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.599915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.599941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.600053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.600207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.600236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.155 [2024-12-08 02:29:54.600369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.600455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.155 [2024-12-08 02:29:54.600481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.155 qpair failed and we were unable to recover it. 00:27:27.156 [2024-12-08 02:29:54.600617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.600731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.600760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.156 qpair failed and we were unable to recover it. 00:27:27.156 [2024-12-08 02:29:54.600890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.601009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.601038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.156 qpair failed and we were unable to recover it. 00:27:27.156 [2024-12-08 02:29:54.601171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.601269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.601299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.156 qpair failed and we were unable to recover it. 00:27:27.156 [2024-12-08 02:29:54.601409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.601493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.601519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.156 qpair failed and we were unable to recover it. 00:27:27.156 [2024-12-08 02:29:54.601649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.601736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.601761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.156 qpair failed and we were unable to recover it. 00:27:27.156 [2024-12-08 02:29:54.601901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.602063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.602091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.156 qpair failed and we were unable to recover it. 00:27:27.156 [2024-12-08 02:29:54.602222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.602333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.602358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.156 qpair failed and we were unable to recover it. 00:27:27.156 [2024-12-08 02:29:54.602448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.602559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.602587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.156 qpair failed and we were unable to recover it. 00:27:27.156 [2024-12-08 02:29:54.602706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.602812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.602840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.156 qpair failed and we were unable to recover it. 00:27:27.156 [2024-12-08 02:29:54.602969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.603093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.603122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.156 qpair failed and we were unable to recover it. 00:27:27.156 [2024-12-08 02:29:54.603211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.603299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.603328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.156 qpair failed and we were unable to recover it. 00:27:27.156 [2024-12-08 02:29:54.603463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.603557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.603583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.156 qpair failed and we were unable to recover it. 00:27:27.156 [2024-12-08 02:29:54.603662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.603775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.603801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.156 qpair failed and we were unable to recover it. 00:27:27.156 [2024-12-08 02:29:54.603913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.604009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.604037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.156 qpair failed and we were unable to recover it. 00:27:27.156 [2024-12-08 02:29:54.604203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.604286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.604311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.156 qpair failed and we were unable to recover it. 00:27:27.156 [2024-12-08 02:29:54.604452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.604530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.604564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.156 qpair failed and we were unable to recover it. 00:27:27.156 [2024-12-08 02:29:54.604691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.604782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.604811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.156 qpair failed and we were unable to recover it. 00:27:27.156 [2024-12-08 02:29:54.604929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.605053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.605082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.156 qpair failed and we were unable to recover it. 00:27:27.156 [2024-12-08 02:29:54.605221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.605307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.605336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.156 qpair failed and we were unable to recover it. 00:27:27.156 [2024-12-08 02:29:54.605506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.605635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.605661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.156 qpair failed and we were unable to recover it. 00:27:27.156 [2024-12-08 02:29:54.605802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.605932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.605961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.156 qpair failed and we were unable to recover it. 00:27:27.156 [2024-12-08 02:29:54.606056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.606156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.606185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.156 qpair failed and we were unable to recover it. 00:27:27.156 [2024-12-08 02:29:54.606268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.606362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.606391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.156 qpair failed and we were unable to recover it. 00:27:27.156 [2024-12-08 02:29:54.606555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.606637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.606663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.156 qpair failed and we were unable to recover it. 00:27:27.156 [2024-12-08 02:29:54.606803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.606911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.606935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.156 qpair failed and we were unable to recover it. 00:27:27.156 [2024-12-08 02:29:54.607074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.607230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.607259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.156 qpair failed and we were unable to recover it. 00:27:27.156 [2024-12-08 02:29:54.607383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.607502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.607531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.156 qpair failed and we were unable to recover it. 00:27:27.156 [2024-12-08 02:29:54.607678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.607765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.607791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.156 qpair failed and we were unable to recover it. 00:27:27.156 [2024-12-08 02:29:54.607873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.608014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.608042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.156 qpair failed and we were unable to recover it. 00:27:27.156 [2024-12-08 02:29:54.608162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.608295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.608323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.156 qpair failed and we were unable to recover it. 00:27:27.156 [2024-12-08 02:29:54.608450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.608570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.608600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.156 qpair failed and we were unable to recover it. 00:27:27.156 [2024-12-08 02:29:54.608731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.608812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.608839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.156 qpair failed and we were unable to recover it. 00:27:27.156 [2024-12-08 02:29:54.608930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.609064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.156 [2024-12-08 02:29:54.609092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.156 qpair failed and we were unable to recover it. 00:27:27.156 [2024-12-08 02:29:54.609217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.609384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.609409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.609526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.609614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.609639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.609758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.609870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.609896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.609987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.610112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.610142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.610239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.610334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.610364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.610459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.610556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.610586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.610704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.610851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.610876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.610997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.611089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.611118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.611233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.611324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.611352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.611470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.611600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.611628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.611748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.611868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.611893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.611987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.612091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.612120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.612249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.612401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.612429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.612564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.612691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.612720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.612838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.612955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.612981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.613066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.613198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.613228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.613324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.613493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.613519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.613605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.613719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.613745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.613858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.613966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.613992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.614108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.614220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.614245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.614382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.614528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.614587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.614682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.614797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.614826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.614953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.615077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.615102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.615194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.615283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.615309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.615406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.615557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.615585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.615759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.615874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.615900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.615991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.616075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.616101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.616258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.616341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.616369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.616503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.616590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.616617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.616752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.616847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.616875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.617041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.617182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.617223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.617347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.617495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.617524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.617626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.617743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.617771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.617895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.618114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.618140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.618278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.618386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.618412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.618576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.618677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.618720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.618811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.618960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.618986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.619091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.619184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.619212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.619315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.619402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.619428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.619544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.619635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.157 [2024-12-08 02:29:54.619677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.157 qpair failed and we were unable to recover it. 00:27:27.157 [2024-12-08 02:29:54.619830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.619982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.620011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.620098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.620221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.620249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.620379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.620492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.620517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.620625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.620743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.620771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.620898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.621053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.621081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.621178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.621327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.621361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.621505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.621607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.621633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.621718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.621868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.621896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.622050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.622201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.622229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.622382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.622601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.622645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.622760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.622874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.622900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.623010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.623109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.623138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.623261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.623397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.623423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.623567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.623701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.623729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.623869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.623983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.624009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.624147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.624240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.624272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.624402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.624520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.624557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.624685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.624785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.624814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.624910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.624994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.625019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.625131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.625271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.625299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.625424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.625543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.625572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.625666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.625786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.625815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.625954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.626065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.626091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.626194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.626311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.626339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.626490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.626643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.626670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.626774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.626893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.626925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.627041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.627147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.627173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.627289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.627446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.627474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.627567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.627719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.627747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.627846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.627989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.628014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.628152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.628287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.628313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.628451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.628604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.628633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.628726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.628818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.628846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.628975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.629098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.629127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.629244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.629382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.629407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.629489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.629651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.629682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.629803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.629893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.629935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.630086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.630174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.630202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.630309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.630419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.630444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.630559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.630696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.630724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.630851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.630991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.631017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.631101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.631182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.158 [2024-12-08 02:29:54.631207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.158 qpair failed and we were unable to recover it. 00:27:27.158 [2024-12-08 02:29:54.631318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.631424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.631449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.159 qpair failed and we were unable to recover it. 00:27:27.159 [2024-12-08 02:29:54.631573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.631663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.631691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.159 qpair failed and we were unable to recover it. 00:27:27.159 [2024-12-08 02:29:54.631791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.631907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.631935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.159 qpair failed and we were unable to recover it. 00:27:27.159 [2024-12-08 02:29:54.632019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.632155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.632181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.159 qpair failed and we were unable to recover it. 00:27:27.159 [2024-12-08 02:29:54.632300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.632445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.632471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.159 qpair failed and we were unable to recover it. 00:27:27.159 [2024-12-08 02:29:54.632586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.632712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.632741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.159 qpair failed and we were unable to recover it. 00:27:27.159 [2024-12-08 02:29:54.632881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.633005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.633033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.159 qpair failed and we were unable to recover it. 00:27:27.159 [2024-12-08 02:29:54.633184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.633302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.633331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.159 qpair failed and we were unable to recover it. 00:27:27.159 [2024-12-08 02:29:54.633488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.633567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.633593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.159 qpair failed and we were unable to recover it. 00:27:27.159 [2024-12-08 02:29:54.633703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.633820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.633848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.159 qpair failed and we were unable to recover it. 00:27:27.159 [2024-12-08 02:29:54.633948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.634068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.634096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.159 qpair failed and we were unable to recover it. 00:27:27.159 [2024-12-08 02:29:54.634255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.634367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.634393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.159 qpair failed and we were unable to recover it. 00:27:27.159 [2024-12-08 02:29:54.634506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.634595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.634621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.159 qpair failed and we were unable to recover it. 00:27:27.159 [2024-12-08 02:29:54.634737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.634850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.634875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.159 qpair failed and we were unable to recover it. 00:27:27.159 [2024-12-08 02:29:54.635023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.635188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.635216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.159 qpair failed and we were unable to recover it. 00:27:27.159 [2024-12-08 02:29:54.635308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.635460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.635488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.159 qpair failed and we were unable to recover it. 00:27:27.159 [2024-12-08 02:29:54.635630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.635714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.635739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.159 qpair failed and we were unable to recover it. 00:27:27.159 [2024-12-08 02:29:54.635847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.635999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.636028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.159 qpair failed and we were unable to recover it. 00:27:27.159 [2024-12-08 02:29:54.636116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.636234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.636262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.159 qpair failed and we were unable to recover it. 00:27:27.159 [2024-12-08 02:29:54.636362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.636452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.636479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.159 qpair failed and we were unable to recover it. 00:27:27.159 [2024-12-08 02:29:54.636613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.636729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.636755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.159 qpair failed and we were unable to recover it. 00:27:27.159 [2024-12-08 02:29:54.636911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.636995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.637023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.159 qpair failed and we were unable to recover it. 00:27:27.159 [2024-12-08 02:29:54.637175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.637315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.637340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.159 qpair failed and we were unable to recover it. 00:27:27.159 [2024-12-08 02:29:54.637454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.637562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.637606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.159 qpair failed and we were unable to recover it. 00:27:27.159 [2024-12-08 02:29:54.637770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.637855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.637880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.159 qpair failed and we were unable to recover it. 00:27:27.159 [2024-12-08 02:29:54.637968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.638053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.638079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.159 qpair failed and we were unable to recover it. 00:27:27.159 [2024-12-08 02:29:54.638222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.638336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.638364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.159 qpair failed and we were unable to recover it. 00:27:27.159 [2024-12-08 02:29:54.638517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.638611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.638641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.159 qpair failed and we were unable to recover it. 00:27:27.159 [2024-12-08 02:29:54.638778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.638870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.638896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.159 qpair failed and we were unable to recover it. 00:27:27.159 [2024-12-08 02:29:54.639023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.639140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.639169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.159 qpair failed and we were unable to recover it. 00:27:27.159 [2024-12-08 02:29:54.639292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.639395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.639421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.159 qpair failed and we were unable to recover it. 00:27:27.159 [2024-12-08 02:29:54.639513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.639651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.639680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.159 qpair failed and we were unable to recover it. 00:27:27.159 [2024-12-08 02:29:54.639841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.639950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.639976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.159 qpair failed and we were unable to recover it. 00:27:27.159 [2024-12-08 02:29:54.640111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.640267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.640296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.159 qpair failed and we were unable to recover it. 00:27:27.159 [2024-12-08 02:29:54.640452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.640617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.640643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.159 qpair failed and we were unable to recover it. 00:27:27.159 [2024-12-08 02:29:54.640749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.640860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.640902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.159 qpair failed and we were unable to recover it. 00:27:27.159 [2024-12-08 02:29:54.641034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.159 [2024-12-08 02:29:54.641143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.641169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.641263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.641377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.641402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.641565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.641701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.641727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.641843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.641957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.642000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.642111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.642186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.642211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.642326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.642441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.642469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.642633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.642720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.642747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.642860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.643025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.643054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.643196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.643278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.643305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.643396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.643541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.643567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.643651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.643735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.643761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.643888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.644023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.644052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.644163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.644277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.644302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.644390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.644572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.644601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.644740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.644853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.644879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.644993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.645077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.645103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.645231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.645342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.645367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.645504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.645637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.645666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.645824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.645976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.646005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.646105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.646230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.646259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.646391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.646506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.646532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.646648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.646735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.646762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.646861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.647020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.647048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.647168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.647273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.647299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.647414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.647527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.647562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.647652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.647748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.647774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.647940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.648072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.648100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.648182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.648271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.648299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.648419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.648532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.648587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.648705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.648825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.648851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.648958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.649074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.649100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.649239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.649367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.649408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.649495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.649642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.649668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.649771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.649895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.649923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.650014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.650100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.650129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.650279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.650370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.650399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.650548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.650658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.650683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.650790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.650922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.650950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.651088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.651177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.651206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.651328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.651488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.651514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.651611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.651723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.651749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.160 qpair failed and we were unable to recover it. 00:27:27.160 [2024-12-08 02:29:54.651891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.160 [2024-12-08 02:29:54.652020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.652048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.652171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.652267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.652297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.652420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.652549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.652578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.652708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.652824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.652850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.652976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.653097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.653125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.653253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.653370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.653398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.653487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.653646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.653675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.653790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.653869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.653896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.654015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.654126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.654151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.654236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.654335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.654364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.654471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.654565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.654595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.654732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.654872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.654898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.654992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.655116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.655144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.655267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.655408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.655433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.655555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.655643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.655670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.655750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.655890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.655915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.656036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.656126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.656152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.656305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.656465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.656494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.656673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.656782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.656808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.656893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.657011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.657036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.657146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.657231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.657257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.657370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.657475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.657501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.657647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.657809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.657838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.657970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.658053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.658079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.658207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.658324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.658353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.658506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.658643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.658673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.658819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.658963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.658988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.659107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.659220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.659246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.659354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.659534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.659571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.659695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.659828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.659854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.659970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.660099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.660126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.660232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.660348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.660373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.660534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.660663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.660691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.660819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.660944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.660973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.661145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.661235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.661260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.661389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.661504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.661530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.661641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.661767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.661795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.661945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.662033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.662066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.662162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.662287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.662315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.662456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.662575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.662601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.662693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.662816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.662858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.662989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.663114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.161 [2024-12-08 02:29:54.663157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.161 qpair failed and we were unable to recover it. 00:27:27.161 [2024-12-08 02:29:54.663295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.663421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.663449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.162 qpair failed and we were unable to recover it. 00:27:27.162 [2024-12-08 02:29:54.663592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.663708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.663733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.162 qpair failed and we were unable to recover it. 00:27:27.162 [2024-12-08 02:29:54.663861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.663980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.664008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.162 qpair failed and we were unable to recover it. 00:27:27.162 [2024-12-08 02:29:54.664148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.664259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.664285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.162 qpair failed and we were unable to recover it. 00:27:27.162 [2024-12-08 02:29:54.664381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.664492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.664518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.162 qpair failed and we were unable to recover it. 00:27:27.162 [2024-12-08 02:29:54.664649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.664755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.664784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.162 qpair failed and we were unable to recover it. 00:27:27.162 [2024-12-08 02:29:54.664948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.665037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.665064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.162 qpair failed and we were unable to recover it. 00:27:27.162 [2024-12-08 02:29:54.665217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.665341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.665368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.162 qpair failed and we were unable to recover it. 00:27:27.162 [2024-12-08 02:29:54.665486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.665574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.665602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.162 qpair failed and we were unable to recover it. 00:27:27.162 [2024-12-08 02:29:54.665703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.665844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.665869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.162 qpair failed and we were unable to recover it. 00:27:27.162 [2024-12-08 02:29:54.665969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.666097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.666126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.162 qpair failed and we were unable to recover it. 00:27:27.162 [2024-12-08 02:29:54.666245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.666407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.666432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.162 qpair failed and we were unable to recover it. 00:27:27.162 [2024-12-08 02:29:54.666550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.666655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.666682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.162 qpair failed and we were unable to recover it. 00:27:27.162 [2024-12-08 02:29:54.666773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.666882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.666907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.162 qpair failed and we were unable to recover it. 00:27:27.162 [2024-12-08 02:29:54.667041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.667163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.667192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.162 qpair failed and we were unable to recover it. 00:27:27.162 [2024-12-08 02:29:54.667291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.667440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.667474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.162 qpair failed and we were unable to recover it. 00:27:27.162 [2024-12-08 02:29:54.667594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.667716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.667745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.162 qpair failed and we were unable to recover it. 00:27:27.162 [2024-12-08 02:29:54.667854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.667994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.668019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.162 qpair failed and we were unable to recover it. 00:27:27.162 [2024-12-08 02:29:54.668125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.668258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.668287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.162 qpair failed and we were unable to recover it. 00:27:27.162 [2024-12-08 02:29:54.668441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.668547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.668574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.162 qpair failed and we were unable to recover it. 00:27:27.162 [2024-12-08 02:29:54.668658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.668743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.668769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.162 qpair failed and we were unable to recover it. 00:27:27.162 [2024-12-08 02:29:54.668886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.668998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.669024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.162 qpair failed and we were unable to recover it. 00:27:27.162 [2024-12-08 02:29:54.669168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.669302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.669330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.162 qpair failed and we were unable to recover it. 00:27:27.162 [2024-12-08 02:29:54.669452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.669608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.669638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.162 qpair failed and we were unable to recover it. 00:27:27.162 [2024-12-08 02:29:54.669785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.669927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.669953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.162 qpair failed and we were unable to recover it. 00:27:27.162 [2024-12-08 02:29:54.670063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.670151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.670181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.162 qpair failed and we were unable to recover it. 00:27:27.162 [2024-12-08 02:29:54.670299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.670408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.670451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.162 qpair failed and we were unable to recover it. 00:27:27.162 [2024-12-08 02:29:54.670590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.670733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.670759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.162 qpair failed and we were unable to recover it. 00:27:27.162 [2024-12-08 02:29:54.670895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.671057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.671082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.162 qpair failed and we were unable to recover it. 00:27:27.162 [2024-12-08 02:29:54.671198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.671284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.671309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.162 qpair failed and we were unable to recover it. 00:27:27.162 [2024-12-08 02:29:54.671443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.671568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.671598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.162 qpair failed and we were unable to recover it. 00:27:27.162 [2024-12-08 02:29:54.671689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.671829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.671855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.162 qpair failed and we were unable to recover it. 00:27:27.162 [2024-12-08 02:29:54.671939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.672080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.672106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.162 qpair failed and we were unable to recover it. 00:27:27.162 [2024-12-08 02:29:54.672188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.672330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.672356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.162 qpair failed and we were unable to recover it. 00:27:27.162 [2024-12-08 02:29:54.672463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.672558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.672587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.162 qpair failed and we were unable to recover it. 00:27:27.162 [2024-12-08 02:29:54.672708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.672833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.672861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.162 qpair failed and we were unable to recover it. 00:27:27.162 [2024-12-08 02:29:54.672949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.162 [2024-12-08 02:29:54.673035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.673063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.673203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.673339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.673365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.673479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.673630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.673659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.673789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.673904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.673932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.674054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.674179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.674207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.674321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.674441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.674467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.674623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.674710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.674738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.674831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.674948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.674976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.675080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.675165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.675193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.675334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.675447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.675472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.675589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.675715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.675743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.675894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.675988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.676029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.676151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.676285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.676314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.676443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.676532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.676564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.676672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.676805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.676833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.676955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.677075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.677104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.677234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.677365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.677393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.677524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.677625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.677651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.677765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.677921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.677950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.678077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.678196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.678224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.678351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.678438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.678466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.678628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.678714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.678740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.678877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.679013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.679042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.679195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.679316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.679345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.679466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.679565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.679595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.679700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.679817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.679842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.679924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.680069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.680098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.680258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.680368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.680393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.680505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.680604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.680645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.680786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.680894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.680919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.681057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.681150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.681176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.681265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.681366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.681395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.681511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.681604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.681632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.681747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.681865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.681891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.682022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.682117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.682145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.682236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.682361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.682390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.682521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.682684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.682712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.682844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.682918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.682944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.683068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.683220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.683249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.683370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.683468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.683496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.683605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.683730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.683758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.163 qpair failed and we were unable to recover it. 00:27:27.163 [2024-12-08 02:29:54.683887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.163 [2024-12-08 02:29:54.683967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.683993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.684121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.684248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.684276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.684398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.684521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.684557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.684679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.684814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.684840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.684953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.685067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.685092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.685175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.685283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.685309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.685392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.685479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.685505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.685614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.685723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.685767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.685879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.685988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.686014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.686140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.686267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.686295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.686389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.686489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.686516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.686639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.686781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.686806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.686921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.687032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.687057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.687137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.687219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.687244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.687343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.687434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.687462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.687581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.687711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.687739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.687844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.687926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.687951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.688063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.688178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.688221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.688372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.688501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.688526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.688628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.688719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.688745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.688864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.688971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.688996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.689145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.689260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.689288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.689438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.689564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.689593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.689717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.689819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.689845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.689961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.690075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.690100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.690221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.690349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.690377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.690474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.690596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.690625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.690767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.690853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.690878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.690994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.691098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.691123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.691233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.691381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.691410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.691547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.691694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.691725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.691884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.692013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.692041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.692177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.692292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.692317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.692398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.692506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.692561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.692693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.692793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.692822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.692943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.693065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.693093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.693231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.693340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.693366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.693482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.693628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.693655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.693791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.693912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.693941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.694039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.694166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.694194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.694335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.694414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.694439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.694548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.694687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.694728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.164 qpair failed and we were unable to recover it. 00:27:27.164 [2024-12-08 02:29:54.694839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.164 [2024-12-08 02:29:54.694923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.694949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.695062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.695214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.695242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.695401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.695509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.695535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.695675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.695766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.695796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.695905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.696023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.696052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.696155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.696282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.696310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.696447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.696564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.696590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.696704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.696803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.696832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.696953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.697076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.697106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.697261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.697346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.697375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.697545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.697671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.697696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.697836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.697933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.697962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.698087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.698244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.698272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.698422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.698521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.698560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.698690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.698796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.698821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.698933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.699052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.699080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.699167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.699290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.699318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.699448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.699585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.699614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.699776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.699860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.699886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.700024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.700179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.700207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.700329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.700422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.700450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.700575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.700709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.700734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.700832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.700920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.700946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.701058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.701170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.701214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.701308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.701453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.701482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.701602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.701734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.701759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.701907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.702032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.702057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.702190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.702312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.702341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.702431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.702556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.702585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.702738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.702882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.702911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.703012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.703132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.703158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.703300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.703465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.703490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.703634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.703722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.703747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.703858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.703973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.703998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.704089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.704201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.704227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.704403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.704483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.704509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.704662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.704783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.165 [2024-12-08 02:29:54.704809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.165 qpair failed and we were unable to recover it. 00:27:27.165 [2024-12-08 02:29:54.704949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.705031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.705064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.705189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.705274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.705300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.705407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.705495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.705523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.705690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.705852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.705880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.706008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.706100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.706128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.706237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.706355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.706381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.706466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.706550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.706577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.706663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.706785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.706813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.706899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.706998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.707029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.707168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.707261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.707287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.707401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.707522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.707580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.707681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.707831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.707860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.707989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.708102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.708130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.708240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.708357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.708383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.708474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.708589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.708616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.708726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.708904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.708930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.709043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.709180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.709209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.709380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.709457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.709482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.709588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.709683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.709712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.709812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.709898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.709926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.710020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.710139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.710171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.710312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.710406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.710431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.710524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.710647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.710689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.710841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.711006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.711031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.711118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.711257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.711286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.711427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.711548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.711574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.711714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.711825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.711854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.712011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.712133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.712162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.712276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.712398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.712428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.712569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.712657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.712682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.712774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.712876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.712922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.713045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.713164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.713193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.713293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.713447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.713475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.713600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.713742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.713768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.713875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.713969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.713998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.714083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.714245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.714270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.714350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.714490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.714515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.714642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.714720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.714746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.714898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.714987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.715012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.715123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.715227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.715254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.166 qpair failed and we were unable to recover it. 00:27:27.166 [2024-12-08 02:29:54.715388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.166 [2024-12-08 02:29:54.715502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.715531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.715683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.715794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.715820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.715957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.716105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.716134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.716231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.716358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.716384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.716482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.716657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.716687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.716796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.716906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.716931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.717015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.717156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.717185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.717315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.717435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.717463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.717581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.717678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.717705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.717820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.717908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.717934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.718016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.718159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.718187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.718324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.718431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.718457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.718576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.718694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.718722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.718857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.718968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.718993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.719129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.719248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.719276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.719410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.719520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.719552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.719670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.719753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.719794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.719893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.720007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.720032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.720149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.720306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.720332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.720448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.720553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.720579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.720692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.720775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.720801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.720958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.721034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.721059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.721189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.721277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.721305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.721428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.721514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.721579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.721724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.721833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.721859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.721943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.722056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.722081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.722256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.722398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.722423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.722556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.722644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.722673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.722813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.722922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.722948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.723061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.723177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.723203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.723308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.723458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.723486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.723591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.723724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.723749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.723860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.723991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.724019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.724151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.724236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.724262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.724354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.724436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.724463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.724546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.724690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.724716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.724804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.724914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.724942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.725056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.725169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.725195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.725299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.725418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.725445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.725544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.725672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.725701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.725824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.725947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.725975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.726110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.726197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.726223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.167 qpair failed and we were unable to recover it. 00:27:27.167 [2024-12-08 02:29:54.726307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.167 [2024-12-08 02:29:54.726423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.726448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.726585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.726740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.726768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.726862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.726969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.726997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.727129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.727270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.727295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.727461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.727583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.727627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.727771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.727866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.727891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.728022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.728145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.728172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.728308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.728395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.728420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.728517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.728687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.728712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.728832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.729009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.729034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.729120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.729232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.729257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.729399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.729511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.729542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.729687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.729809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.729837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.729923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.730057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.730082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.730167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.730287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.730313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.730422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.730553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.730579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.730687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.730782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.730811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.730905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.731033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.731061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.731152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.731254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.731282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.731458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.731551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.731577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.731690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.731774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.731800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.731944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.732052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.732081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.732236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.732357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.732385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.732487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.732598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.732624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.732762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.732882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.732910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.733035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.733187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.733215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.733348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.733456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.733481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.733564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.733673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.733698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.733823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.733923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.733952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.734081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.734208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.734251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.734330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.734448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.734474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.734635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.734751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.734778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.734886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.734987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.735018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.735155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.735268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.735293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.735410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.735523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.735577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.735694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.735812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.735837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.735927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.736029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.736057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.736180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.736295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.736324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.736470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.736584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.736611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.736702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.736825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.736851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.736962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.737053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.737078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.168 qpair failed and we were unable to recover it. 00:27:27.168 [2024-12-08 02:29:54.737240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.168 [2024-12-08 02:29:54.737401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.737429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.737526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.737629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.737658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.737798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.737936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.737961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.738097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.738178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.738206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.738295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.738422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.738449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.738573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.738670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.738698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.738835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.738949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.738974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.739144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.739283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.739308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.739408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.739569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.739599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.739714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.739819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.739848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.739949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.740031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.740055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.740147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.740260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.740285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.740424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.740508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.740559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.740674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.740790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.740818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.741012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.741093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.741121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.741249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.741347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.741376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.741493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.741646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.741672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.741762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.741889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.741918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.742055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.742171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.742197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.742327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.742417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.742446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.742529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.742666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.742694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.742816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.742909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.742937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.743075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.743157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.743184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.743266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.743432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.743475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.743614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.743764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.743792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.743945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.744109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.744134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.744252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.744338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.744363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.744475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.744548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.744575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.744656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.744747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.744772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.744896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.745053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.745081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.745187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.745275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.745300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.745387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.745518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.745553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.745662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.745788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.745816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.745915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.746033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.746062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.746198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.746309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.746335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.746467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.746607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.746636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.746755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.746878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.746906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.169 qpair failed and we were unable to recover it. 00:27:27.169 [2024-12-08 02:29:54.746999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.169 [2024-12-08 02:29:54.747088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.747116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.747221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.747333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.747364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.747507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.747609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.747639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.747753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.747886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.747913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.748012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.748173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.748198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.748286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.748377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.748403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.748523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.748665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.748694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.748848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.748972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.749012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.749101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.749222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.749248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.749361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.749469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.749495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.749605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.749707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.749735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.749829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.749947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.749979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.750075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.750188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.750216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.750328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.750467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.750492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.750648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.750753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.750781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.750940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.751060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.751086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.751211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.751358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.751387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.751528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.751671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.751698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.751808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.751964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.751992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.752087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.752215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.752244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.752396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.752533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.752571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.752686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.752765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.752795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.752930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.753015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.753043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.753158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.753276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.753304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.753421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.753511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.753562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.753644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.753759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.753785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.753872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.754015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.754040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.754131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.754244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.754268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.754365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.754492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.754520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.754631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.754713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.754738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.754851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.754935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.754977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.755117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.755253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.755283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.755426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.755523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.755561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.755706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.755816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.755841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.755976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.756103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.756129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.756239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.756351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.756377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.756492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.756632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.756661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.756770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.756882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.756907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.757022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.757112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.757141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.757315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.757419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.757445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.757534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.757665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.757694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.757802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.757916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.757942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.758074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.758171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.170 [2024-12-08 02:29:54.758199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.170 qpair failed and we were unable to recover it. 00:27:27.170 [2024-12-08 02:29:54.758352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.758473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.758501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.758633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.758728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.758756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.758865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.758945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.758970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.759072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.759180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.759208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.759330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.759422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.759451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.759574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.759711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.759737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.759880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.759961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.759987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.760128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.760207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.760233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.760374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.760452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.760493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.760646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.760776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.760805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.760969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.761082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.761108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.761277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.761358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.761383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.761513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.761643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.761671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.761775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.761902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.761927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.762010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.762130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.762155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.762289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.762412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.762440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.762548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.762636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.762664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.762799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.762935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.762960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.763104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.763245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.763286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.763413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.763564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.763593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.763716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.763845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.763875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.764019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.764140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.764168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.764305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.764379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.764404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.764517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.764631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.764659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.764791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.764910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.764937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.765066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.765189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.765217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.765322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.765404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.765429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.765560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.765646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.765674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.765796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.765913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.765942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.766048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.766168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.766208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.766349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.766458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.766483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.766566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.766655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.766681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.766760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.766872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.766898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.767037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.767160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.767189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.767315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.767457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.767482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.767627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.767752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.767782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.767906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.768025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.768068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.768158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.768277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.768303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.768443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.768557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.768584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.768673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.768790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.768816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.768954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.769079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.769109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.171 qpair failed and we were unable to recover it. 00:27:27.171 [2024-12-08 02:29:54.769242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.171 [2024-12-08 02:29:54.769370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.769399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.769542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.769654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.769679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.769808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.769894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.769923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.770064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.770182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.770208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.770351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.770500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.770528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.770663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.770796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.770822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.770912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.771016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.771042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.771177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.771304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.771330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.771480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.771582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.771611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.771774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.771852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.771877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.771985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.772111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.772139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.772253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.772345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.772373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.772498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.772627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.772656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.772814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.772931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.772957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.773037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.773198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.773226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.773325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.773453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.773482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.773628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.773744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.773770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.773857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.773972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.773997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.774122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.774233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.774259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.774392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.774544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.774573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.774729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.774817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.774847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.774982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.775088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.775114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.775273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.775370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.775397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.775479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.775623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.775652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.775758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.775873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.775902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.776009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.776149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.776174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.776308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.776430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.776458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.776615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.776738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.776767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.776857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.776979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.777007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.777137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.777248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.777272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.777367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.777487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.777516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.777646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.777742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.777784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.777875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.777989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.778032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.778197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.778312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.778338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.778485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.778574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.778604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.778696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.778796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.778824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.778960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.779040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.779068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.172 qpair failed and we were unable to recover it. 00:27:27.172 [2024-12-08 02:29:54.779235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.172 [2024-12-08 02:29:54.779325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.779350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.779464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.779582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.779609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.779693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.779857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.779885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.780017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.780144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.780171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.780311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.780399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.780424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.780552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.780653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.780683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.780809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.780957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.780986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.781126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.781212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.781238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.781356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.781498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.781523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.781642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.781760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.781788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.781878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.781998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.782027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.782150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.782285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.782312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.782428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.782564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.782590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.782680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.782781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.782809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.782894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.783052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.783077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.783168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.783255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.783298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.783409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.783527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.783563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.783691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.783794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.783820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.783973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.784103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.784128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.784242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.784374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.784403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.784545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.784658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.784684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.784812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.784923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.784949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.785109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.785255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.785283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.785409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.785545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.785575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.785684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.785806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.785831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.785992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.786107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.786135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.786232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.786352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.786380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.786510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.786652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.786678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.786790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.786898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.786924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.787014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.787153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.787197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.787337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.787446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.787471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.787602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.787700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.787733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.787871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.787991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.788018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.788123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.788271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.788301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.788455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.788602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.788631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.788733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.788857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.788886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.789033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.789118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.789143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.789274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.789401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.789430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.789553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.789645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.789673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.789796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.789921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.789949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.790071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.790153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.790179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.173 [2024-12-08 02:29:54.790294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.790406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.173 [2024-12-08 02:29:54.790439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.173 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.790592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.790690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.790718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.790821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.790910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.790938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.791069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.791181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.791206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.791340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.791466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.791491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.791603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.791757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.791785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.791878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.792005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.792033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.792193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.792307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.792332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.792509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.792657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.792683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.792819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.792951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.792977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.793092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.793229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.793262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.793427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.793566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.793610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.793735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.793858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.793886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.794038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.794158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.794187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.794311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.794399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.794427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.794561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.794653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.794678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.794793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.794905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.794929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.795021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.795200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.795225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.795367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.795475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.795503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.795652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.795737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.795762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.795897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.795995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.796029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.796126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.796256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.796284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.796372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.796495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.796524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.796675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.796758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.796784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.796899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.797044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.797069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.797185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.797343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.797384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.797511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.797624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.797653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.797762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.797881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.797907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.798046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.798200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.798228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.798378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.798464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.798493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.798598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.798730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.798759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.798909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.798997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.799023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.799138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.799265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.799293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.799411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.799535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.799597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.799693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.799791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.799819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.799927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.800041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.800066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.800173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.800266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.800292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.800429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.800524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.800564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.800694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.800821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.800850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.800992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.801074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.801100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.174 qpair failed and we were unable to recover it. 00:27:27.174 [2024-12-08 02:29:54.801211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.174 [2024-12-08 02:29:54.801295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.801318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.801406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.801566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.801594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.801721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.801862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.801887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.801975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.802055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.802080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.802187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.802270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.802295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.802425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.802512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.802548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.802683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.802796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.802825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.802941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.803053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.803078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.803207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.803332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.803360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.803483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.803577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.803606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.803739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.803871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.803898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.804037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.804153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.804179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.804294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.804385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.804411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.804506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.804630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.804658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.804750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.804876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.804904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.805031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.805138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.805165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.805255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.805375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.805404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.805519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.805625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.805655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.805759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.805907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.805936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.806080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.806191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.806217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.806321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.806410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.806435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.806563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.806730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.806758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.806885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.807010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.807038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.807200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.807317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.807342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.807459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.807622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.807648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.807767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.807925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.807952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.808058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.808179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.808208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.808374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.808472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.808497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.808635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.808719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.808745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.808840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.808999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.809027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.809152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.809290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.809316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.809463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.809563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.809589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.809693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.809782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.809821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.809976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.810067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.810095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.810223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.810337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.810365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.810506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.810614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.810641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.810732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.810896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.810924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.175 qpair failed and we were unable to recover it. 00:27:27.175 [2024-12-08 02:29:54.811010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.811126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.175 [2024-12-08 02:29:54.811154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.811285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.811409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.811437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.811578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.811658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.811684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.811774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.811880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.811906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.812003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.812115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.812140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.812278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.812364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.812389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.812509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.812633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.812659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.812748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.812864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.812889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.812987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.813082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.813108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.813216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.813329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.813355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.813445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.813561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.813588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.813679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.813790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.813816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.813929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.814021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.814047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.814162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.814273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.814298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.814417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.814502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.814527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.814637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.814732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.814758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.814876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.814958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.815001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.815098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.815193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.815221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.815327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.815479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.815505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.815651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.815737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.815763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.815883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.815980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.816027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.816122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.816244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.816287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.816402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.816482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.816508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.816610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.816716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.816741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.816915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.817093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.817127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.817253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.817405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.817431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.817543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.817666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.817692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.817784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.817904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.817930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.818021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.818192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.818217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.818330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.818445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.818472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.818570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.818688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.818714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.818851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.818942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.818970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.819104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.819246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.819272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.819410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.819496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.819523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.819672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.819770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.819796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.819887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.820004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.820032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.820174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.820303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.820330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.820424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.820517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.820554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.820701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.820778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.820802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.820905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.821019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.821071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.821227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.821365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.821390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.176 qpair failed and we were unable to recover it. 00:27:27.176 [2024-12-08 02:29:54.821510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.176 [2024-12-08 02:29:54.821624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.821649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.821734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.821832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.821858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.821943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.822070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.822095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.822181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.822293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.822331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.822487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.822592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.822618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.822714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.822826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.822851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.822981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.823087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.823113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.823221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.823310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.823335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.823420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.823520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.823557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.823696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.823781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.823812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.823932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.824067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.824111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.824256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.824348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.824375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.824530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.824674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.824700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.824838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.824981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.825007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.825094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.825177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.825202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.825308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.825436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.825463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.825548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.825640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.825665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.825772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.825860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.825885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.826001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.826113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.826155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.826272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.826393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.826420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.826517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.826649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.826674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.826788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.826907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.826932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.827068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.827156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.827191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.827293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.827386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.827414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.827518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.827645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.827671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.827757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.827867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.827892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.827969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.828074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.828099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.828171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.828288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.828313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.828396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.828505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.828530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.828691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.828773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.828810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.828924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.829016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.829045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.829180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.829276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.829302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.829443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.829586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.829611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.829697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.829812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.829837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.829965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.830067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.830096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.830191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.830294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.830321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.830487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.830646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.830670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.830785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.830876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.830902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.831044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.831143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.831168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.831248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.831378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.831411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.831549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.831655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.831682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.177 qpair failed and we were unable to recover it. 00:27:27.177 [2024-12-08 02:29:54.831823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.831958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.177 [2024-12-08 02:29:54.832000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.832156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.832278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.832306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.832452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.832566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.832592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.832703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.832829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.832872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.832985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.833123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.833149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.833281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.833436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.833464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.833564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.833694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.833719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.833844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.833983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.834017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.834149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.834233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.834260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.834409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.834564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.834593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.834702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.834824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.834849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.834966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.835052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.835076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.835157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.835239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.835264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.835387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.835494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.835522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.835671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.835783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.835808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.835918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.836009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.836036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.836144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.836254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.836279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.836453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.836571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.836597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.836707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.836826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.836853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.837006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.837118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.837143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.837283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.837373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.837397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.837483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.837628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.837654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.837747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.837825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.837867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.837990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.838110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.838143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.838302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.838417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.838442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.838580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.838709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.838737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.838883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.838964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.838988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.839108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.839204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.839252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.839385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.839495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.839520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.839687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.839768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.839792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.839938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.840049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.840074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.840207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.840311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.840337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.840478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.840614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.840639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.840754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.840900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.840928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.841024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.841107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.841136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.841225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.841309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.841336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.841469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.841599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.841630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.178 qpair failed and we were unable to recover it. 00:27:27.178 [2024-12-08 02:29:54.841719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.841826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.178 [2024-12-08 02:29:54.841850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.841941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.842021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.842047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.842135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.842274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.842299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.842416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.842499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.842523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.842613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.842701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.842726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.842868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.842992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.843020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.843148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.843293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.843321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.843468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.843555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.843586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.843679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.843825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.843851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.843968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.844095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.844129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.844248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.844400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.844442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.844564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.844712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.844738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.844840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.844924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.844952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.845072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.845201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.845226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.845338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.845431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.845458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.845615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.845711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.845736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.845850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.845932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.845957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.846109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.846234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.846260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.846373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.846453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.846478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.846615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.846725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.846750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.846871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.847014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.847043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.847188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.847341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.847383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.847500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.847617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.847643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.847730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.847818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.847843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.847973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.848137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.848164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.848256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.848365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.848390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.848473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.848591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.848633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.848739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.848895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.848920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.849033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.849125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.849153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.849277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.849403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.849430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.849600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.849733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.849758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.849884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.849992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.850018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.850146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.850278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.850306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.850463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.850589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.850630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.850746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.850849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.850891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.851052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.851136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.851160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.851288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.851410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.851437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.851588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.851747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.851775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.851895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.851976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.852001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.852114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.852224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.852248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.852376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.852464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.852491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.852610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.852694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.179 [2024-12-08 02:29:54.852718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.179 qpair failed and we were unable to recover it. 00:27:27.179 [2024-12-08 02:29:54.852834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.852992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.853019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.853173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.853314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.853338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.853501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.853639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.853667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.853800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.853888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.853913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.854045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.854161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.854187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.854270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.854418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.854444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.854624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.854737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.854762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.854897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.854985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.855012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.855139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.855280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.855307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.855442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.855535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.855566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.855726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.855812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.855839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.855958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.856122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.856147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.856269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.856375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.856403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.856516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.856665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.856691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.856792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.856909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.856936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.857037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.857144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.857170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.857285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.857377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.857404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.857573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.857660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.857685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.857771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.857897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.857925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.858042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.858194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.858222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.858388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.858501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.858525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.858624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.858759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.858784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.858944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.859095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.859122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.859212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.859342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.859369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.859465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.859576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.859624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.859735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.859853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.859878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.859959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.860082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.860109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.860232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.860384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.860413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.860548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.860639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.860668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.860804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.860920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.860944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.861052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.861199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.861223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.861339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.861455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.861480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.861621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.861787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.861811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.861918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.862027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.862052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.862169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.862291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.862318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.862441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.862564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.862590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.862679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.862815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.862861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.862974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.863114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.863139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.863266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.863357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.863386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.863518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.863650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.863678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.863810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.863945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.863970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.864087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.864202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.180 [2024-12-08 02:29:54.864227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.180 qpair failed and we were unable to recover it. 00:27:27.180 [2024-12-08 02:29:54.864319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.864406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.864431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.864531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.864626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.864652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.864771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.864877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.864905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.865035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.865179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.865205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.865337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.865459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.865492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.865597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.865720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.865745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.865865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.865972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.865996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.866087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.866226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.866250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.866381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.866482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.866509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.866616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.866723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.866747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.866861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.866994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.867019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.867133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.867259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.867283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.867366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.867474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.867502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.867630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.867773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.867797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.867894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.868026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.868053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.868194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.868333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.868357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.868466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.868567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.868595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.868770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.868909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.868933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.869053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.869140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.869165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.869311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.869426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.869450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.869530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.869675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.869701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.869813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.869890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.869916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.869995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.870133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.870161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.870267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.870342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.870367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.870455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.870581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.870624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.870776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.870915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.870941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.871117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.871232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.871257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.871347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.871456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.871482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.871593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.871771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.871796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.871907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.872018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.872061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.872153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.872255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.872279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.872359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.872449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.872473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.872613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.872715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.872743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.872862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.872961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.872988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.873119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.873202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.873229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.873402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.873510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.873541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.873663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.873801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.873827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.873916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.874052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.181 [2024-12-08 02:29:54.874080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.181 qpair failed and we were unable to recover it. 00:27:27.181 [2024-12-08 02:29:54.874206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.874335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.874363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.874516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.874606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.874633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.874813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.874931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.874956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.875099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.875230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.875258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.875357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.875445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.875472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.875617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.875724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.875748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.875858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.875977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.876004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.876137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.876251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.876275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.876432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.876544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.876572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.876672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.876760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.876784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.876871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.876953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.876978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.877129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.877255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.877285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.877429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.877507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.877532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.877630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.877743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.877769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.877920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.878016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.878044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.878163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.878289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.878329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.878448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.878588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.878616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.878733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.878845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.878874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.878992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.879126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.879154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.879281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.879376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.879403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.879516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.879675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.879703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.879832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.879924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.879948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.880088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.880170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.880195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.880288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.880422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.880447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.880530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.880704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.880731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.880837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.880952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.880977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.881062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.881203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.881228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.881362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.881483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.881515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.881653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.881737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.881780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.881859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.881976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.882000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.882138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.882224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.882250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.882380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.882483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.882511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.882654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.882773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.882802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.882913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.883024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.883049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.883136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.883263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.883291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.883388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.883528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.883566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.883649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.883732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.883757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.883872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.883981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.884021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.884119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.884264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.884290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.884367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.884453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.884477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.884573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.884665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.884691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.182 [2024-12-08 02:29:54.884773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.884879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.182 [2024-12-08 02:29:54.884904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.182 qpair failed and we were unable to recover it. 00:27:27.183 [2024-12-08 02:29:54.885023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.885147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.885171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-12-08 02:29:54.885285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.885402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.885426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-12-08 02:29:54.885549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.885660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.885685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-12-08 02:29:54.885776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.885855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.885880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-12-08 02:29:54.885969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.886082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.886108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-12-08 02:29:54.886201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.886308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.886333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-12-08 02:29:54.886419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.886505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.886532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-12-08 02:29:54.886658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.886797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.886824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-12-08 02:29:54.886913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.887008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.887034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-12-08 02:29:54.887145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.887221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.887246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-12-08 02:29:54.887333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.887455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.887480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-12-08 02:29:54.887566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.887654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.887680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-12-08 02:29:54.887754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.887838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.887863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-12-08 02:29:54.887977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.888062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.888087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-12-08 02:29:54.888192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.888335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.888360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-12-08 02:29:54.888471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.888579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.888604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-12-08 02:29:54.888697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.888807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.888832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-12-08 02:29:54.888909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.889022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.889047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-12-08 02:29:54.889171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.889310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.889336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-12-08 02:29:54.889458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.889555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.889581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-12-08 02:29:54.889671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.889757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.183 [2024-12-08 02:29:54.889782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.183 qpair failed and we were unable to recover it. 00:27:27.183 [2024-12-08 02:29:54.889896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.488 [2024-12-08 02:29:54.890002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.488 [2024-12-08 02:29:54.890028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.488 qpair failed and we were unable to recover it. 00:27:27.488 [2024-12-08 02:29:54.890117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.488 [2024-12-08 02:29:54.890229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.488 [2024-12-08 02:29:54.890254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.488 qpair failed and we were unable to recover it. 00:27:27.488 [2024-12-08 02:29:54.890398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.488 [2024-12-08 02:29:54.890479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.488 [2024-12-08 02:29:54.890504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.488 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.890606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.890711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.890737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.890859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.890962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.890987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.891100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.891242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.891267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.891383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.891459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.891485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.891584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.891656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.891682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.891766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.891876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.891901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.891987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.892100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.892125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.892204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.892322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.892347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.892431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.892505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.892530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.892647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.892724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.892749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.892841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.892979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.893005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.893089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.893195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.893220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.893359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.893468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.893498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.893598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.893684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.893709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.893790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.893895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.893921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.894007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.894118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.894143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.894218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.894323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.894347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.894427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.894509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.894534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.894652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.894734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.894759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.894871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.894975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.895000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.895088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.895203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.895229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.895320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.895427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.895453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.895582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.895666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.895692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.895843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.895924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.895948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.896028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.896139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.896164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.896238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.896334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.896359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.896435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.896554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.896580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.896662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.896776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.896802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.896882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.896993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.897018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.897129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.897702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.897733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.897878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.898015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.898041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.898142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.898234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.898260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.898405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.898550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.898593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.898702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.898818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.898844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.898977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.899060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.899087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.899200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.899313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.899339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.899495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.899584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.899610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.899704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.899778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.899802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.899886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.899963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.899989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.900110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.900187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.900212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.489 qpair failed and we were unable to recover it. 00:27:27.489 [2024-12-08 02:29:54.900348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.489 [2024-12-08 02:29:54.900470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.900499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.900649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.900736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.900763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.900886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.900970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.900996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.901136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.901219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.901244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.901397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.901549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.901575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.901659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.901769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.901794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.901926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.902059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.902084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.902177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.902253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.902279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.902387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.902529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.902580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.902664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.902759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.902784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.902902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.902984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.903008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.903096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.903211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.903236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.903321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.903447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.903475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.903597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.903688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.903713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.903827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.904019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.904059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.904173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.904336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.904364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.904449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.904552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.904581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.904679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.904761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.904787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.904969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.905089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.905121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.905209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.905362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.905387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.905479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.905567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.905594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.905690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.905801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.905843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.905966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.906125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.906151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.906234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.906346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.906376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.906493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.906665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.906692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.906774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.906907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.906933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.907028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.907142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.907167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.907284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.907362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.907387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.907484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.907618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.907645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.907738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.907823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.907849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.907938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.908052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.908080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.908198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.908308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.908336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.908425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.908531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.908566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.908646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.908723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.908748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.908894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.908985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.909013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.909114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.909254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.909279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.909397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.909472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.909498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.909653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.909743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.909769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.909909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.909986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.910030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.910193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.910305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.490 [2024-12-08 02:29:54.910330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.490 qpair failed and we were unable to recover it. 00:27:27.490 [2024-12-08 02:29:54.910467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.910588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.910613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.910729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.910928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.910952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.911082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.911202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.911230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.911340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.911447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.911474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.911596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.911707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.911735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.911877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.911973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.911998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.912128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.912216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.912244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.912341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.912494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.912522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.912660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.912770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.912795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.912882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.913044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.913077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.913243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.913327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.913355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.913458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.913583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.913609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.913717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.913843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.913872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.913965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.914080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.914108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.914210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.914340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.914366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.914469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.914626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.914652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.914744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.914829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.914872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.914992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.915143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.915171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.915259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.915356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.915385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.915535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.915708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.915734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.915851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.915968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.915997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.916130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.916216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.916242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.916353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.916483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.916511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.916664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.916750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.916776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.916856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.916989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.917018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.917124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.917242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.917269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.917346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.917461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.917485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.917606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.917714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.917739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.917855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.917963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.917988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.918065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.918202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.918244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.918464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.918572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.918601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.918743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.918860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.918885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.919020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.919100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.919128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.919254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.919358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.919383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.919469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.919588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.919621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.919721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.919810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.919836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.919920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.920078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.920121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.920243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.920377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.920405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.920542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.920645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.920679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.920784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.920869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.920894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.491 [2024-12-08 02:29:54.920999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.921134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.491 [2024-12-08 02:29:54.921168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.491 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.921273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.921366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.921395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.921489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.921641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.921667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.921770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.921890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.921916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.922022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.922145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.922174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.922282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.922411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.922439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.922606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.922688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.922715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.922834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.922941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.922982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.923125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.923214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.923242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.923337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.923417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.923444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.923554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.923649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.923676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.923774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.923878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.923910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.923998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.924132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.924166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.924292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.924420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.924449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.924543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.924677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.924702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.924799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.924936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.924961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.925107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.925192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.925217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.925305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.925417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.925443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.925586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.925731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.925759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.925872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.925976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.926001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.926126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.926234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.926260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.926339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.926468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.926496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.926639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.926724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.926749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.926888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.926985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.927012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.927128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.927215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.927243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.927348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.927469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.927496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.927645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.927759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.927784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.927933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.928048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.928074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.928203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.928323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.928350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.928447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.928614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.928641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.928730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.928875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.928901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.928995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.929082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.929111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.929252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.929387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.929413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.929590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.929706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.929730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.929837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.929950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.929977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.930105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.930204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.930228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.930351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.930427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.930452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.930544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.930661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.930687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.930784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.930870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.930895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.931032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.931158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.931182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.931357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.931479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.931507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.931629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.931714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.931739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.931878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.932014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.932061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.932257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.932378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.932405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.932506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.932621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.932646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.932764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.932856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.932900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.933032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.933126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.933154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.933265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.933359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.933387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.933512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.933632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.933657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.492 qpair failed and we were unable to recover it. 00:27:27.492 [2024-12-08 02:29:54.933777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.933916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.492 [2024-12-08 02:29:54.933947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.934035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.934129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.934157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.934256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.934362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.934387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.934512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.934683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.934707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.934865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.934981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.935013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.935111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.935236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.935265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.935379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.935510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.935552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.935674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.935767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.935791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.935907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.936018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.936061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.936929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.937086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.937114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.937259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.937373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.937398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.937574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.937700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.937725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.937877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.937987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.938014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.938162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.938309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.938334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.938464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.938583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.938629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.938776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.938898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.938929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.939056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.939191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.939218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.939375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.939527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.939562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.939696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.939834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.939858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.939981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.940118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.940147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.940245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.940380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.940408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.940530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.940652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.940679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.940771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.940887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.940912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.941020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.941111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.941136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.941250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.941336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.941361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.941469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.941548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.941573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.941694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.941836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.941861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.941977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.942066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.942093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.942227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.942336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.942364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.942474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.942580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.942605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.942693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.942814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.942841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.942993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.943088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.943115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.943216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.943343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.943370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.943499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.943623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.943648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.943733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.943845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.943869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.943991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.944120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.944147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.944243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.944372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.944412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.944504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.944610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.944643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.944743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.944844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.944868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.944982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.945114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.945148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.945274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.945375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.945403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.945526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.945682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.945707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.945800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.945932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.945959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.946053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.946178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.946206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.946305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.946425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.946455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.946578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.946675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.946700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.946802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.946930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.946958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.947113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.947235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.947263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.947387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.947524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.947555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.947650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.947763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.947789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.947956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.948101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.948129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.948253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.948375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.948404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.948504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.948644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.948671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.948758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.948868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.948894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.949057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.949223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.949250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.493 qpair failed and we were unable to recover it. 00:27:27.493 [2024-12-08 02:29:54.949386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.493 [2024-12-08 02:29:54.949527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.949560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.949651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.949739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.949764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.949841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.949952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.949982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.950066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.950174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.950199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.950319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.950402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.950427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.950571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.950679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.950704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.950790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.950871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.950914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.951144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.951313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.951341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.951437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.951527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.951562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.951674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.951757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.951783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.951874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.951981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.952022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.952133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.952269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.952298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.952425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.952576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.952616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.952739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.952853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.952878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.952981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.953098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.953126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.953254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.953405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.953433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.953571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.953679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.953704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.953814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.953931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.953979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.954153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.954256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.954284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.954451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.954582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.954608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.954704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.954817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.954858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.954962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.955093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.955122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.955223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.955311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.955347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.955460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.955602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.955629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.955728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.955806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.955847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.955941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.956096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.956125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.956272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.956431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.956459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.956607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.956701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.956726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.956874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.956985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.957010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.957127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.957286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.957312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.957421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.957533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.957565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.957650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.957741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.957767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.957869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.957953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.957977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.958066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.958211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.958237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.958322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.958431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.958457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.958549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.958636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.958660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.958744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.958896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.958922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.959010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.959129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.959155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.959266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.959380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.959405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.959524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.959648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.959673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.959768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.959856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.959881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.960033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.960165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.960192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.960313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.960398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.960423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.960528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.960654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.960679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.960787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.960864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.960888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.960999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.961109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.961134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.961243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.961344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.961369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.961480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.961592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.961618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.961736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.961849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.961875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.961982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.962069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.962094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.962174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.962257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.962282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.494 [2024-12-08 02:29:54.962378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.962489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.494 [2024-12-08 02:29:54.962514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.494 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.962635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.962743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.962774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.962911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.963002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.963035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.963126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.963221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.963255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.963451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.963530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.963567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.963760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.963913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.963942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.964102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.964221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.964249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.964443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.964563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.964590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.964705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.964801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.964828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.964959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.965092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.965119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.965244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.965336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.965364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.965456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.965581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.965608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.965699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.965814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.965855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.965974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.966064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.966092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.966193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.966310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.966336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.966416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.966550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.966578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.966705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.966817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.966844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.966983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.967067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.967093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.967209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.967307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.967338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.967445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.967558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.967584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.967677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.967761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.967788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.967886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.968007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.968035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.968128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.968275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.968311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.968427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.968520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.968554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.968650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.968767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.968794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.968891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.969005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.969030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.969174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.969256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.969282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.969370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.969464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.969491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.969620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.969704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.969731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.969872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.969985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.970011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.970125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.970219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.970246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.970377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.970498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.970524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.970629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.970746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.970773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.970909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.970998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.971024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.971135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.971249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.971274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.971406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.971490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.971515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.971648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.971742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.971772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.971870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.972026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.972053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.972167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.972303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.972328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.972413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.972527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.972562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.972644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.972733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.972758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.972914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.973035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.973061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.973167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.973245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.973270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.973390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.973495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.973520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.973641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.973783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.973808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.973894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.974031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.974056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.974136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.974234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.974260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.974349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.974430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.974455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.974568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.974682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.974707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.974807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.974886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.974911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.975055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.975180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.975205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.975291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.975434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.975458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.975570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.975659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.975686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.975807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.975964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.976000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.495 [2024-12-08 02:29:54.976132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.976249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.495 [2024-12-08 02:29:54.976275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.495 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.976422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.977159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.977190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.977318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.977459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.977485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.977584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.977674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.977701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.977798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.977941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.977967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.978053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.978137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.978164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.978283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.978377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.978403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.978520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.978657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.978682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.978768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.978880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.978905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.979049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.979129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.979170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.979315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.979398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.979423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.979548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.979620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.979645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.979768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.979890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.979918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.980003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.980124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.980152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.980276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.980400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.980428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.980551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.980659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.980685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.980775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.980866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.980893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.981035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.981116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.981160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.981266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.981366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.981395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.981513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.981616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.981642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.981733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.981827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.981856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.981972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.982088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.982116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.982286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.982383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.982412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.982519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.982643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.982669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.982763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.982894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.982923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.983021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.983170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.983198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.983300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.983400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.983429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.983524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.983647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.983673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.983778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.983939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.983988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.984080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.984165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.984191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.984340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.984423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.984449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.984557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.984645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.984671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.984771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.984891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.984918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.985009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.985121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.985147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.985240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.985359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.985385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.985477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.985580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.985605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.985690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.985773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.985798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.985946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.986064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.986090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.986195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.986275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.986301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.986389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.986467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.986492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.986592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.986672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.986698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.986790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.986910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.986937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.987055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.987151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.987176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.987262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.987404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.987429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.987570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.987654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.987679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.987772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.987895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.987922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.988066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.988179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.988205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.988321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.988403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.988429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.988520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.988617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.988644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.988749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.988888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.988917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.989053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.989164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.989191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.989291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.989375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.989400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.496 qpair failed and we were unable to recover it. 00:27:27.496 [2024-12-08 02:29:54.989481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.989602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.496 [2024-12-08 02:29:54.989632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.989729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.989822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.989866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.990025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.990139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.990164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.990261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.990343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.990369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.990456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.990544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.990588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.990697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.990803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.990841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.990977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.991081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.991106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.991245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.991346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.991375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.991468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.991592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.991620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.991725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.991824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.991851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.991947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.992052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.992077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.992223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.992316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.992357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.992443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.992553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.992578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.992691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.992795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.992823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.992959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.993054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.993082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.993169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.993250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.993276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.993433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.993546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.993573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.993666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.993744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.993774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.993908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.993998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.994026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.994117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.994208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.994235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.994359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.994452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.994480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.994601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.994689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.994715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.994813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.994959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.994987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.995113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.995235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.995263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.995393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.995516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.995566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.995687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.995769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.995794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.995907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.996081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.996114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.996230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.996372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.996402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.996516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.996613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.996639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.996731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.996820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.996871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.996973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.997095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.997124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.997249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.997359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.997388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.997495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.997622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.997649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.997740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.997828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.997874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.998004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.998097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.998124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.998236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.998343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.998376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.998479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.998601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.998626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.998721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.998808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.998834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.998958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.999042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.999075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.999168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.999319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:54.999349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:54.999442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:55.000279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:55.000314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:55.000461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:55.000607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:55.000633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:55.000716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:55.000808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:55.000861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:55.000975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:55.001095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:55.001121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:55.001203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:55.001310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:55.001340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:55.001476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:55.001615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:55.001642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:55.001724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:55.001811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:55.001835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:55.001920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:55.002027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:55.002053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:55.002148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:55.002331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:55.002374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:55.002475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:55.002568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:55.002610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:55.002703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:55.002790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:55.002819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.497 qpair failed and we were unable to recover it. 00:27:27.497 [2024-12-08 02:29:55.002909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:55.003045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.497 [2024-12-08 02:29:55.003071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.003175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.003315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.003340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.003444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.003533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.003583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.003692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.003776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.003803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.003906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.004037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.004065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.004167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.004282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.004310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.004406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.004498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.004533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.004666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.004756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.004785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.004936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.005058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.005087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.005190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.005291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.005320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.005452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.005554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.005580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.005667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.005754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.005780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.005862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.005950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.005975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.006147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.006272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.006301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.006420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.006509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.006558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.006662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.006759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.006793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.006873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.006971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.006997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.007090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.007190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.007219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.007366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.007534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.007587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.007671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.007761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.007786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.007890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.008005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.008031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.008141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.008275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.008304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.008449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.008590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.008617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.008697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.008772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.008798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.008928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.009022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.009052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.009139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.009234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.009262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.009381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.009487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.009518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.009618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.009708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.009738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.009893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.010012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.010057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.010225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.010318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.010346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.010471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.010606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.010632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.010721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.010813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.010839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.010962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.011053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.011079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.011192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.011322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.011351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.011446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.011584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.011613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.011698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.011785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.011811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.011911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.012052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.012084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.012237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.012370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.012396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.012533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.012630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.012656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.012749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.012872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.012903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.013006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.013192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.013218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.013311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.013431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.013457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.013597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.013686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.013713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.013799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.013890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.013915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.014028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.014155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.014181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.014266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.014385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.014412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.014505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.014616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.014641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.014734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.014817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.014845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.014974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.015089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.015115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.015201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.015293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.015319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.015401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.015498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.015522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.015629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.015721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.015747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.015844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.015993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.016018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.016132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.016225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.016250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.016366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.016477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.016502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.498 [2024-12-08 02:29:55.016608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.016693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.498 [2024-12-08 02:29:55.016718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.498 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.016809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.016890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.016919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.017005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.017123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.017149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.017246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.017323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.017348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.017435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.017521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.017557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.017658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.017738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.017763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.017867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.017989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.018014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.018135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.018222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.018247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.018364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.018448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.018473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.018608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.018696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.018721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.018810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.018902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.018927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.019041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.019118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.019143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.019234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.019321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.019346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.019462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.019586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.019613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.019703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.019785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.019810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.019889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.019999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.020024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.020112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.020228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.020255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.020350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.020439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.020465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.020587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.020674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.020698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.020788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.020908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.020934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.021067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.021155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.021180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.021294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.021388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.021413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.021499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.021584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.021610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.021713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.021793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.021819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.021912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.022026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.022052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.022190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.022272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.022298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.022409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.022524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.022558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.022652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.022737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.022762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.022884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.022998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.023024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.023119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.023231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.023256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.023352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.023434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.023460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.023591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.023675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.023700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.023790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.023883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.023908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.024027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.024121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.024147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.024260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.024345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.024371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.024464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.024550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.024576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.024674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.024755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.024780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.024881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.025005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.025032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.025140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.025299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.025327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.025439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.025516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.025560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.025663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.025745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.025777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.025869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.025956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.025981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.026098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.026225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.026261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.026347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.026496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.026527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.026635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.026716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.026741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.026906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.026989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.027017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.027168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.027297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.027326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.027436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.027560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.027604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.027695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.027783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.027809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.027913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.028086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.028116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.028267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.028381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.028413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.028526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.028623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.028648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.499 qpair failed and we were unable to recover it. 00:27:27.499 [2024-12-08 02:29:55.028741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.499 [2024-12-08 02:29:55.028856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.028886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.029010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.029163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.029198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.029296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.029425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.029453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.029607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.029698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.029724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.029808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.029991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.030026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.030173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.030311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.030347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.030470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.030582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.030608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.030700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.030790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.030815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.031000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.031136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.031166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.031286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.031417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.031446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.031543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.031650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.031676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.031762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.031897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.031925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.032049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.032168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.032196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.032312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.032411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.032457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.032592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.032686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.032711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.032799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.032962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.032991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.033153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.033240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.033268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.033359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.033439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.033466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.033559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.033672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.033705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.033792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.033905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.033935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.034109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.034254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.034284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.034404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.034488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.034530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.034632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.034730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.034755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.034840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.034983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.035010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.035140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.035278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.035308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.035428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.035615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.035642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.035738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.035818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.035844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.036023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.036122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.036150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.036280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.036392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.036421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.036553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.036665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.036691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.036774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.036957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.036983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.037123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.037278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.037305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.037479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.037601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.037627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.037719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.037802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.037828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.038931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.039067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.039097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.039240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.039416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.039458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.039606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.039702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.039728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.039843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.039965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.039993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.040161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.040302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.040329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.040488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.040611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.040637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.040727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.040814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.040840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.040981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.041058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.041083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.041167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.041244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.041269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.041420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.041502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.041527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.041674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.041782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.041812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.041947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.042105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.042133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.042253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.042348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.042378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.042515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.042636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.042663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.042746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.042881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.042911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.043083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.043174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.043205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.043307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.043414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.043444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.043598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.043689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.043715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.043799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.043949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.043978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.044116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.044201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.044228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.044343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.044471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.044502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.500 qpair failed and we were unable to recover it. 00:27:27.500 [2024-12-08 02:29:55.044640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.500 [2024-12-08 02:29:55.044773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.044802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.044955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.045106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.045154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.045261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.045407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.045432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.045564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.045709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.045735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.045854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.045961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.045986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.046072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.046244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.046269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.046352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.046465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.046490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.046595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.046690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.046722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.046814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.046954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.046987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.047108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.047197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.047222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.047337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.047465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.047494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.047660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.047750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.047775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.047919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.048043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.048071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.048159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.048284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.048312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.048414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.048559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.048604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.048716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.048810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.048854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.048980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.049144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.049187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.049307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.049437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.049471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.049583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.049672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.049698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.049787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.049893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.049918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.050010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.050178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.050222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.050342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.050455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.050499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.050610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.050721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.050747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.050868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.051007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.051034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.051185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.051267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.051296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.051385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.051490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.051519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.051637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.051728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.051754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.051858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.051992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.052027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.052156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.052237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.052264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.052384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.052500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.052525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.052626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.052712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.052737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.052870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.052977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.053003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.053145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.053273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.053298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.053391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.053473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.053498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.053631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.053709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.053735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.053813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.053931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.053957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.054069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.054157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.054182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.054268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.054360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.054389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.054501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.054602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.054628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.054714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.054806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.054831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.054939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.055055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.055081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.055194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.055311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.055336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.055423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.055499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.055525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.055632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.055717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.055743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.055828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.055919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.055944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.056030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.056112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.056137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.056253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.056330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.056356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.056440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.056519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.056551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.056647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.056733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.056758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.056846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.056951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.056977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.057085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.057163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.057188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.057299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.057384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.501 [2024-12-08 02:29:55.057410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.501 qpair failed and we were unable to recover it. 00:27:27.501 [2024-12-08 02:29:55.057497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.057585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.057611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.057704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.057789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.057814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.057906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.057981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.058006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.058087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.058169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.058195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.058337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.058456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.058482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.058582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.058666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.058691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.058780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.058871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.058897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.059009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.059142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.059167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.059309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.059402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.059428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.059535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.059640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.059667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.059758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.059865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.059890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.059973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.060112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.060138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.060233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.060345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.060371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.060485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.060601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.060628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.060739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.060861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.060887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.061030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.061141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.061166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.061284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.061368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.061395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.061513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.061596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.061623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.061738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.061829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.061854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.061938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.062017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.062042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.062154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.062257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.062283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.062378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.062468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.062494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.062578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.062691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.062718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.062869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.062983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.063008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.063090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.063178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.063220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.063359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.063476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.063501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.063623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.063709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.063735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.063823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.063977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.064001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.064092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.064201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.064226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.064338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.064451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.064477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.064572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.064684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.064710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.064818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.064935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.064960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.065076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.065160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.065185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.065305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.065415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.065441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.065564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.065648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.065673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.065788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.065876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.065901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.066017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.066122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.066147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.066260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.066373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.066398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.066481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.066599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.066626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.066708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.066787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.066812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.066907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.066998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.067024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.067167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.067282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.067309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.067393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.067503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.067528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.067648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.067765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.067790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.067871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.067978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.068004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.068095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.068204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.068230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.068349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.068473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.068499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.068636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.068721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.068747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.068881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.068962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.068987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.069067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.069145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.069171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.069319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.069400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.069426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.069549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.069628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.069654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.069764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.069861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.069887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.069996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.070139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.070165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.502 [2024-12-08 02:29:55.070279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.070369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.502 [2024-12-08 02:29:55.070411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.502 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.070553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.070640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.070666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.070807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.070891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.070926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.071050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.071166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.071191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.071310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.071421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.071446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.071561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.071648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.071674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.071764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.071881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.071906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.071992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.072070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.072096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.072234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.072312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.072337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.072427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.072547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.072574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.072661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.072775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.072801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.072890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.073030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.073055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.073173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.073248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.073274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.073365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.073449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.073476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.073568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.073646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.073672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.073760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.073840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.073866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.073977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.074051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.074077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.074189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.074302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.074328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.074443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.074531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.074568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.074651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.074740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.074766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.074883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.074963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.074988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.075101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.075181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.075207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.075289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.075431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.075457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.075571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.075654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.075679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.075793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.075882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.075907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.076030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.076133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.076159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.076248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.076356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.076383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.076528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.076664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.076690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.076782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.076903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.076928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.077042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.077157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.077183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.077302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.077443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.077469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.077571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.077658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.077684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.077772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.077873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.077899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.077989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.078107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.078133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.078232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.078339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.078365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.078518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.078639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.078665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.078744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.078874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.078900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.078988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.079097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.079123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.079238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.079332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.079357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.079466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.079595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.079622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.079735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.079843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.079869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.079948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.080030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.080055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.080137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.080281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.080307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.080419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.080499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.080524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.080610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.080696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.080721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.080833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.080940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.080966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.081078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.081188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.081215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.081303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.081421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.081447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.081553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.081664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.081690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.081800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.081883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.081909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.082039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.082153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.082179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.082288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.082372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.082397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.082510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.082641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.082667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.082754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.082849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.082874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.503 qpair failed and we were unable to recover it. 00:27:27.503 [2024-12-08 02:29:55.083002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.503 [2024-12-08 02:29:55.083114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.083140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.083240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.083363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.083389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.083475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.083596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.083622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.083733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.083816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.083841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.083929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.084013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.084039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.084151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.084258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.084283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.084406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.084520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.084571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.084654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.084764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.084790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.084906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.085030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.085059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.085209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.085326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.085352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.085445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.085566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.085592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.085671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.085784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.085809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.085890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.086008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.086034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.086146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.086254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.086280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.086385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.086503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.086528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.086629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.086737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.086763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.086861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.086936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.086961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.087072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.087214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.087240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.087375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.087488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.087518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.087611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.087706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.087731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.087852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.087931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.087957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.088082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.088198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.088224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.088312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.088399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.088425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.088513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.088648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.088674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.088765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.088849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.088875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.089019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.089135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.089161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.089259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.089334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.089360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.089438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.089562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.089589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.089670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.089749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.089779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.089903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.090017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.090043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.090163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.090254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.090279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.090416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.090541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.090567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.090678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.090793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.090818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.090936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.091052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.091077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.091191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.091301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.091327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.091447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.091555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.091581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.091696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.091778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.091804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.091885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.091978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.092003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.092088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.092176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.092205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.092339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.092459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.092486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.092667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.092860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.092886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.093020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.093169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.093197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.093322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.093446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.093475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.093598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.093683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.093709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.093854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.093948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.093976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.094103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.094191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.094218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.094359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.094566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.094591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.094706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.094816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.094845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.094941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.095029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.095058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.095202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.095313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.095342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.095471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.095616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.095642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.504 [2024-12-08 02:29:55.095765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.095859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-12-08 02:29:55.095889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.504 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.096048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.096138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.096166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.096262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.096418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.096444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.096560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.096674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.096700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.096867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.096991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.097033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.097192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.097292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.097317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.097433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.097569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.097596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.097710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.097795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.097829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.097929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.098034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.098060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.098181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.098313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.098342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.098435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.098589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.098615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.098736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.098821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.098847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.098942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.099053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.099082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.099164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.099286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.099315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.099442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.099544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.099590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.099740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.099871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.099899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.100041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.100132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.100160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.100292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.100376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.100403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.100578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.100689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.100723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.100834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.100945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.100970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.101109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.101194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.101219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.101307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.101447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.101475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.101578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.101656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.101682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.101810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.101916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.101941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.102069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.102207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.102233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.102355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.102466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.102509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.102678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.102790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.102816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.102899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.103016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.103041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.103153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.103285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.103327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.103465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.103557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.103601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.103721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.103859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.103888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.104012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.104103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.104130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.104279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.104409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.104437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.104579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.104693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.104718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.104829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.105008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.105033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.105176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.105324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.105349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.105493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.105680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.105707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.105791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.105896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.105921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.106013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.106152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.106177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.106318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.106417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.106442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.106554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.106672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.106697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.106823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.106914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.106939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.107027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.107136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.107162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.107284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.107371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.107396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.107486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.107606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.107632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.107716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.107806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.107831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.107912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.108044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.108073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.108183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.108305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.108330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.108444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.108566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.108610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.108693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.108810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.108835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.108944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.109047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.109076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.109242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.109323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.109348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.109507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.109645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.109673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.109785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.109901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.109927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.505 qpair failed and we were unable to recover it. 00:27:27.505 [2024-12-08 02:29:55.110043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.110184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-12-08 02:29:55.110209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.110333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.110440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.110465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.110619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.110772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.110798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.110936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.111066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.111091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.111223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.111351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.111380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.111501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.111607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.111633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.111749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.111846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.111873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.111972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.112089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.112116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.112261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.112374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.112402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.112496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.112586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.112612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.112701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.112786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.112811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.112914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.113037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.113062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.113170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.113307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.113332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.113502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.113609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.113635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.113755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.113839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.113879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.113968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.114095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.114131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.114218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.114304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.114329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.114456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.114629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.114654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.114773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.114890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.114914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.115020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.115192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.115216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.115294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.115455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.115481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.115607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.115715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.115740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.115842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.116005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.116029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.116151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.116236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.116276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.116407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.116543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.116586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.116666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.116770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.116794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.116912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.117022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.117046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.117143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.117269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.117294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.117412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.117541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.117585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.117724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.117809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.117844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.117964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.118079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.118104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.118226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.118313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.118340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.118437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.118612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.118638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.118779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.118905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.118946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.119053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.119193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.119222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.119368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.119457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.119485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.119585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.119730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.119755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.119867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.119970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.119995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.120145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.120276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.120301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.120416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.120579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.120607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.120701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.120820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.120847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.120951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.121068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.121093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.121195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.121326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.121351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.121497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.121612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.121639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.121750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.121868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.121894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.122031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.122113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.122139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.122273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.122365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.122391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.122502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.122659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.122685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.122778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.122883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.122927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.123047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.123140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.123166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.123253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.123367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.123396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.123494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.123644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-12-08 02:29:55.123672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.506 qpair failed and we were unable to recover it. 00:27:27.506 [2024-12-08 02:29:55.123814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.123926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.123955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.124125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.124265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.124315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.124462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.124601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.124631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.124725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.124858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.124887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.125040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.125176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.125203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.125306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.125431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.125457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.125556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.125685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.125711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.125791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.125902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.125927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.126085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.126222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.126249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.126437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.126521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.126560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.126698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.126820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.126853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.127010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.127165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.127192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.127314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.127415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.127447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.127581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.127691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.127717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.127822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.127931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.127957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.128062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.128181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.128208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.128298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.128431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.128456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.128599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.128727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.128753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.128921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.129079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.129120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.129259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.129373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.129399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.129483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.129661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.129690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.129833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.129951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.129976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.130134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.130221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.130268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.130387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.130506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.130533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.130696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.130776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.130801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.130901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.131018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.131045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.131167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.131267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.131292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.131430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.131547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.131590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.131698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.131786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.131811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.131929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.132040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.132064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.132196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.132316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.132347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.132500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.132679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.132723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.132850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.132945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.132978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.133113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.133230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.133256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.133368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.133455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.133481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.133618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.133751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.133777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.133906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.134055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.134082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.134189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.134287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.134312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.134432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.134580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.134607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.134749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.134843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.134871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.135057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.135194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.135223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.135342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.135445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.135487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.135577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.135767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.135793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.135939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.136110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.136138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.136243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.136405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.136430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.136565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.136679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.136704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.136853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.137009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.137054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.137239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.137348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.137373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.137530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.137675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.137703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.137859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.137982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.138008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.138125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.138284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.138311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.138415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.138575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.138601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.138732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.138871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.138899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.139027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.139127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-12-08 02:29:55.139154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.507 qpair failed and we were unable to recover it. 00:27:27.507 [2024-12-08 02:29:55.139277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.139403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.139430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.139531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.139668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.139694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.139814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.139940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.139965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.140079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.140191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.140216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.140346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.140472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.140499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.140638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.140757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.140783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.140914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.141052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.141078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.141201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.141308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.141334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.141433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.141577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.141603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.141693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.141801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.141826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.141937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.142078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.142103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.142256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.142375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.142416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.142557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.142673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.142699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.142822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.142961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.142988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.143094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.143251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.143277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.143417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.143502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.143529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.143641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.143726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.143751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.143887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.143967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.143992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.144080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.144187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.144212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.144320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.144439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.144466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.144585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.144676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.144702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.144811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.144969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.144993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.145069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.145151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.145177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.145320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.145448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.145472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.145624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.145740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.145767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.145934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.146077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.146104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.146265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.146394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.146421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.146591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.146678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.146703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.146830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.146920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.146947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.147038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.147150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.147177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.147274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.147391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.147418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.147517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.147633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.147659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.147779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.147911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.147938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.148056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.148149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.148176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.148295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.148387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.148414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.148562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.148691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.148717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.148853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.148944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.148972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.149071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.149162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.149188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.149361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.149485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.149511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.149637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.149751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.149776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.149904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.150019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.150046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.150165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.150252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.150279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.150370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.150486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.150513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.150655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.150734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.150760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.150930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.151033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.151059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.151137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.151216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.151257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.151336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.151481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.151508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.151680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.151804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.151845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.151956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.152066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.152092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.152228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.152341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.152369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.152492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.152654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.152680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.152779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.152890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.152915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.153056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.153148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.508 [2024-12-08 02:29:55.153173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.508 qpair failed and we were unable to recover it. 00:27:27.508 [2024-12-08 02:29:55.153254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.153359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.153388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.153497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.153687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.153716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.153850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.153964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.153991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.154092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.154214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.154242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.154339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.154455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.154483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.154592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.154675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.154700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.154855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.154970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.154996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.155136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.155236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.155264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.155391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.155514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.155546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.155677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.155786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.155827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.155925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.156004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.156048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.156169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.156274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.156302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.156438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.156521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.156555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.156652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.156761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.156786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.156868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.156984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.157010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.157102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.157225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.157253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.157347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.157466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.157494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.157622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.157770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.157797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.157908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.158031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.158057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.158191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.158287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.158316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.158420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.158504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.158532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.158652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.158761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.158786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.158874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.158977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.159003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.159103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.159211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.159236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.159314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.159444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.159473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.159610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.159755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.159780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.159925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.160083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.160112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.160217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.160339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.160367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.160523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.160658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.160684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.160798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.160927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.160955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.161116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.161259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.161285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.161418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.161506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.161535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.161697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.161811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.161836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.161949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.162105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.162133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.162270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.162408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.162433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.162584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.162697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.162722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.162857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.162979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.163021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.163135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.163270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.163298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.163400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.163505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.163533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.163680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.163759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.163784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.163912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.164033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.164061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.164216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.164352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.164377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.164460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.164566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.164593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.164671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.164799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.164824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.164994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.165121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.165149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.165263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.165396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.165420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.165535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.165658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.165683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.165769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.165946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.165973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.166123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.166210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.166238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.166413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.166564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.166606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.166720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.166813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.509 [2024-12-08 02:29:55.166839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.509 qpair failed and we were unable to recover it. 00:27:27.509 [2024-12-08 02:29:55.166959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.167089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.167116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.167240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.167356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.167384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.167501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.167608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.167633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.167718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.167841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.167866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.167997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.168093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.168121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.168244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.168330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.168362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.168485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.168610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.168638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.168765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.168883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.168908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.169037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.169194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.169221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.169328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.169448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.169475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.169625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.169701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.169726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.169843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.169924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.169949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.170062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.170145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.170173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.170306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.170435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.170463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.170627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.170769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.170794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.170913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.171044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.171076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.171216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.171336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.171363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.171490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.171613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.171639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.171720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.171874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.171901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.172039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.172168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.172196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.172316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.172416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.172441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.172520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.172631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.172656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.172735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.172850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.172875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.172959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.173066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.173091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.173224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.173353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.173381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.173531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.173638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.173671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.173759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.173871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.173899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.174029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.174112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.174137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.174287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.174370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.174398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.174502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.174612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.174638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.174781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.174922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.174950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.175059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.175137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.175162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.175253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.175365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.175390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.175471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.175570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.175613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.175724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.175877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.175904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.176091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.176226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.176275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.176370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.176486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.176513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.176630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.176742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.176767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.176900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.177028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.177055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.177184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.177321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.177349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.177473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.177615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.177641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.177734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.177814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.177840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.177972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.178066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.178094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.178231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.178334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.178359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.178561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.178680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.178708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.178810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.178965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.178990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.179137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.179265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.179292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.179446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.179547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.179591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.179701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.179783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.179808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.179913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.180045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.180070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.180191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.180269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.180294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.180448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.180578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.180619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.180757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.180860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.180889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.510 [2024-12-08 02:29:55.180978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.181126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.510 [2024-12-08 02:29:55.181154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.510 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.181276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.181425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.181454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.181624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.181738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.181764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.181941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.182065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.182093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.182193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.182344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.182371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.182492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.182662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.182687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.182799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.182891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.182916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.183030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.183164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.183192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.183313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.183434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.183462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.183587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.183678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.183706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.183871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.184011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.184052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.184146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.184243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.184271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.184398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.184519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.184555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.184666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.184810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.184853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.184966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.185076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.185101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.185260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.185351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.185379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.185497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.185623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.185649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.185756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.185870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.185894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.186001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.186073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.186098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.186254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.186374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.186403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.186522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.186641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.186667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.186763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.186848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.186872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.186991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.187100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.187125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.187212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.187364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.187392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.187527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.187669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.187695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.187823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.187924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.187951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.188084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.188202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.188227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.188387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.188512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.188547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.188684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.188792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.188837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.188964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.189086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.189127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.189253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.189374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.189401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.189501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.189667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.189693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.189820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.189915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.189943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.190131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.190281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.190309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.190477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.190636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.190662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.190779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.190888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.190912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.191026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.191183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.191211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.191304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.191403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.191431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.191561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.191686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.191711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.191823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.191985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.192013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.192166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.192259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.192286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.192388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.192534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.192568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.192671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.192775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.192800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.192940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.193044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.193072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.193200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.193281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.193309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.193430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.193574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.193615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.193701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.193812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.193837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.193969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.194094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.194122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.194241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.194323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.194350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.194485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.194561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.194587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.194728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.194810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.194834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.511 qpair failed and we were unable to recover it. 00:27:27.511 [2024-12-08 02:29:55.194965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.511 [2024-12-08 02:29:55.195044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.195072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.195194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.195316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.195346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.195513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.195630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.195656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.195741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.195823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.195847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.195932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.196025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.196052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.196143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.196267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.196295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.196414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.196504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.196532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.196676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.196798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.196823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.196931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.197085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.197110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.197221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.197401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.197428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.197551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.197679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.197704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.197818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.197902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.197927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.198109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.198234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.198263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.198415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.198546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.198591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.198704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.198861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.198889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.199006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.199120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.199145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.199236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.199396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.199424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.199594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.199710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.199735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.199862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.199948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.199976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.200115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.200230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.200255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.200362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.200513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.200547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.200681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.200787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.200829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.200914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.201039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.201068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.201178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.201253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.201278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.201389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.201489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.201517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.201662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.201745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.201771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.201908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.201981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.202022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.202144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.202268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.202296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.202420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.202502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.202527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.202647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.202756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.202782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.202901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.203013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.203041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.203176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.203260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.203285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.203411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.203507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.203565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.203647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.203760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.203803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.203889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.204006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.204033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.204165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.204271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.204296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.204429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.204597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.204624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.204737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.204906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.204934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.205091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.205201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.205227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.205355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.205455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.205484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.205577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.205708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.205733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.205812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.205943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.205971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.206117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.206260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.206302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.206507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.206618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.206643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.206730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.206816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.206857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.206980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.207096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.207124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.207247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.207369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.207398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.207563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.207673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.207698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.207857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.207953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.207981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.208139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.208214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.208238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.208358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.208468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.208496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.208632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.208718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.208743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.208822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.208910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.208935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.512 qpair failed and we were unable to recover it. 00:27:27.512 [2024-12-08 02:29:55.209107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.512 [2024-12-08 02:29:55.209218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.209243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.209377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.209528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.209563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.209723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.209806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.209831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.209945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.210078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.210115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.210262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.210357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.210386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.210505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.210672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.210698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.210811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.210891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.210916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.211090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.211241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.211265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.211402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.211572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.211613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.211728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.211847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.211880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.212000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.212107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.212132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.212214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.212346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.212374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.212541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.212640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.212666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.212781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.212945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.212973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.213102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.213184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.213209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.213369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.213458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.213486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.213634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.213710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.213735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.213892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.214015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.214043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.214161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.214250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.214277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.214375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.214523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.214560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.214721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.214822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.214850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.215003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.215093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.215121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.215257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.215372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.215396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.215492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.215640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.215665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.215790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.215904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.215932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.216057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.216171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.216199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.216311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.216457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.216498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.216639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.216750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.216775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.216916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.217032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.217060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.217209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.217303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.217335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.217462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.217620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.217646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.217765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.217927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.217955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.218105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.218201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.218228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.218349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.218471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.218498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.218633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.218723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.218748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.218860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.218972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.218997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.219104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.219211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.219236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.219319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.219480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.219507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.219614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.219699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.219724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.219815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.219907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.219937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.220023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.220133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.220158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.220304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.220397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.220424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.220562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.220675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.220700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.220817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.220903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.220930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.221082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.221200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.221228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.221379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.221545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.221571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.221656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.221765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.221791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.221967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.222166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.222191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.222300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.222430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.222458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.222608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.222701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.222728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.222849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.222955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.222979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.513 qpair failed and we were unable to recover it. 00:27:27.513 [2024-12-08 02:29:55.223105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.513 [2024-12-08 02:29:55.223263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.223288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-12-08 02:29:55.223399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.223484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.223526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-12-08 02:29:55.223633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.223718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.223746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-12-08 02:29:55.223872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.223991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.224017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-12-08 02:29:55.224103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.224258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.224286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-12-08 02:29:55.224417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.224528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.224569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-12-08 02:29:55.224651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.224754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.224781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-12-08 02:29:55.224918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.225022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.225047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-12-08 02:29:55.225154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.225255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.225283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-12-08 02:29:55.225410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.225542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.225571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-12-08 02:29:55.225696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.225845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.225873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-12-08 02:29:55.225984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.226093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.226118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-12-08 02:29:55.226198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.226334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.226362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-12-08 02:29:55.226521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.226668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.226694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-12-08 02:29:55.226816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.226942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.226967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-12-08 02:29:55.227053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.227142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.227168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-12-08 02:29:55.227288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.227447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.227475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-12-08 02:29:55.227578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.227700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.227728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-12-08 02:29:55.227817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.227902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.227930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-12-08 02:29:55.228065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.228146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.228172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-12-08 02:29:55.228301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.228438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.228463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-12-08 02:29:55.228547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.228659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.228701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-12-08 02:29:55.228828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.228912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.228940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-12-08 02:29:55.229070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.229209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.229234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-12-08 02:29:55.229353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.229453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.229477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-12-08 02:29:55.229605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.229741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.229769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-12-08 02:29:55.229896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.230017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.230044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-12-08 02:29:55.230172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.230283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.230308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-12-08 02:29:55.230420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.230530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.230576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-12-08 02:29:55.230701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.230824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.230852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-12-08 02:29:55.230974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.231100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.231125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-12-08 02:29:55.231275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.231385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.231410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-12-08 02:29:55.231521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.231639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.514 [2024-12-08 02:29:55.231667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.514 qpair failed and we were unable to recover it. 00:27:27.514 [2024-12-08 02:29:55.231757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.795 [2024-12-08 02:29:55.231844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.795 [2024-12-08 02:29:55.231873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.795 qpair failed and we were unable to recover it. 00:27:27.795 [2024-12-08 02:29:55.231977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.795 [2024-12-08 02:29:55.232097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.795 [2024-12-08 02:29:55.232126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.795 qpair failed and we were unable to recover it. 00:27:27.795 [2024-12-08 02:29:55.232265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.795 [2024-12-08 02:29:55.232372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.795 [2024-12-08 02:29:55.232397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.795 qpair failed and we were unable to recover it. 00:27:27.795 [2024-12-08 02:29:55.232478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.795 [2024-12-08 02:29:55.232591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.795 [2024-12-08 02:29:55.232620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.795 qpair failed and we were unable to recover it. 00:27:27.795 [2024-12-08 02:29:55.232703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.795 [2024-12-08 02:29:55.232834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.795 [2024-12-08 02:29:55.232862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.795 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.233012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.233134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.233161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.233261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.233374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.233399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.233480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.233613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.233642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.233786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.233873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.233898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.234009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.234126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.234152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.234234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.234313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.234338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.234503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.234593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.234622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.234719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.234832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.234859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.234977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.235062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.235090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.235197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.235306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.235331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.235461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.235550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.235578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.235681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.235805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.235830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.235965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.236055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.236082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.236222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.236363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.236388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.236490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.236598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.236627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.236718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.236836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.236863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.236983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.237070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.237098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.237213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.237321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.237346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.237418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.237512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.237556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.237660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.237816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.237843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.237937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.238102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.238128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.238240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.238350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.238376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.238505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.238608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.238637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.238732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.238811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.238839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.238989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.239109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.239137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.239242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.239331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.239357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.239481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.239565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.239591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.239683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.239764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.239789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.239919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.240083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.240107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.240249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.240363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.240389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.240494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.240623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.240652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.240804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.240952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.240984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.241146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.241265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.241294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.241427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.241511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.241543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.241656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.241757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.241784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.241871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.241996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.242024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.242147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.242267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.242296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.242442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.242521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.242552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.242634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.242722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.242748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.242839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.242958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.242985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.243079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.243268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.243294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.243410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.243543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.243570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.243731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.243832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.243861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.244027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.244168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.244194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.244353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.244476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.244505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.244650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.244789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.244814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.244996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.245114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.245141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.245302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.245426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.245455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.245601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.245727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.245753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.245837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.245955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.245980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.796 qpair failed and we were unable to recover it. 00:27:27.796 [2024-12-08 02:29:55.246132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.796 [2024-12-08 02:29:55.246217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.246243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.246399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.246528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.246564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.246688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.246843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.246872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.247010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.247131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.247157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.247268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.247428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.247457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.247557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.247660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.247689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.247844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.247969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.247997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.248162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.248279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.248305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.248433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.248530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.248564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.248667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.248789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.248818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.248965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.249079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.249105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.249247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.249369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.249395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.249533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.249694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.249723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.249846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.249985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.250011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.250124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.250291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.250319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.250426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.250548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.250575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.250710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.250836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.250866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.250966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.251114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.251143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.251277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.251397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.251426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.251534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.251636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.251663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.251796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.251886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.251914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.252051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.252154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.252184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.252308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.252406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.252434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.252596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.252705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.252731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.252902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.253008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.253034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.253159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.253249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.253277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.253374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.253494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.253522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.253678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.253792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.253817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.253930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.254041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.254084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.254209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.254357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.254386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.254469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.254568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.254596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.254710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.254850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.254880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.254974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.255116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.255145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.255302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.255386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.255412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.255495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.255627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.255656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.255788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.255899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.255925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.256029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.256195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.256220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.256334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.256446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.256471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.256585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.256720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.256748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.256869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.257010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.257035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.257173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.257254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.257282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.257415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.257493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.257522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.257651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.257782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.257824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.257936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.258020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.258045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.258163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.258248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.258273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.258384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.258492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.258533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.258642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.258764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.258792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.258922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.259063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.259088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.259206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.259328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.259356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.797 [2024-12-08 02:29:55.259448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.259575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.797 [2024-12-08 02:29:55.259604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.797 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.259723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.259809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.259838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.259967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.260079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.260109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.260212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.260331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.260360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.260476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.260602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.260631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.260722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.260857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.260882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.260995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.261131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.261156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.261268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.261363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.261392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.261515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.261629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.261659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.261787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.261891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.261919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.262021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.262139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.262165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.262285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.262399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.262424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.262532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.262625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.262651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.262766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.262883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.262908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.262995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.263135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.263161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.263295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.263414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.263442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.263534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.263669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.263700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.263859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.264011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.264040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.264183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.264295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.264321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.264408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.264573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.264603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.264744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.264885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.264910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.265012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.265134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.265162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.265325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.265444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.265469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.265601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.265700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.265728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.265868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.265986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.266013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.266121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.266263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.266288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.266378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.266484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.266509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.266630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.266781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.266810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.266976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.267093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.267119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.267248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.267422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.267448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.267605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.267718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.267743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.267845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.267947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.267976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.268126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.268248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.268276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.268406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.268529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.268564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.268682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.268793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.268818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.268981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.269101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.269131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.269270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.269382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.269407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.269517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.269671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.269697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.269818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.269928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.269952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.270062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.270182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.270210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.270337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.270494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.270523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.270670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.270786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.270811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.270898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.271010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.271036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.271150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.271242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.271268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.271348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.271509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.271545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.271678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.271829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.798 [2024-12-08 02:29:55.271857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.798 qpair failed and we were unable to recover it. 00:27:27.798 [2024-12-08 02:29:55.271959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.272047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.272073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.272157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.272271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.272296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.272466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.272588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.272617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.272723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.272821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.272848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.273010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.273093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.273119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.273255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.273390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.273419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.273561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.273678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.273704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.273834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.273971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.274000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.274140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.274222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.274247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.274408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.274548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.274573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.274702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.274858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.274886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.274984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.275105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.275135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.275273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.275359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.275385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.275514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.275674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.275702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.275844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.275932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.275956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.276070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.276164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.276192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.276325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.276420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.276445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.276570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.276679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.276708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.276828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.276916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.276944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.277044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.277152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.277178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.277331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.277472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.277515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.277675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.277809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.277833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.277946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.278058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.278100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.278220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.278380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.278405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.278520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.278663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.278689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.278836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.278931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.278958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.279106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.279229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.279258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.279390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.279512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.279548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.279690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.279799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.279825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.279928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.280016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.280046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.280139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.280262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.280291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.280394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.280514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.280553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.280665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.280780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.280807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.280965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.281096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.281125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.281292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.281403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.281428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.281544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.281694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.281722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.281861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.281977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.282003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.282093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.282179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.282206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.282386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.282527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.282559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.282675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.282773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.282800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.282911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.283024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.283050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.283210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.283300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.283327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.283454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.283569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.283599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.283691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.283775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.283804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.283940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.284080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.284105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.284205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.284295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.284324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.284416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.284544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.284573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.284698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.284842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.284868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.284982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.285087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.285112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.285197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.285335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.285364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.285487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.285626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.285656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.799 [2024-12-08 02:29:55.285785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.285923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.799 [2024-12-08 02:29:55.285948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.799 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.286068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.286149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.286176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.286262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.286340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.286365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.286486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.286616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.286643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.286785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.286887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.286916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.287012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.287151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.287176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.287415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.287549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.287580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.287731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.287831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.287859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.288006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.288083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.288109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.288225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.288308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.288334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.288493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.288618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.288647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.288775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.288873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.288901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.289000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.289128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.289156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.289271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.289393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.289418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.289534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.289625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.289652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.289788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.289911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.289939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.290066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.290202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.290227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.290311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.290425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.290450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.290559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.290691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.290718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.290815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.290930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.290957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.291078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.291200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.291227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.291357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.291470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.291496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.291632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.291723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.291750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.291883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.292007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.292035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.292165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.292265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.292294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.292400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.292486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.292512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.292640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.292755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.292783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.292937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.293091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.293119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.293275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.293377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.293406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.293511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.293650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.293676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.293791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.293880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.293905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.294013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.294109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.294139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.294263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.294396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.294421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.294562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.294646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.294672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.294756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.294846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.294871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.294986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.295133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.295159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.295280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.295397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.295427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.295554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.295673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.295698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.295830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.295931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.295960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.296119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.296214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.296242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.296366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.296465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.296492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.296640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.296784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.296808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.296950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.297027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.297052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.297212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.297330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.297357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.297489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.297618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.297646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.297775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.297885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.297911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.298074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.298198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.298231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.298321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.298409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.298436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.298559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.298710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.298738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.298881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.298998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.299024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.800 qpair failed and we were unable to recover it. 00:27:27.800 [2024-12-08 02:29:55.299112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.800 [2024-12-08 02:29:55.299243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.299272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.299424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.299525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.299560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.299687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.299785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.299814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.299949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.300062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.300087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.300218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.300352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.300377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.300484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.300580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.300607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.300693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.300791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.300821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.300936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.301025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.301050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.301182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.301305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.301335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.301465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.301618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.301648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.301779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.301880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.301908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.302038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.302148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.302174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.302283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.302412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.302439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.302611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.302706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.302736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.302896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.303028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.303056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.303164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.303302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.303328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.303454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.303555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.303589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.303715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.303875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.303901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.304013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.304146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.304174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.304286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.304403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.304429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.304511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.304630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.304660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.304760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.304887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.304927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.305016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.305098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.305123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.305264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.305377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.305402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.305501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.305648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.305677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.305804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.305943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.305969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.306090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.306198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.306226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.306374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.306485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.306511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.306633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.306716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.306742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.306854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.306971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.306997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.307169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.307325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.307354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.307470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.307593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.307619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.307706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.307787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.307812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.307931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.308098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.308127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.308219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.308342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.308370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.308471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.308559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.308585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.308700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.308780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.308804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.308969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.309126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.309152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.309314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.309466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.309507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.309638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.309781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.309806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.309945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.310069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.310098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.310185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.310307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.310337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.310495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.310614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.310643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.310752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.310869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.310895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.801 qpair failed and we were unable to recover it. 00:27:27.801 [2024-12-08 02:29:55.311012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.801 [2024-12-08 02:29:55.311120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.311146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.311286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.311370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.311395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.311485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.311596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.311639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.311757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.311872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.311897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.312023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.312182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.312207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.312347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.312475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.312503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.312672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.312794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.312822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.312956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.313063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.313089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.313273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.313364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.313389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.313502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.313583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.313608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.313752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.313863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.313890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.314026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.314100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.314125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.314280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.314400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.314428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.314524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.314624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.314653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.314747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.314867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.314896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.315027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.315169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.315195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.315363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.315454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.315482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.315637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.315772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.315798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.315927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.316049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.316072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.316207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.316351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.316377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.316519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.316646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.316675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.316767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.316888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.316931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.317051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.317145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.317189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.317299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.317383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.317409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.317578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.317686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.317715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.317879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.318001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.318029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.318202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.318312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.318338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.318427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.318509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.318534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.318677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.318770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.318800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.318924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.319048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.319078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.319248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.319359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.319389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.319501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.319590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.319616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.319721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.319809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.319837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.320007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.320106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.320134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.320257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.320345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.320374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.320510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.320661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.320688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.320836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.320929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.320954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.321072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.321184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.321213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.321338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.321456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.321484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.321597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.321713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.321739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.321848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.321951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.321990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.322076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.322164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.322192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.322340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.322462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.322491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.322613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.322695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.322720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.322889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.323042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.323069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.323198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.323327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.323352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.323439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.323552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.323580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.323694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.323780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.323806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.323904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.324012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.324037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.324198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.324320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.324348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.802 [2024-12-08 02:29:55.324440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.324594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.802 [2024-12-08 02:29:55.324624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.802 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.324733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.324849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.324874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.325002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.325126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.325154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.325256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.325379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.325408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.325531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.325653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.325682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.325850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.325965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.325990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.326106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.326198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.326227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.326328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.326427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.326456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.326582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.326710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.326738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.326876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.326992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.327018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.327166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.327286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.327314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.327444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.327568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.327597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.327752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.327846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.327874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.327985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.328080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.328106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.328219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.328303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.328328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.328473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.328603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.328633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.328717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.328837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.328866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.328995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.329159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.329188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.329293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.329418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.329448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.329585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.329747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.329773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.329882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.329979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.330007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.330119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.330225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.330252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.330379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.330504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.330532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.330632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.330729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.330759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.330884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.331009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.331038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.331175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.331320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.331345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.331475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.331644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.331670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.331783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.331944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.331972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.332100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.332238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.332264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.332355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.332445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.332470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.332608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.332735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.332764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.332897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.333025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.333068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.333221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.333357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.333386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.333502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.333619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.333645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.333777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.333904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.333932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.334056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.334207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.334233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.334380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.334476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.334506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.334651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.334790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.334815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.334893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.334973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.334999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.335086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.335197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.335222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.335365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.335486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.335514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.335631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.335749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.335774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.335864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.336013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.336040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.336185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.336336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.336361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.336451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.336616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.336643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.336759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.336857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.336883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.337040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.337154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.337181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.803 qpair failed and we were unable to recover it. 00:27:27.803 [2024-12-08 02:29:55.337314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.803 [2024-12-08 02:29:55.337417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.337447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.337571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.337699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.337740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.337857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.337948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.337974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.338113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.338249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.338286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.338405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.338522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.338556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.338695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.338812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.338838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.338983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.339099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.339128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.339294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.339453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.339482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.339609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.339731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.339763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.339853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.339970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.339998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.340123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.340273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.340298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.340464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.340594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.340642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.340736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.340887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.340915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.341026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.341167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.341193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.341308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.341422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.341448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.341566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.341661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.341689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.341785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.341904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.341936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.342027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.342186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.342214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.342354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.342446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.342471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.342590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.342724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.342752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.342889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.342992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.343019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.343101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.343222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.343252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.343396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.343483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.343507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.343645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.343740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.343768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.343849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.343941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.343970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.344111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.344211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.344239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.344355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.344467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.344501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.344630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.344747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.344773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.344919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.345042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.345072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.345163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.345275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.345303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.345428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.345511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.345543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.345662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.345792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.345821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.345915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.346035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.346070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.346196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.346323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.346366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.346463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.346607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.346633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.346780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.346913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.346939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.347074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.347194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.347229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.347321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.347438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.347467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.347575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.347667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.347693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.347804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.347924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.347966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.348068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.348215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.348257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.348378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.348456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.348497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.348644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.348765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.348791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.348895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.348996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.349025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.349150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.349271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.349301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.349435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.349569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.349598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.349727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.349818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.349844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.349949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.350058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.350102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.350195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.350299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.350326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.350423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.350571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.350601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.350712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.350870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.350896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.804 qpair failed and we were unable to recover it. 00:27:27.804 [2024-12-08 02:29:55.351006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.804 [2024-12-08 02:29:55.351103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.351131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.351223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.351323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.351353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.351442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.351609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.351635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.351730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.351855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.351881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.352012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.352170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.352198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.352337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.352467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.352495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.352606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.352696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.352726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.352898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.352993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.353019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.353126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.353246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.353275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.353403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.353522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.353556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.353658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.353776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.353804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.353935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.354082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.354108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.354243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.354416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.354441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.354587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.354732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.354760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.354883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.355003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.355031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.355165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.355311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.355337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.355500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.355621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.355648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.355816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.355948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.355972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.356121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.356202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.356228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.356319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.356425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.356450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.356562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.356645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.356671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.356769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.356878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.356907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.357038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.357195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.357223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.357332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.357414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.357440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.357558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.357668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.357697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.357848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.357952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.357981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.358147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.358266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.358292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.358405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.358527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.358561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.358663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.358783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.358812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.358903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.359037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.359066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.359190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.359299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.359329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.359469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.359578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.359605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.359716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.359831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.359859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.359974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.360095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.360125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.360282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.360369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.360405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.360509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.360604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.360632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.360724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.360832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.360860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.360986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.361113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.361143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.361247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.361366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.361395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.361559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.361665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.361691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.361800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.361952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.361978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.362087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.362189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.362220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.362349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.362478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.362507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.362642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.362784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.362810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.362908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.363065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.363099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.363209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.363345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.363374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.363544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.363659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.363685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.363764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.363852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.363878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.364002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.364088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.364116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.364238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.364369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.364395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.364527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.364626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.364659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.805 [2024-12-08 02:29:55.364772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.364880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.805 [2024-12-08 02:29:55.364906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.805 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.365026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.365177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.365206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.365373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.365490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.365517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.365629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.365779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.365808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.365958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.366073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.366099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.366281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.366421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.366447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.366557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.366668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.366695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.366808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.366941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.366970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.367132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.367250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.367276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.367441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.367553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.367579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.367673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.367788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.367814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.367974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.368075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.368104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.368221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.368304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.368329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.368416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.368549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.368578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.368674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.368801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.368829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.368969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.369060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.369086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.369178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.369317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.369343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.369487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.369641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.369668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.369758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.369841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.369866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.369979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.370110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.370139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.370274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.370357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.370383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.370463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.370597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.370625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.370720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.370836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.370864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.370995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.371118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.371147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.371251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.371339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.371364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.371506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.371622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.371652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.371810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.371916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.371942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.372077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.372201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.372231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.372389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.372476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.372502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.372598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.372673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.372699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.372791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.372940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.372984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.373115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.373207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.373235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.373339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.373454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.373480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.373566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.373650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.373676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.373793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.373965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.373990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.374098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.374235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.374264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.374377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.374459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.374485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.374605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.374738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.374768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.374903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.374993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.375019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.375104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.375246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.375275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.375405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.375550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.375601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.375731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.375827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.375855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.375956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.376052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.376080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.376201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.376313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.376338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.376429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.376513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.376544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.376638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.376757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.376783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.376865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.377004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.377033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.806 [2024-12-08 02:29:55.377141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.377266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.806 [2024-12-08 02:29:55.377306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.806 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.377449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.377543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.377570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.377682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.377786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.377813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.377968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.378086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.378116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.378213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.378308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.378337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.378446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.378561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.378588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.378728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.378846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.378876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.379037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.379116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.379150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.379262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.379405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.379431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.379524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.379685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.379712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.379828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.379926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.379955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.380057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.380205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.380234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.380361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.380479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.380508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.380626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.380713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.380738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.380851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.380997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.381026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.381153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.381297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.381323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.381445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.381528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.381558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.381689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.381769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.381795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.381888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.382034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.382081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.382196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.382341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.382370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.382498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.382641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.382670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.382804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.382878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.382904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.383011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.383173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.383199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.383306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.383390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.383418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.383575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.383703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.383732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.383851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.383964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.383990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.384083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.384202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.384228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.384381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.384504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.384533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.384698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.384815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.384844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.384932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.385069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.385094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.385186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.385331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.385359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.385513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.385640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.385669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.385792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.385921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.385947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.386060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.386212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.386237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.386372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.386503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.386531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.386712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.386811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.386837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.386954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.387114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.387142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.387262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.387345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.387370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.387460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.387601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.387634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.387741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.387862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.387890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.388013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.388134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.388162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.388266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.388370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.388404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.388488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.388576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.388603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.388684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.388803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.388831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.388951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.389101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.389129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.389253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.389366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.389392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.389565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.389652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.389678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.389796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.389954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.389983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.390107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.390228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.390258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.390391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.390512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.390544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.390639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.390789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.390815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.390935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.391081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.391109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.391204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.391304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.391334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.807 qpair failed and we were unable to recover it. 00:27:27.807 [2024-12-08 02:29:55.391473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.807 [2024-12-08 02:29:55.391587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.391613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.391703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.391877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.391906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.392036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.392177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.392202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.392287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.392417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.392445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.392582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.392716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.392742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.392879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.393056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.393084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.393191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.393292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.393322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.393478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.393613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.393656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.393747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.393872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.393898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.394004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.394089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.394114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.394269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.394420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.394448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.394580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.394669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.394698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.394867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.395002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.395028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.395144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.395229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.395272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.395377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.395501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.395529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.395630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.395725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.395754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.395892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.396006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.396031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.396179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.396281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.396306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.396393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.396533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.396569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.396697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.396786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.396814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.396951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.397075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.397101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.397213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.397296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.397321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.397468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.397603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.397629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.397717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.397822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.397848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.397934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.398074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.398099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.398211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.398379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.398412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.398548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.398708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.398749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.398863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.398944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.398969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.399086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.399203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.399229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.399387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.399491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.399520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.399652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.399747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.399777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.399951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.400067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.400092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.400204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.400303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.400329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.400428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.400606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.400632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.400748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.400910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.400939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.401075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.401188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.401213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.401336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.401450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.401477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.401599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.401684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.401726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.401890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.402001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.402026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.402161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.402309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.402338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.402452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.402595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.402621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.402753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.402882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.402911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.403066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.403182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.403210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.403311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.403440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.403466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.403581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.403685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.403710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.403846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.403999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.404027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.404126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.404231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.404259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.808 [2024-12-08 02:29:55.404381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.404510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.808 [2024-12-08 02:29:55.404543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.808 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.404682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.404798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.404825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.404950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.405065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.405094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.405216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.405310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.405339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.405431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.405525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.405563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.405671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.405759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.405784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.405900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.406064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.406092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.406227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.406370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.406397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.406570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.406701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.406730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.406869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.406974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.407000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.407113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.407236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.407265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.407363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.407496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.407522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.407664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.407836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.407879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.407959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.408052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.408079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.408166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.408272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.408299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.408417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.408525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.408560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.408654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.408751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.408780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.408881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.409000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.409025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.409138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.409217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.409242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.409338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.409445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.409470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.409593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.409685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.409728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.409886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.410006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.410031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.410133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.410250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.410278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.410428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.410513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.410549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.410677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.410771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.410799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.410927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.411064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.411100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.411206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.411362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.411391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.411492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.411621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.411651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.411748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.411874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.411904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.412013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.412152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.412179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.412271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.412450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.412476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.412587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.412668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.412695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.412786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.412952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.412982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.413117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.413226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.413252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.413345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.413462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.413488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.413631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.413728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.413755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.413917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.414033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.414059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.414149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.414258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.414284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.414417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.414567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.414594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.414708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.414837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.414867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.414969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.415062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.415091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.415230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.415348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.415375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.415503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.415632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.415662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.415794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.415888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.415932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.416021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.416109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.416137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.416283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.416379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.416405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.416522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.416619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.416645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.416723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.416810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.416835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.416946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.417071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.417100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.417231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.417353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.417379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.809 [2024-12-08 02:29:55.417481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.417614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.809 [2024-12-08 02:29:55.417644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.809 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.417768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.417893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.417922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.418047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.418188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.418216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.418351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.418473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.418499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.418621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.418792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.418818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.418944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.419102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.419131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.419282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.419421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.419447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.419534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.419657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.419683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.419780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.419874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.419901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.420075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.420169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.420198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.420346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.420519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.420551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.420694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.420816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.420842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.420977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.421133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.421162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.421311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.421459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.421488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.421625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.421718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.421747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.421913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.422007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.422034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.422125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.422237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.422280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.422406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.422530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.422582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.422709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.422837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.422866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.423004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.423114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.423143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.423248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.423372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.423400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.423498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.423635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.423663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.423754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.423896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.423925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.424041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.424159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.424184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.424324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.424418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.424446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.424534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.424677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.424705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.424832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.424956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.424984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.425124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.425260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.425285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.425397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.425500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.425528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.425660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.425779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.425812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.425961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.426085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.426115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.426224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.426361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.426387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.426495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.426604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.426634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.426737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.426858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.426887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.426999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.427152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.427193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.427308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.427419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.427444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.427561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.427723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.427752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.427873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.427997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.428025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.428115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.428208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.428237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.428355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.428497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.428527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.428668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.428763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.428790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.428925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.429007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.429032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.429180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.429282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.429311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.429474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.429589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.429614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.429750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.429848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.429877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.430009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.430099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.430127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.430268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.430378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.430404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.430517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.430652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.430678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.430779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.430924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.430949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.431067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.431149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.431178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.431291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.431422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.431464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.431581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.431725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.431751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.431886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.432010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.432054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.432196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.432332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.432374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.810 qpair failed and we were unable to recover it. 00:27:27.810 [2024-12-08 02:29:55.432489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.810 [2024-12-08 02:29:55.432577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.432624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.432760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.432841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.432869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.433012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.433136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.433164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.433253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.433343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.433371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.433522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.433643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.433672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.433779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.433916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.433941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.434084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.434205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.434233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.434389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.434569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.434599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.434736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.434856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.434882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.434997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.435108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.435134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.435232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.435326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.435354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.435443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.435598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.435628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.435728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.435855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.435884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.436045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.436185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.436211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.436352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.436453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.436480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.436615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.436710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.436739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.436871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.436965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.436994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.437104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.437218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.437244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.437335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.437479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.437508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.437641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.437768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.437795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.437919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.438018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.438046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.438189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.438278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.438304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.438415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.438553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.438582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.438705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.438846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.438872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.439010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.439172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.439199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.439308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.439447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.439472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.439612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.439747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.439772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.439895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.440036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.440061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.440221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.440347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.440376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.440521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.440662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.440689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.440830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.440922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.440951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.441075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.441203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.441232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.441328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.441449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.441480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.441625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.441738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.441764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.441881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.442004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.442033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.442188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.442343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.442371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.442506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.442613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.442642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.442780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.442893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.442919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.443045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.443167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.443195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.443345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.443493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.443522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.443633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.443752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.443781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.443918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.444027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.444052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.444157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.444242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.444270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.444408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.444523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.444557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.444672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.444800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.444842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.444930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.445044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.445071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.445198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.445322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.445350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.445475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.445603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.445633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.445736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.445899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.445928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.446096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.446205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.446230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.446343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.446457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.446481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.446613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.446758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.446786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.446928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.447065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.447090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.447201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.447277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.447302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.447388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.447545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.447571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.447653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.447781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.447809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.447912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.448008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.448040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.448183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.448271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.448297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.448393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.448487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.448514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.448675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.448836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.448864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.449010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.449150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.449175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.449265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.449385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.449410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.811 [2024-12-08 02:29:55.449492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.449579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.811 [2024-12-08 02:29:55.449606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.811 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.449748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.449882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.449910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.450070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.450168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.450196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.450327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.450402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.450427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.450567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.450689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.450718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.450814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.450944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.450972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.451064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.451159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.451187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.451313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.451451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.451476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.451562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.451677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.451705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.451824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.451943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.451971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.452094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.452254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.452282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.452445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.452562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.452588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.452673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.452753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.452779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.452938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.453057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.453085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.453212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.453300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.453328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.453471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.453583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.453609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.453696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.453858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.453886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.454010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.454157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.454185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.454279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.454406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.454433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.454571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.454688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.454714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.454803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.454915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.454941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.455078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.455162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.455190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.455355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.455436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.455461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.455589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.455672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.455698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.455801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.455899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.455942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.456025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.456106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.456131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.456270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.456352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.456394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.456527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.456625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.456650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.456747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.456866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.456894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.457010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.457128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.457156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.457253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.457397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.457424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.457567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.457651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.457676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.457796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.457931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.457959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.458111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.458231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.458259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.458429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.458517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.458550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.458631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.458747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.458772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.458873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.458978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.459004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.459093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.459169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.459194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.459334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.459483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.459511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.459632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.459743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.459768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.459885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.459983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.460011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.460141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.460257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.460282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.460436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.460557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.460583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.460691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.460779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.460804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.460890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.461000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.461028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.461185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.461317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.461343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.461492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.461570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.461596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.461687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.461802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.461827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.461970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.462073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.462101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.462214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.462321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.462346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.462437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.462571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.462599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.462739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.462857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.462882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.462966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.463106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.463131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.463237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.463351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.463377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.463542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.463633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.463661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.463798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.463912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.463937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.464019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.464155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.464182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.464301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.464439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.464464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.464576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.464702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.464730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.464870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.464981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.465007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.465109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.465223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.465250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.465375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.465496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.465524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.465652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.465774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.465803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.465941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.466029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.466054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.466139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.466246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.466275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.466356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.466492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.466520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.466654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.466807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.466835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.812 qpair failed and we were unable to recover it. 00:27:27.812 [2024-12-08 02:29:55.466971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.812 [2024-12-08 02:29:55.467105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.467130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.467258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.467380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.467408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.467542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.467636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.467664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.467816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.467900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.467928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.468047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.468187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.468211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.468326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.468411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.468439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.468560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.468691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.468720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.468850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.468936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.468968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.469112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.469230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.469254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.469335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.469465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.469493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.469592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.469718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.469746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.469874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.470027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.470055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.470193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.470315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.470340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.470472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.470605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.470633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.470797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.470911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.470936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.471060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.471182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.471210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.471357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.471459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.471487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.471613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.471700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.471729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.471831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.471923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.471951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.472044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.472132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.472160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.472302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.472421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.472445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.472558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.472647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.472672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.472765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.472925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.472953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.473085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.473202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.473227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.473341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.473420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.473446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.473530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.473647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.473672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.473751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.473882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.473910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.474029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.474189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.474218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.474359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.474437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.474462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.474625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.474743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.474770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.474899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.475056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.475084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.475235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.475364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.475392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.475501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.475618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.475645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.475779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.475900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.475925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.476012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.476112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.476140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.476229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.476324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.476351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.476488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.476606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.476632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.476739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.476865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.476892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.476985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.477072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.477100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.477254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.477377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.477405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.477513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.477632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.477658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.477766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.477919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.477944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.478064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.478137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.478162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.478243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.478405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.478433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.478581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.478664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.478689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.478846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.478961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.478989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.479119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.479198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.479223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.479306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.479405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.479433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.479544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.479624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.479651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.479739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.479849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.479874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.479991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.480160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.480188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.480341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.480466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.480494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.480639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.480751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.480776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.480861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.480986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.481014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.481132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.481256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.481283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.481405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.481504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.481533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.481655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.481774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.481799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.481885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.481996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.482024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.482148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.482264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.482292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.482380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.482500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.482527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.482643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.482735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.482760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.482873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.482989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.483032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.483162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.483299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.483323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.813 qpair failed and we were unable to recover it. 00:27:27.813 [2024-12-08 02:29:55.483430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.483547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.813 [2024-12-08 02:29:55.483573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.483665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.483755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.483780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.483907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.484060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.484087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.484180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.484306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.484348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.484465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.484551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.484593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.484762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.484876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.484902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.485034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.485169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.485194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.485319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.485421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.485447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.485534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.485696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.485724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.485855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.485973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.485998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.486140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.486222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.486262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.486417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.486505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.486532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.486635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.486724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.486752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.486910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.487023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.487049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.487149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.487233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.487260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.487361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.487478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.487506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.487651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.487770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.487795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.487911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.488039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.488064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.488219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.488343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.488372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.488526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.488635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.488664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.488788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.488885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.488914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.489027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.489145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.489170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.489308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.489389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.489431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.489520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.489652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.489681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.489775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.489867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.489895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.490011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.490146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.490171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.490268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.490393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.490421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.490517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.490613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.490642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.490772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.490894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.490934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.491074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.491178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.491202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.491318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.491407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.491434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.491559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.491651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.491680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.491820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.491928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.491953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.492061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.492172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.492198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.492303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.492415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.492457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.492615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.492740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.492768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.492858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.492978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.493006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.493171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.493281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.493306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.493436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.493552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.493580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.493719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.493832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.493857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.493968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.494100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.494128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.494231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.494342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.494366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.494520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.494624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.494653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.494751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.494874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.494901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.495038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.495118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.495143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.495259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.495345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.495371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.495510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.495609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.495637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.495735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.495862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.495890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.495978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.496104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.496133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.496265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.496372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.496397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.496492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.496580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.496606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.496741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.496856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.496884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.496998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.497124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.497152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.497251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.497368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.497393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.497469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.497623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.497649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.497770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.497849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.497890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.498040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.498133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.498161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.498280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.498365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.498389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.498532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.498625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.498651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.498739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.498882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.498907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.499036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.499154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.499182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.499309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.499398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.499423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.499541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.499621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.499646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.499726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.499822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.499847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.500004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.500121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.500149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.500262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.500345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.500370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.500524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.500631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.500661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.814 qpair failed and we were unable to recover it. 00:27:27.814 [2024-12-08 02:29:55.500756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.814 [2024-12-08 02:29:55.500883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.500911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.501000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.501116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.501143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.501274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.501355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.501381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.501516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.501608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.501636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.501761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.501882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.501907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.502021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.502098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.502124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.502210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.502284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.502309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.502416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.502509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.502533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.502660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.502747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.502790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.502920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.503085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.503113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.503276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.503385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.503410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.503528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.503642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.503666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.503753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.503867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.503891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.504059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.504213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.504238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.504354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.504468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.504493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.504643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.504772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.504799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.504889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.504970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.504997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.505113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.505209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.505238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.505400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.505489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.505515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.505637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.505765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.505792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.505891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.505985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.506014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.506109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.506230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.506259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.506395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.506500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.506525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.506649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.506785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.506810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.506925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.507053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.507082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.507211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.507364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.507392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.507530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.507626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.507651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.507758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.507888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.507916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.508014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.508096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.508128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.508218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.508355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.508379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.508520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.508644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.508669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.508780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.508904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.508929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.509043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.509150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.509175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.509256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.509394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.509421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.509522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.509664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.509689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.509780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.509955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.510007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.510137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.510254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.510282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.510437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.510569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.510598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.510745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.510859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.510888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.511020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.511143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.511171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.511257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.511403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.511430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.511606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.511721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.511746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.511864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.511952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.511978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.512075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.512227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.512254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.512404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.512494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.512522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.512623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.512740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.512769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.512909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.513049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.513074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.513201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.513292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.513319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.513449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.513611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.513645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.513768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.513885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.513914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.514025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.514139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.514165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.514337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.514446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.514475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.514596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.514745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.514770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.514854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.514971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.514996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.515080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.515192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.515217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.515303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.515389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.515414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.515498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.515624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.515668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.515761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.515884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.515912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.516076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.516161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.516186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.516325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.516448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.516476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.516569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.516692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.516720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.516810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.516923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.516951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.517066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.517175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-12-08 02:29:55.517201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.815 qpair failed and we were unable to recover it. 00:27:27.815 [2024-12-08 02:29:55.517359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.517488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.517515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.517614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.517708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.517736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.517867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.517983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.518011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.518143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.518231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.518256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.518373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.518486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.518529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.518662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.518797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.518823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.518942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.519088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.519116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.519254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.519363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.519388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.519522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.519615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.519643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.519737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.519871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.519896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.520039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.520170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.520197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.520307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.520396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.520421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.520502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.520627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.520656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.520738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.520829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.520858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.520986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.521105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.521132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.521273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.521358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.521384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.521566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.521716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.521744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.521837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.521928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.521956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.522055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.522177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.522206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.522314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.522397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.522422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.522528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.522617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.522643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.522728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.522837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.522862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.522947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.523104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.523131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.523263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.523348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.523374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.523465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.523612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.523640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.523740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.523875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.523899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.523989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.524095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.524137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.524304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.524387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.524413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.524564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.524714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.524742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.524863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.524985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.525012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.525091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.525183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.525212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.525326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.525445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.525470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.525576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.525665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.525708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.525812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.525936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.525963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.526088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.526244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.526272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.526407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.526524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.526554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.526659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.526786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.526815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.526917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.527003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.527031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.527112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.527230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.527258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.527397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.527509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.527535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.527664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.527827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.527852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.527965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.528098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.528126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.528263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.528403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.528427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.528513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.528607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.528634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.528748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.528898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.528923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.529063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.529186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.529214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.529383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.529493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.529518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.529655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.529736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.529762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.529885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.530007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.530032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.530148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.530264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.530289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.530428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.530578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.530607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.530739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.530823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.530848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.530943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.531073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.531101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.531191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.531312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.531340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.531477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.531556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.531582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.531694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.531770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.531795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.531913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.532056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.532081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.532167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.532268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.532296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.532461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.532552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.532579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.532691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.532783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.532810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.532947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.533065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.533093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.533189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.533308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.533336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.533454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.533573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.533602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.533743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.533881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.533907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.534001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.534149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.534177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.534301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.534419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.534448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.816 qpair failed and we were unable to recover it. 00:27:27.816 [2024-12-08 02:29:55.534576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-12-08 02:29:55.534702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.534730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.534866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.534951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.534976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.535117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.535234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.535262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.535386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.535488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.535516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.535654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.535808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.535836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.536003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.536114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.536139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.536247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.536409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.536434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.536546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.536682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.536708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.536816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.536903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.536930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.537095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.537181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.537206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.537362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.537531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.537561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.537645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.537725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.537751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.537862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.538007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.538033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.538124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.538239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.538264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.538347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.538437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.538463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.538569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.538691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.538717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.538814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.538964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.538991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.539136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.539261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.539286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.539398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.539595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.539623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.539736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.539847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.539876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.539991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.540157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.540185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.540323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.540434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.540460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.540598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.540712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.540740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.540861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.540984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.541013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.541133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.541252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.541280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.541391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.541469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.541495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.541678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.541802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.541832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.541986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.542137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.542165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.542302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.542424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.542451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.542615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.542723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.542748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.542857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.542959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.542987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.543108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.543198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.543227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.543314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.543441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.543469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.543595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.543745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.543771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.543876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.543992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.544019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.544113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.544202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.544230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.544365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.544453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.544478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.544605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.544743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.544768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.544907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.545037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.545065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.545225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.545311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.545335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.545458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.545575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.545602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.545709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.545850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.545875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.546020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.546107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.546135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.546234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.546373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.546398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.546482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.546600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.546626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.546740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.546825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.546850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.547009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.547102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.547130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.547248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.547359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.547387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.547559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.547700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.547726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.547839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.547912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.547938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.548070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.548170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.548204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.548362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.548475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.548503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.548611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.548728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.548753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.548836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.548977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.549002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.549092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.549201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.549226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.549307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.549470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.549497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.549615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.549698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.549723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.549832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.549906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.549931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.550017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.550147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.550174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.550298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.550416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.550444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.550574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.550716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.550749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.550916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.551025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.551050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.551164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.551251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-12-08 02:29:55.551276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.817 qpair failed and we were unable to recover it. 00:27:27.817 [2024-12-08 02:29:55.551394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.818 [2024-12-08 02:29:55.551515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.818 [2024-12-08 02:29:55.551548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.818 qpair failed and we were unable to recover it. 00:27:27.818 [2024-12-08 02:29:55.551645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.818 [2024-12-08 02:29:55.551774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.818 [2024-12-08 02:29:55.551802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.818 qpair failed and we were unable to recover it. 00:27:27.818 [2024-12-08 02:29:55.551938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.818 [2024-12-08 02:29:55.552077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.818 [2024-12-08 02:29:55.552103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.818 qpair failed and we were unable to recover it. 00:27:27.818 [2024-12-08 02:29:55.552258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.818 [2024-12-08 02:29:55.552408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.818 [2024-12-08 02:29:55.552436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.818 qpair failed and we were unable to recover it. 00:27:27.818 [2024-12-08 02:29:55.552596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.818 [2024-12-08 02:29:55.552724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.818 [2024-12-08 02:29:55.552752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.818 qpair failed and we were unable to recover it. 00:27:27.818 [2024-12-08 02:29:55.552862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.818 [2024-12-08 02:29:55.552940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.818 [2024-12-08 02:29:55.552965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:27.818 qpair failed and we were unable to recover it. 00:27:27.818 [2024-12-08 02:29:55.553080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.818 [2024-12-08 02:29:55.553160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.818 [2024-12-08 02:29:55.553185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.133 qpair failed and we were unable to recover it. 00:27:28.133 [2024-12-08 02:29:55.553285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.553374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.553409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.133 qpair failed and we were unable to recover it. 00:27:28.133 [2024-12-08 02:29:55.553557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.553657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.553685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.133 qpair failed and we were unable to recover it. 00:27:28.133 [2024-12-08 02:29:55.553773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.553880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.553907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.133 qpair failed and we were unable to recover it. 00:27:28.133 [2024-12-08 02:29:55.554043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.554154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.554179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.133 qpair failed and we were unable to recover it. 00:27:28.133 [2024-12-08 02:29:55.554292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.554384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.554412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.133 qpair failed and we were unable to recover it. 00:27:28.133 [2024-12-08 02:29:55.554549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.554633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.554659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.133 qpair failed and we were unable to recover it. 00:27:28.133 [2024-12-08 02:29:55.554766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.554897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.554925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.133 qpair failed and we were unable to recover it. 00:27:28.133 [2024-12-08 02:29:55.555022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.555140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.555165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.133 qpair failed and we were unable to recover it. 00:27:28.133 [2024-12-08 02:29:55.555265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.555401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.555430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.133 qpair failed and we were unable to recover it. 00:27:28.133 [2024-12-08 02:29:55.555556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.555706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.555734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.133 qpair failed and we were unable to recover it. 00:27:28.133 [2024-12-08 02:29:55.555824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.555944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.555976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.133 qpair failed and we were unable to recover it. 00:27:28.133 [2024-12-08 02:29:55.556111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.556228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.556253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.133 qpair failed and we were unable to recover it. 00:27:28.133 [2024-12-08 02:29:55.556356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.556493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.556521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.133 qpair failed and we were unable to recover it. 00:27:28.133 [2024-12-08 02:29:55.556650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.556755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.556783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.133 qpair failed and we were unable to recover it. 00:27:28.133 [2024-12-08 02:29:55.556890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.557043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.557070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.133 qpair failed and we were unable to recover it. 00:27:28.133 [2024-12-08 02:29:55.557205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.557291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.557316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.133 qpair failed and we were unable to recover it. 00:27:28.133 [2024-12-08 02:29:55.557408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.557554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.557583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.133 qpair failed and we were unable to recover it. 00:27:28.133 [2024-12-08 02:29:55.557715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.557836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.557864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.133 qpair failed and we were unable to recover it. 00:27:28.133 [2024-12-08 02:29:55.557985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.558071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.558098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.133 qpair failed and we were unable to recover it. 00:27:28.133 [2024-12-08 02:29:55.558235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.558345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.558371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.133 qpair failed and we were unable to recover it. 00:27:28.133 [2024-12-08 02:29:55.558495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.558639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.558668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.133 qpair failed and we were unable to recover it. 00:27:28.133 [2024-12-08 02:29:55.558797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.558886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.558914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.133 qpair failed and we were unable to recover it. 00:27:28.133 [2024-12-08 02:29:55.559011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.559138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.559163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.133 qpair failed and we were unable to recover it. 00:27:28.133 [2024-12-08 02:29:55.559274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.559387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.559413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.133 qpair failed and we were unable to recover it. 00:27:28.133 [2024-12-08 02:29:55.559518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.559642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.559670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.133 qpair failed and we were unable to recover it. 00:27:28.133 [2024-12-08 02:29:55.559764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.559913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.559939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.133 qpair failed and we were unable to recover it. 00:27:28.133 [2024-12-08 02:29:55.560029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.560158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.133 [2024-12-08 02:29:55.560187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.133 qpair failed and we were unable to recover it. 00:27:28.133 [2024-12-08 02:29:55.560349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.560470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.560495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.134 qpair failed and we were unable to recover it. 00:27:28.134 [2024-12-08 02:29:55.560605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.560698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.560726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.134 qpair failed and we were unable to recover it. 00:27:28.134 [2024-12-08 02:29:55.560820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.560923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.560950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.134 qpair failed and we were unable to recover it. 00:27:28.134 [2024-12-08 02:29:55.561071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.561168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.561196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.134 qpair failed and we were unable to recover it. 00:27:28.134 [2024-12-08 02:29:55.561328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.561413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.561437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.134 qpair failed and we were unable to recover it. 00:27:28.134 [2024-12-08 02:29:55.561528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.561624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.561650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.134 qpair failed and we were unable to recover it. 00:27:28.134 [2024-12-08 02:29:55.561744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.561819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.561844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.134 qpair failed and we were unable to recover it. 00:27:28.134 [2024-12-08 02:29:55.561932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.562047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.562072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.134 qpair failed and we were unable to recover it. 00:27:28.134 [2024-12-08 02:29:55.562163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.562241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.562267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.134 qpair failed and we were unable to recover it. 00:27:28.134 [2024-12-08 02:29:55.562396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.562513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.562549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.134 qpair failed and we were unable to recover it. 00:27:28.134 [2024-12-08 02:29:55.562662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.562783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.562811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.134 qpair failed and we were unable to recover it. 00:27:28.134 [2024-12-08 02:29:55.562898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.562993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.563021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.134 qpair failed and we were unable to recover it. 00:27:28.134 [2024-12-08 02:29:55.563154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.563296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.563321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.134 qpair failed and we were unable to recover it. 00:27:28.134 [2024-12-08 02:29:55.563454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.563576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.563606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.134 qpair failed and we were unable to recover it. 00:27:28.134 [2024-12-08 02:29:55.563708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.563803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.563831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.134 qpair failed and we were unable to recover it. 00:27:28.134 [2024-12-08 02:29:55.563967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.564053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.564079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.134 qpair failed and we were unable to recover it. 00:27:28.134 [2024-12-08 02:29:55.564197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.564310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.564336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.134 qpair failed and we were unable to recover it. 00:27:28.134 [2024-12-08 02:29:55.564437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.564524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.564559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.134 qpair failed and we were unable to recover it. 00:27:28.134 [2024-12-08 02:29:55.564658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.564782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.564811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.134 qpair failed and we were unable to recover it. 00:27:28.134 [2024-12-08 02:29:55.564909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.564999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.565029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.134 qpair failed and we were unable to recover it. 00:27:28.134 [2024-12-08 02:29:55.565160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.565299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.565324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.134 qpair failed and we were unable to recover it. 00:27:28.134 [2024-12-08 02:29:55.565437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.565531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.565585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.134 qpair failed and we were unable to recover it. 00:27:28.134 [2024-12-08 02:29:55.565721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.565865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.565891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.134 qpair failed and we were unable to recover it. 00:27:28.134 [2024-12-08 02:29:55.566019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.566173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.566201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.134 qpair failed and we were unable to recover it. 00:27:28.134 [2024-12-08 02:29:55.566353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.566446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.566471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.134 qpair failed and we were unable to recover it. 00:27:28.134 [2024-12-08 02:29:55.566623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.566735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.566760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.134 qpair failed and we were unable to recover it. 00:27:28.134 [2024-12-08 02:29:55.566845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.567026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.567052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.134 qpair failed and we were unable to recover it. 00:27:28.134 [2024-12-08 02:29:55.567143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.567227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.567270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.134 qpair failed and we were unable to recover it. 00:27:28.134 [2024-12-08 02:29:55.567407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.567527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.134 [2024-12-08 02:29:55.567560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.134 qpair failed and we were unable to recover it. 00:27:28.135 [2024-12-08 02:29:55.567661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.567792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.567820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.135 qpair failed and we were unable to recover it. 00:27:28.135 [2024-12-08 02:29:55.567975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.568073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.568101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.135 qpair failed and we were unable to recover it. 00:27:28.135 [2024-12-08 02:29:55.568225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.568316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.568344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.135 qpair failed and we were unable to recover it. 00:27:28.135 [2024-12-08 02:29:55.568481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.568574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.568600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.135 qpair failed and we were unable to recover it. 00:27:28.135 [2024-12-08 02:29:55.568687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.568807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.568835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.135 qpair failed and we were unable to recover it. 00:27:28.135 [2024-12-08 02:29:55.568948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.569037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.569065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.135 qpair failed and we were unable to recover it. 00:27:28.135 [2024-12-08 02:29:55.569151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.569285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.569311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.135 qpair failed and we were unable to recover it. 00:27:28.135 [2024-12-08 02:29:55.569387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.569466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.569491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.135 qpair failed and we were unable to recover it. 00:27:28.135 [2024-12-08 02:29:55.569614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.569695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.569737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.135 qpair failed and we were unable to recover it. 00:27:28.135 [2024-12-08 02:29:55.569828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.569950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.569979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.135 qpair failed and we were unable to recover it. 00:27:28.135 [2024-12-08 02:29:55.570066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.570198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.570226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.135 qpair failed and we were unable to recover it. 00:27:28.135 [2024-12-08 02:29:55.570361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.570441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.570477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.135 qpair failed and we were unable to recover it. 00:27:28.135 [2024-12-08 02:29:55.570580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.570682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.570707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.135 qpair failed and we were unable to recover it. 00:27:28.135 [2024-12-08 02:29:55.570797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.570896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.570924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.135 qpair failed and we were unable to recover it. 00:27:28.135 [2024-12-08 02:29:55.571008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.571125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.571153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.135 qpair failed and we were unable to recover it. 00:27:28.135 [2024-12-08 02:29:55.571309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.571444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.571469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.135 qpair failed and we were unable to recover it. 00:27:28.135 [2024-12-08 02:29:55.571564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.571678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.571706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.135 qpair failed and we were unable to recover it. 00:27:28.135 [2024-12-08 02:29:55.571860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.571943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.571968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.135 qpair failed and we were unable to recover it. 00:27:28.135 [2024-12-08 02:29:55.572081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.572166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.572191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.135 qpair failed and we were unable to recover it. 00:27:28.135 [2024-12-08 02:29:55.572345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.572457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.572483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.135 qpair failed and we were unable to recover it. 00:27:28.135 [2024-12-08 02:29:55.572598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.572751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.572779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.135 qpair failed and we were unable to recover it. 00:27:28.135 [2024-12-08 02:29:55.572887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.573005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.573033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.135 qpair failed and we were unable to recover it. 00:27:28.135 [2024-12-08 02:29:55.573125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.573243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.573271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.135 qpair failed and we were unable to recover it. 00:27:28.135 [2024-12-08 02:29:55.573388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.573503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.573554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.135 qpair failed and we were unable to recover it. 00:27:28.135 [2024-12-08 02:29:55.573678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.573764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.573791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.135 qpair failed and we were unable to recover it. 00:27:28.135 [2024-12-08 02:29:55.573959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.574106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.574134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.135 qpair failed and we were unable to recover it. 00:27:28.135 [2024-12-08 02:29:55.574232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.574364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.574390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.135 qpair failed and we were unable to recover it. 00:27:28.135 [2024-12-08 02:29:55.574512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.574603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.574629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.135 qpair failed and we were unable to recover it. 00:27:28.135 [2024-12-08 02:29:55.574725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.135 [2024-12-08 02:29:55.574864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.574898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.136 qpair failed and we were unable to recover it. 00:27:28.136 [2024-12-08 02:29:55.574989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.575104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.575129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.136 qpair failed and we were unable to recover it. 00:27:28.136 [2024-12-08 02:29:55.575281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.575417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.575444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.136 qpair failed and we were unable to recover it. 00:27:28.136 [2024-12-08 02:29:55.575544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.575685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.575711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.136 qpair failed and we were unable to recover it. 00:27:28.136 [2024-12-08 02:29:55.575831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.575958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.575985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.136 qpair failed and we were unable to recover it. 00:27:28.136 [2024-12-08 02:29:55.576087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.576212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.576240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.136 qpair failed and we were unable to recover it. 00:27:28.136 [2024-12-08 02:29:55.576362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.576450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.576478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.136 qpair failed and we were unable to recover it. 00:27:28.136 [2024-12-08 02:29:55.576625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.576739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.576765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.136 qpair failed and we were unable to recover it. 00:27:28.136 [2024-12-08 02:29:55.576865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.576983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.577012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.136 qpair failed and we were unable to recover it. 00:27:28.136 [2024-12-08 02:29:55.577163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.577252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.577281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.136 qpair failed and we were unable to recover it. 00:27:28.136 [2024-12-08 02:29:55.577432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.577521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.577563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.136 qpair failed and we were unable to recover it. 00:27:28.136 [2024-12-08 02:29:55.577728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.577846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.577872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.136 qpair failed and we were unable to recover it. 00:27:28.136 [2024-12-08 02:29:55.578045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.578173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.578201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.136 qpair failed and we were unable to recover it. 00:27:28.136 [2024-12-08 02:29:55.578323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.578421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.578449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.136 qpair failed and we were unable to recover it. 00:27:28.136 [2024-12-08 02:29:55.578614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.578778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.578803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.136 qpair failed and we were unable to recover it. 00:27:28.136 [2024-12-08 02:29:55.578901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.578982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.579007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.136 qpair failed and we were unable to recover it. 00:27:28.136 [2024-12-08 02:29:55.579152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.579270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.579298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.136 qpair failed and we were unable to recover it. 00:27:28.136 [2024-12-08 02:29:55.579420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.579548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.579578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.136 qpair failed and we were unable to recover it. 00:27:28.136 [2024-12-08 02:29:55.579743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.579831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.579857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.136 qpair failed and we were unable to recover it. 00:27:28.136 [2024-12-08 02:29:55.579996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.580110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.580135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.136 qpair failed and we were unable to recover it. 00:27:28.136 [2024-12-08 02:29:55.580310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.580397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.580426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.136 qpair failed and we were unable to recover it. 00:27:28.136 [2024-12-08 02:29:55.580528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.580652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.580680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.136 qpair failed and we were unable to recover it. 00:27:28.136 [2024-12-08 02:29:55.580782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.580904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.580933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.136 qpair failed and we were unable to recover it. 00:27:28.136 [2024-12-08 02:29:55.581049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.581191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.581216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.136 qpair failed and we were unable to recover it. 00:27:28.136 [2024-12-08 02:29:55.581349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.581449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.581478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.136 qpair failed and we were unable to recover it. 00:27:28.136 [2024-12-08 02:29:55.581618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.581704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.581732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.136 qpair failed and we were unable to recover it. 00:27:28.136 [2024-12-08 02:29:55.581834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.582000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.582025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.136 qpair failed and we were unable to recover it. 00:27:28.136 [2024-12-08 02:29:55.582134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.582274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.582300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.136 qpair failed and we were unable to recover it. 00:27:28.136 [2024-12-08 02:29:55.582411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.582555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.136 [2024-12-08 02:29:55.582584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.136 qpair failed and we were unable to recover it. 00:27:28.137 [2024-12-08 02:29:55.582678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.582799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.582828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.137 qpair failed and we were unable to recover it. 00:27:28.137 [2024-12-08 02:29:55.582957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.583092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.583120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.137 qpair failed and we were unable to recover it. 00:27:28.137 [2024-12-08 02:29:55.583262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.583414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.583439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.137 qpair failed and we were unable to recover it. 00:27:28.137 [2024-12-08 02:29:55.583567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.583696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.583722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.137 qpair failed and we were unable to recover it. 00:27:28.137 [2024-12-08 02:29:55.583875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.583969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.583997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.137 qpair failed and we were unable to recover it. 00:27:28.137 [2024-12-08 02:29:55.584120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.584253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.584282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.137 qpair failed and we were unable to recover it. 00:27:28.137 [2024-12-08 02:29:55.584393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.584508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.584533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.137 qpair failed and we were unable to recover it. 00:27:28.137 [2024-12-08 02:29:55.584641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.584768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.584796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.137 qpair failed and we were unable to recover it. 00:27:28.137 [2024-12-08 02:29:55.584929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.585069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.585097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.137 qpair failed and we were unable to recover it. 00:27:28.137 [2024-12-08 02:29:55.585249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.585403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.585431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.137 qpair failed and we were unable to recover it. 00:27:28.137 [2024-12-08 02:29:55.585566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.585653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.585679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.137 qpair failed and we were unable to recover it. 00:27:28.137 [2024-12-08 02:29:55.585769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.585884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.585924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.137 qpair failed and we were unable to recover it. 00:27:28.137 [2024-12-08 02:29:55.586064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.586173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.586199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.137 qpair failed and we were unable to recover it. 00:27:28.137 [2024-12-08 02:29:55.586331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.586451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.586480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.137 qpair failed and we were unable to recover it. 00:27:28.137 [2024-12-08 02:29:55.586626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.586743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.586768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.137 qpair failed and we were unable to recover it. 00:27:28.137 [2024-12-08 02:29:55.586871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.586949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.586974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.137 qpair failed and we were unable to recover it. 00:27:28.137 [2024-12-08 02:29:55.587090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.587196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.587225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.137 qpair failed and we were unable to recover it. 00:27:28.137 [2024-12-08 02:29:55.587352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.587478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.587504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.137 qpair failed and we were unable to recover it. 00:27:28.137 [2024-12-08 02:29:55.587660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.587804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.587829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.137 qpair failed and we were unable to recover it. 00:27:28.137 [2024-12-08 02:29:55.587933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.588049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.588077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.137 qpair failed and we were unable to recover it. 00:27:28.137 [2024-12-08 02:29:55.588205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.588299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.588328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.137 qpair failed and we were unable to recover it. 00:27:28.137 [2024-12-08 02:29:55.588458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.588550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.588579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.137 qpair failed and we were unable to recover it. 00:27:28.137 [2024-12-08 02:29:55.588690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.588774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.588799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.137 qpair failed and we were unable to recover it. 00:27:28.137 [2024-12-08 02:29:55.588910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.589013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.589041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.137 qpair failed and we were unable to recover it. 00:27:28.137 [2024-12-08 02:29:55.589161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.589280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.137 [2024-12-08 02:29:55.589317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.138 qpair failed and we were unable to recover it. 00:27:28.138 [2024-12-08 02:29:55.589449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.589602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.589644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.138 qpair failed and we were unable to recover it. 00:27:28.138 [2024-12-08 02:29:55.589758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.589896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.589921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.138 qpair failed and we were unable to recover it. 00:27:28.138 [2024-12-08 02:29:55.590024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.590146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.590175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.138 qpair failed and we were unable to recover it. 00:27:28.138 [2024-12-08 02:29:55.590311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.590394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.590427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.138 qpair failed and we were unable to recover it. 00:27:28.138 [2024-12-08 02:29:55.590550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.590676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.590704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.138 qpair failed and we were unable to recover it. 00:27:28.138 [2024-12-08 02:29:55.590811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.590958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.590983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.138 qpair failed and we were unable to recover it. 00:27:28.138 [2024-12-08 02:29:55.591123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.591277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.591304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.138 qpair failed and we were unable to recover it. 00:27:28.138 [2024-12-08 02:29:55.591427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.591559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.591588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.138 qpair failed and we were unable to recover it. 00:27:28.138 [2024-12-08 02:29:55.591736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.591855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.591884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.138 qpair failed and we were unable to recover it. 00:27:28.138 [2024-12-08 02:29:55.591988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.592103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.592130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.138 qpair failed and we were unable to recover it. 00:27:28.138 [2024-12-08 02:29:55.592214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.592345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.592373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.138 qpair failed and we were unable to recover it. 00:27:28.138 [2024-12-08 02:29:55.592475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.592602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.592631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.138 qpair failed and we were unable to recover it. 00:27:28.138 [2024-12-08 02:29:55.592728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.592849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.592877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.138 qpair failed and we were unable to recover it. 00:27:28.138 [2024-12-08 02:29:55.593008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.593146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.593175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.138 qpair failed and we were unable to recover it. 00:27:28.138 [2024-12-08 02:29:55.593336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.593475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.593500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.138 qpair failed and we were unable to recover it. 00:27:28.138 [2024-12-08 02:29:55.593629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.593751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.593779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.138 qpair failed and we were unable to recover it. 00:27:28.138 [2024-12-08 02:29:55.593901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.594022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.594050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.138 qpair failed and we were unable to recover it. 00:27:28.138 [2024-12-08 02:29:55.594193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.594310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.594336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.138 qpair failed and we were unable to recover it. 00:27:28.138 [2024-12-08 02:29:55.594462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.594587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.594616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.138 qpair failed and we were unable to recover it. 00:27:28.138 [2024-12-08 02:29:55.594731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.594819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.594847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.138 qpair failed and we were unable to recover it. 00:27:28.138 [2024-12-08 02:29:55.594959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.595076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.595103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.138 qpair failed and we were unable to recover it. 00:27:28.138 [2024-12-08 02:29:55.595265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.595383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.595408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.138 qpair failed and we were unable to recover it. 00:27:28.138 [2024-12-08 02:29:55.595577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.595703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.595731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.138 qpair failed and we were unable to recover it. 00:27:28.138 [2024-12-08 02:29:55.595827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.595964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.595993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.138 qpair failed and we were unable to recover it. 00:27:28.138 [2024-12-08 02:29:55.596118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.596276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.596303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.138 qpair failed and we were unable to recover it. 00:27:28.138 [2024-12-08 02:29:55.596415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.596510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.596543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.138 qpair failed and we were unable to recover it. 00:27:28.138 [2024-12-08 02:29:55.596665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.596777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.596806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.138 qpair failed and we were unable to recover it. 00:27:28.138 [2024-12-08 02:29:55.596893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.597016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.597043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.138 qpair failed and we were unable to recover it. 00:27:28.138 [2024-12-08 02:29:55.597144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.138 [2024-12-08 02:29:55.597260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.597291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.139 qpair failed and we were unable to recover it. 00:27:28.139 [2024-12-08 02:29:55.597423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.597533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.597572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.139 qpair failed and we were unable to recover it. 00:27:28.139 [2024-12-08 02:29:55.597677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.597809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.597835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.139 qpair failed and we were unable to recover it. 00:27:28.139 [2024-12-08 02:29:55.597986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.598065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.598093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.139 qpair failed and we were unable to recover it. 00:27:28.139 [2024-12-08 02:29:55.598192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.598312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.598340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.139 qpair failed and we were unable to recover it. 00:27:28.139 [2024-12-08 02:29:55.598469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.598554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.598584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.139 qpair failed and we were unable to recover it. 00:27:28.139 [2024-12-08 02:29:55.598706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.598815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.598843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.139 qpair failed and we were unable to recover it. 00:27:28.139 [2024-12-08 02:29:55.598969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.599062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.599091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.139 qpair failed and we were unable to recover it. 00:27:28.139 [2024-12-08 02:29:55.599195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.599293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.599321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.139 qpair failed and we were unable to recover it. 00:27:28.139 [2024-12-08 02:29:55.599424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.599531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.599563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.139 qpair failed and we were unable to recover it. 00:27:28.139 [2024-12-08 02:29:55.599651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.599813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.599841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.139 qpair failed and we were unable to recover it. 00:27:28.139 [2024-12-08 02:29:55.599950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.600101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.600129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.139 qpair failed and we were unable to recover it. 00:27:28.139 [2024-12-08 02:29:55.600280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.600442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.600476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.139 qpair failed and we were unable to recover it. 00:27:28.139 [2024-12-08 02:29:55.600605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.600719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.600744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.139 qpair failed and we were unable to recover it. 00:27:28.139 [2024-12-08 02:29:55.600837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.600977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.601005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.139 qpair failed and we were unable to recover it. 00:27:28.139 [2024-12-08 02:29:55.601133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.601261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.601288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.139 qpair failed and we were unable to recover it. 00:27:28.139 [2024-12-08 02:29:55.601413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.601526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.601560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.139 qpair failed and we were unable to recover it. 00:27:28.139 [2024-12-08 02:29:55.601657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.601767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.601793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.139 qpair failed and we were unable to recover it. 00:27:28.139 [2024-12-08 02:29:55.601929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.602064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.602093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.139 qpair failed and we were unable to recover it. 00:27:28.139 [2024-12-08 02:29:55.602181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.602278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.602306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.139 qpair failed and we were unable to recover it. 00:27:28.139 [2024-12-08 02:29:55.602466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.602576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.602602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.139 qpair failed and we were unable to recover it. 00:27:28.139 [2024-12-08 02:29:55.602694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.602767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.602792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.139 qpair failed and we were unable to recover it. 00:27:28.139 [2024-12-08 02:29:55.602924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.603005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.603033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.139 qpair failed and we were unable to recover it. 00:27:28.139 [2024-12-08 02:29:55.603167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.603277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.603303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.139 qpair failed and we were unable to recover it. 00:27:28.139 [2024-12-08 02:29:55.603428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.603513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.603547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.139 qpair failed and we were unable to recover it. 00:27:28.139 [2024-12-08 02:29:55.603686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.603798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.603825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.139 qpair failed and we were unable to recover it. 00:27:28.139 [2024-12-08 02:29:55.603935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.604037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.604065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.139 qpair failed and we were unable to recover it. 00:27:28.139 [2024-12-08 02:29:55.604151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.604248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.604276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.139 qpair failed and we were unable to recover it. 00:27:28.139 [2024-12-08 02:29:55.604393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.604541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.139 [2024-12-08 02:29:55.604570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.139 qpair failed and we were unable to recover it. 00:27:28.139 [2024-12-08 02:29:55.604669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.604751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.604777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.140 qpair failed and we were unable to recover it. 00:27:28.140 [2024-12-08 02:29:55.604888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.604982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.605007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.140 qpair failed and we were unable to recover it. 00:27:28.140 [2024-12-08 02:29:55.605125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.605255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.605289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.140 qpair failed and we were unable to recover it. 00:27:28.140 [2024-12-08 02:29:55.605383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.605464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.605493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.140 qpair failed and we were unable to recover it. 00:27:28.140 [2024-12-08 02:29:55.605610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.605720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.605745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.140 qpair failed and we were unable to recover it. 00:27:28.140 [2024-12-08 02:29:55.605830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.605943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.605969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.140 qpair failed and we were unable to recover it. 00:27:28.140 [2024-12-08 02:29:55.606048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.606153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.606181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.140 qpair failed and we were unable to recover it. 00:27:28.140 [2024-12-08 02:29:55.606309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.606398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.606426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.140 qpair failed and we were unable to recover it. 00:27:28.140 [2024-12-08 02:29:55.606568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.606655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.606681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.140 qpair failed and we were unable to recover it. 00:27:28.140 [2024-12-08 02:29:55.606821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.606982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.607007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.140 qpair failed and we were unable to recover it. 00:27:28.140 [2024-12-08 02:29:55.607100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.607232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.607261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.140 qpair failed and we were unable to recover it. 00:27:28.140 [2024-12-08 02:29:55.607386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.607518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.607553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.140 qpair failed and we were unable to recover it. 00:27:28.140 [2024-12-08 02:29:55.607661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.607807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.607832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.140 qpair failed and we were unable to recover it. 00:27:28.140 [2024-12-08 02:29:55.607943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.608026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.608054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.140 qpair failed and we were unable to recover it. 00:27:28.140 [2024-12-08 02:29:55.608181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.608296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.608324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.140 qpair failed and we were unable to recover it. 00:27:28.140 [2024-12-08 02:29:55.608463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.608546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.608574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.140 qpair failed and we were unable to recover it. 00:27:28.140 [2024-12-08 02:29:55.608702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.608779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.608805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.140 qpair failed and we were unable to recover it. 00:27:28.140 [2024-12-08 02:29:55.608901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.609036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.609062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.140 qpair failed and we were unable to recover it. 00:27:28.140 [2024-12-08 02:29:55.609143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.609251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.609276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.140 qpair failed and we were unable to recover it. 00:27:28.140 [2024-12-08 02:29:55.609443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.609565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.609594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.140 qpair failed and we were unable to recover it. 00:27:28.140 [2024-12-08 02:29:55.609700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.609806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.609831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.140 qpair failed and we were unable to recover it. 00:27:28.140 [2024-12-08 02:29:55.609921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.610039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.610064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.140 qpair failed and we were unable to recover it. 00:27:28.140 [2024-12-08 02:29:55.610176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.610282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.610310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.140 qpair failed and we were unable to recover it. 00:27:28.140 [2024-12-08 02:29:55.610406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.610527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.610583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.140 qpair failed and we were unable to recover it. 00:27:28.140 [2024-12-08 02:29:55.610687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.610795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.610820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.140 qpair failed and we were unable to recover it. 00:27:28.140 [2024-12-08 02:29:55.610934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.611059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.611087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.140 qpair failed and we were unable to recover it. 00:27:28.140 [2024-12-08 02:29:55.611218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.611353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.611378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.140 qpair failed and we were unable to recover it. 00:27:28.140 [2024-12-08 02:29:55.611520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.611628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.611657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.140 qpair failed and we were unable to recover it. 00:27:28.140 [2024-12-08 02:29:55.611762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.611884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.140 [2024-12-08 02:29:55.611909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.140 qpair failed and we were unable to recover it. 00:27:28.141 [2024-12-08 02:29:55.612004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.612118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.612147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.141 qpair failed and we were unable to recover it. 00:27:28.141 [2024-12-08 02:29:55.612269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.612365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.612393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.141 qpair failed and we were unable to recover it. 00:27:28.141 [2024-12-08 02:29:55.612552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.612679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.612707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.141 qpair failed and we were unable to recover it. 00:27:28.141 [2024-12-08 02:29:55.612819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.612933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.612959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.141 qpair failed and we were unable to recover it. 00:27:28.141 [2024-12-08 02:29:55.613055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.613148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.613176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.141 qpair failed and we were unable to recover it. 00:27:28.141 [2024-12-08 02:29:55.613301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.613429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.613458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.141 qpair failed and we were unable to recover it. 00:27:28.141 [2024-12-08 02:29:55.613550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.613666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.613694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.141 qpair failed and we were unable to recover it. 00:27:28.141 [2024-12-08 02:29:55.613794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.613956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.613984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.141 qpair failed and we were unable to recover it. 00:27:28.141 [2024-12-08 02:29:55.614115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.614236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.614264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.141 qpair failed and we were unable to recover it. 00:27:28.141 [2024-12-08 02:29:55.614353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.614473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.614501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.141 qpair failed and we were unable to recover it. 00:27:28.141 [2024-12-08 02:29:55.614614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.614694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.614720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.141 qpair failed and we were unable to recover it. 00:27:28.141 [2024-12-08 02:29:55.614831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.614942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.614968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.141 qpair failed and we were unable to recover it. 00:27:28.141 [2024-12-08 02:29:55.615078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.615249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.615277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.141 qpair failed and we were unable to recover it. 00:27:28.141 [2024-12-08 02:29:55.615398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.615493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.615524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.141 qpair failed and we were unable to recover it. 00:27:28.141 [2024-12-08 02:29:55.615675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.615803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.615841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.141 qpair failed and we were unable to recover it. 00:27:28.141 [2024-12-08 02:29:55.615973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.616062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.616088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.141 qpair failed and we were unable to recover it. 00:27:28.141 [2024-12-08 02:29:55.616201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.616361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.616389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.141 qpair failed and we were unable to recover it. 00:27:28.141 [2024-12-08 02:29:55.616515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.616665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.616691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.141 qpair failed and we were unable to recover it. 00:27:28.141 [2024-12-08 02:29:55.616855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.616955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.616984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.141 qpair failed and we were unable to recover it. 00:27:28.141 [2024-12-08 02:29:55.617118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.617217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.617242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.141 qpair failed and we were unable to recover it. 00:27:28.141 [2024-12-08 02:29:55.617363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.617491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.617520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.141 qpair failed and we were unable to recover it. 00:27:28.141 [2024-12-08 02:29:55.617635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.617755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.617783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.141 qpair failed and we were unable to recover it. 00:27:28.141 [2024-12-08 02:29:55.617947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.618039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.618067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.141 qpair failed and we were unable to recover it. 00:27:28.141 [2024-12-08 02:29:55.618176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.618252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.618279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.141 qpair failed and we were unable to recover it. 00:27:28.141 [2024-12-08 02:29:55.618440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.618566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.618595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.141 qpair failed and we were unable to recover it. 00:27:28.141 [2024-12-08 02:29:55.618734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.618879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.618909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.141 qpair failed and we were unable to recover it. 00:27:28.141 [2024-12-08 02:29:55.619035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.619191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.619219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.141 qpair failed and we were unable to recover it. 00:27:28.141 [2024-12-08 02:29:55.619352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.619460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.619486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.141 qpair failed and we were unable to recover it. 00:27:28.141 [2024-12-08 02:29:55.619593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.619715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.141 [2024-12-08 02:29:55.619744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.142 qpair failed and we were unable to recover it. 00:27:28.142 [2024-12-08 02:29:55.619872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.619976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.620004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.142 qpair failed and we were unable to recover it. 00:27:28.142 [2024-12-08 02:29:55.620144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.620254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.620279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.142 qpair failed and we were unable to recover it. 00:27:28.142 [2024-12-08 02:29:55.620425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.620509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.620534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.142 qpair failed and we were unable to recover it. 00:27:28.142 [2024-12-08 02:29:55.620639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.620791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.620819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.142 qpair failed and we were unable to recover it. 00:27:28.142 [2024-12-08 02:29:55.620912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.621033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.621061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.142 qpair failed and we were unable to recover it. 00:27:28.142 [2024-12-08 02:29:55.621153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.621243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.621272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.142 qpair failed and we were unable to recover it. 00:27:28.142 [2024-12-08 02:29:55.621411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.621522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.621556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.142 qpair failed and we were unable to recover it. 00:27:28.142 [2024-12-08 02:29:55.621665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.621767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.621795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.142 qpair failed and we were unable to recover it. 00:27:28.142 [2024-12-08 02:29:55.621974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.622115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.622141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.142 qpair failed and we were unable to recover it. 00:27:28.142 [2024-12-08 02:29:55.622276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.622367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.622397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.142 qpair failed and we were unable to recover it. 00:27:28.142 [2024-12-08 02:29:55.622528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.622660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.622685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.142 qpair failed and we were unable to recover it. 00:27:28.142 [2024-12-08 02:29:55.622839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.622922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.622947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.142 qpair failed and we were unable to recover it. 00:27:28.142 [2024-12-08 02:29:55.623061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.623170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.623199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.142 qpair failed and we were unable to recover it. 00:27:28.142 [2024-12-08 02:29:55.623352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.623520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.623561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.142 qpair failed and we were unable to recover it. 00:27:28.142 [2024-12-08 02:29:55.623647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.623731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.623755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.142 qpair failed and we were unable to recover it. 00:27:28.142 [2024-12-08 02:29:55.623841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.623953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.623981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.142 qpair failed and we were unable to recover it. 00:27:28.142 [2024-12-08 02:29:55.624123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.624203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.624231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.142 qpair failed and we were unable to recover it. 00:27:28.142 [2024-12-08 02:29:55.624349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.624483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.624512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.142 qpair failed and we were unable to recover it. 00:27:28.142 [2024-12-08 02:29:55.624633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.624745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.624770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.142 qpair failed and we were unable to recover it. 00:27:28.142 [2024-12-08 02:29:55.624887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.624988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.625016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.142 qpair failed and we were unable to recover it. 00:27:28.142 [2024-12-08 02:29:55.625115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.625267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.625295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.142 qpair failed and we were unable to recover it. 00:27:28.142 [2024-12-08 02:29:55.625467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.625638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.625664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.142 qpair failed and we were unable to recover it. 00:27:28.142 [2024-12-08 02:29:55.625784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.625905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.625930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.142 qpair failed and we were unable to recover it. 00:27:28.142 [2024-12-08 02:29:55.626049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.626138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.626163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.142 qpair failed and we were unable to recover it. 00:27:28.142 [2024-12-08 02:29:55.626274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.626399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.626427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.142 qpair failed and we were unable to recover it. 00:27:28.142 [2024-12-08 02:29:55.626518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.626678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.142 [2024-12-08 02:29:55.626707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.142 qpair failed and we were unable to recover it. 00:27:28.143 [2024-12-08 02:29:55.626855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.626994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.627019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.143 qpair failed and we were unable to recover it. 00:27:28.143 [2024-12-08 02:29:55.627157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.627260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.627288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.143 qpair failed and we were unable to recover it. 00:27:28.143 [2024-12-08 02:29:55.627406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.627499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.627527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.143 qpair failed and we were unable to recover it. 00:27:28.143 [2024-12-08 02:29:55.627649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.627771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.627800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.143 qpair failed and we were unable to recover it. 00:27:28.143 [2024-12-08 02:29:55.627950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.628035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.628060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.143 qpair failed and we were unable to recover it. 00:27:28.143 [2024-12-08 02:29:55.628196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.628289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.628317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.143 qpair failed and we were unable to recover it. 00:27:28.143 [2024-12-08 02:29:55.628447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.628558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.628602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.143 qpair failed and we were unable to recover it. 00:27:28.143 [2024-12-08 02:29:55.628691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.628807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.628835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.143 qpair failed and we were unable to recover it. 00:27:28.143 [2024-12-08 02:29:55.628970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.629087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.629113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.143 qpair failed and we were unable to recover it. 00:27:28.143 [2024-12-08 02:29:55.629206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.629317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.629342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.143 qpair failed and we were unable to recover it. 00:27:28.143 [2024-12-08 02:29:55.629420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.629561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.629591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.143 qpair failed and we were unable to recover it. 00:27:28.143 [2024-12-08 02:29:55.629759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.629882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.629907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.143 qpair failed and we were unable to recover it. 00:27:28.143 [2024-12-08 02:29:55.630024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.630145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.630171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.143 qpair failed and we were unable to recover it. 00:27:28.143 [2024-12-08 02:29:55.630329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.630453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.630485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.143 qpair failed and we were unable to recover it. 00:27:28.143 [2024-12-08 02:29:55.630633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.630754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.630779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.143 qpair failed and we were unable to recover it. 00:27:28.143 [2024-12-08 02:29:55.630864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.630973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.631000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.143 qpair failed and we were unable to recover it. 00:27:28.143 [2024-12-08 02:29:55.631137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.631221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.631246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.143 qpair failed and we were unable to recover it. 00:27:28.143 [2024-12-08 02:29:55.631361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.631458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.631486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.143 qpair failed and we were unable to recover it. 00:27:28.143 [2024-12-08 02:29:55.631629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.631747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.631772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.143 qpair failed and we were unable to recover it. 00:27:28.143 [2024-12-08 02:29:55.631854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.631967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.631992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.143 qpair failed and we were unable to recover it. 00:27:28.143 [2024-12-08 02:29:55.632130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.632269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.632294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.143 qpair failed and we were unable to recover it. 00:27:28.143 [2024-12-08 02:29:55.632432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.632520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.632554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.143 qpair failed and we were unable to recover it. 00:27:28.143 [2024-12-08 02:29:55.632656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.632813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.632841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.143 qpair failed and we were unable to recover it. 00:27:28.143 [2024-12-08 02:29:55.632938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.633097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.633126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.143 qpair failed and we were unable to recover it. 00:27:28.143 [2024-12-08 02:29:55.633238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.633320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.633345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.143 qpair failed and we were unable to recover it. 00:27:28.143 [2024-12-08 02:29:55.633476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.633601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.633631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.143 qpair failed and we were unable to recover it. 00:27:28.143 [2024-12-08 02:29:55.633724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.633857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.633886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.143 qpair failed and we were unable to recover it. 00:27:28.143 [2024-12-08 02:29:55.634013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.634104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.634132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.143 qpair failed and we were unable to recover it. 00:27:28.143 [2024-12-08 02:29:55.634257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.143 [2024-12-08 02:29:55.634363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.634388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.144 qpair failed and we were unable to recover it. 00:27:28.144 [2024-12-08 02:29:55.634479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.634631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.634660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.144 qpair failed and we were unable to recover it. 00:27:28.144 [2024-12-08 02:29:55.634748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.634866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.634894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.144 qpair failed and we were unable to recover it. 00:27:28.144 [2024-12-08 02:29:55.634994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.635126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.635152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.144 qpair failed and we were unable to recover it. 00:27:28.144 [2024-12-08 02:29:55.635258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.635377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.635402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.144 qpair failed and we were unable to recover it. 00:27:28.144 [2024-12-08 02:29:55.635545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.635633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.635665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.144 qpair failed and we were unable to recover it. 00:27:28.144 [2024-12-08 02:29:55.635810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.635924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.635949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.144 qpair failed and we were unable to recover it. 00:27:28.144 [2024-12-08 02:29:55.636079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.636243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.636268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.144 qpair failed and we were unable to recover it. 00:27:28.144 [2024-12-08 02:29:55.636409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.636496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.636521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.144 qpair failed and we were unable to recover it. 00:27:28.144 [2024-12-08 02:29:55.636622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.636706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.636731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.144 qpair failed and we were unable to recover it. 00:27:28.144 [2024-12-08 02:29:55.636887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.636998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.637025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.144 qpair failed and we were unable to recover it. 00:27:28.144 [2024-12-08 02:29:55.637128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.637264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.637289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.144 qpair failed and we were unable to recover it. 00:27:28.144 [2024-12-08 02:29:55.637431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.637548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.637574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.144 qpair failed and we were unable to recover it. 00:27:28.144 [2024-12-08 02:29:55.637681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.637847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.637875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.144 qpair failed and we were unable to recover it. 00:27:28.144 [2024-12-08 02:29:55.637967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.638082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.638110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.144 qpair failed and we were unable to recover it. 00:27:28.144 [2024-12-08 02:29:55.638234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.638361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.638394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.144 qpair failed and we were unable to recover it. 00:27:28.144 [2024-12-08 02:29:55.638533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.638656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.638681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.144 qpair failed and we were unable to recover it. 00:27:28.144 [2024-12-08 02:29:55.638831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.638925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.638953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.144 qpair failed and we were unable to recover it. 00:27:28.144 [2024-12-08 02:29:55.639046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.639158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.639183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.144 qpair failed and we were unable to recover it. 00:27:28.144 [2024-12-08 02:29:55.639285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.639440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.639468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.144 qpair failed and we were unable to recover it. 00:27:28.144 [2024-12-08 02:29:55.639588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.639679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.639705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.144 qpair failed and we were unable to recover it. 00:27:28.144 [2024-12-08 02:29:55.639839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.639967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.639995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.144 qpair failed and we were unable to recover it. 00:27:28.144 [2024-12-08 02:29:55.640141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.640232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.640260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.144 qpair failed and we were unable to recover it. 00:27:28.144 [2024-12-08 02:29:55.640360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.640487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.640512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.144 qpair failed and we were unable to recover it. 00:27:28.144 [2024-12-08 02:29:55.640612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.640695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.640720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.144 qpair failed and we were unable to recover it. 00:27:28.144 [2024-12-08 02:29:55.640833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.640916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.640968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.144 qpair failed and we were unable to recover it. 00:27:28.144 [2024-12-08 02:29:55.641105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.641194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.641224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.144 qpair failed and we were unable to recover it. 00:27:28.144 [2024-12-08 02:29:55.641383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.641476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.641505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.144 qpair failed and we were unable to recover it. 00:27:28.144 [2024-12-08 02:29:55.641634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.641757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.641785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.144 qpair failed and we were unable to recover it. 00:27:28.144 [2024-12-08 02:29:55.641886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.144 [2024-12-08 02:29:55.641972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.642000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.145 qpair failed and we were unable to recover it. 00:27:28.145 [2024-12-08 02:29:55.642120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.642239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.642268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.145 qpair failed and we were unable to recover it. 00:27:28.145 [2024-12-08 02:29:55.642421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.642516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.642550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.145 qpair failed and we were unable to recover it. 00:27:28.145 [2024-12-08 02:29:55.642697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.642813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.642838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.145 qpair failed and we were unable to recover it. 00:27:28.145 [2024-12-08 02:29:55.642959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.643066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.643090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.145 qpair failed and we were unable to recover it. 00:27:28.145 [2024-12-08 02:29:55.643169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.643309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.643335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.145 qpair failed and we were unable to recover it. 00:27:28.145 [2024-12-08 02:29:55.643461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.643586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.643615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.145 qpair failed and we were unable to recover it. 00:27:28.145 [2024-12-08 02:29:55.643720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.643811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.643836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.145 qpair failed and we were unable to recover it. 00:27:28.145 [2024-12-08 02:29:55.643971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.644100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.644128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.145 qpair failed and we were unable to recover it. 00:27:28.145 [2024-12-08 02:29:55.644261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.644377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.644405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.145 qpair failed and we were unable to recover it. 00:27:28.145 [2024-12-08 02:29:55.644543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.644692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.644721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.145 qpair failed and we were unable to recover it. 00:27:28.145 [2024-12-08 02:29:55.644842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.644959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.644985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.145 qpair failed and we were unable to recover it. 00:27:28.145 [2024-12-08 02:29:55.645098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.645207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.645233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.145 qpair failed and we were unable to recover it. 00:27:28.145 [2024-12-08 02:29:55.645366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.645512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.645556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.145 qpair failed and we were unable to recover it. 00:27:28.145 [2024-12-08 02:29:55.645655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.645782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.645808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.145 qpair failed and we were unable to recover it. 00:27:28.145 [2024-12-08 02:29:55.645889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.646013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.646038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.145 qpair failed and we were unable to recover it. 00:27:28.145 [2024-12-08 02:29:55.646168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.646261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.646289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.145 qpair failed and we were unable to recover it. 00:27:28.145 [2024-12-08 02:29:55.646440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.646525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.646560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.145 qpair failed and we were unable to recover it. 00:27:28.145 [2024-12-08 02:29:55.646698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.646803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.646829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.145 qpair failed and we were unable to recover it. 00:27:28.145 [2024-12-08 02:29:55.646944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.647056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.647081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.145 qpair failed and we were unable to recover it. 00:27:28.145 [2024-12-08 02:29:55.647206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.647304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.647333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.145 qpair failed and we were unable to recover it. 00:27:28.145 [2024-12-08 02:29:55.647457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.647585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.647615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.145 qpair failed and we were unable to recover it. 00:27:28.145 [2024-12-08 02:29:55.647755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.647879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.647905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.145 qpair failed and we were unable to recover it. 00:27:28.145 [2024-12-08 02:29:55.647992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.648132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.648158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.145 qpair failed and we were unable to recover it. 00:27:28.145 [2024-12-08 02:29:55.648244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.648360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.648388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.145 qpair failed and we were unable to recover it. 00:27:28.145 [2024-12-08 02:29:55.648500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.648631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.648660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.145 qpair failed and we were unable to recover it. 00:27:28.145 [2024-12-08 02:29:55.648778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.648935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.648961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.145 qpair failed and we were unable to recover it. 00:27:28.145 [2024-12-08 02:29:55.649078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.649184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.649210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.145 qpair failed and we were unable to recover it. 00:27:28.145 [2024-12-08 02:29:55.649332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.649426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.145 [2024-12-08 02:29:55.649454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.145 qpair failed and we were unable to recover it. 00:27:28.146 [2024-12-08 02:29:55.649604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.649724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.649752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.146 qpair failed and we were unable to recover it. 00:27:28.146 [2024-12-08 02:29:55.649874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.649965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.649993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.146 qpair failed and we were unable to recover it. 00:27:28.146 [2024-12-08 02:29:55.650153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.650276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.650301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.146 qpair failed and we were unable to recover it. 00:27:28.146 [2024-12-08 02:29:55.650418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.650549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.650578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.146 qpair failed and we were unable to recover it. 00:27:28.146 [2024-12-08 02:29:55.650703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.650812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.650837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.146 qpair failed and we were unable to recover it. 00:27:28.146 [2024-12-08 02:29:55.651005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.651136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.651165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.146 qpair failed and we were unable to recover it. 00:27:28.146 [2024-12-08 02:29:55.651326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.651409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.651435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.146 qpair failed and we were unable to recover it. 00:27:28.146 [2024-12-08 02:29:55.651560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.651658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.651687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.146 qpair failed and we were unable to recover it. 00:27:28.146 [2024-12-08 02:29:55.651839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.651933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.651960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.146 qpair failed and we were unable to recover it. 00:27:28.146 [2024-12-08 02:29:55.652052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.652175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.652203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.146 qpair failed and we were unable to recover it. 00:27:28.146 [2024-12-08 02:29:55.652362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.652473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.652505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.146 qpair failed and we were unable to recover it. 00:27:28.146 [2024-12-08 02:29:55.652612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.652739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.652768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.146 qpair failed and we were unable to recover it. 00:27:28.146 [2024-12-08 02:29:55.652898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.653050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.653079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.146 qpair failed and we were unable to recover it. 00:27:28.146 [2024-12-08 02:29:55.653204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.653324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.653352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.146 qpair failed and we were unable to recover it. 00:27:28.146 [2024-12-08 02:29:55.653478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.653593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.653620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.146 qpair failed and we were unable to recover it. 00:27:28.146 [2024-12-08 02:29:55.653746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.653863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.653891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.146 qpair failed and we were unable to recover it. 00:27:28.146 [2024-12-08 02:29:55.653980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.654063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.654090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.146 qpair failed and we were unable to recover it. 00:27:28.146 [2024-12-08 02:29:55.654223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.654309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.654337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.146 qpair failed and we were unable to recover it. 00:27:28.146 [2024-12-08 02:29:55.654448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.654564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.654591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.146 qpair failed and we were unable to recover it. 00:27:28.146 [2024-12-08 02:29:55.654706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.654842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.654867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.146 qpair failed and we were unable to recover it. 00:27:28.146 [2024-12-08 02:29:55.654994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.655131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.655160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.146 qpair failed and we were unable to recover it. 00:27:28.146 [2024-12-08 02:29:55.655308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.655423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.655449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.146 qpair failed and we were unable to recover it. 00:27:28.146 [2024-12-08 02:29:55.655564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.655678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.655703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.146 qpair failed and we were unable to recover it. 00:27:28.146 [2024-12-08 02:29:55.655810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.655960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.655989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.146 qpair failed and we were unable to recover it. 00:27:28.146 [2024-12-08 02:29:55.656116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.656229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.656257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.146 qpair failed and we were unable to recover it. 00:27:28.146 [2024-12-08 02:29:55.656387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.656513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.146 [2024-12-08 02:29:55.656548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.146 qpair failed and we were unable to recover it. 00:27:28.147 [2024-12-08 02:29:55.656682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.656801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.656826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.147 qpair failed and we were unable to recover it. 00:27:28.147 [2024-12-08 02:29:55.656952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.657035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.657061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.147 qpair failed and we were unable to recover it. 00:27:28.147 [2024-12-08 02:29:55.657150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.657311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.657340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.147 qpair failed and we were unable to recover it. 00:27:28.147 [2024-12-08 02:29:55.657439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.657557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.657586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.147 qpair failed and we were unable to recover it. 00:27:28.147 [2024-12-08 02:29:55.657712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.657795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.657821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.147 qpair failed and we were unable to recover it. 00:27:28.147 [2024-12-08 02:29:55.657972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.658071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.658099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.147 qpair failed and we were unable to recover it. 00:27:28.147 [2024-12-08 02:29:55.658232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.658376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.658402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.147 qpair failed and we were unable to recover it. 00:27:28.147 [2024-12-08 02:29:55.658563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.658684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.658712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.147 qpair failed and we were unable to recover it. 00:27:28.147 [2024-12-08 02:29:55.658811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.658931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.658956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.147 qpair failed and we were unable to recover it. 00:27:28.147 [2024-12-08 02:29:55.659044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.659155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.659180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.147 qpair failed and we were unable to recover it. 00:27:28.147 [2024-12-08 02:29:55.659361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.659454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.659482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.147 qpair failed and we were unable to recover it. 00:27:28.147 [2024-12-08 02:29:55.659628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.659744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.659769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.147 qpair failed and we were unable to recover it. 00:27:28.147 [2024-12-08 02:29:55.659915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.660022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.660048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.147 qpair failed and we were unable to recover it. 00:27:28.147 [2024-12-08 02:29:55.660186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.660280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.660309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.147 qpair failed and we were unable to recover it. 00:27:28.147 [2024-12-08 02:29:55.660406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.660520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.660554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.147 qpair failed and we were unable to recover it. 00:27:28.147 [2024-12-08 02:29:55.660651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.660810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.660839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.147 qpair failed and we were unable to recover it. 00:27:28.147 [2024-12-08 02:29:55.661000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.661113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.661138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.147 qpair failed and we were unable to recover it. 00:27:28.147 [2024-12-08 02:29:55.661282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.661376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.661404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.147 qpair failed and we were unable to recover it. 00:27:28.147 [2024-12-08 02:29:55.661524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.661653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.661682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.147 qpair failed and we were unable to recover it. 00:27:28.147 [2024-12-08 02:29:55.661799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.661925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.661954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.147 qpair failed and we were unable to recover it. 00:27:28.147 [2024-12-08 02:29:55.662066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.662178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.662203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.147 qpair failed and we were unable to recover it. 00:27:28.147 [2024-12-08 02:29:55.662335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.662420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.662449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.147 qpair failed and we were unable to recover it. 00:27:28.147 [2024-12-08 02:29:55.662587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.662701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.662727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.147 qpair failed and we were unable to recover it. 00:27:28.147 [2024-12-08 02:29:55.662850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.662961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.662989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.147 qpair failed and we were unable to recover it. 00:27:28.147 [2024-12-08 02:29:55.663156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.663269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.663295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.147 qpair failed and we were unable to recover it. 00:27:28.147 [2024-12-08 02:29:55.663440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.663590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.663619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.147 qpair failed and we were unable to recover it. 00:27:28.147 [2024-12-08 02:29:55.663718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.663805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.663835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.147 qpair failed and we were unable to recover it. 00:27:28.147 [2024-12-08 02:29:55.663928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.664054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.664082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.147 qpair failed and we were unable to recover it. 00:27:28.147 [2024-12-08 02:29:55.664211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.664297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.147 [2024-12-08 02:29:55.664322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.148 qpair failed and we were unable to recover it. 00:27:28.148 [2024-12-08 02:29:55.664404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.664548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.664577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.148 qpair failed and we were unable to recover it. 00:27:28.148 [2024-12-08 02:29:55.664662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.664754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.664782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.148 qpair failed and we were unable to recover it. 00:27:28.148 [2024-12-08 02:29:55.664961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.665073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.665099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.148 qpair failed and we were unable to recover it. 00:27:28.148 [2024-12-08 02:29:55.665237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.665324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.665349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.148 qpair failed and we were unable to recover it. 00:27:28.148 [2024-12-08 02:29:55.665461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.665557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.665587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.148 qpair failed and we were unable to recover it. 00:27:28.148 [2024-12-08 02:29:55.665674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.665790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.665827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.148 qpair failed and we were unable to recover it. 00:27:28.148 [2024-12-08 02:29:55.665982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.666106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.666134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.148 qpair failed and we were unable to recover it. 00:27:28.148 [2024-12-08 02:29:55.666273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.666352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.666378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.148 qpair failed and we were unable to recover it. 00:27:28.148 [2024-12-08 02:29:55.666468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.666688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.666717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.148 qpair failed and we were unable to recover it. 00:27:28.148 [2024-12-08 02:29:55.666841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.666965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.666994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.148 qpair failed and we were unable to recover it. 00:27:28.148 [2024-12-08 02:29:55.667124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.667252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.667277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.148 qpair failed and we were unable to recover it. 00:27:28.148 [2024-12-08 02:29:55.667394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.667472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.667497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.148 qpair failed and we were unable to recover it. 00:27:28.148 [2024-12-08 02:29:55.667616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.667755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.667784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.148 qpair failed and we were unable to recover it. 00:27:28.148 [2024-12-08 02:29:55.667917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.668008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.668060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.148 qpair failed and we were unable to recover it. 00:27:28.148 [2024-12-08 02:29:55.668175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.668333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.668361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.148 qpair failed and we were unable to recover it. 00:27:28.148 [2024-12-08 02:29:55.668468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.668609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.668636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.148 qpair failed and we were unable to recover it. 00:27:28.148 [2024-12-08 02:29:55.668770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.668895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.668923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.148 qpair failed and we were unable to recover it. 00:27:28.148 [2024-12-08 02:29:55.669072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.669160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.669187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.148 qpair failed and we were unable to recover it. 00:27:28.148 [2024-12-08 02:29:55.669310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.669435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.669464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.148 qpair failed and we were unable to recover it. 00:27:28.148 [2024-12-08 02:29:55.669570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.669684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.669709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.148 qpair failed and we were unable to recover it. 00:27:28.148 [2024-12-08 02:29:55.669821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.669957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.669986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.148 qpair failed and we were unable to recover it. 00:27:28.148 [2024-12-08 02:29:55.670110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.670210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.670239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.148 qpair failed and we were unable to recover it. 00:27:28.148 [2024-12-08 02:29:55.670393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.670524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.670555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.148 qpair failed and we were unable to recover it. 00:27:28.148 [2024-12-08 02:29:55.670668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.670758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.670785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.148 qpair failed and we were unable to recover it. 00:27:28.148 [2024-12-08 02:29:55.670946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.671047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.671076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.148 qpair failed and we were unable to recover it. 00:27:28.148 [2024-12-08 02:29:55.671167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.671281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.671309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.148 qpair failed and we were unable to recover it. 00:27:28.148 [2024-12-08 02:29:55.671462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.671600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.671626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.148 qpair failed and we were unable to recover it. 00:27:28.148 [2024-12-08 02:29:55.671768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.671879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.148 [2024-12-08 02:29:55.671904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.148 qpair failed and we were unable to recover it. 00:27:28.148 [2024-12-08 02:29:55.672041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.672134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.672164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.149 qpair failed and we were unable to recover it. 00:27:28.149 [2024-12-08 02:29:55.672288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.672407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.672435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.149 qpair failed and we were unable to recover it. 00:27:28.149 [2024-12-08 02:29:55.672527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.672651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.672680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.149 qpair failed and we were unable to recover it. 00:27:28.149 [2024-12-08 02:29:55.672821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.672935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.672961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.149 qpair failed and we were unable to recover it. 00:27:28.149 [2024-12-08 02:29:55.673082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.673215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.673243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.149 qpair failed and we were unable to recover it. 00:27:28.149 [2024-12-08 02:29:55.673364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.673483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.673515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.149 qpair failed and we were unable to recover it. 00:27:28.149 [2024-12-08 02:29:55.673677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.673794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.673822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.149 qpair failed and we were unable to recover it. 00:27:28.149 [2024-12-08 02:29:55.673962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.674041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.674067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.149 qpair failed and we were unable to recover it. 00:27:28.149 [2024-12-08 02:29:55.674199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.674332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.674360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.149 qpair failed and we were unable to recover it. 00:27:28.149 [2024-12-08 02:29:55.674490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.674621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.674649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.149 qpair failed and we were unable to recover it. 00:27:28.149 [2024-12-08 02:29:55.674751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.674843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.674870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.149 qpair failed and we were unable to recover it. 00:27:28.149 [2024-12-08 02:29:55.674973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.675091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.675115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.149 qpair failed and we were unable to recover it. 00:27:28.149 [2024-12-08 02:29:55.675206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.675356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.675383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.149 qpair failed and we were unable to recover it. 00:27:28.149 [2024-12-08 02:29:55.675524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.675713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.675742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.149 qpair failed and we were unable to recover it. 00:27:28.149 [2024-12-08 02:29:55.675863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.676017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.676044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.149 qpair failed and we were unable to recover it. 00:27:28.149 [2024-12-08 02:29:55.676204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.676287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.676316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.149 qpair failed and we were unable to recover it. 00:27:28.149 [2024-12-08 02:29:55.676420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.676550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.676579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.149 qpair failed and we were unable to recover it. 00:27:28.149 [2024-12-08 02:29:55.676731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.676825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.676853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.149 qpair failed and we were unable to recover it. 00:27:28.149 [2024-12-08 02:29:55.676951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.677106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.677134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.149 qpair failed and we were unable to recover it. 00:27:28.149 [2024-12-08 02:29:55.677240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.677357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.677381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.149 qpair failed and we were unable to recover it. 00:27:28.149 [2024-12-08 02:29:55.677463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.677609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.677635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.149 qpair failed and we were unable to recover it. 00:27:28.149 [2024-12-08 02:29:55.677750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.677834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.677858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.149 qpair failed and we were unable to recover it. 00:27:28.149 [2024-12-08 02:29:55.678000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.678104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.678132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.149 qpair failed and we were unable to recover it. 00:27:28.149 [2024-12-08 02:29:55.678271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.678411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.678435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.149 qpair failed and we were unable to recover it. 00:27:28.149 [2024-12-08 02:29:55.678556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.678683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.678711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.149 qpair failed and we were unable to recover it. 00:27:28.149 [2024-12-08 02:29:55.678816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.678927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.678957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.149 qpair failed and we were unable to recover it. 00:27:28.149 [2024-12-08 02:29:55.679045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.679181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.679209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.149 qpair failed and we were unable to recover it. 00:27:28.149 [2024-12-08 02:29:55.679349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.679486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.679511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.149 qpair failed and we were unable to recover it. 00:27:28.149 [2024-12-08 02:29:55.679648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.679797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.149 [2024-12-08 02:29:55.679825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.149 qpair failed and we were unable to recover it. 00:27:28.150 [2024-12-08 02:29:55.679925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.680055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.680080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.150 qpair failed and we were unable to recover it. 00:27:28.150 [2024-12-08 02:29:55.680190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.680325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.680353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.150 qpair failed and we were unable to recover it. 00:27:28.150 [2024-12-08 02:29:55.680523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.680618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.680644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.150 qpair failed and we were unable to recover it. 00:27:28.150 [2024-12-08 02:29:55.680747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.680834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.680859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.150 qpair failed and we were unable to recover it. 00:27:28.150 [2024-12-08 02:29:55.680949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.681081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.681109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.150 qpair failed and we were unable to recover it. 00:27:28.150 [2024-12-08 02:29:55.681241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.681334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.681361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.150 qpair failed and we were unable to recover it. 00:27:28.150 [2024-12-08 02:29:55.681469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.681577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.681607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.150 qpair failed and we were unable to recover it. 00:27:28.150 [2024-12-08 02:29:55.681769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.681894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.681937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.150 qpair failed and we were unable to recover it. 00:27:28.150 [2024-12-08 02:29:55.682048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.682166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.682209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.150 qpair failed and we were unable to recover it. 00:27:28.150 [2024-12-08 02:29:55.682336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.682416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.682441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.150 qpair failed and we were unable to recover it. 00:27:28.150 [2024-12-08 02:29:55.682578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.682661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.682687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.150 qpair failed and we were unable to recover it. 00:27:28.150 [2024-12-08 02:29:55.682800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.682952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.682993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.150 qpair failed and we were unable to recover it. 00:27:28.150 [2024-12-08 02:29:55.683111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.683255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.683279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.150 qpair failed and we were unable to recover it. 00:27:28.150 [2024-12-08 02:29:55.683408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.683499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.683527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.150 qpair failed and we were unable to recover it. 00:27:28.150 [2024-12-08 02:29:55.683725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.683846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.683870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.150 qpair failed and we were unable to recover it. 00:27:28.150 [2024-12-08 02:29:55.684018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.684161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.684186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.150 qpair failed and we were unable to recover it. 00:27:28.150 [2024-12-08 02:29:55.684318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.684410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.684438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.150 qpair failed and we were unable to recover it. 00:27:28.150 [2024-12-08 02:29:55.684559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.684686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.684714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.150 qpair failed and we were unable to recover it. 00:27:28.150 [2024-12-08 02:29:55.684859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.684970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.684995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.150 qpair failed and we were unable to recover it. 00:27:28.150 [2024-12-08 02:29:55.685126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.685219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.685247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.150 qpair failed and we were unable to recover it. 00:27:28.150 [2024-12-08 02:29:55.685352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.685440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.685467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.150 qpair failed and we were unable to recover it. 00:27:28.150 [2024-12-08 02:29:55.685588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.685706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.685734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.150 qpair failed and we were unable to recover it. 00:27:28.150 [2024-12-08 02:29:55.685875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.685962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.685987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.150 qpair failed and we were unable to recover it. 00:27:28.150 [2024-12-08 02:29:55.686118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.686241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.686271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.150 qpair failed and we were unable to recover it. 00:27:28.150 [2024-12-08 02:29:55.686365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.686495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.686523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.150 qpair failed and we were unable to recover it. 00:27:28.150 [2024-12-08 02:29:55.686650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.686743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.686770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.150 qpair failed and we were unable to recover it. 00:27:28.150 [2024-12-08 02:29:55.686910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.687017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.687042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.150 qpair failed and we were unable to recover it. 00:27:28.150 [2024-12-08 02:29:55.687130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.687272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.687298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.150 qpair failed and we were unable to recover it. 00:27:28.150 [2024-12-08 02:29:55.687429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.150 [2024-12-08 02:29:55.687520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.687565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.151 qpair failed and we were unable to recover it. 00:27:28.151 [2024-12-08 02:29:55.687725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.687874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.687899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.151 qpair failed and we were unable to recover it. 00:27:28.151 [2024-12-08 02:29:55.688009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.688099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.688124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.151 qpair failed and we were unable to recover it. 00:27:28.151 [2024-12-08 02:29:55.688252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.688374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.688403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.151 qpair failed and we were unable to recover it. 00:27:28.151 [2024-12-08 02:29:55.688504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.688668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.688697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.151 qpair failed and we were unable to recover it. 00:27:28.151 [2024-12-08 02:29:55.688826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.688950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.688978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.151 qpair failed and we were unable to recover it. 00:27:28.151 [2024-12-08 02:29:55.689073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.689163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.689187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.151 qpair failed and we were unable to recover it. 00:27:28.151 [2024-12-08 02:29:55.689300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.689415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.689442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.151 qpair failed and we were unable to recover it. 00:27:28.151 [2024-12-08 02:29:55.689525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.689696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.689722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.151 qpair failed and we were unable to recover it. 00:27:28.151 [2024-12-08 02:29:55.689871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.690031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.690058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.151 qpair failed and we were unable to recover it. 00:27:28.151 [2024-12-08 02:29:55.690191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.690331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.690356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.151 qpair failed and we were unable to recover it. 00:27:28.151 [2024-12-08 02:29:55.690523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.690638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.690664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.151 qpair failed and we were unable to recover it. 00:27:28.151 [2024-12-08 02:29:55.690773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.690914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.690942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.151 qpair failed and we were unable to recover it. 00:27:28.151 [2024-12-08 02:29:55.691093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.691222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.691246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.151 qpair failed and we were unable to recover it. 00:27:28.151 [2024-12-08 02:29:55.691333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.691409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.691434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.151 qpair failed and we were unable to recover it. 00:27:28.151 [2024-12-08 02:29:55.691585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.691681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.691709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.151 qpair failed and we were unable to recover it. 00:27:28.151 [2024-12-08 02:29:55.691838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.691932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.691959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.151 qpair failed and we were unable to recover it. 00:27:28.151 [2024-12-08 02:29:55.692059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.692177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.692205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.151 qpair failed and we were unable to recover it. 00:27:28.151 [2024-12-08 02:29:55.692307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.692387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.692413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.151 qpair failed and we were unable to recover it. 00:27:28.151 [2024-12-08 02:29:55.692494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.692672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.692701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.151 qpair failed and we were unable to recover it. 00:27:28.151 [2024-12-08 02:29:55.692801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.692895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.692923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.151 qpair failed and we were unable to recover it. 00:27:28.151 [2024-12-08 02:29:55.693013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.693098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.693126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.151 qpair failed and we were unable to recover it. 00:27:28.151 [2024-12-08 02:29:55.693231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.693344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.693369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.151 qpair failed and we were unable to recover it. 00:27:28.151 [2024-12-08 02:29:55.693452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.693576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.693604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.151 qpair failed and we were unable to recover it. 00:27:28.151 [2024-12-08 02:29:55.693721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.693813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.693840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.151 qpair failed and we were unable to recover it. 00:27:28.151 [2024-12-08 02:29:55.693943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.694104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.694129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.151 qpair failed and we were unable to recover it. 00:27:28.151 [2024-12-08 02:29:55.694215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.694324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.151 [2024-12-08 02:29:55.694348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.151 qpair failed and we were unable to recover it. 00:27:28.152 [2024-12-08 02:29:55.694464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.694549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.694574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.152 qpair failed and we were unable to recover it. 00:27:28.152 [2024-12-08 02:29:55.694688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.694771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.694798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.152 qpair failed and we were unable to recover it. 00:27:28.152 [2024-12-08 02:29:55.694889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.695051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.695078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.152 qpair failed and we were unable to recover it. 00:27:28.152 [2024-12-08 02:29:55.695187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.695303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.695328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.152 qpair failed and we were unable to recover it. 00:27:28.152 [2024-12-08 02:29:55.695460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.695565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.695594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.152 qpair failed and we were unable to recover it. 00:27:28.152 [2024-12-08 02:29:55.695698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.695817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.695845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.152 qpair failed and we were unable to recover it. 00:27:28.152 [2024-12-08 02:29:55.695994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.696148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.696176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.152 qpair failed and we were unable to recover it. 00:27:28.152 [2024-12-08 02:29:55.696287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.696399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.696424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.152 qpair failed and we were unable to recover it. 00:27:28.152 [2024-12-08 02:29:55.696591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.696692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.696719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.152 qpair failed and we were unable to recover it. 00:27:28.152 [2024-12-08 02:29:55.696807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.696893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.696921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.152 qpair failed and we were unable to recover it. 00:27:28.152 [2024-12-08 02:29:55.697043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.697204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.697228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.152 qpair failed and we were unable to recover it. 00:27:28.152 [2024-12-08 02:29:55.697367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.697479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.697504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.152 qpair failed and we were unable to recover it. 00:27:28.152 [2024-12-08 02:29:55.697617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.697701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.697746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.152 qpair failed and we were unable to recover it. 00:27:28.152 [2024-12-08 02:29:55.697906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.698022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.698047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.152 qpair failed and we were unable to recover it. 00:27:28.152 [2024-12-08 02:29:55.698185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.698268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.698310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.152 qpair failed and we were unable to recover it. 00:27:28.152 [2024-12-08 02:29:55.698439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.698563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.698588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.152 qpair failed and we were unable to recover it. 00:27:28.152 [2024-12-08 02:29:55.698723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.698870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.698918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.152 qpair failed and we were unable to recover it. 00:27:28.152 [2024-12-08 02:29:55.699039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.699166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.699193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.152 qpair failed and we were unable to recover it. 00:27:28.152 [2024-12-08 02:29:55.699318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.699414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.699442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.152 qpair failed and we were unable to recover it. 00:27:28.152 [2024-12-08 02:29:55.699556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.699645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.699670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.152 qpair failed and we were unable to recover it. 00:27:28.152 [2024-12-08 02:29:55.699789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.699952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.699979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.152 qpair failed and we were unable to recover it. 00:27:28.152 [2024-12-08 02:29:55.700078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.700194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.700222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.152 qpair failed and we were unable to recover it. 00:27:28.152 [2024-12-08 02:29:55.700355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.700474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.700502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.152 qpair failed and we were unable to recover it. 00:27:28.152 [2024-12-08 02:29:55.700636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.700776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.700802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.152 qpair failed and we were unable to recover it. 00:27:28.152 [2024-12-08 02:29:55.700969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.701091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.701118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.152 qpair failed and we were unable to recover it. 00:27:28.152 [2024-12-08 02:29:55.701239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.701326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.701353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.152 qpair failed and we were unable to recover it. 00:27:28.152 [2024-12-08 02:29:55.701455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.701549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.701578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.152 qpair failed and we were unable to recover it. 00:27:28.152 [2024-12-08 02:29:55.701680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.701795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.701820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.152 qpair failed and we were unable to recover it. 00:27:28.152 [2024-12-08 02:29:55.701931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.152 [2024-12-08 02:29:55.702052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.702084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.153 qpair failed and we were unable to recover it. 00:27:28.153 [2024-12-08 02:29:55.702210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.702300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.702328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.153 qpair failed and we were unable to recover it. 00:27:28.153 [2024-12-08 02:29:55.702453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.702582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.702609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.153 qpair failed and we were unable to recover it. 00:27:28.153 [2024-12-08 02:29:55.702728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.702835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.702860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.153 qpair failed and we were unable to recover it. 00:27:28.153 [2024-12-08 02:29:55.702986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.703094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.703123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.153 qpair failed and we were unable to recover it. 00:27:28.153 [2024-12-08 02:29:55.703242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.703341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.703369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.153 qpair failed and we were unable to recover it. 00:27:28.153 [2024-12-08 02:29:55.703486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.703601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.703627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.153 qpair failed and we were unable to recover it. 00:27:28.153 [2024-12-08 02:29:55.703744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.703855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.703880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.153 qpair failed and we were unable to recover it. 00:27:28.153 [2024-12-08 02:29:55.704015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.704139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.704181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.153 qpair failed and we were unable to recover it. 00:27:28.153 [2024-12-08 02:29:55.704333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.704469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.704497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.153 qpair failed and we were unable to recover it. 00:27:28.153 [2024-12-08 02:29:55.704643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.704725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.704749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.153 qpair failed and we were unable to recover it. 00:27:28.153 [2024-12-08 02:29:55.704863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.704953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.704978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.153 qpair failed and we were unable to recover it. 00:27:28.153 [2024-12-08 02:29:55.705059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.705140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.705166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.153 qpair failed and we were unable to recover it. 00:27:28.153 [2024-12-08 02:29:55.705286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.705405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.705429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.153 qpair failed and we were unable to recover it. 00:27:28.153 [2024-12-08 02:29:55.705511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.705639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.705664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.153 qpair failed and we were unable to recover it. 00:27:28.153 [2024-12-08 02:29:55.705771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.705889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.705914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.153 qpair failed and we were unable to recover it. 00:27:28.153 [2024-12-08 02:29:55.706046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.706175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.706203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.153 qpair failed and we were unable to recover it. 00:27:28.153 [2024-12-08 02:29:55.706289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.706459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.706485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.153 qpair failed and we were unable to recover it. 00:27:28.153 [2024-12-08 02:29:55.706607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.706723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.706748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.153 qpair failed and we were unable to recover it. 00:27:28.153 [2024-12-08 02:29:55.706863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.706980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.707004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.153 qpair failed and we were unable to recover it. 00:27:28.153 [2024-12-08 02:29:55.707112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.707231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.707259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.153 qpair failed and we were unable to recover it. 00:27:28.153 [2024-12-08 02:29:55.707350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.707472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.707500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.153 qpair failed and we were unable to recover it. 00:27:28.153 [2024-12-08 02:29:55.707635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.707722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.707747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.153 qpair failed and we were unable to recover it. 00:27:28.153 [2024-12-08 02:29:55.707859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.707965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.707989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.153 qpair failed and we were unable to recover it. 00:27:28.153 [2024-12-08 02:29:55.708095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.708251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.708279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.153 qpair failed and we were unable to recover it. 00:27:28.153 [2024-12-08 02:29:55.708404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.708526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.708560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.153 qpair failed and we were unable to recover it. 00:27:28.153 [2024-12-08 02:29:55.708675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.708827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.708855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.153 qpair failed and we were unable to recover it. 00:27:28.153 [2024-12-08 02:29:55.708947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.709104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.709130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.153 qpair failed and we were unable to recover it. 00:27:28.153 [2024-12-08 02:29:55.709220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.709347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.709375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.153 qpair failed and we were unable to recover it. 00:27:28.153 [2024-12-08 02:29:55.709482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.153 [2024-12-08 02:29:55.709618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.709646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.154 qpair failed and we were unable to recover it. 00:27:28.154 [2024-12-08 02:29:55.709775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.709867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.709894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.154 qpair failed and we were unable to recover it. 00:27:28.154 [2024-12-08 02:29:55.710033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.710143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.710167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.154 qpair failed and we were unable to recover it. 00:27:28.154 [2024-12-08 02:29:55.710292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.710415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.710442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.154 qpair failed and we were unable to recover it. 00:27:28.154 [2024-12-08 02:29:55.710564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.710716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.710744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.154 qpair failed and we were unable to recover it. 00:27:28.154 [2024-12-08 02:29:55.710868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.710957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.710985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.154 qpair failed and we were unable to recover it. 00:27:28.154 [2024-12-08 02:29:55.711112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.711230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.711254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.154 qpair failed and we were unable to recover it. 00:27:28.154 [2024-12-08 02:29:55.711339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.711442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.711467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.154 qpair failed and we were unable to recover it. 00:27:28.154 [2024-12-08 02:29:55.711580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.711661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.711686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.154 qpair failed and we were unable to recover it. 00:27:28.154 [2024-12-08 02:29:55.711796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.711928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.711956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.154 qpair failed and we were unable to recover it. 00:27:28.154 [2024-12-08 02:29:55.712091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.712203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.712228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.154 qpair failed and we were unable to recover it. 00:27:28.154 [2024-12-08 02:29:55.712350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.712483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.712510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.154 qpair failed and we were unable to recover it. 00:27:28.154 [2024-12-08 02:29:55.712638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.712755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.712783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.154 qpair failed and we were unable to recover it. 00:27:28.154 [2024-12-08 02:29:55.712934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.713101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.713127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.154 qpair failed and we were unable to recover it. 00:27:28.154 [2024-12-08 02:29:55.713211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.713295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.713321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.154 qpair failed and we were unable to recover it. 00:27:28.154 [2024-12-08 02:29:55.713481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.713630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.713656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.154 qpair failed and we were unable to recover it. 00:27:28.154 [2024-12-08 02:29:55.713767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.713902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.713930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.154 qpair failed and we were unable to recover it. 00:27:28.154 [2024-12-08 02:29:55.714026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.714174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.714201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.154 qpair failed and we were unable to recover it. 00:27:28.154 [2024-12-08 02:29:55.714307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.714423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.714447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.154 qpair failed and we were unable to recover it. 00:27:28.154 [2024-12-08 02:29:55.714579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.714718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.714743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.154 qpair failed and we were unable to recover it. 00:27:28.154 [2024-12-08 02:29:55.714879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.715041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.715068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.154 qpair failed and we were unable to recover it. 00:27:28.154 [2024-12-08 02:29:55.715191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.715310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.715339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.154 qpair failed and we were unable to recover it. 00:27:28.154 [2024-12-08 02:29:55.715448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.715553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.715578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.154 qpair failed and we were unable to recover it. 00:27:28.154 [2024-12-08 02:29:55.715675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.715830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.715859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.154 qpair failed and we were unable to recover it. 00:27:28.154 [2024-12-08 02:29:55.715981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.716121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.716147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.154 qpair failed and we were unable to recover it. 00:27:28.154 [2024-12-08 02:29:55.716287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.716393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.716425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.154 qpair failed and we were unable to recover it. 00:27:28.154 [2024-12-08 02:29:55.716530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.716614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.716640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.154 qpair failed and we were unable to recover it. 00:27:28.154 [2024-12-08 02:29:55.716734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.716849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.716875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.154 qpair failed and we were unable to recover it. 00:27:28.154 [2024-12-08 02:29:55.717007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.717099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.154 [2024-12-08 02:29:55.717127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.154 qpair failed and we were unable to recover it. 00:27:28.154 [2024-12-08 02:29:55.717253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.717342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.717369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.155 qpair failed and we were unable to recover it. 00:27:28.155 [2024-12-08 02:29:55.717497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.717618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.717643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.155 qpair failed and we were unable to recover it. 00:27:28.155 [2024-12-08 02:29:55.717726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.717830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.717872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.155 qpair failed and we were unable to recover it. 00:27:28.155 [2024-12-08 02:29:55.717980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.718105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.718133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.155 qpair failed and we were unable to recover it. 00:27:28.155 [2024-12-08 02:29:55.718228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.718350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.718377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.155 qpair failed and we were unable to recover it. 00:27:28.155 [2024-12-08 02:29:55.718522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.718645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.718671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.155 qpair failed and we were unable to recover it. 00:27:28.155 [2024-12-08 02:29:55.718756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.718890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.718937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.155 qpair failed and we were unable to recover it. 00:27:28.155 [2024-12-08 02:29:55.719064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.719174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.719202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.155 qpair failed and we were unable to recover it. 00:27:28.155 [2024-12-08 02:29:55.719291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.719374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.719402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.155 qpair failed and we were unable to recover it. 00:27:28.155 [2024-12-08 02:29:55.719555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.719671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.719696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.155 qpair failed and we were unable to recover it. 00:27:28.155 [2024-12-08 02:29:55.719804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.719896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.719923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.155 qpair failed and we were unable to recover it. 00:27:28.155 [2024-12-08 02:29:55.720048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.720136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.720163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.155 qpair failed and we were unable to recover it. 00:27:28.155 [2024-12-08 02:29:55.720288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.720406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.720433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.155 qpair failed and we were unable to recover it. 00:27:28.155 [2024-12-08 02:29:55.720591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.720680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.720704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.155 qpair failed and we were unable to recover it. 00:27:28.155 [2024-12-08 02:29:55.720806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.720928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.720956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.155 qpair failed and we were unable to recover it. 00:27:28.155 [2024-12-08 02:29:55.721077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.721227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.721254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.155 qpair failed and we were unable to recover it. 00:27:28.155 [2024-12-08 02:29:55.721379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.721462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.721494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.155 qpair failed and we were unable to recover it. 00:27:28.155 [2024-12-08 02:29:55.721638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.721723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.721749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.155 qpair failed and we were unable to recover it. 00:27:28.155 [2024-12-08 02:29:55.721874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.722002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.722029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.155 qpair failed and we were unable to recover it. 00:27:28.155 [2024-12-08 02:29:55.722185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.722279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.722307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.155 qpair failed and we were unable to recover it. 00:27:28.155 [2024-12-08 02:29:55.722403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.722550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.722578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.155 qpair failed and we were unable to recover it. 00:27:28.155 [2024-12-08 02:29:55.722691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.722802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.722827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.155 qpair failed and we were unable to recover it. 00:27:28.155 [2024-12-08 02:29:55.722909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.723021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.723046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.155 qpair failed and we were unable to recover it. 00:27:28.155 [2024-12-08 02:29:55.723191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.723316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.723344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.155 qpair failed and we were unable to recover it. 00:27:28.155 [2024-12-08 02:29:55.723495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.723628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.723656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.155 qpair failed and we were unable to recover it. 00:27:28.155 [2024-12-08 02:29:55.723790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.723878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.155 [2024-12-08 02:29:55.723903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.155 qpair failed and we were unable to recover it. 00:27:28.155 [2024-12-08 02:29:55.723985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.724116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.724148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.156 qpair failed and we were unable to recover it. 00:27:28.156 [2024-12-08 02:29:55.724277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.724389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.724417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.156 qpair failed and we were unable to recover it. 00:27:28.156 [2024-12-08 02:29:55.724575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.724666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.724695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.156 qpair failed and we were unable to recover it. 00:27:28.156 [2024-12-08 02:29:55.724812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.724926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.724950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.156 qpair failed and we were unable to recover it. 00:27:28.156 [2024-12-08 02:29:55.725043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.725165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.725193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.156 qpair failed and we were unable to recover it. 00:27:28.156 [2024-12-08 02:29:55.725300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.725397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.725426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.156 qpair failed and we were unable to recover it. 00:27:28.156 [2024-12-08 02:29:55.725521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.725641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.725670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.156 qpair failed and we were unable to recover it. 00:27:28.156 [2024-12-08 02:29:55.725766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.725875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.725899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.156 qpair failed and we were unable to recover it. 00:27:28.156 [2024-12-08 02:29:55.726028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.726152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.726179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.156 qpair failed and we were unable to recover it. 00:27:28.156 [2024-12-08 02:29:55.726298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.726417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.726445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.156 qpair failed and we were unable to recover it. 00:27:28.156 [2024-12-08 02:29:55.726577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.726673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.726701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.156 qpair failed and we were unable to recover it. 00:27:28.156 [2024-12-08 02:29:55.726827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.726940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.726966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.156 qpair failed and we were unable to recover it. 00:27:28.156 [2024-12-08 02:29:55.727047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.727164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.727189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.156 qpair failed and we were unable to recover it. 00:27:28.156 [2024-12-08 02:29:55.727319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.727403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.727430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.156 qpair failed and we were unable to recover it. 00:27:28.156 [2024-12-08 02:29:55.727562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.727693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.727718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.156 qpair failed and we were unable to recover it. 00:27:28.156 [2024-12-08 02:29:55.727834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.727974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.727999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.156 qpair failed and we were unable to recover it. 00:27:28.156 [2024-12-08 02:29:55.728142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.728266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.728294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.156 qpair failed and we were unable to recover it. 00:27:28.156 [2024-12-08 02:29:55.728388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.728519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.728556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.156 qpair failed and we were unable to recover it. 00:27:28.156 [2024-12-08 02:29:55.728663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.728814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.728842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.156 qpair failed and we were unable to recover it. 00:27:28.156 [2024-12-08 02:29:55.729007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.729116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.729141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.156 qpair failed and we were unable to recover it. 00:27:28.156 [2024-12-08 02:29:55.729301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.729429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.729457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.156 qpair failed and we were unable to recover it. 00:27:28.156 [2024-12-08 02:29:55.729600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.729710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.729735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.156 qpair failed and we were unable to recover it. 00:27:28.156 [2024-12-08 02:29:55.729874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.730007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.730035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.156 qpair failed and we were unable to recover it. 00:27:28.156 [2024-12-08 02:29:55.730158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.730266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.730291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.156 qpair failed and we were unable to recover it. 00:27:28.156 [2024-12-08 02:29:55.730447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.730570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.730598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.156 qpair failed and we were unable to recover it. 00:27:28.156 [2024-12-08 02:29:55.730737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.730879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.730904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.156 qpair failed and we were unable to recover it. 00:27:28.156 [2024-12-08 02:29:55.731053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.731181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.731208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.156 qpair failed and we were unable to recover it. 00:27:28.156 [2024-12-08 02:29:55.731348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.731456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.731480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.156 qpair failed and we were unable to recover it. 00:27:28.156 [2024-12-08 02:29:55.731617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.156 [2024-12-08 02:29:55.731759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.731787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.157 qpair failed and we were unable to recover it. 00:27:28.157 [2024-12-08 02:29:55.731926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.732058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.732086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.157 qpair failed and we were unable to recover it. 00:27:28.157 [2024-12-08 02:29:55.732183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.732327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.732354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.157 qpair failed and we were unable to recover it. 00:27:28.157 [2024-12-08 02:29:55.732497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.732589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.732614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.157 qpair failed and we were unable to recover it. 00:27:28.157 [2024-12-08 02:29:55.732742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.732867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.732894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.157 qpair failed and we were unable to recover it. 00:27:28.157 [2024-12-08 02:29:55.733041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.733173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.733197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.157 qpair failed and we were unable to recover it. 00:27:28.157 [2024-12-08 02:29:55.733318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.733470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.733510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.157 qpair failed and we were unable to recover it. 00:27:28.157 [2024-12-08 02:29:55.733601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.733681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.733707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.157 qpair failed and we were unable to recover it. 00:27:28.157 [2024-12-08 02:29:55.733874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.734048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.734100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.157 qpair failed and we were unable to recover it. 00:27:28.157 [2024-12-08 02:29:55.734223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.734345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.734374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.157 qpair failed and we were unable to recover it. 00:27:28.157 [2024-12-08 02:29:55.734463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.734596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.734626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.157 qpair failed and we were unable to recover it. 00:27:28.157 [2024-12-08 02:29:55.734737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.734876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.734901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.157 qpair failed and we were unable to recover it. 00:27:28.157 [2024-12-08 02:29:55.735060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.735154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.735182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.157 qpair failed and we were unable to recover it. 00:27:28.157 [2024-12-08 02:29:55.735325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.735406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.735432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.157 qpair failed and we were unable to recover it. 00:27:28.157 [2024-12-08 02:29:55.735546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.735698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.735722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.157 qpair failed and we were unable to recover it. 00:27:28.157 [2024-12-08 02:29:55.735861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.735977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.736001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.157 qpair failed and we were unable to recover it. 00:27:28.157 [2024-12-08 02:29:55.736109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.736200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.736242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.157 qpair failed and we were unable to recover it. 00:27:28.157 [2024-12-08 02:29:55.736381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.736500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.736525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.157 qpair failed and we were unable to recover it. 00:27:28.157 [2024-12-08 02:29:55.736609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.736748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.736773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.157 qpair failed and we were unable to recover it. 00:27:28.157 [2024-12-08 02:29:55.736883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.736993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.737018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.157 qpair failed and we were unable to recover it. 00:27:28.157 [2024-12-08 02:29:55.737132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.737207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.737231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.157 qpair failed and we were unable to recover it. 00:27:28.157 [2024-12-08 02:29:55.737318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.737402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.737426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.157 qpair failed and we were unable to recover it. 00:27:28.157 [2024-12-08 02:29:55.737561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.737693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.737717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.157 qpair failed and we were unable to recover it. 00:27:28.157 [2024-12-08 02:29:55.737858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.737972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.737997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.157 qpair failed and we were unable to recover it. 00:27:28.157 [2024-12-08 02:29:55.738103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.738224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.738252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.157 qpair failed and we were unable to recover it. 00:27:28.157 [2024-12-08 02:29:55.738375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.738500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.738528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.157 qpair failed and we were unable to recover it. 00:27:28.157 [2024-12-08 02:29:55.738661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.738791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.738819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.157 qpair failed and we were unable to recover it. 00:27:28.157 [2024-12-08 02:29:55.738955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.739034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.739059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.157 qpair failed and we were unable to recover it. 00:27:28.157 [2024-12-08 02:29:55.739187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.739273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.157 [2024-12-08 02:29:55.739301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.157 qpair failed and we were unable to recover it. 00:27:28.157 [2024-12-08 02:29:55.739436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.739571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.739596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.158 qpair failed and we were unable to recover it. 00:27:28.158 [2024-12-08 02:29:55.739739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.739831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.739859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.158 qpair failed and we were unable to recover it. 00:27:28.158 [2024-12-08 02:29:55.739993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.740077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.740102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.158 qpair failed and we were unable to recover it. 00:27:28.158 [2024-12-08 02:29:55.740231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.740381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.740408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.158 qpair failed and we were unable to recover it. 00:27:28.158 [2024-12-08 02:29:55.740544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.740663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.740691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.158 qpair failed and we were unable to recover it. 00:27:28.158 [2024-12-08 02:29:55.740790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.740911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.740938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.158 qpair failed and we were unable to recover it. 00:27:28.158 [2024-12-08 02:29:55.741080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.741164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.741189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.158 qpair failed and we were unable to recover it. 00:27:28.158 [2024-12-08 02:29:55.741323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.741417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.741444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.158 qpair failed and we were unable to recover it. 00:27:28.158 [2024-12-08 02:29:55.741553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.741645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.741673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.158 qpair failed and we were unable to recover it. 00:27:28.158 [2024-12-08 02:29:55.741829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.741939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.741965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.158 qpair failed and we were unable to recover it. 00:27:28.158 [2024-12-08 02:29:55.742080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.742187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.742212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.158 qpair failed and we were unable to recover it. 00:27:28.158 [2024-12-08 02:29:55.742331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.742464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.742491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.158 qpair failed and we were unable to recover it. 00:27:28.158 [2024-12-08 02:29:55.742593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.742722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.742752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.158 qpair failed and we were unable to recover it. 00:27:28.158 [2024-12-08 02:29:55.742874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.742955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.742982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.158 qpair failed and we were unable to recover it. 00:27:28.158 [2024-12-08 02:29:55.743125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.743245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.743270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.158 qpair failed and we were unable to recover it. 00:27:28.158 [2024-12-08 02:29:55.743401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.743522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.743557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.158 qpair failed and we were unable to recover it. 00:27:28.158 [2024-12-08 02:29:55.743719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.743816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.743844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.158 qpair failed and we were unable to recover it. 00:27:28.158 [2024-12-08 02:29:55.743994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.744121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.744149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.158 qpair failed and we were unable to recover it. 00:27:28.158 [2024-12-08 02:29:55.744286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.744366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.744391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.158 qpair failed and we were unable to recover it. 00:27:28.158 [2024-12-08 02:29:55.744498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.744605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.744633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.158 qpair failed and we were unable to recover it. 00:27:28.158 [2024-12-08 02:29:55.744726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.744894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.744919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.158 qpair failed and we were unable to recover it. 00:27:28.158 [2024-12-08 02:29:55.745013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.745131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.745155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.158 qpair failed and we were unable to recover it. 00:27:28.158 [2024-12-08 02:29:55.745267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.745384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.745408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.158 qpair failed and we were unable to recover it. 00:27:28.158 [2024-12-08 02:29:55.745547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.745707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.745734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.158 qpair failed and we were unable to recover it. 00:27:28.158 [2024-12-08 02:29:55.745866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.745999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.746027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.158 qpair failed and we were unable to recover it. 00:27:28.158 [2024-12-08 02:29:55.746142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.746259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.746287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.158 qpair failed and we were unable to recover it. 00:27:28.158 [2024-12-08 02:29:55.746421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.746505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.746531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.158 qpair failed and we were unable to recover it. 00:27:28.158 [2024-12-08 02:29:55.746706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.746805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.746833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.158 qpair failed and we were unable to recover it. 00:27:28.158 [2024-12-08 02:29:55.746950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.158 [2024-12-08 02:29:55.747073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.747101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.159 qpair failed and we were unable to recover it. 00:27:28.159 [2024-12-08 02:29:55.747190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.747310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.747337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.159 qpair failed and we were unable to recover it. 00:27:28.159 [2024-12-08 02:29:55.747441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.747601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.747628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.159 qpair failed and we were unable to recover it. 00:27:28.159 [2024-12-08 02:29:55.747785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.747905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.747933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.159 qpair failed and we were unable to recover it. 00:27:28.159 [2024-12-08 02:29:55.748053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.748147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.748175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.159 qpair failed and we were unable to recover it. 00:27:28.159 [2024-12-08 02:29:55.748299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.748447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.748476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.159 qpair failed and we were unable to recover it. 00:27:28.159 [2024-12-08 02:29:55.748633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.748774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.748798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.159 qpair failed and we were unable to recover it. 00:27:28.159 [2024-12-08 02:29:55.748943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.749077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.749102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.159 qpair failed and we were unable to recover it. 00:27:28.159 [2024-12-08 02:29:55.749239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.749351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.749394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.159 qpair failed and we were unable to recover it. 00:27:28.159 [2024-12-08 02:29:55.749521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.749613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.749642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.159 qpair failed and we were unable to recover it. 00:27:28.159 [2024-12-08 02:29:55.749786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.749896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.749921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.159 qpair failed and we were unable to recover it. 00:27:28.159 [2024-12-08 02:29:55.750035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.750170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.750197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.159 qpair failed and we were unable to recover it. 00:27:28.159 [2024-12-08 02:29:55.750302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.750426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.750452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.159 qpair failed and we were unable to recover it. 00:27:28.159 [2024-12-08 02:29:55.750574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.750680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.750704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.159 qpair failed and we were unable to recover it. 00:27:28.159 [2024-12-08 02:29:55.750791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.750871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.750895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.159 qpair failed and we were unable to recover it. 00:27:28.159 [2024-12-08 02:29:55.751003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.751134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.751162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.159 qpair failed and we were unable to recover it. 00:27:28.159 [2024-12-08 02:29:55.751248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.751381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.751408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.159 qpair failed and we were unable to recover it. 00:27:28.159 [2024-12-08 02:29:55.751584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.751694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.751718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.159 qpair failed and we were unable to recover it. 00:27:28.159 [2024-12-08 02:29:55.751859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.751972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.751996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.159 qpair failed and we were unable to recover it. 00:27:28.159 [2024-12-08 02:29:55.752082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.752200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.752224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.159 qpair failed and we were unable to recover it. 00:27:28.159 [2024-12-08 02:29:55.752345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.752459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.752486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.159 qpair failed and we were unable to recover it. 00:27:28.159 [2024-12-08 02:29:55.752626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.752735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.752760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.159 qpair failed and we were unable to recover it. 00:27:28.159 [2024-12-08 02:29:55.752873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.753009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.753033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.159 qpair failed and we were unable to recover it. 00:27:28.159 [2024-12-08 02:29:55.753162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.753282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.753310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.159 qpair failed and we were unable to recover it. 00:27:28.159 [2024-12-08 02:29:55.753439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.753575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.753619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.159 qpair failed and we were unable to recover it. 00:27:28.159 [2024-12-08 02:29:55.753710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.753823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.753848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.159 qpair failed and we were unable to recover it. 00:27:28.159 [2024-12-08 02:29:55.753963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.754105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.754130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.159 qpair failed and we were unable to recover it. 00:27:28.159 [2024-12-08 02:29:55.754224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.754345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.754373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.159 qpair failed and we were unable to recover it. 00:27:28.159 [2024-12-08 02:29:55.754502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.754620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.159 [2024-12-08 02:29:55.754645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.159 qpair failed and we were unable to recover it. 00:27:28.160 [2024-12-08 02:29:55.754753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.754864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.754905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.160 qpair failed and we were unable to recover it. 00:27:28.160 [2024-12-08 02:29:55.755045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.755182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.755206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.160 qpair failed and we were unable to recover it. 00:27:28.160 [2024-12-08 02:29:55.755307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.755431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.755458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.160 qpair failed and we were unable to recover it. 00:27:28.160 [2024-12-08 02:29:55.755584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.755674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.755701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.160 qpair failed and we were unable to recover it. 00:27:28.160 [2024-12-08 02:29:55.755860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.755979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.756006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.160 qpair failed and we were unable to recover it. 00:27:28.160 [2024-12-08 02:29:55.756111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.756195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.756220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.160 qpair failed and we were unable to recover it. 00:27:28.160 [2024-12-08 02:29:55.756309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.756419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.756445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.160 qpair failed and we were unable to recover it. 00:27:28.160 [2024-12-08 02:29:55.756530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.756618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.756647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.160 qpair failed and we were unable to recover it. 00:27:28.160 [2024-12-08 02:29:55.756743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.756875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.756903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.160 qpair failed and we were unable to recover it. 00:27:28.160 [2024-12-08 02:29:55.757031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.757144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.757169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.160 qpair failed and we were unable to recover it. 00:27:28.160 [2024-12-08 02:29:55.757285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.757400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.757443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.160 qpair failed and we were unable to recover it. 00:27:28.160 [2024-12-08 02:29:55.757561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.757714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.757741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.160 qpair failed and we were unable to recover it. 00:27:28.160 [2024-12-08 02:29:55.757896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.758018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.758045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.160 qpair failed and we were unable to recover it. 00:27:28.160 [2024-12-08 02:29:55.758170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.758282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.758306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.160 qpair failed and we were unable to recover it. 00:27:28.160 [2024-12-08 02:29:55.758446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.758570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.758613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.160 qpair failed and we were unable to recover it. 00:27:28.160 [2024-12-08 02:29:55.758742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.758837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.758865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.160 qpair failed and we were unable to recover it. 00:27:28.160 [2024-12-08 02:29:55.758967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.759090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.759118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.160 qpair failed and we were unable to recover it. 00:27:28.160 [2024-12-08 02:29:55.759201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.759359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.759388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.160 qpair failed and we were unable to recover it. 00:27:28.160 [2024-12-08 02:29:55.759515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.759614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.759643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.160 qpair failed and we were unable to recover it. 00:27:28.160 [2024-12-08 02:29:55.759763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.759875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.759903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.160 qpair failed and we were unable to recover it. 00:27:28.160 [2024-12-08 02:29:55.760028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.760156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.760184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.160 qpair failed and we were unable to recover it. 00:27:28.160 [2024-12-08 02:29:55.760342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.760421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.760445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.160 qpair failed and we were unable to recover it. 00:27:28.160 [2024-12-08 02:29:55.760579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.760719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.760748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.160 qpair failed and we were unable to recover it. 00:27:28.160 [2024-12-08 02:29:55.760872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.760995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.761022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.160 qpair failed and we were unable to recover it. 00:27:28.160 [2024-12-08 02:29:55.761177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.761269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.761296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.160 qpair failed and we were unable to recover it. 00:27:28.160 [2024-12-08 02:29:55.761432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.761544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.160 [2024-12-08 02:29:55.761570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.160 qpair failed and we were unable to recover it. 00:27:28.161 [2024-12-08 02:29:55.761735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.761869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.761894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.161 qpair failed and we were unable to recover it. 00:27:28.161 [2024-12-08 02:29:55.762023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.762113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.762146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.161 qpair failed and we were unable to recover it. 00:27:28.161 [2024-12-08 02:29:55.762269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.762417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.762444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.161 qpair failed and we were unable to recover it. 00:27:28.161 [2024-12-08 02:29:55.762554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.762639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.762664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.161 qpair failed and we were unable to recover it. 00:27:28.161 [2024-12-08 02:29:55.762753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.762881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.762908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.161 qpair failed and we were unable to recover it. 00:27:28.161 [2024-12-08 02:29:55.763005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.763096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.763123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.161 qpair failed and we were unable to recover it. 00:27:28.161 [2024-12-08 02:29:55.763242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.763359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.763387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.161 qpair failed and we were unable to recover it. 00:27:28.161 [2024-12-08 02:29:55.763517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.763619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.763645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.161 qpair failed and we were unable to recover it. 00:27:28.161 [2024-12-08 02:29:55.763774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.763860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.763888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.161 qpair failed and we were unable to recover it. 00:27:28.161 [2024-12-08 02:29:55.764017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.764157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.764182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.161 qpair failed and we were unable to recover it. 00:27:28.161 [2024-12-08 02:29:55.764262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.764401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.764426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.161 qpair failed and we were unable to recover it. 00:27:28.161 [2024-12-08 02:29:55.764545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.764651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.764680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.161 qpair failed and we were unable to recover it. 00:27:28.161 [2024-12-08 02:29:55.764779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.764902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.764931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.161 qpair failed and we were unable to recover it. 00:27:28.161 [2024-12-08 02:29:55.765055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.765193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.765218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.161 qpair failed and we were unable to recover it. 00:27:28.161 [2024-12-08 02:29:55.765302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.765409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.765434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.161 qpair failed and we were unable to recover it. 00:27:28.161 [2024-12-08 02:29:55.765575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.765714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.765754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.161 qpair failed and we were unable to recover it. 00:27:28.161 [2024-12-08 02:29:55.765852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.765969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.765996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.161 qpair failed and we were unable to recover it. 00:27:28.161 [2024-12-08 02:29:55.766119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.766267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.766295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.161 qpair failed and we were unable to recover it. 00:27:28.161 [2024-12-08 02:29:55.766422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.766517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.766550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.161 qpair failed and we were unable to recover it. 00:27:28.161 [2024-12-08 02:29:55.766680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.766754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.766779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.161 qpair failed and we were unable to recover it. 00:27:28.161 [2024-12-08 02:29:55.766854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.767015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.767043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.161 qpair failed and we were unable to recover it. 00:27:28.161 [2024-12-08 02:29:55.767134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.767257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.767284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.161 qpair failed and we were unable to recover it. 00:27:28.161 [2024-12-08 02:29:55.767388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.767473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.767501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.161 qpair failed and we were unable to recover it. 00:27:28.161 [2024-12-08 02:29:55.767639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.767786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.767811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.161 qpair failed and we were unable to recover it. 00:27:28.161 [2024-12-08 02:29:55.767973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.768091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.768119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.161 qpair failed and we were unable to recover it. 00:27:28.161 [2024-12-08 02:29:55.768247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.768338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.768366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.161 qpair failed and we were unable to recover it. 00:27:28.161 [2024-12-08 02:29:55.768512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.768663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.768692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.161 qpair failed and we were unable to recover it. 00:27:28.161 [2024-12-08 02:29:55.768866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.769010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.769052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.161 qpair failed and we were unable to recover it. 00:27:28.161 [2024-12-08 02:29:55.769175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.161 [2024-12-08 02:29:55.769342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.769367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.162 qpair failed and we were unable to recover it. 00:27:28.162 [2024-12-08 02:29:55.769511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.769603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.769646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.162 qpair failed and we were unable to recover it. 00:27:28.162 [2024-12-08 02:29:55.769769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.769898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.769925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.162 qpair failed and we were unable to recover it. 00:27:28.162 [2024-12-08 02:29:55.770090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.770197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.770222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.162 qpair failed and we were unable to recover it. 00:27:28.162 [2024-12-08 02:29:55.770366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.770494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.770521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.162 qpair failed and we were unable to recover it. 00:27:28.162 [2024-12-08 02:29:55.770668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.770778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.770803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.162 qpair failed and we were unable to recover it. 00:27:28.162 [2024-12-08 02:29:55.770885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.771016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.771044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.162 qpair failed and we were unable to recover it. 00:27:28.162 [2024-12-08 02:29:55.771150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.771257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.771282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.162 qpair failed and we were unable to recover it. 00:27:28.162 [2024-12-08 02:29:55.771363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.771565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.771591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.162 qpair failed and we were unable to recover it. 00:27:28.162 [2024-12-08 02:29:55.771712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.771870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.771898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.162 qpair failed and we were unable to recover it. 00:27:28.162 [2024-12-08 02:29:55.772027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.772184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.772211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.162 qpair failed and we were unable to recover it. 00:27:28.162 [2024-12-08 02:29:55.772321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.772407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.772432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.162 qpair failed and we were unable to recover it. 00:27:28.162 [2024-12-08 02:29:55.772553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.772660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.772687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.162 qpair failed and we were unable to recover it. 00:27:28.162 [2024-12-08 02:29:55.772837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.772930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.772959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.162 qpair failed and we were unable to recover it. 00:27:28.162 [2024-12-08 02:29:55.773115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.773208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.773235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.162 qpair failed and we were unable to recover it. 00:27:28.162 [2024-12-08 02:29:55.773353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.773465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.773490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.162 qpair failed and we were unable to recover it. 00:27:28.162 [2024-12-08 02:29:55.773648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.773746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.773773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.162 qpair failed and we were unable to recover it. 00:27:28.162 [2024-12-08 02:29:55.773863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.774013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.774040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.162 qpair failed and we were unable to recover it. 00:27:28.162 [2024-12-08 02:29:55.774126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.774259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.774283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.162 qpair failed and we were unable to recover it. 00:27:28.162 [2024-12-08 02:29:55.774391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.774506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.774531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.162 qpair failed and we were unable to recover it. 00:27:28.162 [2024-12-08 02:29:55.774624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.774704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.774728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.162 qpair failed and we were unable to recover it. 00:27:28.162 [2024-12-08 02:29:55.774812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.774918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.774942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.162 qpair failed and we were unable to recover it. 00:27:28.162 [2024-12-08 02:29:55.775084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.775169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.775213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.162 qpair failed and we were unable to recover it. 00:27:28.162 [2024-12-08 02:29:55.775382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.775497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.775521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.162 qpair failed and we were unable to recover it. 00:27:28.162 [2024-12-08 02:29:55.775660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.775771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.775796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.162 qpair failed and we were unable to recover it. 00:27:28.162 [2024-12-08 02:29:55.775907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.775988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.776012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.162 qpair failed and we were unable to recover it. 00:27:28.162 [2024-12-08 02:29:55.776126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.776239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.776286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.162 qpair failed and we were unable to recover it. 00:27:28.162 [2024-12-08 02:29:55.776459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.776548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.776573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.162 qpair failed and we were unable to recover it. 00:27:28.162 [2024-12-08 02:29:55.776694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.162 [2024-12-08 02:29:55.776829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.776853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.163 qpair failed and we were unable to recover it. 00:27:28.163 [2024-12-08 02:29:55.776944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.777019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.777044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.163 qpair failed and we were unable to recover it. 00:27:28.163 [2024-12-08 02:29:55.777124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.777240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.777264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.163 qpair failed and we were unable to recover it. 00:27:28.163 [2024-12-08 02:29:55.777381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.777497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.777521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.163 qpair failed and we were unable to recover it. 00:27:28.163 [2024-12-08 02:29:55.777644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.777802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.777829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.163 qpair failed and we were unable to recover it. 00:27:28.163 [2024-12-08 02:29:55.777924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.778020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.778046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.163 qpair failed and we were unable to recover it. 00:27:28.163 [2024-12-08 02:29:55.778204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.778304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.778333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.163 qpair failed and we were unable to recover it. 00:27:28.163 [2024-12-08 02:29:55.778440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.778556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.778581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.163 qpair failed and we were unable to recover it. 00:27:28.163 [2024-12-08 02:29:55.778712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.778804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.778831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.163 qpair failed and we were unable to recover it. 00:27:28.163 [2024-12-08 02:29:55.778925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.779008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.779035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.163 qpair failed and we were unable to recover it. 00:27:28.163 [2024-12-08 02:29:55.779200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.779311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.779336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.163 qpair failed and we were unable to recover it. 00:27:28.163 [2024-12-08 02:29:55.779452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.779554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.779580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.163 qpair failed and we were unable to recover it. 00:27:28.163 [2024-12-08 02:29:55.779689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.779789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.779817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.163 qpair failed and we were unable to recover it. 00:27:28.163 [2024-12-08 02:29:55.779905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.780051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.780079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.163 qpair failed and we were unable to recover it. 00:27:28.163 [2024-12-08 02:29:55.780205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.780308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.780335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.163 qpair failed and we were unable to recover it. 00:27:28.163 [2024-12-08 02:29:55.780471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.780587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.780612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.163 qpair failed and we were unable to recover it. 00:27:28.163 [2024-12-08 02:29:55.780743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.780831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.780859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.163 qpair failed and we were unable to recover it. 00:27:28.163 [2024-12-08 02:29:55.780986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.781081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.781109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.163 qpair failed and we were unable to recover it. 00:27:28.163 [2024-12-08 02:29:55.781265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.781386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.781414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.163 qpair failed and we were unable to recover it. 00:27:28.163 [2024-12-08 02:29:55.781581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.781659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.781683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.163 qpair failed and we were unable to recover it. 00:27:28.163 [2024-12-08 02:29:55.781837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.782013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.782041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.163 qpair failed and we were unable to recover it. 00:27:28.163 [2024-12-08 02:29:55.782168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.782305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.782330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.163 qpair failed and we were unable to recover it. 00:27:28.163 [2024-12-08 02:29:55.782442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.782551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.782593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.163 qpair failed and we were unable to recover it. 00:27:28.163 [2024-12-08 02:29:55.782754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.782831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.782856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.163 qpair failed and we were unable to recover it. 00:27:28.163 [2024-12-08 02:29:55.783016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.783106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.783133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.163 qpair failed and we were unable to recover it. 00:27:28.163 [2024-12-08 02:29:55.783228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.783363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.783388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.163 qpair failed and we were unable to recover it. 00:27:28.163 [2024-12-08 02:29:55.783504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.783598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.783624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.163 qpair failed and we were unable to recover it. 00:27:28.163 [2024-12-08 02:29:55.783709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.783803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.783828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.163 qpair failed and we were unable to recover it. 00:27:28.163 [2024-12-08 02:29:55.783919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.784101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.163 [2024-12-08 02:29:55.784126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.163 qpair failed and we were unable to recover it. 00:27:28.164 [2024-12-08 02:29:55.784268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.784375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.784403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.164 qpair failed and we were unable to recover it. 00:27:28.164 [2024-12-08 02:29:55.784558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.784675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.784703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.164 qpair failed and we were unable to recover it. 00:27:28.164 [2024-12-08 02:29:55.784811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.784891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.784916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.164 qpair failed and we were unable to recover it. 00:27:28.164 [2024-12-08 02:29:55.785001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.785141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.785168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.164 qpair failed and we were unable to recover it. 00:27:28.164 [2024-12-08 02:29:55.785266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.785380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.785407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.164 qpair failed and we were unable to recover it. 00:27:28.164 [2024-12-08 02:29:55.785566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.785666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.785694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.164 qpair failed and we were unable to recover it. 00:27:28.164 [2024-12-08 02:29:55.785828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.785913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.785939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.164 qpair failed and we were unable to recover it. 00:27:28.164 [2024-12-08 02:29:55.786080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.786196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.786224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.164 qpair failed and we were unable to recover it. 00:27:28.164 [2024-12-08 02:29:55.786382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.786468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.786493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.164 qpair failed and we were unable to recover it. 00:27:28.164 [2024-12-08 02:29:55.786633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.786762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.786789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.164 qpair failed and we were unable to recover it. 00:27:28.164 [2024-12-08 02:29:55.786903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.787008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.787032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.164 qpair failed and we were unable to recover it. 00:27:28.164 [2024-12-08 02:29:55.787158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.787256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.787283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.164 qpair failed and we were unable to recover it. 00:27:28.164 [2024-12-08 02:29:55.787448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.787598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.787627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.164 qpair failed and we were unable to recover it. 00:27:28.164 [2024-12-08 02:29:55.787776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.787924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.787952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.164 qpair failed and we were unable to recover it. 00:27:28.164 [2024-12-08 02:29:55.788107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.788225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.788249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.164 qpair failed and we were unable to recover it. 00:27:28.164 [2024-12-08 02:29:55.788362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.788467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.788495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.164 qpair failed and we were unable to recover it. 00:27:28.164 [2024-12-08 02:29:55.788588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.788667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.788694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.164 qpair failed and we were unable to recover it. 00:27:28.164 [2024-12-08 02:29:55.788812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.788937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.788966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.164 qpair failed and we were unable to recover it. 00:27:28.164 [2024-12-08 02:29:55.789079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.789226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.789251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.164 qpair failed and we were unable to recover it. 00:27:28.164 [2024-12-08 02:29:55.789412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.789534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.789567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.164 qpair failed and we were unable to recover it. 00:27:28.164 [2024-12-08 02:29:55.789723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.789816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.789845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.164 qpair failed and we were unable to recover it. 00:27:28.164 [2024-12-08 02:29:55.789962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.790111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.790139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.164 qpair failed and we were unable to recover it. 00:27:28.164 [2024-12-08 02:29:55.790308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.790399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.790423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.164 qpair failed and we were unable to recover it. 00:27:28.164 [2024-12-08 02:29:55.790510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.790601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.790627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.164 qpair failed and we were unable to recover it. 00:27:28.164 [2024-12-08 02:29:55.790749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.790900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.790925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.164 qpair failed and we were unable to recover it. 00:27:28.164 [2024-12-08 02:29:55.791057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.164 [2024-12-08 02:29:55.791206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.791233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.165 qpair failed and we were unable to recover it. 00:27:28.165 [2024-12-08 02:29:55.791395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.791509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.791533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.165 qpair failed and we were unable to recover it. 00:27:28.165 [2024-12-08 02:29:55.791716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.791849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.791875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.165 qpair failed and we were unable to recover it. 00:27:28.165 [2024-12-08 02:29:55.792006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.792108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.792136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.165 qpair failed and we were unable to recover it. 00:27:28.165 [2024-12-08 02:29:55.792261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.792346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.792373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.165 qpair failed and we were unable to recover it. 00:27:28.165 [2024-12-08 02:29:55.792510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.792660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.792685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.165 qpair failed and we were unable to recover it. 00:27:28.165 [2024-12-08 02:29:55.792828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.792950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.792978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.165 qpair failed and we were unable to recover it. 00:27:28.165 [2024-12-08 02:29:55.793105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.793209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.793236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.165 qpair failed and we were unable to recover it. 00:27:28.165 [2024-12-08 02:29:55.793396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.793481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.793508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.165 qpair failed and we were unable to recover it. 00:27:28.165 [2024-12-08 02:29:55.793626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.793768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.793793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.165 qpair failed and we were unable to recover it. 00:27:28.165 [2024-12-08 02:29:55.793875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.793982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.794009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.165 qpair failed and we were unable to recover it. 00:27:28.165 [2024-12-08 02:29:55.794130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.794225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.794252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.165 qpair failed and we were unable to recover it. 00:27:28.165 [2024-12-08 02:29:55.794344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.794499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.794526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.165 qpair failed and we were unable to recover it. 00:27:28.165 [2024-12-08 02:29:55.794637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.794755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.794779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.165 qpair failed and we were unable to recover it. 00:27:28.165 [2024-12-08 02:29:55.794886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.795018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.795043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.165 qpair failed and we were unable to recover it. 00:27:28.165 [2024-12-08 02:29:55.795123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.795238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.795265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.165 qpair failed and we were unable to recover it. 00:27:28.165 [2024-12-08 02:29:55.795412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.795515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.795550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.165 qpair failed and we were unable to recover it. 00:27:28.165 [2024-12-08 02:29:55.795714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.795826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.795852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.165 qpair failed and we were unable to recover it. 00:27:28.165 [2024-12-08 02:29:55.795991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.796110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.796137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.165 qpair failed and we were unable to recover it. 00:27:28.165 [2024-12-08 02:29:55.796260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.796377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.796405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.165 qpair failed and we were unable to recover it. 00:27:28.165 [2024-12-08 02:29:55.796567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.796678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.796703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.165 qpair failed and we were unable to recover it. 00:27:28.165 [2024-12-08 02:29:55.796784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.796920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.796944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.165 qpair failed and we were unable to recover it. 00:27:28.165 [2024-12-08 02:29:55.797042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.797196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.797223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.165 qpair failed and we were unable to recover it. 00:27:28.165 [2024-12-08 02:29:55.797354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.797493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.797521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.165 qpair failed and we were unable to recover it. 00:27:28.165 [2024-12-08 02:29:55.797661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.797810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.797838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.165 qpair failed and we were unable to recover it. 00:27:28.165 [2024-12-08 02:29:55.798003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.798117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.798141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.165 qpair failed and we were unable to recover it. 00:27:28.165 [2024-12-08 02:29:55.798238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.798362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.798389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.165 qpair failed and we were unable to recover it. 00:27:28.165 [2024-12-08 02:29:55.798489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.798617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.798646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.165 qpair failed and we were unable to recover it. 00:27:28.165 [2024-12-08 02:29:55.798742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.798863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.165 [2024-12-08 02:29:55.798890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.166 qpair failed and we were unable to recover it. 00:27:28.166 [2024-12-08 02:29:55.799052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.799162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.799188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.166 qpair failed and we were unable to recover it. 00:27:28.166 [2024-12-08 02:29:55.799329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.799472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.799496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.166 qpair failed and we were unable to recover it. 00:27:28.166 [2024-12-08 02:29:55.799647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.799800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.799828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.166 qpair failed and we were unable to recover it. 00:27:28.166 [2024-12-08 02:29:55.799952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.800093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.800126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.166 qpair failed and we were unable to recover it. 00:27:28.166 [2024-12-08 02:29:55.800239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.800375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.800400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.166 qpair failed and we were unable to recover it. 00:27:28.166 [2024-12-08 02:29:55.800552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.800637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.800662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.166 qpair failed and we were unable to recover it. 00:27:28.166 [2024-12-08 02:29:55.800753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.800887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.800915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.166 qpair failed and we were unable to recover it. 00:27:28.166 [2024-12-08 02:29:55.801039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.801149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.801177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.166 qpair failed and we were unable to recover it. 00:27:28.166 [2024-12-08 02:29:55.801305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.801416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.801442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.166 qpair failed and we were unable to recover it. 00:27:28.166 [2024-12-08 02:29:55.801548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.801698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.801726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.166 qpair failed and we were unable to recover it. 00:27:28.166 [2024-12-08 02:29:55.801852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.801973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.802001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.166 qpair failed and we were unable to recover it. 00:27:28.166 [2024-12-08 02:29:55.802120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.802261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.802286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.166 qpair failed and we were unable to recover it. 00:27:28.166 [2024-12-08 02:29:55.802401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.802547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.802574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.166 qpair failed and we were unable to recover it. 00:27:28.166 [2024-12-08 02:29:55.802742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.802869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.802902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.166 qpair failed and we were unable to recover it. 00:27:28.166 [2024-12-08 02:29:55.803004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.803140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.803165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.166 qpair failed and we were unable to recover it. 00:27:28.166 [2024-12-08 02:29:55.803281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.803366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.803392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.166 qpair failed and we were unable to recover it. 00:27:28.166 [2024-12-08 02:29:55.803505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.803660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.803686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.166 qpair failed and we were unable to recover it. 00:27:28.166 [2024-12-08 02:29:55.803865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.803973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.803998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.166 qpair failed and we were unable to recover it. 00:27:28.166 [2024-12-08 02:29:55.804111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.804273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.804301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.166 qpair failed and we were unable to recover it. 00:27:28.166 [2024-12-08 02:29:55.804397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.804483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.804511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.166 qpair failed and we were unable to recover it. 00:27:28.166 [2024-12-08 02:29:55.804656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.804795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.804821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.166 qpair failed and we were unable to recover it. 00:27:28.166 [2024-12-08 02:29:55.804931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.805055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.805084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.166 qpair failed and we were unable to recover it. 00:27:28.166 [2024-12-08 02:29:55.805209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.805308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.805336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.166 qpair failed and we were unable to recover it. 00:27:28.166 [2024-12-08 02:29:55.805485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.805605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.805639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.166 qpair failed and we were unable to recover it. 00:27:28.166 [2024-12-08 02:29:55.805772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.805915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.805941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.166 qpair failed and we were unable to recover it. 00:27:28.166 [2024-12-08 02:29:55.806079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.806237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.806264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.166 qpair failed and we were unable to recover it. 00:27:28.166 [2024-12-08 02:29:55.806345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.806464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.806492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.166 qpair failed and we were unable to recover it. 00:27:28.166 [2024-12-08 02:29:55.806592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.806701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.806726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.166 qpair failed and we were unable to recover it. 00:27:28.166 [2024-12-08 02:29:55.806811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.166 [2024-12-08 02:29:55.806898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.806923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.167 qpair failed and we were unable to recover it. 00:27:28.167 [2024-12-08 02:29:55.807032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.807144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.807169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.167 qpair failed and we were unable to recover it. 00:27:28.167 [2024-12-08 02:29:55.807254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.807350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.807378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.167 qpair failed and we were unable to recover it. 00:27:28.167 [2024-12-08 02:29:55.807481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.807633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.807662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.167 qpair failed and we were unable to recover it. 00:27:28.167 [2024-12-08 02:29:55.807791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.807901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.807927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.167 qpair failed and we were unable to recover it. 00:27:28.167 [2024-12-08 02:29:55.808080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.808166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.808202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.167 qpair failed and we were unable to recover it. 00:27:28.167 [2024-12-08 02:29:55.808331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.808449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.808477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.167 qpair failed and we were unable to recover it. 00:27:28.167 [2024-12-08 02:29:55.808573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.808663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.808690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.167 qpair failed and we were unable to recover it. 00:27:28.167 [2024-12-08 02:29:55.808832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.808941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.808966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.167 qpair failed and we were unable to recover it. 00:27:28.167 [2024-12-08 02:29:55.809063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.809153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.809180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.167 qpair failed and we were unable to recover it. 00:27:28.167 [2024-12-08 02:29:55.809278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.809360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.809385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.167 qpair failed and we were unable to recover it. 00:27:28.167 [2024-12-08 02:29:55.809513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.809647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.809676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.167 qpair failed and we were unable to recover it. 00:27:28.167 [2024-12-08 02:29:55.809816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.809925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.809950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.167 qpair failed and we were unable to recover it. 00:27:28.167 [2024-12-08 02:29:55.810052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.810215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.810240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.167 qpair failed and we were unable to recover it. 00:27:28.167 [2024-12-08 02:29:55.810357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.810437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.810462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.167 qpair failed and we were unable to recover it. 00:27:28.167 [2024-12-08 02:29:55.810571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.810655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.810680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.167 qpair failed and we were unable to recover it. 00:27:28.167 [2024-12-08 02:29:55.810809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.810919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.810944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.167 qpair failed and we were unable to recover it. 00:27:28.167 [2024-12-08 02:29:55.811085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.811228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.811253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.167 qpair failed and we were unable to recover it. 00:27:28.167 [2024-12-08 02:29:55.811365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.811475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.811500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.167 qpair failed and we were unable to recover it. 00:27:28.167 [2024-12-08 02:29:55.811613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.811733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.811758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.167 qpair failed and we were unable to recover it. 00:27:28.167 [2024-12-08 02:29:55.811871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.811975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.812000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.167 qpair failed and we were unable to recover it. 00:27:28.167 [2024-12-08 02:29:55.812096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.812252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.812279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.167 qpair failed and we were unable to recover it. 00:27:28.167 [2024-12-08 02:29:55.812413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.812524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.812571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.167 qpair failed and we were unable to recover it. 00:27:28.167 [2024-12-08 02:29:55.812692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.812775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.812818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.167 qpair failed and we were unable to recover it. 00:27:28.167 [2024-12-08 02:29:55.812949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.813064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.813090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.167 qpair failed and we were unable to recover it. 00:27:28.167 [2024-12-08 02:29:55.813221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.813353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.813378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.167 qpair failed and we were unable to recover it. 00:27:28.167 [2024-12-08 02:29:55.813495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.813637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.813667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.167 qpair failed and we were unable to recover it. 00:27:28.167 [2024-12-08 02:29:55.813824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.813968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.813996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.167 qpair failed and we were unable to recover it. 00:27:28.167 [2024-12-08 02:29:55.814138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.814281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.167 [2024-12-08 02:29:55.814306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.167 qpair failed and we were unable to recover it. 00:27:28.168 [2024-12-08 02:29:55.814433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.814559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.814599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.168 qpair failed and we were unable to recover it. 00:27:28.168 [2024-12-08 02:29:55.814733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.814855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.814883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.168 qpair failed and we were unable to recover it. 00:27:28.168 [2024-12-08 02:29:55.815011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.815163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.815189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.168 qpair failed and we were unable to recover it. 00:27:28.168 [2024-12-08 02:29:55.815302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.815378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.815403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.168 qpair failed and we were unable to recover it. 00:27:28.168 [2024-12-08 02:29:55.815546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.815668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.815697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.168 qpair failed and we were unable to recover it. 00:27:28.168 [2024-12-08 02:29:55.815821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.815908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.815936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.168 qpair failed and we were unable to recover it. 00:27:28.168 [2024-12-08 02:29:55.816099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.816194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.816220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.168 qpair failed and we were unable to recover it. 00:27:28.168 [2024-12-08 02:29:55.816344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.816452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.816477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.168 qpair failed and we were unable to recover it. 00:27:28.168 [2024-12-08 02:29:55.816597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.816739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.816764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.168 qpair failed and we were unable to recover it. 00:27:28.168 [2024-12-08 02:29:55.816857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.816961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.816986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.168 qpair failed and we were unable to recover it. 00:27:28.168 [2024-12-08 02:29:55.817098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.817218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.817246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.168 qpair failed and we were unable to recover it. 00:27:28.168 [2024-12-08 02:29:55.817412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.817502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.817527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.168 qpair failed and we were unable to recover it. 00:27:28.168 [2024-12-08 02:29:55.817657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.817732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.817773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.168 qpair failed and we were unable to recover it. 00:27:28.168 [2024-12-08 02:29:55.817890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.818011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.818039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.168 qpair failed and we were unable to recover it. 00:27:28.168 [2024-12-08 02:29:55.818158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.818312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.818340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.168 qpair failed and we were unable to recover it. 00:27:28.168 [2024-12-08 02:29:55.818479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.818579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.818604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.168 qpair failed and we were unable to recover it. 00:27:28.168 [2024-12-08 02:29:55.818680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.818768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.818793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.168 qpair failed and we were unable to recover it. 00:27:28.168 [2024-12-08 02:29:55.818881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.819018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.819046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.168 qpair failed and we were unable to recover it. 00:27:28.168 [2024-12-08 02:29:55.819196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.819316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.819345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.168 qpair failed and we were unable to recover it. 00:27:28.168 [2024-12-08 02:29:55.819473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.819599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.819626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.168 qpair failed and we were unable to recover it. 00:27:28.168 [2024-12-08 02:29:55.819728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.819820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.819860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.168 qpair failed and we were unable to recover it. 00:27:28.168 [2024-12-08 02:29:55.819990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.820082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.820111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.168 qpair failed and we were unable to recover it. 00:27:28.168 [2024-12-08 02:29:55.820261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.820369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.820396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.168 qpair failed and we were unable to recover it. 00:27:28.168 [2024-12-08 02:29:55.820524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.820676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.820702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.168 qpair failed and we were unable to recover it. 00:27:28.168 [2024-12-08 02:29:55.820787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.820923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.820950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.168 qpair failed and we were unable to recover it. 00:27:28.168 [2024-12-08 02:29:55.821085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.821173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.821200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.168 qpair failed and we were unable to recover it. 00:27:28.168 [2024-12-08 02:29:55.821321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.821461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.821486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.168 qpair failed and we were unable to recover it. 00:27:28.168 [2024-12-08 02:29:55.821584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.821665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.821690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.168 qpair failed and we were unable to recover it. 00:27:28.168 [2024-12-08 02:29:55.821825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.821926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.168 [2024-12-08 02:29:55.821955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.169 qpair failed and we were unable to recover it. 00:27:28.169 [2024-12-08 02:29:55.822044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.822133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.822161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.169 qpair failed and we were unable to recover it. 00:27:28.169 [2024-12-08 02:29:55.822256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.822350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.822379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.169 qpair failed and we were unable to recover it. 00:27:28.169 [2024-12-08 02:29:55.822514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.822608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.822634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.169 qpair failed and we were unable to recover it. 00:27:28.169 [2024-12-08 02:29:55.822735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.822897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.822922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.169 qpair failed and we were unable to recover it. 00:27:28.169 [2024-12-08 02:29:55.823031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.823112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.823137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.169 qpair failed and we were unable to recover it. 00:27:28.169 [2024-12-08 02:29:55.823253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.823383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.823413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.169 qpair failed and we were unable to recover it. 00:27:28.169 [2024-12-08 02:29:55.823570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.823661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.823687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.169 qpair failed and we were unable to recover it. 00:27:28.169 [2024-12-08 02:29:55.823801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.823907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.823935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.169 qpair failed and we were unable to recover it. 00:27:28.169 [2024-12-08 02:29:55.824062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.824157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.824185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.169 qpair failed and we were unable to recover it. 00:27:28.169 [2024-12-08 02:29:55.824275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.824363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.824405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.169 qpair failed and we were unable to recover it. 00:27:28.169 [2024-12-08 02:29:55.824484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.824608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.824633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.169 qpair failed and we were unable to recover it. 00:27:28.169 [2024-12-08 02:29:55.824733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.824821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.824849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.169 qpair failed and we were unable to recover it. 00:27:28.169 [2024-12-08 02:29:55.824981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.825111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.825139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.169 qpair failed and we were unable to recover it. 00:27:28.169 [2024-12-08 02:29:55.825264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.825353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.825380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.169 qpair failed and we were unable to recover it. 00:27:28.169 [2024-12-08 02:29:55.825516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.825659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.825686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.169 qpair failed and we were unable to recover it. 00:27:28.169 [2024-12-08 02:29:55.825823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.825912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.825939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.169 qpair failed and we were unable to recover it. 00:27:28.169 [2024-12-08 02:29:55.826081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.826156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.826181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.169 qpair failed and we were unable to recover it. 00:27:28.169 [2024-12-08 02:29:55.826273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.826404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.826433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.169 qpair failed and we were unable to recover it. 00:27:28.169 [2024-12-08 02:29:55.826586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.826694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.826718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.169 qpair failed and we were unable to recover it. 00:27:28.169 [2024-12-08 02:29:55.826830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.826913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.826939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.169 qpair failed and we were unable to recover it. 00:27:28.169 [2024-12-08 02:29:55.827053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.827136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.827162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.169 qpair failed and we were unable to recover it. 00:27:28.169 [2024-12-08 02:29:55.827268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.827354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.827379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.169 qpair failed and we were unable to recover it. 00:27:28.169 [2024-12-08 02:29:55.827519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.827606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.827631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.169 qpair failed and we were unable to recover it. 00:27:28.169 [2024-12-08 02:29:55.827797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.827892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.827920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.169 qpair failed and we were unable to recover it. 00:27:28.169 [2024-12-08 02:29:55.828010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.828109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.828137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.169 qpair failed and we were unable to recover it. 00:27:28.169 [2024-12-08 02:29:55.828231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.828323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.169 [2024-12-08 02:29:55.828351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.169 qpair failed and we were unable to recover it. 00:27:28.169 [2024-12-08 02:29:55.828448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.828558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.828584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.170 qpair failed and we were unable to recover it. 00:27:28.170 [2024-12-08 02:29:55.828699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.828831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.828858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.170 qpair failed and we were unable to recover it. 00:27:28.170 [2024-12-08 02:29:55.828992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.829126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.829154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.170 qpair failed and we were unable to recover it. 00:27:28.170 [2024-12-08 02:29:55.829307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.829456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.829484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.170 qpair failed and we were unable to recover it. 00:27:28.170 [2024-12-08 02:29:55.829626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.829772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.829798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.170 qpair failed and we were unable to recover it. 00:27:28.170 [2024-12-08 02:29:55.829968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.830103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.830129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.170 qpair failed and we were unable to recover it. 00:27:28.170 [2024-12-08 02:29:55.830268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.830345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.830370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.170 qpair failed and we were unable to recover it. 00:27:28.170 [2024-12-08 02:29:55.830483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.830562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.830588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.170 qpair failed and we were unable to recover it. 00:27:28.170 [2024-12-08 02:29:55.830704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.830783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.830809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.170 qpair failed and we were unable to recover it. 00:27:28.170 [2024-12-08 02:29:55.830932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.831073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.831098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.170 qpair failed and we were unable to recover it. 00:27:28.170 [2024-12-08 02:29:55.831236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.831323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.831366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.170 qpair failed and we were unable to recover it. 00:27:28.170 [2024-12-08 02:29:55.831507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.831639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.831668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.170 qpair failed and we were unable to recover it. 00:27:28.170 [2024-12-08 02:29:55.831807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.831929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.831955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.170 qpair failed and we were unable to recover it. 00:27:28.170 [2024-12-08 02:29:55.832046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.832156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.832181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.170 qpair failed and we were unable to recover it. 00:27:28.170 [2024-12-08 02:29:55.832296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.832417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.832446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.170 qpair failed and we were unable to recover it. 00:27:28.170 [2024-12-08 02:29:55.832560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.832681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.832709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.170 qpair failed and we were unable to recover it. 00:27:28.170 [2024-12-08 02:29:55.832825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.832969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.832995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.170 qpair failed and we were unable to recover it. 00:27:28.170 [2024-12-08 02:29:55.833153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.833244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.833272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.170 qpair failed and we were unable to recover it. 00:27:28.170 [2024-12-08 02:29:55.833407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.833522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.833556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.170 qpair failed and we were unable to recover it. 00:27:28.170 [2024-12-08 02:29:55.833695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.833841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.833868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.170 qpair failed and we were unable to recover it. 00:27:28.170 [2024-12-08 02:29:55.834007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.834119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.834144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.170 qpair failed and we were unable to recover it. 00:27:28.170 [2024-12-08 02:29:55.834275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.834395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.834423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.170 qpair failed and we were unable to recover it. 00:27:28.170 [2024-12-08 02:29:55.834512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.834626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.834654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.170 qpair failed and we were unable to recover it. 00:27:28.170 [2024-12-08 02:29:55.834770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.834899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.834924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.170 qpair failed and we were unable to recover it. 00:27:28.170 [2024-12-08 02:29:55.835002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.835145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.835170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.170 qpair failed and we were unable to recover it. 00:27:28.170 [2024-12-08 02:29:55.835273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.835367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.835396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.170 qpair failed and we were unable to recover it. 00:27:28.170 [2024-12-08 02:29:55.835516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.835661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.835695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.170 qpair failed and we were unable to recover it. 00:27:28.170 [2024-12-08 02:29:55.835835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.835973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.835998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.170 qpair failed and we were unable to recover it. 00:27:28.170 [2024-12-08 02:29:55.836079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.836160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.170 [2024-12-08 02:29:55.836185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.170 qpair failed and we were unable to recover it. 00:27:28.171 [2024-12-08 02:29:55.836287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.836392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.836434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.171 qpair failed and we were unable to recover it. 00:27:28.171 [2024-12-08 02:29:55.836566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.836656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.836685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.171 qpair failed and we were unable to recover it. 00:27:28.171 [2024-12-08 02:29:55.836773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.836894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.836933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.171 qpair failed and we were unable to recover it. 00:27:28.171 [2024-12-08 02:29:55.837096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.837184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.837210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.171 qpair failed and we were unable to recover it. 00:27:28.171 [2024-12-08 02:29:55.837294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.837434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.837462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.171 qpair failed and we were unable to recover it. 00:27:28.171 [2024-12-08 02:29:55.837587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.837707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.837735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.171 qpair failed and we were unable to recover it. 00:27:28.171 [2024-12-08 02:29:55.837863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.838017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.838045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.171 qpair failed and we were unable to recover it. 00:27:28.171 [2024-12-08 02:29:55.838207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.838319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.838343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.171 qpair failed and we were unable to recover it. 00:27:28.171 [2024-12-08 02:29:55.838494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.838610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.838635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.171 qpair failed and we were unable to recover it. 00:27:28.171 [2024-12-08 02:29:55.838726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.838869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.838897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.171 qpair failed and we were unable to recover it. 00:27:28.171 [2024-12-08 02:29:55.839037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.839147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.839172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.171 qpair failed and we were unable to recover it. 00:27:28.171 [2024-12-08 02:29:55.839251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.839372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.839396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.171 qpair failed and we were unable to recover it. 00:27:28.171 [2024-12-08 02:29:55.839511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.839599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.839641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.171 qpair failed and we were unable to recover it. 00:27:28.171 [2024-12-08 02:29:55.839773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.839910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.839935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.171 qpair failed and we were unable to recover it. 00:27:28.171 [2024-12-08 02:29:55.840067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.840189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.840217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.171 qpair failed and we were unable to recover it. 00:27:28.171 [2024-12-08 02:29:55.840318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.840401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.840426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.171 qpair failed and we were unable to recover it. 00:27:28.171 [2024-12-08 02:29:55.840507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.840638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.840666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.171 qpair failed and we were unable to recover it. 00:27:28.171 [2024-12-08 02:29:55.840751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.840885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.840909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.171 qpair failed and we were unable to recover it. 00:27:28.171 [2024-12-08 02:29:55.841023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.841144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.841170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.171 qpair failed and we were unable to recover it. 00:27:28.171 [2024-12-08 02:29:55.841307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.841422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.841448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.171 qpair failed and we were unable to recover it. 00:27:28.171 [2024-12-08 02:29:55.841579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.841665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.841693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.171 qpair failed and we were unable to recover it. 00:27:28.171 [2024-12-08 02:29:55.841815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.841905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.841933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.171 qpair failed and we were unable to recover it. 00:27:28.171 [2024-12-08 02:29:55.842031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.842180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.842208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.171 qpair failed and we were unable to recover it. 00:27:28.171 [2024-12-08 02:29:55.842371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.842458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.842486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.171 qpair failed and we were unable to recover it. 00:27:28.171 [2024-12-08 02:29:55.842612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.842724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.842752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.171 qpair failed and we were unable to recover it. 00:27:28.171 [2024-12-08 02:29:55.842848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.842943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.842971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.171 qpair failed and we were unable to recover it. 00:27:28.171 [2024-12-08 02:29:55.843088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.843211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.843239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.171 qpair failed and we were unable to recover it. 00:27:28.171 [2024-12-08 02:29:55.843347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.843454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.843479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.171 qpair failed and we were unable to recover it. 00:27:28.171 [2024-12-08 02:29:55.843601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.171 [2024-12-08 02:29:55.843712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.843738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.172 qpair failed and we were unable to recover it. 00:27:28.172 [2024-12-08 02:29:55.843818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.843955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.843998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.172 qpair failed and we were unable to recover it. 00:27:28.172 [2024-12-08 02:29:55.844113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.844233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.844261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.172 qpair failed and we were unable to recover it. 00:27:28.172 [2024-12-08 02:29:55.844371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.844462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.844488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.172 qpair failed and we were unable to recover it. 00:27:28.172 [2024-12-08 02:29:55.844570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.844715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.844741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.172 qpair failed and we were unable to recover it. 00:27:28.172 [2024-12-08 02:29:55.844835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.844916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.844945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.172 qpair failed and we were unable to recover it. 00:27:28.172 [2024-12-08 02:29:55.845111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.845257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.845283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.172 qpair failed and we were unable to recover it. 00:27:28.172 [2024-12-08 02:29:55.845364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.845475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.845501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.172 qpair failed and we were unable to recover it. 00:27:28.172 [2024-12-08 02:29:55.845599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.845709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.845735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.172 qpair failed and we were unable to recover it. 00:27:28.172 [2024-12-08 02:29:55.845843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.845981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.846009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.172 qpair failed and we were unable to recover it. 00:27:28.172 [2024-12-08 02:29:55.846104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.846188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.846215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.172 qpair failed and we were unable to recover it. 00:27:28.172 [2024-12-08 02:29:55.846352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.846505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.846530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.172 qpair failed and we were unable to recover it. 00:27:28.172 [2024-12-08 02:29:55.846657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.846777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.846806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.172 qpair failed and we were unable to recover it. 00:27:28.172 [2024-12-08 02:29:55.846893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.846981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.847009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.172 qpair failed and we were unable to recover it. 00:27:28.172 [2024-12-08 02:29:55.847129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.847280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.847306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.172 qpair failed and we were unable to recover it. 00:27:28.172 [2024-12-08 02:29:55.847420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.847503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.847549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.172 qpair failed and we were unable to recover it. 00:27:28.172 [2024-12-08 02:29:55.847632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.847746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.847771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.172 qpair failed and we were unable to recover it. 00:27:28.172 [2024-12-08 02:29:55.847884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.847969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.847993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.172 qpair failed and we were unable to recover it. 00:27:28.172 [2024-12-08 02:29:55.848101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.848249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.848277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.172 qpair failed and we were unable to recover it. 00:27:28.172 [2024-12-08 02:29:55.848410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.848522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.848559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.172 qpair failed and we were unable to recover it. 00:27:28.172 [2024-12-08 02:29:55.848689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.848809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.848838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.172 qpair failed and we were unable to recover it. 00:27:28.172 [2024-12-08 02:29:55.848944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.849035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.849063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.172 qpair failed and we were unable to recover it. 00:27:28.172 [2024-12-08 02:29:55.849191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.849306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.849333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.172 qpair failed and we were unable to recover it. 00:27:28.172 [2024-12-08 02:29:55.849497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.849617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.849643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.172 qpair failed and we were unable to recover it. 00:27:28.172 [2024-12-08 02:29:55.849782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.849931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.849960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.172 qpair failed and we were unable to recover it. 00:27:28.172 [2024-12-08 02:29:55.850051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.850174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.850207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.172 qpair failed and we were unable to recover it. 00:27:28.172 [2024-12-08 02:29:55.850326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.850443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.850472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.172 qpair failed and we were unable to recover it. 00:27:28.172 [2024-12-08 02:29:55.850600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.850736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.850761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.172 qpair failed and we were unable to recover it. 00:27:28.172 [2024-12-08 02:29:55.850889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.851000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.172 [2024-12-08 02:29:55.851024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.172 qpair failed and we were unable to recover it. 00:27:28.172 [2024-12-08 02:29:55.851187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.851310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.851337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.173 qpair failed and we were unable to recover it. 00:27:28.173 [2024-12-08 02:29:55.851464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.851595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.851621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.173 qpair failed and we were unable to recover it. 00:27:28.173 [2024-12-08 02:29:55.851712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.851797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.851822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.173 qpair failed and we were unable to recover it. 00:27:28.173 [2024-12-08 02:29:55.851950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.852064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.852092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.173 qpair failed and we were unable to recover it. 00:27:28.173 [2024-12-08 02:29:55.852211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.852328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.852355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.173 qpair failed and we were unable to recover it. 00:27:28.173 [2024-12-08 02:29:55.852474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.852596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.852624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.173 qpair failed and we were unable to recover it. 00:27:28.173 [2024-12-08 02:29:55.852764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.852852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.852877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.173 qpair failed and we were unable to recover it. 00:27:28.173 [2024-12-08 02:29:55.852988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.853094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.853118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.173 qpair failed and we were unable to recover it. 00:27:28.173 [2024-12-08 02:29:55.853236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.853314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.853338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.173 qpair failed and we were unable to recover it. 00:27:28.173 [2024-12-08 02:29:55.853444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.853561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.853586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.173 qpair failed and we were unable to recover it. 00:27:28.173 [2024-12-08 02:29:55.853672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.853782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.853807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.173 qpair failed and we were unable to recover it. 00:27:28.173 [2024-12-08 02:29:55.853942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.854093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.854120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.173 qpair failed and we were unable to recover it. 00:27:28.173 [2024-12-08 02:29:55.854223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.854311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.854339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.173 qpair failed and we were unable to recover it. 00:27:28.173 [2024-12-08 02:29:55.854490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.854594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.854622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.173 qpair failed and we were unable to recover it. 00:27:28.173 [2024-12-08 02:29:55.854721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.854861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.854885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.173 qpair failed and we were unable to recover it. 00:27:28.173 [2024-12-08 02:29:55.855001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.855106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.855131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.173 qpair failed and we were unable to recover it. 00:27:28.173 [2024-12-08 02:29:55.855222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.855359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.855384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.173 qpair failed and we were unable to recover it. 00:27:28.173 [2024-12-08 02:29:55.855470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.855577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.855603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.173 qpair failed and we were unable to recover it. 00:27:28.173 [2024-12-08 02:29:55.855718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.855812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.855838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.173 qpair failed and we were unable to recover it. 00:27:28.173 [2024-12-08 02:29:55.855972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.856058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.856086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.173 qpair failed and we were unable to recover it. 00:27:28.173 [2024-12-08 02:29:55.856176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.856295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.856325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.173 qpair failed and we were unable to recover it. 00:27:28.173 [2024-12-08 02:29:55.856450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.856572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.856600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.173 qpair failed and we were unable to recover it. 00:27:28.173 [2024-12-08 02:29:55.856733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.856851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.856875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.173 qpair failed and we were unable to recover it. 00:27:28.173 [2024-12-08 02:29:55.857017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.857154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.857182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.173 qpair failed and we were unable to recover it. 00:27:28.173 [2024-12-08 02:29:55.857303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.857434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.857458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.173 qpair failed and we were unable to recover it. 00:27:28.173 [2024-12-08 02:29:55.857548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.857660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.173 [2024-12-08 02:29:55.857685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.173 qpair failed and we were unable to recover it. 00:27:28.173 [2024-12-08 02:29:55.857798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.857914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.857939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.174 qpair failed and we were unable to recover it. 00:27:28.174 [2024-12-08 02:29:55.858085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.858192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.858216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.174 qpair failed and we were unable to recover it. 00:27:28.174 [2024-12-08 02:29:55.858334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.858448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.858490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.174 qpair failed and we were unable to recover it. 00:27:28.174 [2024-12-08 02:29:55.858610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.858687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.858712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.174 qpair failed and we were unable to recover it. 00:27:28.174 [2024-12-08 02:29:55.858864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.859000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.859025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.174 qpair failed and we were unable to recover it. 00:27:28.174 [2024-12-08 02:29:55.859158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.859283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.859325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.174 qpair failed and we were unable to recover it. 00:27:28.174 [2024-12-08 02:29:55.859415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.859526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.859568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.174 qpair failed and we were unable to recover it. 00:27:28.174 [2024-12-08 02:29:55.859658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.859740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.859766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.174 qpair failed and we were unable to recover it. 00:27:28.174 [2024-12-08 02:29:55.859845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.859953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.859979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.174 qpair failed and we were unable to recover it. 00:27:28.174 [2024-12-08 02:29:55.860131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.860243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.860271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.174 qpair failed and we were unable to recover it. 00:27:28.174 [2024-12-08 02:29:55.860365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.860513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.860549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.174 qpair failed and we were unable to recover it. 00:27:28.174 [2024-12-08 02:29:55.860640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.860764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.860792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.174 qpair failed and we were unable to recover it. 00:27:28.174 [2024-12-08 02:29:55.860894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.861033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.861057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.174 qpair failed and we were unable to recover it. 00:27:28.174 [2024-12-08 02:29:55.861216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.861309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.861336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.174 qpair failed and we were unable to recover it. 00:27:28.174 [2024-12-08 02:29:55.861430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.861511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.861545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.174 qpair failed and we were unable to recover it. 00:27:28.174 [2024-12-08 02:29:55.861676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.861797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.861824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.174 qpair failed and we were unable to recover it. 00:27:28.174 [2024-12-08 02:29:55.861961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.862050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.862077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.174 qpair failed and we were unable to recover it. 00:27:28.174 [2024-12-08 02:29:55.862218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.862362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.862389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.174 qpair failed and we were unable to recover it. 00:27:28.174 [2024-12-08 02:29:55.862500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.862612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.862638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.174 qpair failed and we were unable to recover it. 00:27:28.174 [2024-12-08 02:29:55.862734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.862850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.862891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.174 qpair failed and we were unable to recover it. 00:27:28.174 [2024-12-08 02:29:55.863047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.863164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.863189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.174 qpair failed and we were unable to recover it. 00:27:28.174 [2024-12-08 02:29:55.863280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.863358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.863384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.174 qpair failed and we were unable to recover it. 00:27:28.174 [2024-12-08 02:29:55.863504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.863611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.863654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.174 qpair failed and we were unable to recover it. 00:27:28.174 [2024-12-08 02:29:55.863820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.863902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.863927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.174 qpair failed and we were unable to recover it. 00:27:28.174 [2024-12-08 02:29:55.864038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.864149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.864173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.174 qpair failed and we were unable to recover it. 00:27:28.174 [2024-12-08 02:29:55.864284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.864421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.864449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.174 qpair failed and we were unable to recover it. 00:27:28.174 [2024-12-08 02:29:55.864583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.864704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.864731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.174 qpair failed and we were unable to recover it. 00:27:28.174 [2024-12-08 02:29:55.864832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.864988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.865015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.174 qpair failed and we were unable to recover it. 00:27:28.174 [2024-12-08 02:29:55.865156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.865231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.174 [2024-12-08 02:29:55.865255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.174 qpair failed and we were unable to recover it. 00:27:28.175 [2024-12-08 02:29:55.865395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.865514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.865547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.175 qpair failed and we were unable to recover it. 00:27:28.175 [2024-12-08 02:29:55.865673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.865789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.865818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.175 qpair failed and we were unable to recover it. 00:27:28.175 [2024-12-08 02:29:55.865977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.866133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.866161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.175 qpair failed and we were unable to recover it. 00:27:28.175 [2024-12-08 02:29:55.866293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.866379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.866404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.175 qpair failed and we were unable to recover it. 00:27:28.175 [2024-12-08 02:29:55.866490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.866604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.866632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.175 qpair failed and we were unable to recover it. 00:27:28.175 [2024-12-08 02:29:55.866762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.866860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.866886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.175 qpair failed and we were unable to recover it. 00:27:28.175 [2024-12-08 02:29:55.867004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.867091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.867117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.175 qpair failed and we were unable to recover it. 00:27:28.175 [2024-12-08 02:29:55.867229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.867334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.867359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.175 qpair failed and we were unable to recover it. 00:27:28.175 [2024-12-08 02:29:55.867457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.867588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.867617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.175 qpair failed and we were unable to recover it. 00:27:28.175 [2024-12-08 02:29:55.867707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.867801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.867829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.175 qpair failed and we were unable to recover it. 00:27:28.175 [2024-12-08 02:29:55.867982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.868077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.868105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.175 qpair failed and we were unable to recover it. 00:27:28.175 [2024-12-08 02:29:55.868232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.868316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.868341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.175 qpair failed and we were unable to recover it. 00:27:28.175 [2024-12-08 02:29:55.868487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.868577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.868618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.175 qpair failed and we were unable to recover it. 00:27:28.175 [2024-12-08 02:29:55.868742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.868861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.868889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.175 qpair failed and we were unable to recover it. 00:27:28.175 [2024-12-08 02:29:55.868986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.869102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.869143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.175 qpair failed and we were unable to recover it. 00:27:28.175 [2024-12-08 02:29:55.869279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.869357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.869383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.175 qpair failed and we were unable to recover it. 00:27:28.175 [2024-12-08 02:29:55.869470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.869559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.869584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.175 qpair failed and we were unable to recover it. 00:27:28.175 [2024-12-08 02:29:55.869703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.869781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.869807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.175 qpair failed and we were unable to recover it. 00:27:28.175 [2024-12-08 02:29:55.869894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.870031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.870056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.175 qpair failed and we were unable to recover it. 00:27:28.175 [2024-12-08 02:29:55.870205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.870283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.870309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.175 qpair failed and we were unable to recover it. 00:27:28.175 [2024-12-08 02:29:55.870413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.870573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.870602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.175 qpair failed and we were unable to recover it. 00:27:28.175 [2024-12-08 02:29:55.870733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.870854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.870882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.175 qpair failed and we were unable to recover it. 00:27:28.175 [2024-12-08 02:29:55.871031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.871206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.871232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.175 qpair failed and we were unable to recover it. 00:27:28.175 [2024-12-08 02:29:55.871373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.871485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.871510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.175 qpair failed and we were unable to recover it. 00:27:28.175 [2024-12-08 02:29:55.871612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.871707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.871735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.175 qpair failed and we were unable to recover it. 00:27:28.175 [2024-12-08 02:29:55.871861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.871947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.871975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.175 qpair failed and we were unable to recover it. 00:27:28.175 [2024-12-08 02:29:55.872068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.872186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.872214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.175 qpair failed and we were unable to recover it. 00:27:28.175 [2024-12-08 02:29:55.872323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.872463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.872489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.175 qpair failed and we were unable to recover it. 00:27:28.175 [2024-12-08 02:29:55.872624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.175 [2024-12-08 02:29:55.872713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.872757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.176 qpair failed and we were unable to recover it. 00:27:28.176 [2024-12-08 02:29:55.872839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.872926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.872951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.176 qpair failed and we were unable to recover it. 00:27:28.176 [2024-12-08 02:29:55.873070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.873145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.873169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.176 qpair failed and we were unable to recover it. 00:27:28.176 [2024-12-08 02:29:55.873297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.873376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.873400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.176 qpair failed and we were unable to recover it. 00:27:28.176 [2024-12-08 02:29:55.873484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.873572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.873598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.176 qpair failed and we were unable to recover it. 00:27:28.176 [2024-12-08 02:29:55.873704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.873793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.873818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.176 qpair failed and we were unable to recover it. 00:27:28.176 [2024-12-08 02:29:55.873921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.874085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.874110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.176 qpair failed and we were unable to recover it. 00:27:28.176 [2024-12-08 02:29:55.874223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.874328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.874353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.176 qpair failed and we were unable to recover it. 00:27:28.176 [2024-12-08 02:29:55.874479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.874563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.874591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.176 qpair failed and we were unable to recover it. 00:27:28.176 [2024-12-08 02:29:55.874721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.874836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.874864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.176 qpair failed and we were unable to recover it. 00:27:28.176 [2024-12-08 02:29:55.874954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.875075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.875104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.176 qpair failed and we were unable to recover it. 00:27:28.176 [2024-12-08 02:29:55.875229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.875377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.875402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.176 qpair failed and we were unable to recover it. 00:27:28.176 [2024-12-08 02:29:55.875506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.875611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.875639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.176 qpair failed and we were unable to recover it. 00:27:28.176 [2024-12-08 02:29:55.875731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.875867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.875892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.176 qpair failed and we were unable to recover it. 00:27:28.176 [2024-12-08 02:29:55.875968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.876059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.876083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.176 qpair failed and we were unable to recover it. 00:27:28.176 [2024-12-08 02:29:55.876238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.876349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.876374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.176 qpair failed and we were unable to recover it. 00:27:28.176 [2024-12-08 02:29:55.876482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.876648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.876673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.176 qpair failed and we were unable to recover it. 00:27:28.176 [2024-12-08 02:29:55.876760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.876890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.876917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.176 qpair failed and we were unable to recover it. 00:27:28.176 [2024-12-08 02:29:55.877014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.877161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.877189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.176 qpair failed and we were unable to recover it. 00:27:28.176 [2024-12-08 02:29:55.877292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.877369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.877394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.176 qpair failed and we were unable to recover it. 00:27:28.176 [2024-12-08 02:29:55.877478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.877601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.877642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.176 qpair failed and we were unable to recover it. 00:27:28.176 [2024-12-08 02:29:55.877755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.877849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.877878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.176 qpair failed and we were unable to recover it. 00:27:28.176 [2024-12-08 02:29:55.878042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.878122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.878147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.176 qpair failed and we were unable to recover it. 00:27:28.176 [2024-12-08 02:29:55.878285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.176 [2024-12-08 02:29:55.878394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.878418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.460 qpair failed and we were unable to recover it. 00:27:28.460 [2024-12-08 02:29:55.878556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.878682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.878711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.460 qpair failed and we were unable to recover it. 00:27:28.460 [2024-12-08 02:29:55.878839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.878966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.878993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.460 qpair failed and we were unable to recover it. 00:27:28.460 [2024-12-08 02:29:55.879115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.879199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.879226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.460 qpair failed and we were unable to recover it. 00:27:28.460 [2024-12-08 02:29:55.879355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.879439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.879463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.460 qpair failed and we were unable to recover it. 00:27:28.460 [2024-12-08 02:29:55.879580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.879734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.879759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.460 qpair failed and we were unable to recover it. 00:27:28.460 [2024-12-08 02:29:55.879868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.879952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.879976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.460 qpair failed and we were unable to recover it. 00:27:28.460 [2024-12-08 02:29:55.880056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.880171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.880196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.460 qpair failed and we were unable to recover it. 00:27:28.460 [2024-12-08 02:29:55.880339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.880449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.880474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.460 qpair failed and we were unable to recover it. 00:27:28.460 [2024-12-08 02:29:55.880614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.880706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.880734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.460 qpair failed and we were unable to recover it. 00:27:28.460 [2024-12-08 02:29:55.880888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.880971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.880995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.460 qpair failed and we were unable to recover it. 00:27:28.460 [2024-12-08 02:29:55.881101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.881225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.881253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.460 qpair failed and we were unable to recover it. 00:27:28.460 [2024-12-08 02:29:55.881339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.881413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.881438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.460 qpair failed and we were unable to recover it. 00:27:28.460 [2024-12-08 02:29:55.881550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.881638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.881665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.460 qpair failed and we were unable to recover it. 00:27:28.460 [2024-12-08 02:29:55.881759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.881839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.881864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.460 qpair failed and we were unable to recover it. 00:27:28.460 [2024-12-08 02:29:55.882052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.882163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.882188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.460 qpair failed and we were unable to recover it. 00:27:28.460 [2024-12-08 02:29:55.882301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.882442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.882468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.460 qpair failed and we were unable to recover it. 00:27:28.460 [2024-12-08 02:29:55.882583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.882712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.882740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.460 qpair failed and we were unable to recover it. 00:27:28.460 [2024-12-08 02:29:55.882833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.882923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.882951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.460 qpair failed and we were unable to recover it. 00:27:28.460 [2024-12-08 02:29:55.883073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.883197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.460 [2024-12-08 02:29:55.883225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.460 qpair failed and we were unable to recover it. 00:27:28.460 [2024-12-08 02:29:55.883360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.883472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.883498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.461 qpair failed and we were unable to recover it. 00:27:28.461 [2024-12-08 02:29:55.883652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.883747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.883780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.461 qpair failed and we were unable to recover it. 00:27:28.461 [2024-12-08 02:29:55.883872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.883997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.884027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.461 qpair failed and we were unable to recover it. 00:27:28.461 [2024-12-08 02:29:55.884160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.884251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.884280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.461 qpair failed and we were unable to recover it. 00:27:28.461 [2024-12-08 02:29:55.884410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.884524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.884557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.461 qpair failed and we were unable to recover it. 00:27:28.461 [2024-12-08 02:29:55.884661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.884796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.884822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.461 qpair failed and we were unable to recover it. 00:27:28.461 [2024-12-08 02:29:55.884909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.885068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.885096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.461 qpair failed and we were unable to recover it. 00:27:28.461 [2024-12-08 02:29:55.885262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.885348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.885374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.461 qpair failed and we were unable to recover it. 00:27:28.461 [2024-12-08 02:29:55.885453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.885547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.885573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.461 qpair failed and we were unable to recover it. 00:27:28.461 [2024-12-08 02:29:55.885672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.885815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.885843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.461 qpair failed and we were unable to recover it. 00:27:28.461 [2024-12-08 02:29:55.885978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.886061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.886086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.461 qpair failed and we were unable to recover it. 00:27:28.461 [2024-12-08 02:29:55.886242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.886359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.886395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.461 qpair failed and we were unable to recover it. 00:27:28.461 [2024-12-08 02:29:55.886511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.886647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.886674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.461 qpair failed and we were unable to recover it. 00:27:28.461 [2024-12-08 02:29:55.886801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.886959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.886984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.461 qpair failed and we were unable to recover it. 00:27:28.461 [2024-12-08 02:29:55.887106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.887265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.887294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.461 qpair failed and we were unable to recover it. 00:27:28.461 [2024-12-08 02:29:55.887383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.887506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.887534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.461 qpair failed and we were unable to recover it. 00:27:28.461 [2024-12-08 02:29:55.887719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.887856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.887899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.461 qpair failed and we were unable to recover it. 00:27:28.461 [2024-12-08 02:29:55.887991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.888086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.888114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.461 qpair failed and we were unable to recover it. 00:27:28.461 [2024-12-08 02:29:55.888247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.888370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.888398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.461 qpair failed and we were unable to recover it. 00:27:28.461 [2024-12-08 02:29:55.888524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.888698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.888724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.461 qpair failed and we were unable to recover it. 00:27:28.461 [2024-12-08 02:29:55.888842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.888947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.888973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.461 qpair failed and we were unable to recover it. 00:27:28.461 [2024-12-08 02:29:55.889089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.889189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.889222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.461 qpair failed and we were unable to recover it. 00:27:28.461 [2024-12-08 02:29:55.889362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.889511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.889543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.461 qpair failed and we were unable to recover it. 00:27:28.461 [2024-12-08 02:29:55.889646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.889762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.889790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.461 qpair failed and we were unable to recover it. 00:27:28.461 [2024-12-08 02:29:55.889900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.890039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.890064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.461 qpair failed and we were unable to recover it. 00:27:28.461 [2024-12-08 02:29:55.890176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.890296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.890325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.461 qpair failed and we were unable to recover it. 00:27:28.461 [2024-12-08 02:29:55.890446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.890526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.890593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.461 qpair failed and we were unable to recover it. 00:27:28.461 [2024-12-08 02:29:55.890717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.890847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.890873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.461 qpair failed and we were unable to recover it. 00:27:28.461 [2024-12-08 02:29:55.890988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.891097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.461 [2024-12-08 02:29:55.891122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.462 qpair failed and we were unable to recover it. 00:27:28.462 [2024-12-08 02:29:55.891237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.891340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.891368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.462 qpair failed and we were unable to recover it. 00:27:28.462 [2024-12-08 02:29:55.891494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.891637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.891666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.462 qpair failed and we were unable to recover it. 00:27:28.462 [2024-12-08 02:29:55.891814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.891908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.891936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.462 qpair failed and we were unable to recover it. 00:27:28.462 [2024-12-08 02:29:55.892054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.892140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.892164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.462 qpair failed and we were unable to recover it. 00:27:28.462 [2024-12-08 02:29:55.892277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.892388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.892430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.462 qpair failed and we were unable to recover it. 00:27:28.462 [2024-12-08 02:29:55.892528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.892622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.892650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.462 qpair failed and we were unable to recover it. 00:27:28.462 [2024-12-08 02:29:55.892750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.892864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.892892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.462 qpair failed and we were unable to recover it. 00:27:28.462 [2024-12-08 02:29:55.893039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.893122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.893147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.462 qpair failed and we were unable to recover it. 00:27:28.462 [2024-12-08 02:29:55.893263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.893425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.893452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.462 qpair failed and we were unable to recover it. 00:27:28.462 [2024-12-08 02:29:55.893583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.893702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.893730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.462 qpair failed and we were unable to recover it. 00:27:28.462 [2024-12-08 02:29:55.893835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.893956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.893984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.462 qpair failed and we were unable to recover it. 00:27:28.462 [2024-12-08 02:29:55.894084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.894158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.894183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.462 qpair failed and we were unable to recover it. 00:27:28.462 [2024-12-08 02:29:55.894266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.894367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.894394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.462 qpair failed and we were unable to recover it. 00:27:28.462 [2024-12-08 02:29:55.894496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.894603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.894631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.462 qpair failed and we were unable to recover it. 00:27:28.462 [2024-12-08 02:29:55.894755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.894911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.894939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.462 qpair failed and we were unable to recover it. 00:27:28.462 [2024-12-08 02:29:55.895082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.895172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.895197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.462 qpair failed and we were unable to recover it. 00:27:28.462 [2024-12-08 02:29:55.895309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.895442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.895471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.462 qpair failed and we were unable to recover it. 00:27:28.462 [2024-12-08 02:29:55.895603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.895689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.895717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.462 qpair failed and we were unable to recover it. 00:27:28.462 [2024-12-08 02:29:55.895855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.896012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.896037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.462 qpair failed and we were unable to recover it. 00:27:28.462 [2024-12-08 02:29:55.896175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.896290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.896314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.462 qpair failed and we were unable to recover it. 00:27:28.462 [2024-12-08 02:29:55.896427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.896532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.896561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.462 qpair failed and we were unable to recover it. 00:27:28.462 [2024-12-08 02:29:55.896686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.896775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.896808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.462 qpair failed and we were unable to recover it. 00:27:28.462 [2024-12-08 02:29:55.896931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.897084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.897112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.462 qpair failed and we were unable to recover it. 00:27:28.462 [2024-12-08 02:29:55.897221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.897336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.897360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.462 qpair failed and we were unable to recover it. 00:27:28.462 [2024-12-08 02:29:55.897474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.897597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.897626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.462 qpair failed and we were unable to recover it. 00:27:28.462 [2024-12-08 02:29:55.897779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.897914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.897942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.462 qpair failed and we were unable to recover it. 00:27:28.462 [2024-12-08 02:29:55.898069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.898154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.898182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.462 qpair failed and we were unable to recover it. 00:27:28.462 [2024-12-08 02:29:55.898329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.462 [2024-12-08 02:29:55.898442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.898467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.463 qpair failed and we were unable to recover it. 00:27:28.463 [2024-12-08 02:29:55.898594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.898741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.898772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.463 qpair failed and we were unable to recover it. 00:27:28.463 [2024-12-08 02:29:55.898895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.899058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.899086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.463 qpair failed and we were unable to recover it. 00:27:28.463 [2024-12-08 02:29:55.899180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.899281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.899309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.463 qpair failed and we were unable to recover it. 00:27:28.463 [2024-12-08 02:29:55.899474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.899560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.899592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.463 qpair failed and we were unable to recover it. 00:27:28.463 [2024-12-08 02:29:55.899708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.899806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.899834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.463 qpair failed and we were unable to recover it. 00:27:28.463 [2024-12-08 02:29:55.899968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.900065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.900093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.463 qpair failed and we were unable to recover it. 00:27:28.463 [2024-12-08 02:29:55.900227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.900328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.900352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.463 qpair failed and we were unable to recover it. 00:27:28.463 [2024-12-08 02:29:55.900466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.900545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.900571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.463 qpair failed and we were unable to recover it. 00:27:28.463 [2024-12-08 02:29:55.900697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.900845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.900870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.463 qpair failed and we were unable to recover it. 00:27:28.463 [2024-12-08 02:29:55.900957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.901091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.901118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.463 qpair failed and we were unable to recover it. 00:27:28.463 [2024-12-08 02:29:55.901248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.901371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.901398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.463 qpair failed and we were unable to recover it. 00:27:28.463 [2024-12-08 02:29:55.901504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.901628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.901654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.463 qpair failed and we were unable to recover it. 00:27:28.463 [2024-12-08 02:29:55.901735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.901846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.901874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.463 qpair failed and we were unable to recover it. 00:27:28.463 [2024-12-08 02:29:55.901972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.902094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.902121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.463 qpair failed and we were unable to recover it. 00:27:28.463 [2024-12-08 02:29:55.902247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.902354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.902380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.463 qpair failed and we were unable to recover it. 00:27:28.463 [2024-12-08 02:29:55.902498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.902658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.902685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.463 qpair failed and we were unable to recover it. 00:27:28.463 [2024-12-08 02:29:55.902829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.902914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.902942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.463 qpair failed and we were unable to recover it. 00:27:28.463 [2024-12-08 02:29:55.903091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.903256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.903282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.463 qpair failed and we were unable to recover it. 00:27:28.463 [2024-12-08 02:29:55.903396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.903503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.903554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.463 qpair failed and we were unable to recover it. 00:27:28.463 [2024-12-08 02:29:55.903662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.903807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.903833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.463 qpair failed and we were unable to recover it. 00:27:28.463 [2024-12-08 02:29:55.903944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.904076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.904104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.463 qpair failed and we were unable to recover it. 00:27:28.463 [2024-12-08 02:29:55.904226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.904335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.904361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.463 qpair failed and we were unable to recover it. 00:27:28.463 [2024-12-08 02:29:55.904475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.904562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.904617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.463 qpair failed and we were unable to recover it. 00:27:28.463 [2024-12-08 02:29:55.904759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.904871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.904896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.463 qpair failed and we were unable to recover it. 00:27:28.463 [2024-12-08 02:29:55.905012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.905176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.905204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.463 qpair failed and we were unable to recover it. 00:27:28.463 [2024-12-08 02:29:55.905331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.905458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.905486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.463 qpair failed and we were unable to recover it. 00:27:28.463 [2024-12-08 02:29:55.905616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.905765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.905793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.463 qpair failed and we were unable to recover it. 00:27:28.463 [2024-12-08 02:29:55.905909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.905996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.463 [2024-12-08 02:29:55.906021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.463 qpair failed and we were unable to recover it. 00:27:28.464 [2024-12-08 02:29:55.906136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.906269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.906298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.464 qpair failed and we were unable to recover it. 00:27:28.464 [2024-12-08 02:29:55.906393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.906513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.906566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.464 qpair failed and we were unable to recover it. 00:27:28.464 [2024-12-08 02:29:55.906700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.906830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.906859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.464 qpair failed and we were unable to recover it. 00:27:28.464 [2024-12-08 02:29:55.906992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.907104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.907130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.464 qpair failed and we were unable to recover it. 00:27:28.464 [2024-12-08 02:29:55.907252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.907337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.907365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.464 qpair failed and we were unable to recover it. 00:27:28.464 [2024-12-08 02:29:55.907462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.907588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.907617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.464 qpair failed and we were unable to recover it. 00:27:28.464 [2024-12-08 02:29:55.907720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.907842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.907870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.464 qpair failed and we were unable to recover it. 00:27:28.464 [2024-12-08 02:29:55.908008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.908121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.908148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.464 qpair failed and we were unable to recover it. 00:27:28.464 [2024-12-08 02:29:55.908259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.908387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.908416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.464 qpair failed and we were unable to recover it. 00:27:28.464 [2024-12-08 02:29:55.908549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.908712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.908741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.464 qpair failed and we were unable to recover it. 00:27:28.464 [2024-12-08 02:29:55.908865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.908983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.909011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.464 qpair failed and we were unable to recover it. 00:27:28.464 [2024-12-08 02:29:55.909173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.909310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.909335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.464 qpair failed and we were unable to recover it. 00:27:28.464 [2024-12-08 02:29:55.909473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.909574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.909602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.464 qpair failed and we were unable to recover it. 00:27:28.464 [2024-12-08 02:29:55.909719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.909807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.909835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.464 qpair failed and we were unable to recover it. 00:27:28.464 [2024-12-08 02:29:55.909952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.910064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.910091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.464 qpair failed and we were unable to recover it. 00:27:28.464 [2024-12-08 02:29:55.910228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.910344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.910368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.464 qpair failed and we were unable to recover it. 00:27:28.464 [2024-12-08 02:29:55.910533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.910656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.910695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.464 qpair failed and we were unable to recover it. 00:27:28.464 [2024-12-08 02:29:55.910823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.910988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.911014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.464 qpair failed and we were unable to recover it. 00:27:28.464 [2024-12-08 02:29:55.911104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.911215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.911240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.464 qpair failed and we were unable to recover it. 00:27:28.464 [2024-12-08 02:29:55.911351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.911463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.911488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.464 qpair failed and we were unable to recover it. 00:27:28.464 [2024-12-08 02:29:55.911640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.911788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.911814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.464 qpair failed and we were unable to recover it. 00:27:28.464 [2024-12-08 02:29:55.911955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.912088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.912116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.464 qpair failed and we were unable to recover it. 00:27:28.464 [2024-12-08 02:29:55.912207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.912292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.912320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.464 qpair failed and we were unable to recover it. 00:27:28.464 [2024-12-08 02:29:55.912449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.912559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.464 [2024-12-08 02:29:55.912597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.464 qpair failed and we were unable to recover it. 00:27:28.464 [2024-12-08 02:29:55.912701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.912799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.912827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.465 qpair failed and we were unable to recover it. 00:27:28.465 [2024-12-08 02:29:55.912951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.913079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.913114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.465 qpair failed and we were unable to recover it. 00:27:28.465 [2024-12-08 02:29:55.913230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.913354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.913382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.465 qpair failed and we were unable to recover it. 00:27:28.465 [2024-12-08 02:29:55.913559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.913687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.913712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.465 qpair failed and we were unable to recover it. 00:27:28.465 [2024-12-08 02:29:55.913850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.913942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.913970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.465 qpair failed and we were unable to recover it. 00:27:28.465 [2024-12-08 02:29:55.914108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.914238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.914264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.465 qpair failed and we were unable to recover it. 00:27:28.465 [2024-12-08 02:29:55.914379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.914459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.914485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.465 qpair failed and we were unable to recover it. 00:27:28.465 [2024-12-08 02:29:55.914643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.914757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.914782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.465 qpair failed and we were unable to recover it. 00:27:28.465 [2024-12-08 02:29:55.914896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.914982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.915024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.465 qpair failed and we were unable to recover it. 00:27:28.465 [2024-12-08 02:29:55.915145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.915276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.915304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.465 qpair failed and we were unable to recover it. 00:27:28.465 [2024-12-08 02:29:55.915445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.915556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.915582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.465 qpair failed and we were unable to recover it. 00:27:28.465 [2024-12-08 02:29:55.915694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.915814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.915839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.465 qpair failed and we were unable to recover it. 00:27:28.465 [2024-12-08 02:29:55.915932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.916106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.916134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.465 qpair failed and we were unable to recover it. 00:27:28.465 [2024-12-08 02:29:55.916262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.916420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.916445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.465 qpair failed and we were unable to recover it. 00:27:28.465 [2024-12-08 02:29:55.916528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.916645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.916670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.465 qpair failed and we were unable to recover it. 00:27:28.465 [2024-12-08 02:29:55.916777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.916885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.916910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.465 qpair failed and we were unable to recover it. 00:27:28.465 [2024-12-08 02:29:55.917006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.917145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.917171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.465 qpair failed and we were unable to recover it. 00:27:28.465 [2024-12-08 02:29:55.917250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.917356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.917384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.465 qpair failed and we were unable to recover it. 00:27:28.465 [2024-12-08 02:29:55.917474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.917610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.917639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.465 qpair failed and we were unable to recover it. 00:27:28.465 [2024-12-08 02:29:55.917740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.917879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.917904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.465 qpair failed and we were unable to recover it. 00:27:28.465 [2024-12-08 02:29:55.918013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.918142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.918170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.465 qpair failed and we were unable to recover it. 00:27:28.465 [2024-12-08 02:29:55.918301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.918414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.918442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.465 qpair failed and we were unable to recover it. 00:27:28.465 [2024-12-08 02:29:55.918533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.918665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.918692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.465 qpair failed and we were unable to recover it. 00:27:28.465 [2024-12-08 02:29:55.918860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.918950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.918976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.465 qpair failed and we were unable to recover it. 00:27:28.465 [2024-12-08 02:29:55.919103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.919240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.919266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.465 qpair failed and we were unable to recover it. 00:27:28.465 [2024-12-08 02:29:55.919407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.919519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.919579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.465 qpair failed and we were unable to recover it. 00:27:28.465 [2024-12-08 02:29:55.919734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.919883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.919910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.465 qpair failed and we were unable to recover it. 00:27:28.465 [2024-12-08 02:29:55.920044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.920124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.920149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.465 qpair failed and we were unable to recover it. 00:27:28.465 [2024-12-08 02:29:55.920236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.465 [2024-12-08 02:29:55.920342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.920370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.466 qpair failed and we were unable to recover it. 00:27:28.466 [2024-12-08 02:29:55.920467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.920587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.920616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.466 qpair failed and we were unable to recover it. 00:27:28.466 [2024-12-08 02:29:55.920741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.920893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.920922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.466 qpair failed and we were unable to recover it. 00:27:28.466 [2024-12-08 02:29:55.921061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.921144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.921169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.466 qpair failed and we were unable to recover it. 00:27:28.466 [2024-12-08 02:29:55.921252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.921383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.921411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.466 qpair failed and we were unable to recover it. 00:27:28.466 [2024-12-08 02:29:55.921547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.921696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.921721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.466 qpair failed and we were unable to recover it. 00:27:28.466 [2024-12-08 02:29:55.921839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.921924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.921965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.466 qpair failed and we were unable to recover it. 00:27:28.466 [2024-12-08 02:29:55.922071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.922155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.922179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.466 qpair failed and we were unable to recover it. 00:27:28.466 [2024-12-08 02:29:55.922253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.922377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.922404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.466 qpair failed and we were unable to recover it. 00:27:28.466 [2024-12-08 02:29:55.922547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.922633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.922658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.466 qpair failed and we were unable to recover it. 00:27:28.466 [2024-12-08 02:29:55.922801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.922962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.922990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.466 qpair failed and we were unable to recover it. 00:27:28.466 [2024-12-08 02:29:55.923133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.923247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.923273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.466 qpair failed and we were unable to recover it. 00:27:28.466 [2024-12-08 02:29:55.923388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.923465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.923491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.466 qpair failed and we were unable to recover it. 00:27:28.466 [2024-12-08 02:29:55.923630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.923752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.923781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.466 qpair failed and we were unable to recover it. 00:27:28.466 [2024-12-08 02:29:55.923903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.924054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.924082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.466 qpair failed and we were unable to recover it. 00:27:28.466 [2024-12-08 02:29:55.924184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.924271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.924301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.466 qpair failed and we were unable to recover it. 00:27:28.466 [2024-12-08 02:29:55.924414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.924523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.924556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.466 qpair failed and we were unable to recover it. 00:27:28.466 [2024-12-08 02:29:55.924685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.924842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.924870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.466 qpair failed and we were unable to recover it. 00:27:28.466 [2024-12-08 02:29:55.925039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.925133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.925161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.466 qpair failed and we were unable to recover it. 00:27:28.466 [2024-12-08 02:29:55.925294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.925375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.925402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.466 qpair failed and we were unable to recover it. 00:27:28.466 [2024-12-08 02:29:55.925526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.925655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.925684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.466 qpair failed and we were unable to recover it. 00:27:28.466 [2024-12-08 02:29:55.925778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.925898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.925927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.466 qpair failed and we were unable to recover it. 00:27:28.466 [2024-12-08 02:29:55.926054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.926223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.926248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.466 qpair failed and we were unable to recover it. 00:27:28.466 [2024-12-08 02:29:55.926392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.926508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.926533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.466 qpair failed and we were unable to recover it. 00:27:28.466 [2024-12-08 02:29:55.926714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.926828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.926854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.466 qpair failed and we were unable to recover it. 00:27:28.466 [2024-12-08 02:29:55.926975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.927083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.927119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.466 qpair failed and we were unable to recover it. 00:27:28.466 [2024-12-08 02:29:55.927259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.927374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.927400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.466 qpair failed and we were unable to recover it. 00:27:28.466 [2024-12-08 02:29:55.927557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.927642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.927668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.466 qpair failed and we were unable to recover it. 00:27:28.466 [2024-12-08 02:29:55.927779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.927937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.466 [2024-12-08 02:29:55.927965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.467 qpair failed and we were unable to recover it. 00:27:28.467 [2024-12-08 02:29:55.928091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.928183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.928212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.467 qpair failed and we were unable to recover it. 00:27:28.467 [2024-12-08 02:29:55.928362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.928483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.928511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.467 qpair failed and we were unable to recover it. 00:27:28.467 [2024-12-08 02:29:55.928671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.928753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.928779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.467 qpair failed and we were unable to recover it. 00:27:28.467 [2024-12-08 02:29:55.928875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.929000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.929044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.467 qpair failed and we were unable to recover it. 00:27:28.467 [2024-12-08 02:29:55.929167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.929290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.929319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.467 qpair failed and we were unable to recover it. 00:27:28.467 [2024-12-08 02:29:55.929411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.929559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.929588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.467 qpair failed and we were unable to recover it. 00:27:28.467 [2024-12-08 02:29:55.929722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.929871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.929901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.467 qpair failed and we were unable to recover it. 00:27:28.467 [2024-12-08 02:29:55.930007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.930154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.930182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.467 qpair failed and we were unable to recover it. 00:27:28.467 [2024-12-08 02:29:55.930281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.930400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.930428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.467 qpair failed and we were unable to recover it. 00:27:28.467 [2024-12-08 02:29:55.930515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.930645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.930674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.467 qpair failed and we were unable to recover it. 00:27:28.467 [2024-12-08 02:29:55.930810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.930959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.930985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.467 qpair failed and we were unable to recover it. 00:27:28.467 [2024-12-08 02:29:55.931148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.931286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.931312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.467 qpair failed and we were unable to recover it. 00:27:28.467 [2024-12-08 02:29:55.931421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.931583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.931613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.467 qpair failed and we were unable to recover it. 00:27:28.467 [2024-12-08 02:29:55.931774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.931863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.931890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.467 qpair failed and we were unable to recover it. 00:27:28.467 [2024-12-08 02:29:55.931980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.932087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.932113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.467 qpair failed and we were unable to recover it. 00:27:28.467 [2024-12-08 02:29:55.932227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.932357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.932385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.467 qpair failed and we were unable to recover it. 00:27:28.467 [2024-12-08 02:29:55.932470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.932601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.932640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.467 qpair failed and we were unable to recover it. 00:27:28.467 [2024-12-08 02:29:55.932730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.932886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.932915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.467 qpair failed and we were unable to recover it. 00:27:28.467 [2024-12-08 02:29:55.933058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.933196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.933222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.467 qpair failed and we were unable to recover it. 00:27:28.467 [2024-12-08 02:29:55.933325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.933444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.933471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.467 qpair failed and we were unable to recover it. 00:27:28.467 [2024-12-08 02:29:55.933626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.933776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.933804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.467 qpair failed and we were unable to recover it. 00:27:28.467 [2024-12-08 02:29:55.933889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.934012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.934039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.467 qpair failed and we were unable to recover it. 00:27:28.467 [2024-12-08 02:29:55.934142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.934220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.934245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.467 qpair failed and we were unable to recover it. 00:27:28.467 [2024-12-08 02:29:55.934342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.934477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.934505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.467 qpair failed and we were unable to recover it. 00:27:28.467 [2024-12-08 02:29:55.934632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.934741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.934766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.467 qpair failed and we were unable to recover it. 00:27:28.467 [2024-12-08 02:29:55.934930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.935048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.935075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.467 qpair failed and we were unable to recover it. 00:27:28.467 [2024-12-08 02:29:55.935203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.935288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.935314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.467 qpair failed and we were unable to recover it. 00:27:28.467 [2024-12-08 02:29:55.935448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.935579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.467 [2024-12-08 02:29:55.935604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.467 qpair failed and we were unable to recover it. 00:27:28.467 [2024-12-08 02:29:55.935684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.935797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.935823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.468 qpair failed and we were unable to recover it. 00:27:28.468 [2024-12-08 02:29:55.935930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.936009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.936035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.468 qpair failed and we were unable to recover it. 00:27:28.468 [2024-12-08 02:29:55.936158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.936239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.936264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.468 qpair failed and we were unable to recover it. 00:27:28.468 [2024-12-08 02:29:55.936387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.936549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.936577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.468 qpair failed and we were unable to recover it. 00:27:28.468 [2024-12-08 02:29:55.936700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.936793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.936821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.468 qpair failed and we were unable to recover it. 00:27:28.468 [2024-12-08 02:29:55.936946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.937070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.937098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.468 qpair failed and we were unable to recover it. 00:27:28.468 [2024-12-08 02:29:55.937227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.937305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.937330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.468 qpair failed and we were unable to recover it. 00:27:28.468 [2024-12-08 02:29:55.937491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.937591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.937620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.468 qpair failed and we were unable to recover it. 00:27:28.468 [2024-12-08 02:29:55.937757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.937870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.937896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.468 qpair failed and we were unable to recover it. 00:27:28.468 [2024-12-08 02:29:55.938028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.938174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.938201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.468 qpair failed and we were unable to recover it. 00:27:28.468 [2024-12-08 02:29:55.938333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.938424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.938449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.468 qpair failed and we were unable to recover it. 00:27:28.468 [2024-12-08 02:29:55.938532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.938618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.938643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.468 qpair failed and we were unable to recover it. 00:27:28.468 [2024-12-08 02:29:55.938749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.938839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.938866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.468 qpair failed and we were unable to recover it. 00:27:28.468 [2024-12-08 02:29:55.939018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.939163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.939190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.468 qpair failed and we were unable to recover it. 00:27:28.468 [2024-12-08 02:29:55.939324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.939433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.939458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.468 qpair failed and we were unable to recover it. 00:27:28.468 [2024-12-08 02:29:55.939554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.939675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.939703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.468 qpair failed and we were unable to recover it. 00:27:28.468 [2024-12-08 02:29:55.939834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.939956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.939983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.468 qpair failed and we were unable to recover it. 00:27:28.468 [2024-12-08 02:29:55.940081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.940178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.940205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.468 qpair failed and we were unable to recover it. 00:27:28.468 [2024-12-08 02:29:55.940320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.940464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.940489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.468 qpair failed and we were unable to recover it. 00:27:28.468 [2024-12-08 02:29:55.940632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.940760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.940788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.468 qpair failed and we were unable to recover it. 00:27:28.468 [2024-12-08 02:29:55.940909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.941010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.941038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.468 qpair failed and we were unable to recover it. 00:27:28.468 [2024-12-08 02:29:55.941169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.941255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.941279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.468 qpair failed and we were unable to recover it. 00:27:28.468 [2024-12-08 02:29:55.941392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.941534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.941566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.468 qpair failed and we were unable to recover it. 00:27:28.468 [2024-12-08 02:29:55.941676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.941803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.941830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.468 qpair failed and we were unable to recover it. 00:27:28.468 [2024-12-08 02:29:55.941958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.942105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.942134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.468 qpair failed and we were unable to recover it. 00:27:28.468 [2024-12-08 02:29:55.942269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.942408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.942433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.468 qpair failed and we were unable to recover it. 00:27:28.468 [2024-12-08 02:29:55.942574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.942687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.942713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.468 qpair failed and we were unable to recover it. 00:27:28.468 [2024-12-08 02:29:55.942827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.942937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.942965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.468 qpair failed and we were unable to recover it. 00:27:28.468 [2024-12-08 02:29:55.943082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.943251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.468 [2024-12-08 02:29:55.943276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.468 qpair failed and we were unable to recover it. 00:27:28.469 [2024-12-08 02:29:55.943371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.943480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.943505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.469 qpair failed and we were unable to recover it. 00:27:28.469 [2024-12-08 02:29:55.943621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.943696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.943722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.469 qpair failed and we were unable to recover it. 00:27:28.469 [2024-12-08 02:29:55.943825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.943937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.943962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.469 qpair failed and we were unable to recover it. 00:27:28.469 [2024-12-08 02:29:55.944109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.944236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.944264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.469 qpair failed and we were unable to recover it. 00:27:28.469 [2024-12-08 02:29:55.944362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.944484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.944512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.469 qpair failed and we were unable to recover it. 00:27:28.469 [2024-12-08 02:29:55.944630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.944708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.944733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.469 qpair failed and we were unable to recover it. 00:27:28.469 [2024-12-08 02:29:55.944856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.944940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.944967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.469 qpair failed and we were unable to recover it. 00:27:28.469 [2024-12-08 02:29:55.945084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.945174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.945198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.469 qpair failed and we were unable to recover it. 00:27:28.469 [2024-12-08 02:29:55.945311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.945416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.945444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.469 qpair failed and we were unable to recover it. 00:27:28.469 [2024-12-08 02:29:55.945546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.945663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.945691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.469 qpair failed and we were unable to recover it. 00:27:28.469 [2024-12-08 02:29:55.945826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.945949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.945976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.469 qpair failed and we were unable to recover it. 00:27:28.469 [2024-12-08 02:29:55.946106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.946222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.946250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.469 qpair failed and we were unable to recover it. 00:27:28.469 [2024-12-08 02:29:55.946410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.946487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.946511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.469 qpair failed and we were unable to recover it. 00:27:28.469 [2024-12-08 02:29:55.946634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.946722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.946746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.469 qpair failed and we were unable to recover it. 00:27:28.469 [2024-12-08 02:29:55.946867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.946972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.946996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.469 qpair failed and we were unable to recover it. 00:27:28.469 [2024-12-08 02:29:55.947073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.947235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.947263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.469 qpair failed and we were unable to recover it. 00:27:28.469 [2024-12-08 02:29:55.947412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.947572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.947603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.469 qpair failed and we were unable to recover it. 00:27:28.469 [2024-12-08 02:29:55.947742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.947859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.947884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.469 qpair failed and we were unable to recover it. 00:27:28.469 [2024-12-08 02:29:55.948053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.948161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.948186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.469 qpair failed and we were unable to recover it. 00:27:28.469 [2024-12-08 02:29:55.948296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.948381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.948405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.469 qpair failed and we were unable to recover it. 00:27:28.469 [2024-12-08 02:29:55.948490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.948603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.948629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.469 qpair failed and we were unable to recover it. 00:27:28.469 [2024-12-08 02:29:55.948713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.948834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.948859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.469 qpair failed and we were unable to recover it. 00:27:28.469 [2024-12-08 02:29:55.948941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.949059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.949084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.469 qpair failed and we were unable to recover it. 00:27:28.469 [2024-12-08 02:29:55.949250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.949388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.949416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.469 qpair failed and we were unable to recover it. 00:27:28.469 [2024-12-08 02:29:55.949546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.949697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.469 [2024-12-08 02:29:55.949723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.469 qpair failed and we were unable to recover it. 00:27:28.469 [2024-12-08 02:29:55.949866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.949947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.949973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.470 qpair failed and we were unable to recover it. 00:27:28.470 [2024-12-08 02:29:55.950153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.950267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.950292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.470 qpair failed and we were unable to recover it. 00:27:28.470 [2024-12-08 02:29:55.950427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.950515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.950547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.470 qpair failed and we were unable to recover it. 00:27:28.470 [2024-12-08 02:29:55.950672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.950790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.950818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.470 qpair failed and we were unable to recover it. 00:27:28.470 [2024-12-08 02:29:55.950953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.951066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.951090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.470 qpair failed and we were unable to recover it. 00:27:28.470 [2024-12-08 02:29:55.951200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.951325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.951353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.470 qpair failed and we were unable to recover it. 00:27:28.470 [2024-12-08 02:29:55.951506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.951663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.951693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.470 qpair failed and we were unable to recover it. 00:27:28.470 [2024-12-08 02:29:55.951819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.951970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.951998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.470 qpair failed and we were unable to recover it. 00:27:28.470 [2024-12-08 02:29:55.952130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.952210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.952236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.470 qpair failed and we were unable to recover it. 00:27:28.470 [2024-12-08 02:29:55.952355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.952496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.952524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.470 qpair failed and we were unable to recover it. 00:27:28.470 [2024-12-08 02:29:55.952655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.952785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.952813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.470 qpair failed and we were unable to recover it. 00:27:28.470 [2024-12-08 02:29:55.952933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.953019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.953046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.470 qpair failed and we were unable to recover it. 00:27:28.470 [2024-12-08 02:29:55.953181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.953291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.953317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.470 qpair failed and we were unable to recover it. 00:27:28.470 [2024-12-08 02:29:55.953397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.953503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.953553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.470 qpair failed and we were unable to recover it. 00:27:28.470 [2024-12-08 02:29:55.953702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.953824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.953851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.470 qpair failed and we were unable to recover it. 00:27:28.470 [2024-12-08 02:29:55.953964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.954042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.954066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.470 qpair failed and we were unable to recover it. 00:27:28.470 [2024-12-08 02:29:55.954176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.954284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.954310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.470 qpair failed and we were unable to recover it. 00:27:28.470 [2024-12-08 02:29:55.954459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.954572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.954599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.470 qpair failed and we were unable to recover it. 00:27:28.470 [2024-12-08 02:29:55.954681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.954809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.954838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.470 qpair failed and we were unable to recover it. 00:27:28.470 [2024-12-08 02:29:55.954991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.955130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.955155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.470 qpair failed and we were unable to recover it. 00:27:28.470 [2024-12-08 02:29:55.955270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.955363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.955388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.470 qpair failed and we were unable to recover it. 00:27:28.470 [2024-12-08 02:29:55.955489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.955591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.955624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.470 qpair failed and we were unable to recover it. 00:27:28.470 [2024-12-08 02:29:55.955752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.955850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.955878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.470 qpair failed and we were unable to recover it. 00:27:28.470 [2024-12-08 02:29:55.956020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.956114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.956143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.470 qpair failed and we were unable to recover it. 00:27:28.470 [2024-12-08 02:29:55.956277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.956356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.956382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.470 qpair failed and we were unable to recover it. 00:27:28.470 [2024-12-08 02:29:55.956533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.956681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.956724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.470 qpair failed and we were unable to recover it. 00:27:28.470 [2024-12-08 02:29:55.956869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.956981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.957006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.470 qpair failed and we were unable to recover it. 00:27:28.470 [2024-12-08 02:29:55.957119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.957227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.957269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.470 qpair failed and we were unable to recover it. 00:27:28.470 [2024-12-08 02:29:55.957398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.957513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.470 [2024-12-08 02:29:55.957543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.470 qpair failed and we were unable to recover it. 00:27:28.471 [2024-12-08 02:29:55.957646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.957742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.957770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.471 qpair failed and we were unable to recover it. 00:27:28.471 [2024-12-08 02:29:55.957868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.957968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.957995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.471 qpair failed and we were unable to recover it. 00:27:28.471 [2024-12-08 02:29:55.958148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.958263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.958291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.471 qpair failed and we were unable to recover it. 00:27:28.471 [2024-12-08 02:29:55.958417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.958503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.958528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.471 qpair failed and we were unable to recover it. 00:27:28.471 [2024-12-08 02:29:55.958677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.958800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.958827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.471 qpair failed and we were unable to recover it. 00:27:28.471 [2024-12-08 02:29:55.958922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.959048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.959075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.471 qpair failed and we were unable to recover it. 00:27:28.471 [2024-12-08 02:29:55.959164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.959302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.959327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.471 qpair failed and we were unable to recover it. 00:27:28.471 [2024-12-08 02:29:55.959446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.959570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.959596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.471 qpair failed and we were unable to recover it. 00:27:28.471 [2024-12-08 02:29:55.959736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.959839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.959881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.471 qpair failed and we were unable to recover it. 00:27:28.471 [2024-12-08 02:29:55.959981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.960097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.960137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.471 qpair failed and we were unable to recover it. 00:27:28.471 [2024-12-08 02:29:55.960297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.960432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.960458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.471 qpair failed and we were unable to recover it. 00:27:28.471 [2024-12-08 02:29:55.960546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.960659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.960684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.471 qpair failed and we were unable to recover it. 00:27:28.471 [2024-12-08 02:29:55.960793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.960933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.960977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.471 qpair failed and we were unable to recover it. 00:27:28.471 [2024-12-08 02:29:55.961114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.961214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.961243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.471 qpair failed and we were unable to recover it. 00:27:28.471 [2024-12-08 02:29:55.961369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.961495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.961523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.471 qpair failed and we were unable to recover it. 00:27:28.471 [2024-12-08 02:29:55.961646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.961759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.961784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.471 qpair failed and we were unable to recover it. 00:27:28.471 [2024-12-08 02:29:55.961875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.961965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.961990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.471 qpair failed and we were unable to recover it. 00:27:28.471 [2024-12-08 02:29:55.962073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.962246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.962272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.471 qpair failed and we were unable to recover it. 00:27:28.471 [2024-12-08 02:29:55.962359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.962439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.962463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.471 qpair failed and we were unable to recover it. 00:27:28.471 [2024-12-08 02:29:55.962577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.962657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.962682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.471 qpair failed and we were unable to recover it. 00:27:28.471 [2024-12-08 02:29:55.962807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.962902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.962930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.471 qpair failed and we were unable to recover it. 00:27:28.471 [2024-12-08 02:29:55.963055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.963168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.963193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.471 qpair failed and we were unable to recover it. 00:27:28.471 [2024-12-08 02:29:55.963308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.963417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.963447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.471 qpair failed and we were unable to recover it. 00:27:28.471 [2024-12-08 02:29:55.963611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.963703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.963728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.471 qpair failed and we were unable to recover it. 00:27:28.471 [2024-12-08 02:29:55.963834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.963930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.963959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.471 qpair failed and we were unable to recover it. 00:27:28.471 [2024-12-08 02:29:55.964055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.964176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.964203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.471 qpair failed and we were unable to recover it. 00:27:28.471 [2024-12-08 02:29:55.964327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.964458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.964487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.471 qpair failed and we were unable to recover it. 00:27:28.471 [2024-12-08 02:29:55.964625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.964739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.471 [2024-12-08 02:29:55.964765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.471 qpair failed and we were unable to recover it. 00:27:28.471 [2024-12-08 02:29:55.964855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.965016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.965044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.472 qpair failed and we were unable to recover it. 00:27:28.472 [2024-12-08 02:29:55.965129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.965226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.965252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.472 qpair failed and we were unable to recover it. 00:27:28.472 [2024-12-08 02:29:55.965368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.965503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.965532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.472 qpair failed and we were unable to recover it. 00:27:28.472 [2024-12-08 02:29:55.965705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.965814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.965840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.472 qpair failed and we were unable to recover it. 00:27:28.472 [2024-12-08 02:29:55.965978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.966117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.966141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.472 qpair failed and we were unable to recover it. 00:27:28.472 [2024-12-08 02:29:55.966230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.966314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.966339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.472 qpair failed and we were unable to recover it. 00:27:28.472 [2024-12-08 02:29:55.966476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.966594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.966623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.472 qpair failed and we were unable to recover it. 00:27:28.472 [2024-12-08 02:29:55.966752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.966874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.966899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.472 qpair failed and we were unable to recover it. 00:27:28.472 [2024-12-08 02:29:55.967039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.967123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.967155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.472 qpair failed and we were unable to recover it. 00:27:28.472 [2024-12-08 02:29:55.967236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.967350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.967376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.472 qpair failed and we were unable to recover it. 00:27:28.472 [2024-12-08 02:29:55.967491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.967607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.967636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.472 qpair failed and we were unable to recover it. 00:27:28.472 [2024-12-08 02:29:55.967751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.967831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.967855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.472 qpair failed and we were unable to recover it. 00:27:28.472 [2024-12-08 02:29:55.967972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.968069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.968096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.472 qpair failed and we were unable to recover it. 00:27:28.472 [2024-12-08 02:29:55.968221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.968356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.968381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.472 qpair failed and we were unable to recover it. 00:27:28.472 [2024-12-08 02:29:55.968473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.968554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.968579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.472 qpair failed and we were unable to recover it. 00:27:28.472 [2024-12-08 02:29:55.968723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.968835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.968861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.472 qpair failed and we were unable to recover it. 00:27:28.472 [2024-12-08 02:29:55.968956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.969044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.969070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.472 qpair failed and we were unable to recover it. 00:27:28.472 [2024-12-08 02:29:55.969172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.969288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.969315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.472 qpair failed and we were unable to recover it. 00:27:28.472 [2024-12-08 02:29:55.969440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.969558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.969592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.472 qpair failed and we were unable to recover it. 00:27:28.472 [2024-12-08 02:29:55.969746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.969885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.969910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.472 qpair failed and we were unable to recover it. 00:27:28.472 [2024-12-08 02:29:55.970057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.970180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.970207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.472 qpair failed and we were unable to recover it. 00:27:28.472 [2024-12-08 02:29:55.970356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.970475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.970503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.472 qpair failed and we were unable to recover it. 00:27:28.472 [2024-12-08 02:29:55.970611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.970691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.970715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.472 qpair failed and we were unable to recover it. 00:27:28.472 [2024-12-08 02:29:55.970797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.970937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.970962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.472 qpair failed and we were unable to recover it. 00:27:28.472 [2024-12-08 02:29:55.971107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.971255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.971282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.472 qpair failed and we were unable to recover it. 00:27:28.472 [2024-12-08 02:29:55.971406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.971530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.971588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.472 qpair failed and we were unable to recover it. 00:27:28.472 [2024-12-08 02:29:55.971745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.971835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.971863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.472 qpair failed and we were unable to recover it. 00:27:28.472 [2024-12-08 02:29:55.971969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.972063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.472 [2024-12-08 02:29:55.972087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.472 qpair failed and we were unable to recover it. 00:27:28.473 [2024-12-08 02:29:55.972168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.972248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.972277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.473 qpair failed and we were unable to recover it. 00:27:28.473 [2024-12-08 02:29:55.972368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.972492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.972519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.473 qpair failed and we were unable to recover it. 00:27:28.473 [2024-12-08 02:29:55.972672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.972810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.972834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:28.473 qpair failed and we were unable to recover it. 00:27:28.473 [2024-12-08 02:29:55.972983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.973114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.973160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.473 qpair failed and we were unable to recover it. 00:27:28.473 [2024-12-08 02:29:55.973273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.973418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.973461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.473 qpair failed and we were unable to recover it. 00:27:28.473 [2024-12-08 02:29:55.973554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.973644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.973671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.473 qpair failed and we were unable to recover it. 00:27:28.473 [2024-12-08 02:29:55.973790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.973904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.973929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.473 qpair failed and we were unable to recover it. 00:27:28.473 [2024-12-08 02:29:55.974039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.974152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.974177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.473 qpair failed and we were unable to recover it. 00:27:28.473 [2024-12-08 02:29:55.974267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.974377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.974402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.473 qpair failed and we were unable to recover it. 00:27:28.473 [2024-12-08 02:29:55.974492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.974578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.974604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.473 qpair failed and we were unable to recover it. 00:27:28.473 [2024-12-08 02:29:55.974694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.974812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.974844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.473 qpair failed and we were unable to recover it. 00:27:28.473 [2024-12-08 02:29:55.974994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.975146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.975172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.473 qpair failed and we were unable to recover it. 00:27:28.473 [2024-12-08 02:29:55.975319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.975411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.975436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.473 qpair failed and we were unable to recover it. 00:27:28.473 [2024-12-08 02:29:55.975559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.975666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.975696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.473 qpair failed and we were unable to recover it. 00:27:28.473 [2024-12-08 02:29:55.975858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.975971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.975997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.473 qpair failed and we were unable to recover it. 00:27:28.473 [2024-12-08 02:29:55.976115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.976197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.976223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.473 qpair failed and we were unable to recover it. 00:27:28.473 [2024-12-08 02:29:55.976307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.976448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.976474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.473 qpair failed and we were unable to recover it. 00:27:28.473 [2024-12-08 02:29:55.976587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.976701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.976727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.473 qpair failed and we were unable to recover it. 00:27:28.473 [2024-12-08 02:29:55.976808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.976917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.976942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.473 qpair failed and we were unable to recover it. 00:27:28.473 [2024-12-08 02:29:55.977030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.977122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.977147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.473 qpair failed and we were unable to recover it. 00:27:28.473 [2024-12-08 02:29:55.977267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.977382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.977408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.473 qpair failed and we were unable to recover it. 00:27:28.473 [2024-12-08 02:29:55.977528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.977630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.977656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.473 qpair failed and we were unable to recover it. 00:27:28.473 [2024-12-08 02:29:55.977799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.977891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.977917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.473 qpair failed and we were unable to recover it. 00:27:28.473 [2024-12-08 02:29:55.978035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.978176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.978202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.473 qpair failed and we were unable to recover it. 00:27:28.473 [2024-12-08 02:29:55.978291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.978374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.978399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.473 qpair failed and we were unable to recover it. 00:27:28.473 [2024-12-08 02:29:55.978485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.978594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.978620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.473 qpair failed and we were unable to recover it. 00:27:28.473 [2024-12-08 02:29:55.978710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.978801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.978827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.473 qpair failed and we were unable to recover it. 00:27:28.473 [2024-12-08 02:29:55.978908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.979038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.473 [2024-12-08 02:29:55.979065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.473 qpair failed and we were unable to recover it. 00:27:28.474 [2024-12-08 02:29:55.979214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.979304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.979329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.474 qpair failed and we were unable to recover it. 00:27:28.474 [2024-12-08 02:29:55.979452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.979571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.979597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.474 qpair failed and we were unable to recover it. 00:27:28.474 [2024-12-08 02:29:55.979711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.979796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.979822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.474 qpair failed and we were unable to recover it. 00:27:28.474 [2024-12-08 02:29:55.979946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.980061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.980087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.474 qpair failed and we were unable to recover it. 00:27:28.474 [2024-12-08 02:29:55.980202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.980308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.980334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.474 qpair failed and we were unable to recover it. 00:27:28.474 [2024-12-08 02:29:55.980445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.980527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.980559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.474 qpair failed and we were unable to recover it. 00:27:28.474 [2024-12-08 02:29:55.980644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.980729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.980755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.474 qpair failed and we were unable to recover it. 00:27:28.474 [2024-12-08 02:29:55.980897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.981003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.981029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.474 qpair failed and we were unable to recover it. 00:27:28.474 [2024-12-08 02:29:55.981109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.981224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.981250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.474 qpair failed and we were unable to recover it. 00:27:28.474 [2024-12-08 02:29:55.981390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.981499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.981524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.474 qpair failed and we were unable to recover it. 00:27:28.474 [2024-12-08 02:29:55.981629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.981757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.981783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.474 qpair failed and we were unable to recover it. 00:27:28.474 [2024-12-08 02:29:55.981893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.982022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.982047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.474 qpair failed and we were unable to recover it. 00:27:28.474 [2024-12-08 02:29:55.982162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.982245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.982271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.474 qpair failed and we were unable to recover it. 00:27:28.474 [2024-12-08 02:29:55.982385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.982498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.982524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.474 qpair failed and we were unable to recover it. 00:27:28.474 [2024-12-08 02:29:55.982632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.982756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.982782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.474 qpair failed and we were unable to recover it. 00:27:28.474 [2024-12-08 02:29:55.982895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.983007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.983032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.474 qpair failed and we were unable to recover it. 00:27:28.474 [2024-12-08 02:29:55.983155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.983249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.983274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.474 qpair failed and we were unable to recover it. 00:27:28.474 [2024-12-08 02:29:55.983392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.983500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.983525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.474 qpair failed and we were unable to recover it. 00:27:28.474 [2024-12-08 02:29:55.983622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.983711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.983738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.474 qpair failed and we were unable to recover it. 00:27:28.474 [2024-12-08 02:29:55.983851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.983991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.984017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.474 qpair failed and we were unable to recover it. 00:27:28.474 [2024-12-08 02:29:55.984159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.984274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.984300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.474 qpair failed and we were unable to recover it. 00:27:28.474 [2024-12-08 02:29:55.984406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.984485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.984510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.474 qpair failed and we were unable to recover it. 00:27:28.474 [2024-12-08 02:29:55.984630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.984730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.984756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.474 qpair failed and we were unable to recover it. 00:27:28.474 [2024-12-08 02:29:55.984876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.984986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.985011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.474 qpair failed and we were unable to recover it. 00:27:28.474 [2024-12-08 02:29:55.985158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.985252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.474 [2024-12-08 02:29:55.985279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.474 qpair failed and we were unable to recover it. 00:27:28.475 [2024-12-08 02:29:55.985402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.985519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.985557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.475 qpair failed and we were unable to recover it. 00:27:28.475 [2024-12-08 02:29:55.985718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.985863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.985906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.475 qpair failed and we were unable to recover it. 00:27:28.475 [2024-12-08 02:29:55.985988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.986112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.986138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.475 qpair failed and we were unable to recover it. 00:27:28.475 [2024-12-08 02:29:55.986255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.986341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.986367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.475 qpair failed and we were unable to recover it. 00:27:28.475 [2024-12-08 02:29:55.986484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.986563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.986589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.475 qpair failed and we were unable to recover it. 00:27:28.475 [2024-12-08 02:29:55.986679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.986769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.986795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.475 qpair failed and we were unable to recover it. 00:27:28.475 [2024-12-08 02:29:55.986910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.987019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.987045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.475 qpair failed and we were unable to recover it. 00:27:28.475 [2024-12-08 02:29:55.987136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.987247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.987272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.475 qpair failed and we were unable to recover it. 00:27:28.475 [2024-12-08 02:29:55.987371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.987458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.987482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.475 qpair failed and we were unable to recover it. 00:27:28.475 [2024-12-08 02:29:55.987567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.987708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.987734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.475 qpair failed and we were unable to recover it. 00:27:28.475 [2024-12-08 02:29:55.987845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.987958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.987983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.475 qpair failed and we were unable to recover it. 00:27:28.475 [2024-12-08 02:29:55.988073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.988158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.988183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.475 qpair failed and we were unable to recover it. 00:27:28.475 [2024-12-08 02:29:55.988298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.988386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.988412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.475 qpair failed and we were unable to recover it. 00:27:28.475 [2024-12-08 02:29:55.988530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.988630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.988656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.475 qpair failed and we were unable to recover it. 00:27:28.475 [2024-12-08 02:29:55.988770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.988856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.988881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.475 qpair failed and we were unable to recover it. 00:27:28.475 [2024-12-08 02:29:55.988995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.989074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.989100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.475 qpair failed and we were unable to recover it. 00:27:28.475 [2024-12-08 02:29:55.989218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.989293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.989319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.475 qpair failed and we were unable to recover it. 00:27:28.475 [2024-12-08 02:29:55.989431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.989575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.989603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.475 qpair failed and we were unable to recover it. 00:27:28.475 [2024-12-08 02:29:55.989721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.989808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.989835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.475 qpair failed and we were unable to recover it. 00:27:28.475 [2024-12-08 02:29:55.989950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.990063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.990089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.475 qpair failed and we were unable to recover it. 00:27:28.475 [2024-12-08 02:29:55.990199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.990273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.990298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.475 qpair failed and we were unable to recover it. 00:27:28.475 [2024-12-08 02:29:55.990412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.990492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.990519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.475 qpair failed and we were unable to recover it. 00:27:28.475 [2024-12-08 02:29:55.990613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.990706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.990732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.475 qpair failed and we were unable to recover it. 00:27:28.475 [2024-12-08 02:29:55.990850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.990962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.990989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.475 qpair failed and we were unable to recover it. 00:27:28.475 [2024-12-08 02:29:55.991106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.991258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.991284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.475 qpair failed and we were unable to recover it. 00:27:28.475 [2024-12-08 02:29:55.991400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.991491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.991516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.475 qpair failed and we were unable to recover it. 00:27:28.475 [2024-12-08 02:29:55.991637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.991749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.991776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.475 qpair failed and we were unable to recover it. 00:27:28.475 [2024-12-08 02:29:55.991891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.991995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.992021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.475 qpair failed and we were unable to recover it. 00:27:28.475 [2024-12-08 02:29:55.992140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.475 [2024-12-08 02:29:55.992220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.992246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.476 qpair failed and we were unable to recover it. 00:27:28.476 [2024-12-08 02:29:55.992329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.992467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.992493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.476 qpair failed and we were unable to recover it. 00:27:28.476 [2024-12-08 02:29:55.992612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.992710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.992739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.476 qpair failed and we were unable to recover it. 00:27:28.476 [2024-12-08 02:29:55.992852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.992960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.992986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.476 qpair failed and we were unable to recover it. 00:27:28.476 [2024-12-08 02:29:55.993070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.993152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.993178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.476 qpair failed and we were unable to recover it. 00:27:28.476 [2024-12-08 02:29:55.993292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.993440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.993466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.476 qpair failed and we were unable to recover it. 00:27:28.476 [2024-12-08 02:29:55.993571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.993656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.993683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.476 qpair failed and we were unable to recover it. 00:27:28.476 [2024-12-08 02:29:55.993773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.993919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.993945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.476 qpair failed and we were unable to recover it. 00:27:28.476 [2024-12-08 02:29:55.994034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.994145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.994172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.476 qpair failed and we were unable to recover it. 00:27:28.476 [2024-12-08 02:29:55.994287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.994396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.994422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.476 qpair failed and we were unable to recover it. 00:27:28.476 [2024-12-08 02:29:55.994546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.994633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.994659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.476 qpair failed and we were unable to recover it. 00:27:28.476 [2024-12-08 02:29:55.994749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.994858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.994883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.476 qpair failed and we were unable to recover it. 00:27:28.476 [2024-12-08 02:29:55.994993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.995085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.995111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.476 qpair failed and we were unable to recover it. 00:27:28.476 [2024-12-08 02:29:55.995201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.995343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.995369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.476 qpair failed and we were unable to recover it. 00:27:28.476 [2024-12-08 02:29:55.995448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.995561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.995588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.476 qpair failed and we were unable to recover it. 00:27:28.476 [2024-12-08 02:29:55.995697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.995774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.995800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.476 qpair failed and we were unable to recover it. 00:27:28.476 [2024-12-08 02:29:55.995892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.996035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.996060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.476 qpair failed and we were unable to recover it. 00:27:28.476 [2024-12-08 02:29:55.996148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.996236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.996262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.476 qpair failed and we were unable to recover it. 00:27:28.476 [2024-12-08 02:29:55.996344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.996462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.996488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.476 qpair failed and we were unable to recover it. 00:27:28.476 [2024-12-08 02:29:55.996601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.996715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.996741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.476 qpair failed and we were unable to recover it. 00:27:28.476 [2024-12-08 02:29:55.996858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.996945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.996971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.476 qpair failed and we were unable to recover it. 00:27:28.476 [2024-12-08 02:29:55.997085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.997196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.997221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.476 qpair failed and we were unable to recover it. 00:27:28.476 [2024-12-08 02:29:55.997360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.997476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.997502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.476 qpair failed and we were unable to recover it. 00:27:28.476 [2024-12-08 02:29:55.997592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.997733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.997759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.476 qpair failed and we were unable to recover it. 00:27:28.476 [2024-12-08 02:29:55.997874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.997987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.998014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.476 qpair failed and we were unable to recover it. 00:27:28.476 [2024-12-08 02:29:55.998139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.998219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.998246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.476 qpair failed and we were unable to recover it. 00:27:28.476 [2024-12-08 02:29:55.998366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.998511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.998544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.476 qpair failed and we were unable to recover it. 00:27:28.476 [2024-12-08 02:29:55.998667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.998837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.998881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.476 qpair failed and we were unable to recover it. 00:27:28.476 [2024-12-08 02:29:55.999043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.999144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.476 [2024-12-08 02:29:55.999170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.476 qpair failed and we were unable to recover it. 00:27:28.477 [2024-12-08 02:29:55.999285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:55.999401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:55.999428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.477 qpair failed and we were unable to recover it. 00:27:28.477 [2024-12-08 02:29:55.999519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:55.999644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:55.999671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.477 qpair failed and we were unable to recover it. 00:27:28.477 [2024-12-08 02:29:55.999785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:55.999871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:55.999897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.477 qpair failed and we were unable to recover it. 00:27:28.477 [2024-12-08 02:29:55.999989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.000133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.000160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.477 qpair failed and we were unable to recover it. 00:27:28.477 [2024-12-08 02:29:56.000301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.000384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.000410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.477 qpair failed and we were unable to recover it. 00:27:28.477 [2024-12-08 02:29:56.000550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.000669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.000695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.477 qpair failed and we were unable to recover it. 00:27:28.477 [2024-12-08 02:29:56.000837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.000951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.000977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.477 qpair failed and we were unable to recover it. 00:27:28.477 [2024-12-08 02:29:56.001118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.001205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.001231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.477 qpair failed and we were unable to recover it. 00:27:28.477 [2024-12-08 02:29:56.001316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.001397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.001424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.477 qpair failed and we were unable to recover it. 00:27:28.477 [2024-12-08 02:29:56.001542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.001638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.001664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.477 qpair failed and we were unable to recover it. 00:27:28.477 [2024-12-08 02:29:56.001752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.001892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.001919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.477 qpair failed and we were unable to recover it. 00:27:28.477 [2024-12-08 02:29:56.002011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.002098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.002124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.477 qpair failed and we were unable to recover it. 00:27:28.477 [2024-12-08 02:29:56.002268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.002384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.002410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.477 qpair failed and we were unable to recover it. 00:27:28.477 [2024-12-08 02:29:56.002560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.002673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.002699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.477 qpair failed and we were unable to recover it. 00:27:28.477 [2024-12-08 02:29:56.002796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.002903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.002928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.477 qpair failed and we were unable to recover it. 00:27:28.477 [2024-12-08 02:29:56.003069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.003166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.003191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.477 qpair failed and we were unable to recover it. 00:27:28.477 [2024-12-08 02:29:56.003304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.003391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.003416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.477 qpair failed and we were unable to recover it. 00:27:28.477 [2024-12-08 02:29:56.003529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.003621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.003647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.477 qpair failed and we were unable to recover it. 00:27:28.477 [2024-12-08 02:29:56.003791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.003904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.003930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.477 qpair failed and we were unable to recover it. 00:27:28.477 [2024-12-08 02:29:56.004022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.004135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.004162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.477 qpair failed and we were unable to recover it. 00:27:28.477 [2024-12-08 02:29:56.004246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.004353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.004379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.477 qpair failed and we were unable to recover it. 00:27:28.477 [2024-12-08 02:29:56.004467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.004551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.004582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.477 qpair failed and we were unable to recover it. 00:27:28.477 [2024-12-08 02:29:56.004673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.004787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.004814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.477 qpair failed and we were unable to recover it. 00:27:28.477 [2024-12-08 02:29:56.004903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.005014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.005040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.477 qpair failed and we were unable to recover it. 00:27:28.477 [2024-12-08 02:29:56.005149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.005265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.005291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.477 qpair failed and we were unable to recover it. 00:27:28.477 [2024-12-08 02:29:56.005407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.005516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.005549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.477 qpair failed and we were unable to recover it. 00:27:28.477 [2024-12-08 02:29:56.005668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.005809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.005836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.477 qpair failed and we were unable to recover it. 00:27:28.477 [2024-12-08 02:29:56.005919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.006036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.006062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.477 qpair failed and we were unable to recover it. 00:27:28.477 [2024-12-08 02:29:56.006176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.477 [2024-12-08 02:29:56.006286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.006313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.478 qpair failed and we were unable to recover it. 00:27:28.478 [2024-12-08 02:29:56.006419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.006501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.006526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.478 qpair failed and we were unable to recover it. 00:27:28.478 [2024-12-08 02:29:56.006628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.006773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.006798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.478 qpair failed and we were unable to recover it. 00:27:28.478 [2024-12-08 02:29:56.006878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.006990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.007021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.478 qpair failed and we were unable to recover it. 00:27:28.478 [2024-12-08 02:29:56.007120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.007226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.007251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.478 qpair failed and we were unable to recover it. 00:27:28.478 [2024-12-08 02:29:56.007368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.007503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.007529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.478 qpair failed and we were unable to recover it. 00:27:28.478 [2024-12-08 02:29:56.007657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.007743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.007769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.478 qpair failed and we were unable to recover it. 00:27:28.478 [2024-12-08 02:29:56.007881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.008024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.008050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.478 qpair failed and we were unable to recover it. 00:27:28.478 [2024-12-08 02:29:56.008167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.008248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.008274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.478 qpair failed and we were unable to recover it. 00:27:28.478 [2024-12-08 02:29:56.008391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.008498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.008523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.478 qpair failed and we were unable to recover it. 00:27:28.478 [2024-12-08 02:29:56.008671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.008759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.008785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.478 qpair failed and we were unable to recover it. 00:27:28.478 [2024-12-08 02:29:56.008897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.009015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.009041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.478 qpair failed and we were unable to recover it. 00:27:28.478 [2024-12-08 02:29:56.009191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.009303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.009329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.478 qpair failed and we were unable to recover it. 00:27:28.478 [2024-12-08 02:29:56.009474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.009558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.009589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.478 qpair failed and we were unable to recover it. 00:27:28.478 [2024-12-08 02:29:56.009690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.009841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.009885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.478 qpair failed and we were unable to recover it. 00:27:28.478 [2024-12-08 02:29:56.010030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.010171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.010197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.478 qpair failed and we were unable to recover it. 00:27:28.478 [2024-12-08 02:29:56.010339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.010446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.010471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.478 qpair failed and we were unable to recover it. 00:27:28.478 [2024-12-08 02:29:56.010620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.010747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.010776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.478 qpair failed and we were unable to recover it. 00:27:28.478 [2024-12-08 02:29:56.010931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.011016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.011043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.478 qpair failed and we were unable to recover it. 00:27:28.478 [2024-12-08 02:29:56.011133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.011220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.011246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.478 qpair failed and we were unable to recover it. 00:27:28.478 [2024-12-08 02:29:56.011326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.011443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.011469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.478 qpair failed and we were unable to recover it. 00:27:28.478 [2024-12-08 02:29:56.011576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.011658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.011683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.478 qpair failed and we were unable to recover it. 00:27:28.478 [2024-12-08 02:29:56.011793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.011885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.011911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.478 qpair failed and we were unable to recover it. 00:27:28.478 [2024-12-08 02:29:56.012030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.012121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.012152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.478 qpair failed and we were unable to recover it. 00:27:28.478 [2024-12-08 02:29:56.012263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.012409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.012435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.478 qpair failed and we were unable to recover it. 00:27:28.478 [2024-12-08 02:29:56.012556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.012674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.478 [2024-12-08 02:29:56.012700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.478 qpair failed and we were unable to recover it. 00:27:28.479 [2024-12-08 02:29:56.012800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.012881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.012908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.479 qpair failed and we were unable to recover it. 00:27:28.479 [2024-12-08 02:29:56.013024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.013109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.013134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.479 qpair failed and we were unable to recover it. 00:27:28.479 [2024-12-08 02:29:56.013254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.013365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.013390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.479 qpair failed and we were unable to recover it. 00:27:28.479 [2024-12-08 02:29:56.013517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.013665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.013693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.479 qpair failed and we were unable to recover it. 00:27:28.479 [2024-12-08 02:29:56.013810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.013926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.013952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.479 qpair failed and we were unable to recover it. 00:27:28.479 [2024-12-08 02:29:56.014067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.014180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.014206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.479 qpair failed and we were unable to recover it. 00:27:28.479 [2024-12-08 02:29:56.014288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.014428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.014454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.479 qpair failed and we were unable to recover it. 00:27:28.479 [2024-12-08 02:29:56.014590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.014699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.014726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.479 qpair failed and we were unable to recover it. 00:27:28.479 [2024-12-08 02:29:56.014838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.014923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.014949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.479 qpair failed and we were unable to recover it. 00:27:28.479 [2024-12-08 02:29:56.015063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.015179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.015205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.479 qpair failed and we were unable to recover it. 00:27:28.479 [2024-12-08 02:29:56.015322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.015438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.015463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.479 qpair failed and we were unable to recover it. 00:27:28.479 [2024-12-08 02:29:56.015556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.015673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.015698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.479 qpair failed and we were unable to recover it. 00:27:28.479 [2024-12-08 02:29:56.015834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.015949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.015975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.479 qpair failed and we were unable to recover it. 00:27:28.479 [2024-12-08 02:29:56.016089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.016185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.016210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.479 qpair failed and we were unable to recover it. 00:27:28.479 [2024-12-08 02:29:56.016326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.016408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.016433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.479 qpair failed and we were unable to recover it. 00:27:28.479 [2024-12-08 02:29:56.016554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.016704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.016730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.479 qpair failed and we were unable to recover it. 00:27:28.479 [2024-12-08 02:29:56.016829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.016941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.016966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.479 qpair failed and we were unable to recover it. 00:27:28.479 [2024-12-08 02:29:56.017053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.017164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.017191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.479 qpair failed and we were unable to recover it. 00:27:28.479 [2024-12-08 02:29:56.017280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.017391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.017417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.479 qpair failed and we were unable to recover it. 00:27:28.479 [2024-12-08 02:29:56.017531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.017617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.017642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.479 qpair failed and we were unable to recover it. 00:27:28.479 [2024-12-08 02:29:56.017743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.017838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.017863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.479 qpair failed and we were unable to recover it. 00:27:28.479 [2024-12-08 02:29:56.017953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.018067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.018093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.479 qpair failed and we were unable to recover it. 00:27:28.479 [2024-12-08 02:29:56.018191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.018278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.018305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.479 qpair failed and we were unable to recover it. 00:27:28.479 [2024-12-08 02:29:56.018404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.018514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.018547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.479 qpair failed and we were unable to recover it. 00:27:28.479 [2024-12-08 02:29:56.018632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.018724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.018750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.479 qpair failed and we were unable to recover it. 00:27:28.479 [2024-12-08 02:29:56.018887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.018967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.018992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.479 qpair failed and we were unable to recover it. 00:27:28.479 [2024-12-08 02:29:56.019111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.019222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.019248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.479 qpair failed and we were unable to recover it. 00:27:28.479 [2024-12-08 02:29:56.019333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.019447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.019472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.479 qpair failed and we were unable to recover it. 00:27:28.479 [2024-12-08 02:29:56.019573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.479 [2024-12-08 02:29:56.019689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.019714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.480 qpair failed and we were unable to recover it. 00:27:28.480 [2024-12-08 02:29:56.019836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.019924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.019948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.480 qpair failed and we were unable to recover it. 00:27:28.480 [2024-12-08 02:29:56.020063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.020202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.020227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.480 qpair failed and we were unable to recover it. 00:27:28.480 [2024-12-08 02:29:56.020308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.020421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.020448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.480 qpair failed and we were unable to recover it. 00:27:28.480 [2024-12-08 02:29:56.020592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.020708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.020734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.480 qpair failed and we were unable to recover it. 00:27:28.480 [2024-12-08 02:29:56.020826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.020954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.020980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.480 qpair failed and we were unable to recover it. 00:27:28.480 [2024-12-08 02:29:56.021122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.021237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.021262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.480 qpair failed and we were unable to recover it. 00:27:28.480 [2024-12-08 02:29:56.021405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.021574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.021599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.480 qpair failed and we were unable to recover it. 00:27:28.480 [2024-12-08 02:29:56.021725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.021861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.021904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.480 qpair failed and we were unable to recover it. 00:27:28.480 [2024-12-08 02:29:56.021994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.022117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.022142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.480 qpair failed and we were unable to recover it. 00:27:28.480 [2024-12-08 02:29:56.022235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.022347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.022371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.480 qpair failed and we were unable to recover it. 00:27:28.480 [2024-12-08 02:29:56.022485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.022577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.022604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.480 qpair failed and we were unable to recover it. 00:27:28.480 [2024-12-08 02:29:56.022713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.022799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.022824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.480 qpair failed and we were unable to recover it. 00:27:28.480 [2024-12-08 02:29:56.022937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.023022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.023047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.480 qpair failed and we were unable to recover it. 00:27:28.480 [2024-12-08 02:29:56.023157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.023268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.023296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.480 qpair failed and we were unable to recover it. 00:27:28.480 [2024-12-08 02:29:56.023378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.023490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.023516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.480 qpair failed and we were unable to recover it. 00:27:28.480 [2024-12-08 02:29:56.023617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.023692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.023717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.480 qpair failed and we were unable to recover it. 00:27:28.480 [2024-12-08 02:29:56.023799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.023911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.023935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.480 qpair failed and we were unable to recover it. 00:27:28.480 [2024-12-08 02:29:56.024047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.024157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.024183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.480 qpair failed and we were unable to recover it. 00:27:28.480 [2024-12-08 02:29:56.024293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.024378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.024403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.480 qpair failed and we were unable to recover it. 00:27:28.480 [2024-12-08 02:29:56.024527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.024624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.024650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.480 qpair failed and we were unable to recover it. 00:27:28.480 [2024-12-08 02:29:56.024734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.024853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.024879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.480 qpair failed and we were unable to recover it. 00:27:28.480 [2024-12-08 02:29:56.024973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.025058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.025086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.480 qpair failed and we were unable to recover it. 00:27:28.480 [2024-12-08 02:29:56.025198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.025311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.025337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.480 qpair failed and we were unable to recover it. 00:27:28.480 [2024-12-08 02:29:56.025448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.025526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.025560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.480 qpair failed and we were unable to recover it. 00:27:28.480 [2024-12-08 02:29:56.025658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.025768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.025794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.480 qpair failed and we were unable to recover it. 00:27:28.480 [2024-12-08 02:29:56.025881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.025964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.025989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.480 qpair failed and we were unable to recover it. 00:27:28.480 [2024-12-08 02:29:56.026082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.026226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.026252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.480 qpair failed and we were unable to recover it. 00:27:28.480 [2024-12-08 02:29:56.026328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.026414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.480 [2024-12-08 02:29:56.026439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.480 qpair failed and we were unable to recover it. 00:27:28.480 [2024-12-08 02:29:56.026558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.026643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.026668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.481 qpair failed and we were unable to recover it. 00:27:28.481 [2024-12-08 02:29:56.026752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.026865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.026891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.481 qpair failed and we were unable to recover it. 00:27:28.481 [2024-12-08 02:29:56.027033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.027152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.027177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.481 qpair failed and we were unable to recover it. 00:27:28.481 [2024-12-08 02:29:56.027264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.027353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.027380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.481 qpair failed and we were unable to recover it. 00:27:28.481 [2024-12-08 02:29:56.027456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.027551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.027587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.481 qpair failed and we were unable to recover it. 00:27:28.481 [2024-12-08 02:29:56.027684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.027771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.027806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.481 qpair failed and we were unable to recover it. 00:27:28.481 [2024-12-08 02:29:56.027884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.028022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.028047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.481 qpair failed and we were unable to recover it. 00:27:28.481 [2024-12-08 02:29:56.028163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.028244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.028269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.481 qpair failed and we were unable to recover it. 00:27:28.481 [2024-12-08 02:29:56.028410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.028500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.028525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.481 qpair failed and we were unable to recover it. 00:27:28.481 [2024-12-08 02:29:56.028676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.028818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.028843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.481 qpair failed and we were unable to recover it. 00:27:28.481 [2024-12-08 02:29:56.028930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.029044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.029069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.481 qpair failed and we were unable to recover it. 00:27:28.481 [2024-12-08 02:29:56.029159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.029298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.029324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.481 qpair failed and we were unable to recover it. 00:27:28.481 [2024-12-08 02:29:56.029465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.029546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.029580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.481 qpair failed and we were unable to recover it. 00:27:28.481 [2024-12-08 02:29:56.029660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.029772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.029809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.481 qpair failed and we were unable to recover it. 00:27:28.481 [2024-12-08 02:29:56.029931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.030044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.030069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.481 qpair failed and we were unable to recover it. 00:27:28.481 [2024-12-08 02:29:56.030210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.030301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.030327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.481 qpair failed and we were unable to recover it. 00:27:28.481 [2024-12-08 02:29:56.030408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.030516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.030557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.481 qpair failed and we were unable to recover it. 00:27:28.481 [2024-12-08 02:29:56.030643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.030753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.030778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.481 qpair failed and we were unable to recover it. 00:27:28.481 [2024-12-08 02:29:56.030863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.030981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.031007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.481 qpair failed and we were unable to recover it. 00:27:28.481 [2024-12-08 02:29:56.031088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.031226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.031252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.481 qpair failed and we were unable to recover it. 00:27:28.481 [2024-12-08 02:29:56.031397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.031476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.031504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.481 qpair failed and we were unable to recover it. 00:27:28.481 [2024-12-08 02:29:56.031626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.031744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.031769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.481 qpair failed and we were unable to recover it. 00:27:28.481 [2024-12-08 02:29:56.031962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.032054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.032079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.481 qpair failed and we were unable to recover it. 00:27:28.481 [2024-12-08 02:29:56.032190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.032298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.032324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.481 qpair failed and we were unable to recover it. 00:27:28.481 [2024-12-08 02:29:56.032437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.032523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.032556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.481 qpair failed and we were unable to recover it. 00:27:28.481 [2024-12-08 02:29:56.032677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.032787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.032813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.481 qpair failed and we were unable to recover it. 00:27:28.481 [2024-12-08 02:29:56.032900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.033041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.033066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.481 qpair failed and we were unable to recover it. 00:27:28.481 [2024-12-08 02:29:56.033182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.033304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.033330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.481 qpair failed and we were unable to recover it. 00:27:28.481 [2024-12-08 02:29:56.033420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.033530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.481 [2024-12-08 02:29:56.033564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.481 qpair failed and we were unable to recover it. 00:27:28.482 [2024-12-08 02:29:56.033665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.033748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.033774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.482 qpair failed and we were unable to recover it. 00:27:28.482 [2024-12-08 02:29:56.033917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.034001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.034026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.482 qpair failed and we were unable to recover it. 00:27:28.482 [2024-12-08 02:29:56.034112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.034225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.034251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.482 qpair failed and we were unable to recover it. 00:27:28.482 [2024-12-08 02:29:56.034369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.034455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.034481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.482 qpair failed and we were unable to recover it. 00:27:28.482 [2024-12-08 02:29:56.034602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.034744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.034769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.482 qpair failed and we were unable to recover it. 00:27:28.482 [2024-12-08 02:29:56.034881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.035021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.035047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.482 qpair failed and we were unable to recover it. 00:27:28.482 [2024-12-08 02:29:56.035180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.035294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.035320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.482 qpair failed and we were unable to recover it. 00:27:28.482 [2024-12-08 02:29:56.035466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.035579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.035605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.482 qpair failed and we were unable to recover it. 00:27:28.482 [2024-12-08 02:29:56.035692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.035780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.035806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.482 qpair failed and we were unable to recover it. 00:27:28.482 [2024-12-08 02:29:56.035930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.036008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.036035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.482 qpair failed and we were unable to recover it. 00:27:28.482 [2024-12-08 02:29:56.036156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.036303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.036328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.482 qpair failed and we were unable to recover it. 00:27:28.482 [2024-12-08 02:29:56.036442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.036526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.036558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.482 qpair failed and we were unable to recover it. 00:27:28.482 [2024-12-08 02:29:56.036676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.036775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.036802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.482 qpair failed and we were unable to recover it. 00:27:28.482 [2024-12-08 02:29:56.036915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.037003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.037028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.482 qpair failed and we were unable to recover it. 00:27:28.482 [2024-12-08 02:29:56.037153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.037265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.037292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.482 qpair failed and we were unable to recover it. 00:27:28.482 [2024-12-08 02:29:56.037405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.037529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.037561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.482 qpair failed and we were unable to recover it. 00:27:28.482 [2024-12-08 02:29:56.037681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.037792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.037820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.482 qpair failed and we were unable to recover it. 00:27:28.482 [2024-12-08 02:29:56.037947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.038057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.038084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.482 qpair failed and we were unable to recover it. 00:27:28.482 [2024-12-08 02:29:56.038196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.038275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.038301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.482 qpair failed and we were unable to recover it. 00:27:28.482 [2024-12-08 02:29:56.038407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.038484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.038510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.482 qpair failed and we were unable to recover it. 00:27:28.482 [2024-12-08 02:29:56.038615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.038734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.038759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.482 qpair failed and we were unable to recover it. 00:27:28.482 [2024-12-08 02:29:56.038852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.038927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.038952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.482 qpair failed and we were unable to recover it. 00:27:28.482 [2024-12-08 02:29:56.039068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.039184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.039209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.482 qpair failed and we were unable to recover it. 00:27:28.482 [2024-12-08 02:29:56.039294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.039412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.039439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.482 qpair failed and we were unable to recover it. 00:27:28.482 [2024-12-08 02:29:56.039519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.039616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.039642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.482 qpair failed and we were unable to recover it. 00:27:28.482 [2024-12-08 02:29:56.039734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.039808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.039833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.482 qpair failed and we were unable to recover it. 00:27:28.482 [2024-12-08 02:29:56.039977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.040091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.040116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.482 qpair failed and we were unable to recover it. 00:27:28.482 [2024-12-08 02:29:56.040197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.040277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.040302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.482 qpair failed and we were unable to recover it. 00:27:28.482 [2024-12-08 02:29:56.040383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.482 [2024-12-08 02:29:56.040500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.040526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.483 qpair failed and we were unable to recover it. 00:27:28.483 [2024-12-08 02:29:56.040619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.040739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.040764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.483 qpair failed and we were unable to recover it. 00:27:28.483 [2024-12-08 02:29:56.040854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.040971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.040997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.483 qpair failed and we were unable to recover it. 00:27:28.483 [2024-12-08 02:29:56.041109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.041194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.041219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.483 qpair failed and we were unable to recover it. 00:27:28.483 [2024-12-08 02:29:56.041297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.041417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.041444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.483 qpair failed and we were unable to recover it. 00:27:28.483 [2024-12-08 02:29:56.041562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.041671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.041698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.483 qpair failed and we were unable to recover it. 00:27:28.483 [2024-12-08 02:29:56.041790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.041872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.041897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.483 qpair failed and we were unable to recover it. 00:27:28.483 [2024-12-08 02:29:56.041993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.042079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.042105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.483 qpair failed and we were unable to recover it. 00:27:28.483 [2024-12-08 02:29:56.042197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.042276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.042302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.483 qpair failed and we were unable to recover it. 00:27:28.483 [2024-12-08 02:29:56.042393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.042507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.042533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.483 qpair failed and we were unable to recover it. 00:27:28.483 [2024-12-08 02:29:56.042661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.042774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.042799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.483 qpair failed and we were unable to recover it. 00:27:28.483 [2024-12-08 02:29:56.042888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.043003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.043029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.483 qpair failed and we were unable to recover it. 00:27:28.483 [2024-12-08 02:29:56.043147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.043227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.043253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.483 qpair failed and we were unable to recover it. 00:27:28.483 [2024-12-08 02:29:56.043342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.043428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.043454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.483 qpair failed and we were unable to recover it. 00:27:28.483 [2024-12-08 02:29:56.043566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.043661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.043690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.483 qpair failed and we were unable to recover it. 00:27:28.483 [2024-12-08 02:29:56.043778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.043928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.043954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.483 qpair failed and we were unable to recover it. 00:27:28.483 [2024-12-08 02:29:56.044067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.044177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.044202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.483 qpair failed and we were unable to recover it. 00:27:28.483 [2024-12-08 02:29:56.044314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.044397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.044423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.483 qpair failed and we were unable to recover it. 00:27:28.483 [2024-12-08 02:29:56.044518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.044638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.044664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.483 qpair failed and we were unable to recover it. 00:27:28.483 [2024-12-08 02:29:56.044798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.044932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.044958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.483 qpair failed and we were unable to recover it. 00:27:28.483 [2024-12-08 02:29:56.045043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.045120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.045146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.483 qpair failed and we were unable to recover it. 00:27:28.483 [2024-12-08 02:29:56.045233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.045309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.045334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.483 qpair failed and we were unable to recover it. 00:27:28.483 [2024-12-08 02:29:56.045409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.045512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.045545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.483 qpair failed and we were unable to recover it. 00:27:28.483 [2024-12-08 02:29:56.045628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.045713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.045738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.483 qpair failed and we were unable to recover it. 00:27:28.483 [2024-12-08 02:29:56.045855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.045968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.045997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.483 qpair failed and we were unable to recover it. 00:27:28.483 [2024-12-08 02:29:56.046133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.046219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.483 [2024-12-08 02:29:56.046244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.483 qpair failed and we were unable to recover it. 00:27:28.484 [2024-12-08 02:29:56.046361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.046502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.046529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.484 qpair failed and we were unable to recover it. 00:27:28.484 [2024-12-08 02:29:56.046653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.046772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.046799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.484 qpair failed and we were unable to recover it. 00:27:28.484 [2024-12-08 02:29:56.046914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.047002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.047028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.484 qpair failed and we were unable to recover it. 00:27:28.484 [2024-12-08 02:29:56.047142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.047284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.047310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.484 qpair failed and we were unable to recover it. 00:27:28.484 [2024-12-08 02:29:56.047450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.047552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.047580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.484 qpair failed and we were unable to recover it. 00:27:28.484 [2024-12-08 02:29:56.047662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.047753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.047778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.484 qpair failed and we were unable to recover it. 00:27:28.484 [2024-12-08 02:29:56.047900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.048020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.048046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.484 qpair failed and we were unable to recover it. 00:27:28.484 [2024-12-08 02:29:56.048132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.048220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.048246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.484 qpair failed and we were unable to recover it. 00:27:28.484 [2024-12-08 02:29:56.048338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.048425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.048456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.484 qpair failed and we were unable to recover it. 00:27:28.484 [2024-12-08 02:29:56.048543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.048667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.048693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.484 qpair failed and we were unable to recover it. 00:27:28.484 [2024-12-08 02:29:56.048782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.048892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.048919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.484 qpair failed and we were unable to recover it. 00:27:28.484 [2024-12-08 02:29:56.049003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.049087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.049111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.484 qpair failed and we were unable to recover it. 00:27:28.484 [2024-12-08 02:29:56.049219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.049301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.049326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.484 qpair failed and we were unable to recover it. 00:27:28.484 [2024-12-08 02:29:56.049411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.049533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.049571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.484 qpair failed and we were unable to recover it. 00:27:28.484 [2024-12-08 02:29:56.049650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.049768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.049793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.484 qpair failed and we were unable to recover it. 00:27:28.484 [2024-12-08 02:29:56.049913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.049992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.050017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.484 qpair failed and we were unable to recover it. 00:27:28.484 [2024-12-08 02:29:56.050106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.050223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.050249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.484 qpair failed and we were unable to recover it. 00:27:28.484 [2024-12-08 02:29:56.050340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.050456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.050482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.484 qpair failed and we were unable to recover it. 00:27:28.484 [2024-12-08 02:29:56.050565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.050649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.050678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.484 qpair failed and we were unable to recover it. 00:27:28.484 [2024-12-08 02:29:56.050760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.050866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.050893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.484 qpair failed and we were unable to recover it. 00:27:28.484 [2024-12-08 02:29:56.051003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.051077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.051103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.484 qpair failed and we were unable to recover it. 00:27:28.484 [2024-12-08 02:29:56.051185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.051298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.051324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.484 qpair failed and we were unable to recover it. 00:27:28.484 [2024-12-08 02:29:56.051405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.051549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.051574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.484 qpair failed and we were unable to recover it. 00:27:28.484 [2024-12-08 02:29:56.051681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.051759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.051785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.484 qpair failed and we were unable to recover it. 00:27:28.484 [2024-12-08 02:29:56.051868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.051949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.051973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.484 qpair failed and we were unable to recover it. 00:27:28.484 [2024-12-08 02:29:56.052083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.052168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.052194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.484 qpair failed and we were unable to recover it. 00:27:28.484 [2024-12-08 02:29:56.052274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.052387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.052413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.484 qpair failed and we were unable to recover it. 00:27:28.484 [2024-12-08 02:29:56.052499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.052597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.052624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.484 qpair failed and we were unable to recover it. 00:27:28.484 [2024-12-08 02:29:56.052738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.484 [2024-12-08 02:29:56.052889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.052915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.485 qpair failed and we were unable to recover it. 00:27:28.485 [2024-12-08 02:29:56.053044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.053155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.053191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.485 qpair failed and we were unable to recover it. 00:27:28.485 [2024-12-08 02:29:56.053284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.053365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.053391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.485 qpair failed and we were unable to recover it. 00:27:28.485 [2024-12-08 02:29:56.053511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.053637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.053663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.485 qpair failed and we were unable to recover it. 00:27:28.485 [2024-12-08 02:29:56.053757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.053861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.053887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.485 qpair failed and we were unable to recover it. 00:27:28.485 [2024-12-08 02:29:56.054013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.054104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.054130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.485 qpair failed and we were unable to recover it. 00:27:28.485 [2024-12-08 02:29:56.054214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.054288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.054314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.485 qpair failed and we were unable to recover it. 00:27:28.485 [2024-12-08 02:29:56.054429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.054516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.054546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.485 qpair failed and we were unable to recover it. 00:27:28.485 [2024-12-08 02:29:56.054622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.054709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.054735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.485 qpair failed and we were unable to recover it. 00:27:28.485 [2024-12-08 02:29:56.054833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.054913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.054939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.485 qpair failed and we were unable to recover it. 00:27:28.485 [2024-12-08 02:29:56.055051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.055192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.055218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.485 qpair failed and we were unable to recover it. 00:27:28.485 [2024-12-08 02:29:56.055339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.055424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.055450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.485 qpair failed and we were unable to recover it. 00:27:28.485 [2024-12-08 02:29:56.055533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.055627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.055653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.485 qpair failed and we were unable to recover it. 00:27:28.485 [2024-12-08 02:29:56.055742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.055836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.055862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.485 qpair failed and we were unable to recover it. 00:27:28.485 [2024-12-08 02:29:56.055957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.056072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.056097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.485 qpair failed and we were unable to recover it. 00:27:28.485 [2024-12-08 02:29:56.056185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.056305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.056332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.485 qpair failed and we were unable to recover it. 00:27:28.485 [2024-12-08 02:29:56.056422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.056529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.056598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.485 qpair failed and we were unable to recover it. 00:27:28.485 [2024-12-08 02:29:56.056675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.056791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.056820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.485 qpair failed and we were unable to recover it. 00:27:28.485 [2024-12-08 02:29:56.056906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.057047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.057073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.485 qpair failed and we were unable to recover it. 00:27:28.485 [2024-12-08 02:29:56.057187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.057327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.057353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.485 qpair failed and we were unable to recover it. 00:27:28.485 [2024-12-08 02:29:56.057449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.057543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.057579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.485 qpair failed and we were unable to recover it. 00:27:28.485 [2024-12-08 02:29:56.057701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.057784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.057810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.485 qpair failed and we were unable to recover it. 00:27:28.485 [2024-12-08 02:29:56.057922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.058035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.058060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.485 qpair failed and we were unable to recover it. 00:27:28.485 [2024-12-08 02:29:56.058142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.058246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.058271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.485 qpair failed and we were unable to recover it. 00:27:28.485 [2024-12-08 02:29:56.058381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.058462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.485 [2024-12-08 02:29:56.058487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.486 qpair failed and we were unable to recover it. 00:27:28.486 [2024-12-08 02:29:56.058610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.058699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.058726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.486 qpair failed and we were unable to recover it. 00:27:28.486 [2024-12-08 02:29:56.058811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.058952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.058978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.486 qpair failed and we were unable to recover it. 00:27:28.486 [2024-12-08 02:29:56.059096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.059203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.059229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.486 qpair failed and we were unable to recover it. 00:27:28.486 [2024-12-08 02:29:56.059350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.059444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.059470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.486 qpair failed and we were unable to recover it. 00:27:28.486 [2024-12-08 02:29:56.059554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.059653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.059679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.486 qpair failed and we were unable to recover it. 00:27:28.486 [2024-12-08 02:29:56.059767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.059912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.059939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.486 qpair failed and we were unable to recover it. 00:27:28.486 [2024-12-08 02:29:56.060057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.060170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.060196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.486 qpair failed and we were unable to recover it. 00:27:28.486 [2024-12-08 02:29:56.060317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.060407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.060433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.486 qpair failed and we were unable to recover it. 00:27:28.486 [2024-12-08 02:29:56.060518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.060617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.060644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.486 qpair failed and we were unable to recover it. 00:27:28.486 [2024-12-08 02:29:56.060753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.060873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.060899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.486 qpair failed and we were unable to recover it. 00:27:28.486 [2024-12-08 02:29:56.060988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.061069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.061094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.486 qpair failed and we were unable to recover it. 00:27:28.486 [2024-12-08 02:29:56.061216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.061324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.061350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.486 qpair failed and we were unable to recover it. 00:27:28.486 [2024-12-08 02:29:56.061496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.061600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.061627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.486 qpair failed and we were unable to recover it. 00:27:28.486 [2024-12-08 02:29:56.061728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.061843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.061869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.486 qpair failed and we were unable to recover it. 00:27:28.486 [2024-12-08 02:29:56.061953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.062066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.062092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.486 qpair failed and we were unable to recover it. 00:27:28.486 [2024-12-08 02:29:56.062206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.062323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.062348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.486 qpair failed and we were unable to recover it. 00:27:28.486 [2024-12-08 02:29:56.062474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.062592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.062619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.486 qpair failed and we were unable to recover it. 00:27:28.486 [2024-12-08 02:29:56.062713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.062794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.062826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.486 qpair failed and we were unable to recover it. 00:27:28.486 [2024-12-08 02:29:56.062915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.063027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.063052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.486 qpair failed and we were unable to recover it. 00:27:28.486 [2024-12-08 02:29:56.063132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.063224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.063250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.486 qpair failed and we were unable to recover it. 00:27:28.486 [2024-12-08 02:29:56.063341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.063428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.063453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.486 qpair failed and we were unable to recover it. 00:27:28.486 [2024-12-08 02:29:56.063580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.063698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.063723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.486 qpair failed and we were unable to recover it. 00:27:28.486 [2024-12-08 02:29:56.063824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.063916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.063942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.486 qpair failed and we were unable to recover it. 00:27:28.486 [2024-12-08 02:29:56.064062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.064177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.064202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.486 qpair failed and we were unable to recover it. 00:27:28.486 [2024-12-08 02:29:56.064282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.064401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.064428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.486 qpair failed and we were unable to recover it. 00:27:28.486 [2024-12-08 02:29:56.064520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.064644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.064670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.486 qpair failed and we were unable to recover it. 00:27:28.486 [2024-12-08 02:29:56.064751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.064859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.064884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.486 qpair failed and we were unable to recover it. 00:27:28.486 [2024-12-08 02:29:56.064999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.065139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.486 [2024-12-08 02:29:56.065165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.486 qpair failed and we were unable to recover it. 00:27:28.487 [2024-12-08 02:29:56.065246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.065362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.065388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.487 qpair failed and we were unable to recover it. 00:27:28.487 [2024-12-08 02:29:56.065505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.065622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.065648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.487 qpair failed and we were unable to recover it. 00:27:28.487 [2024-12-08 02:29:56.065736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.065831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.065855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.487 qpair failed and we were unable to recover it. 00:27:28.487 [2024-12-08 02:29:56.065936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.066008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.066034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.487 qpair failed and we were unable to recover it. 00:27:28.487 [2024-12-08 02:29:56.066151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.066266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.066291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.487 qpair failed and we were unable to recover it. 00:27:28.487 [2024-12-08 02:29:56.066407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.066483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.066508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.487 qpair failed and we were unable to recover it. 00:27:28.487 [2024-12-08 02:29:56.066630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.066704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.066729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.487 qpair failed and we were unable to recover it. 00:27:28.487 [2024-12-08 02:29:56.066858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.066967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.066993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.487 qpair failed and we were unable to recover it. 00:27:28.487 [2024-12-08 02:29:56.067111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.067227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.067252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.487 qpair failed and we were unable to recover it. 00:27:28.487 [2024-12-08 02:29:56.067398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.067475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.067500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.487 qpair failed and we were unable to recover it. 00:27:28.487 [2024-12-08 02:29:56.067593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.067672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.067698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.487 qpair failed and we were unable to recover it. 00:27:28.487 [2024-12-08 02:29:56.067781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.067886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.067912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.487 qpair failed and we were unable to recover it. 00:27:28.487 [2024-12-08 02:29:56.068003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.068092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.068119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.487 qpair failed and we were unable to recover it. 00:27:28.487 [2024-12-08 02:29:56.068237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.068357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.068383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.487 qpair failed and we were unable to recover it. 00:27:28.487 [2024-12-08 02:29:56.068494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.068612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.068638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.487 qpair failed and we were unable to recover it. 00:27:28.487 [2024-12-08 02:29:56.068754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.068875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.068902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.487 qpair failed and we were unable to recover it. 00:27:28.487 [2024-12-08 02:29:56.069020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.069137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.069163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.487 qpair failed and we were unable to recover it. 00:27:28.487 [2024-12-08 02:29:56.069280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.069394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.069419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.487 qpair failed and we were unable to recover it. 00:27:28.487 [2024-12-08 02:29:56.069546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.069633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.069659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.487 qpair failed and we were unable to recover it. 00:27:28.487 [2024-12-08 02:29:56.069760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.069868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.069893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.487 qpair failed and we were unable to recover it. 00:27:28.487 [2024-12-08 02:29:56.070034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.070112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.070137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.487 qpair failed and we were unable to recover it. 00:27:28.487 [2024-12-08 02:29:56.070227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.070319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.070344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.487 qpair failed and we were unable to recover it. 00:27:28.487 [2024-12-08 02:29:56.070433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.070514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.070546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.487 qpair failed and we were unable to recover it. 00:27:28.487 [2024-12-08 02:29:56.070660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.070779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.070804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.487 qpair failed and we were unable to recover it. 00:27:28.487 [2024-12-08 02:29:56.070894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.071004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.071030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.487 qpair failed and we were unable to recover it. 00:27:28.487 [2024-12-08 02:29:56.071105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.487 [2024-12-08 02:29:56.071184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.071211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.488 qpair failed and we were unable to recover it. 00:27:28.488 [2024-12-08 02:29:56.071305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.071388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.071413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.488 qpair failed and we were unable to recover it. 00:27:28.488 [2024-12-08 02:29:56.071524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.071651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.071677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.488 qpair failed and we were unable to recover it. 00:27:28.488 [2024-12-08 02:29:56.071771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.071897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.071922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.488 qpair failed and we were unable to recover it. 00:27:28.488 [2024-12-08 02:29:56.072039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.072150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.072186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.488 qpair failed and we were unable to recover it. 00:27:28.488 [2024-12-08 02:29:56.072294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.072405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.072430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.488 qpair failed and we were unable to recover it. 00:27:28.488 [2024-12-08 02:29:56.072523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.072649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.072676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.488 qpair failed and we were unable to recover it. 00:27:28.488 [2024-12-08 02:29:56.072787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.072900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.072926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.488 qpair failed and we were unable to recover it. 00:27:28.488 [2024-12-08 02:29:56.073009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.073119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.073145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.488 qpair failed and we were unable to recover it. 00:27:28.488 [2024-12-08 02:29:56.073255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.073347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.073371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.488 qpair failed and we were unable to recover it. 00:27:28.488 [2024-12-08 02:29:56.073456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.073571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.073596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.488 qpair failed and we were unable to recover it. 00:27:28.488 [2024-12-08 02:29:56.073692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.073776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.073801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.488 qpair failed and we were unable to recover it. 00:27:28.488 [2024-12-08 02:29:56.073913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.074046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.074071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.488 qpair failed and we were unable to recover it. 00:27:28.488 [2024-12-08 02:29:56.074182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.074278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.074304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.488 qpair failed and we were unable to recover it. 00:27:28.488 [2024-12-08 02:29:56.074425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.074513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.074545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.488 qpair failed and we were unable to recover it. 00:27:28.488 [2024-12-08 02:29:56.074660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.074749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.074774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.488 qpair failed and we were unable to recover it. 00:27:28.488 [2024-12-08 02:29:56.074885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.075001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.075027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.488 qpair failed and we were unable to recover it. 00:27:28.488 [2024-12-08 02:29:56.075120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.075229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.075255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.488 qpair failed and we were unable to recover it. 00:27:28.488 [2024-12-08 02:29:56.075363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.075484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.075509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.488 qpair failed and we were unable to recover it. 00:27:28.488 [2024-12-08 02:29:56.075616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.075699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.075725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.488 qpair failed and we were unable to recover it. 00:27:28.488 [2024-12-08 02:29:56.075835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.075976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.076001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.488 qpair failed and we were unable to recover it. 00:27:28.488 [2024-12-08 02:29:56.076113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.076193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.076218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.488 qpair failed and we were unable to recover it. 00:27:28.488 [2024-12-08 02:29:56.076339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.076425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.076450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.488 qpair failed and we were unable to recover it. 00:27:28.488 [2024-12-08 02:29:56.076579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.076672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.076697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.488 qpair failed and we were unable to recover it. 00:27:28.488 [2024-12-08 02:29:56.076841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.076931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.076956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.488 qpair failed and we were unable to recover it. 00:27:28.488 [2024-12-08 02:29:56.077045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.077181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.077206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.488 qpair failed and we were unable to recover it. 00:27:28.488 [2024-12-08 02:29:56.077347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.077492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.077517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.488 qpair failed and we were unable to recover it. 00:27:28.488 [2024-12-08 02:29:56.077674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.077765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.077790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.488 qpair failed and we were unable to recover it. 00:27:28.488 [2024-12-08 02:29:56.077904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.488 [2024-12-08 02:29:56.078061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.078103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.489 qpair failed and we were unable to recover it. 00:27:28.489 [2024-12-08 02:29:56.078220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.078309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.078335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.489 qpair failed and we were unable to recover it. 00:27:28.489 [2024-12-08 02:29:56.078427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.078574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.078600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.489 qpair failed and we were unable to recover it. 00:27:28.489 [2024-12-08 02:29:56.078719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.078801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.078826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.489 qpair failed and we were unable to recover it. 00:27:28.489 [2024-12-08 02:29:56.078972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.079085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.079110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.489 qpair failed and we were unable to recover it. 00:27:28.489 [2024-12-08 02:29:56.079197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.079292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.079318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.489 qpair failed and we were unable to recover it. 00:27:28.489 [2024-12-08 02:29:56.079402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.079514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.079546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.489 qpair failed and we were unable to recover it. 00:27:28.489 [2024-12-08 02:29:56.079627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.079720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.079746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.489 qpair failed and we were unable to recover it. 00:27:28.489 [2024-12-08 02:29:56.079866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.079978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.080004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.489 qpair failed and we were unable to recover it. 00:27:28.489 [2024-12-08 02:29:56.080085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.080188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.080212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.489 qpair failed and we were unable to recover it. 00:27:28.489 [2024-12-08 02:29:56.080321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.080435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.080461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.489 qpair failed and we were unable to recover it. 00:27:28.489 [2024-12-08 02:29:56.080582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.080669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.080694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.489 qpair failed and we were unable to recover it. 00:27:28.489 [2024-12-08 02:29:56.080822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.080932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.080958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.489 qpair failed and we were unable to recover it. 00:27:28.489 [2024-12-08 02:29:56.081070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.081179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.081204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.489 qpair failed and we were unable to recover it. 00:27:28.489 [2024-12-08 02:29:56.081292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.081412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.081439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.489 qpair failed and we were unable to recover it. 00:27:28.489 [2024-12-08 02:29:56.081559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.081661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.081691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.489 qpair failed and we were unable to recover it. 00:27:28.489 [2024-12-08 02:29:56.081779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.081857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.081882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.489 qpair failed and we were unable to recover it. 00:27:28.489 [2024-12-08 02:29:56.081991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.082102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.082127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.489 qpair failed and we were unable to recover it. 00:27:28.489 [2024-12-08 02:29:56.082240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.082330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.082356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.489 qpair failed and we were unable to recover it. 00:27:28.489 [2024-12-08 02:29:56.082497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.082643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.082668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.489 qpair failed and we were unable to recover it. 00:27:28.489 [2024-12-08 02:29:56.082783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.082893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.082918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.489 qpair failed and we were unable to recover it. 00:27:28.489 [2024-12-08 02:29:56.083036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.083163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.083188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.489 qpair failed and we were unable to recover it. 00:27:28.489 [2024-12-08 02:29:56.083298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.083390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.083415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.489 qpair failed and we were unable to recover it. 00:27:28.489 [2024-12-08 02:29:56.083569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.083649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.083674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.489 qpair failed and we were unable to recover it. 00:27:28.489 [2024-12-08 02:29:56.083788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.083909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.083935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.489 qpair failed and we were unable to recover it. 00:27:28.489 [2024-12-08 02:29:56.084054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.084146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.084175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.489 qpair failed and we were unable to recover it. 00:27:28.489 [2024-12-08 02:29:56.084289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.084403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.084428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.489 qpair failed and we were unable to recover it. 00:27:28.489 [2024-12-08 02:29:56.084577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.084665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.084690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.489 qpair failed and we were unable to recover it. 00:27:28.489 [2024-12-08 02:29:56.084810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.084958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.489 [2024-12-08 02:29:56.084984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.490 qpair failed and we were unable to recover it. 00:27:28.490 [2024-12-08 02:29:56.085095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.085178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.085203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.490 qpair failed and we were unable to recover it. 00:27:28.490 [2024-12-08 02:29:56.085292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.085372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.085397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.490 qpair failed and we were unable to recover it. 00:27:28.490 [2024-12-08 02:29:56.085546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.085659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.085684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.490 qpair failed and we were unable to recover it. 00:27:28.490 [2024-12-08 02:29:56.085778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.085867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.085893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.490 qpair failed and we were unable to recover it. 00:27:28.490 [2024-12-08 02:29:56.086010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.086150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.086176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.490 qpair failed and we were unable to recover it. 00:27:28.490 [2024-12-08 02:29:56.086293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.086438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.086463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.490 qpair failed and we were unable to recover it. 00:27:28.490 [2024-12-08 02:29:56.086575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.086694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.086723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.490 qpair failed and we were unable to recover it. 00:27:28.490 [2024-12-08 02:29:56.086838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.086926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.086951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.490 qpair failed and we were unable to recover it. 00:27:28.490 [2024-12-08 02:29:56.087059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.087171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.087196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.490 qpair failed and we were unable to recover it. 00:27:28.490 [2024-12-08 02:29:56.087310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.087419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.087444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.490 qpair failed and we were unable to recover it. 00:27:28.490 [2024-12-08 02:29:56.087527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.087625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.087651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.490 qpair failed and we were unable to recover it. 00:27:28.490 [2024-12-08 02:29:56.087762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.087885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.087911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.490 qpair failed and we were unable to recover it. 00:27:28.490 [2024-12-08 02:29:56.088058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.088195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.088221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.490 qpair failed and we were unable to recover it. 00:27:28.490 [2024-12-08 02:29:56.088308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.088420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.088445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.490 qpair failed and we were unable to recover it. 00:27:28.490 [2024-12-08 02:29:56.088561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.088685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.088711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.490 qpair failed and we were unable to recover it. 00:27:28.490 [2024-12-08 02:29:56.088834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.088948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.088973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.490 qpair failed and we were unable to recover it. 00:27:28.490 [2024-12-08 02:29:56.089063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.089175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.089205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.490 qpair failed and we were unable to recover it. 00:27:28.490 [2024-12-08 02:29:56.089327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.089412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.089437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.490 qpair failed and we were unable to recover it. 00:27:28.490 [2024-12-08 02:29:56.089519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.089623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.089650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.490 qpair failed and we were unable to recover it. 00:27:28.490 [2024-12-08 02:29:56.089768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.089857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.089882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.490 qpair failed and we were unable to recover it. 00:27:28.490 [2024-12-08 02:29:56.089988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.090100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.090124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.490 qpair failed and we were unable to recover it. 00:27:28.490 [2024-12-08 02:29:56.090265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.090379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.090404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.490 qpair failed and we were unable to recover it. 00:27:28.490 [2024-12-08 02:29:56.090549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.090654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.090680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.490 qpair failed and we were unable to recover it. 00:27:28.490 [2024-12-08 02:29:56.090801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.090922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.090948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.490 qpair failed and we were unable to recover it. 00:27:28.490 [2024-12-08 02:29:56.091064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.091155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.091181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.490 qpair failed and we were unable to recover it. 00:27:28.490 [2024-12-08 02:29:56.091269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.091379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.091404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.490 qpair failed and we were unable to recover it. 00:27:28.490 [2024-12-08 02:29:56.091517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.091620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.091646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.490 qpair failed and we were unable to recover it. 00:27:28.490 [2024-12-08 02:29:56.091732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.091844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.490 [2024-12-08 02:29:56.091870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.490 qpair failed and we were unable to recover it. 00:27:28.490 [2024-12-08 02:29:56.091985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.092107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.092134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.491 qpair failed and we were unable to recover it. 00:27:28.491 [2024-12-08 02:29:56.092215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.092295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.092321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.491 qpair failed and we were unable to recover it. 00:27:28.491 [2024-12-08 02:29:56.092441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.092554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.092587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.491 qpair failed and we were unable to recover it. 00:27:28.491 [2024-12-08 02:29:56.092669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.092778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.092814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.491 qpair failed and we were unable to recover it. 00:27:28.491 [2024-12-08 02:29:56.092932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.093045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.093071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.491 qpair failed and we were unable to recover it. 00:27:28.491 [2024-12-08 02:29:56.093213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.093292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.093317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.491 qpair failed and we were unable to recover it. 00:27:28.491 [2024-12-08 02:29:56.093428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.093541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.093567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.491 qpair failed and we were unable to recover it. 00:27:28.491 [2024-12-08 02:29:56.093649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.093737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.093762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.491 qpair failed and we were unable to recover it. 00:27:28.491 [2024-12-08 02:29:56.093840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.093979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.094012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.491 qpair failed and we were unable to recover it. 00:27:28.491 [2024-12-08 02:29:56.094158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.094273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.094300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.491 qpair failed and we were unable to recover it. 00:27:28.491 [2024-12-08 02:29:56.094415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.094502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.094528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.491 qpair failed and we were unable to recover it. 00:27:28.491 [2024-12-08 02:29:56.094670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.094757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.094783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.491 qpair failed and we were unable to recover it. 00:27:28.491 [2024-12-08 02:29:56.094925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.095012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.095037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.491 qpair failed and we were unable to recover it. 00:27:28.491 [2024-12-08 02:29:56.095185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.095304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.095330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.491 qpair failed and we were unable to recover it. 00:27:28.491 [2024-12-08 02:29:56.095415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.095520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.095552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.491 qpair failed and we were unable to recover it. 00:27:28.491 [2024-12-08 02:29:56.095645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.095732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.095758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.491 qpair failed and we were unable to recover it. 00:27:28.491 [2024-12-08 02:29:56.095878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.095965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.095991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.491 qpair failed and we were unable to recover it. 00:27:28.491 [2024-12-08 02:29:56.096109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.096197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.096222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.491 qpair failed and we were unable to recover it. 00:27:28.491 [2024-12-08 02:29:56.096319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.096426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.096451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.491 qpair failed and we were unable to recover it. 00:27:28.491 [2024-12-08 02:29:56.096544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.096665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.096690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.491 qpair failed and we were unable to recover it. 00:27:28.491 [2024-12-08 02:29:56.096815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.096927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.096953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.491 qpair failed and we were unable to recover it. 00:27:28.491 [2024-12-08 02:29:56.097094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.097207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.097232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.491 qpair failed and we were unable to recover it. 00:27:28.491 [2024-12-08 02:29:56.097317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.097435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.097461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.491 qpair failed and we were unable to recover it. 00:27:28.491 [2024-12-08 02:29:56.097584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.097674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.097700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.491 qpair failed and we were unable to recover it. 00:27:28.491 [2024-12-08 02:29:56.097788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.097929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.097954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.491 qpair failed and we were unable to recover it. 00:27:28.491 [2024-12-08 02:29:56.098069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.098150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.098176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.491 qpair failed and we were unable to recover it. 00:27:28.491 [2024-12-08 02:29:56.098295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.098409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.098433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.491 qpair failed and we were unable to recover it. 00:27:28.491 [2024-12-08 02:29:56.098552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.098644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.098669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.491 qpair failed and we were unable to recover it. 00:27:28.491 [2024-12-08 02:29:56.098785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.098894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.491 [2024-12-08 02:29:56.098920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.492 qpair failed and we were unable to recover it. 00:27:28.492 [2024-12-08 02:29:56.099060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.099149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.099173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.492 qpair failed and we were unable to recover it. 00:27:28.492 [2024-12-08 02:29:56.099254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.099367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.099394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.492 qpair failed and we were unable to recover it. 00:27:28.492 [2024-12-08 02:29:56.099486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.099634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.099660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.492 qpair failed and we were unable to recover it. 00:27:28.492 [2024-12-08 02:29:56.099750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.099831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.099856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.492 qpair failed and we were unable to recover it. 00:27:28.492 [2024-12-08 02:29:56.099978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.100062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.100088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.492 qpair failed and we were unable to recover it. 00:27:28.492 [2024-12-08 02:29:56.100167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.100281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.100307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.492 qpair failed and we were unable to recover it. 00:27:28.492 [2024-12-08 02:29:56.100446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.100533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.100563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.492 qpair failed and we were unable to recover it. 00:27:28.492 [2024-12-08 02:29:56.100650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.100779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.100814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.492 qpair failed and we were unable to recover it. 00:27:28.492 [2024-12-08 02:29:56.100922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.101034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.101059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.492 qpair failed and we were unable to recover it. 00:27:28.492 [2024-12-08 02:29:56.101150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.101266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.101291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.492 qpair failed and we were unable to recover it. 00:27:28.492 [2024-12-08 02:29:56.101438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.101570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.101606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.492 qpair failed and we were unable to recover it. 00:27:28.492 [2024-12-08 02:29:56.101721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.101836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.101862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.492 qpair failed and we were unable to recover it. 00:27:28.492 [2024-12-08 02:29:56.102008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.102122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.102147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.492 qpair failed and we were unable to recover it. 00:27:28.492 [2024-12-08 02:29:56.102264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.102409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.102434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.492 qpair failed and we were unable to recover it. 00:27:28.492 [2024-12-08 02:29:56.102522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.102613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.102639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.492 qpair failed and we were unable to recover it. 00:27:28.492 [2024-12-08 02:29:56.102778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.102901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.102927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.492 qpair failed and we were unable to recover it. 00:27:28.492 [2024-12-08 02:29:56.103013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.103098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.103124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.492 qpair failed and we were unable to recover it. 00:27:28.492 [2024-12-08 02:29:56.103242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.103384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.103410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.492 qpair failed and we were unable to recover it. 00:27:28.492 [2024-12-08 02:29:56.103529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.103682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.103708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.492 qpair failed and we were unable to recover it. 00:27:28.492 [2024-12-08 02:29:56.103797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.103910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.103935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.492 qpair failed and we were unable to recover it. 00:27:28.492 [2024-12-08 02:29:56.104031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.104168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.104194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.492 qpair failed and we were unable to recover it. 00:27:28.492 [2024-12-08 02:29:56.104312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.104463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.104489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.492 qpair failed and we were unable to recover it. 00:27:28.492 [2024-12-08 02:29:56.104572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.104702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.104730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.492 qpair failed and we were unable to recover it. 00:27:28.492 [2024-12-08 02:29:56.104846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.104949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.104974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.492 qpair failed and we were unable to recover it. 00:27:28.492 [2024-12-08 02:29:56.105090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.105167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.492 [2024-12-08 02:29:56.105192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.492 qpair failed and we were unable to recover it. 00:27:28.492 [2024-12-08 02:29:56.105304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.105422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.105447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.493 qpair failed and we were unable to recover it. 00:27:28.493 [2024-12-08 02:29:56.105563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.105655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.105680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.493 qpair failed and we were unable to recover it. 00:27:28.493 [2024-12-08 02:29:56.105765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.105899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.105924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.493 qpair failed and we were unable to recover it. 00:27:28.493 [2024-12-08 02:29:56.106013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.106154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.106180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.493 qpair failed and we were unable to recover it. 00:27:28.493 [2024-12-08 02:29:56.106299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.106383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.106410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.493 qpair failed and we were unable to recover it. 00:27:28.493 [2024-12-08 02:29:56.106534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.106652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.106677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.493 qpair failed and we were unable to recover it. 00:27:28.493 [2024-12-08 02:29:56.106768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.106891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.106917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.493 qpair failed and we were unable to recover it. 00:27:28.493 [2024-12-08 02:29:56.107031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.107138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.107163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.493 qpair failed and we were unable to recover it. 00:27:28.493 [2024-12-08 02:29:56.107242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.107352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.107377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.493 qpair failed and we were unable to recover it. 00:27:28.493 [2024-12-08 02:29:56.107491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.107573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.107598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.493 qpair failed and we were unable to recover it. 00:27:28.493 [2024-12-08 02:29:56.107733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.107899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.107924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.493 qpair failed and we were unable to recover it. 00:27:28.493 [2024-12-08 02:29:56.108012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.108152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.108177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.493 qpair failed and we were unable to recover it. 00:27:28.493 [2024-12-08 02:29:56.108319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.108409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.108435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.493 qpair failed and we were unable to recover it. 00:27:28.493 [2024-12-08 02:29:56.108545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.108658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.108683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.493 qpair failed and we were unable to recover it. 00:27:28.493 [2024-12-08 02:29:56.108829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.108938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.108962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.493 qpair failed and we were unable to recover it. 00:27:28.493 [2024-12-08 02:29:56.109080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.109160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.109185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.493 qpair failed and we were unable to recover it. 00:27:28.493 [2024-12-08 02:29:56.109309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.109392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.109418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.493 qpair failed and we were unable to recover it. 00:27:28.493 [2024-12-08 02:29:56.109576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.109694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.109720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.493 qpair failed and we were unable to recover it. 00:27:28.493 [2024-12-08 02:29:56.109860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.109961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.109986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.493 qpair failed and we were unable to recover it. 00:27:28.493 [2024-12-08 02:29:56.110075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.110160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.110187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.493 qpair failed and we were unable to recover it. 00:27:28.493 [2024-12-08 02:29:56.110300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.110413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.110440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.493 qpair failed and we were unable to recover it. 00:27:28.493 [2024-12-08 02:29:56.110534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.110623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.110648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.493 qpair failed and we were unable to recover it. 00:27:28.493 [2024-12-08 02:29:56.110764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.110875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.110899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.493 qpair failed and we were unable to recover it. 00:27:28.493 [2024-12-08 02:29:56.110980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.111060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.111086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.493 qpair failed and we were unable to recover it. 00:27:28.493 [2024-12-08 02:29:56.111175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.111292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.111318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.493 qpair failed and we were unable to recover it. 00:27:28.493 [2024-12-08 02:29:56.111404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.111520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.111554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.493 qpair failed and we were unable to recover it. 00:27:28.493 [2024-12-08 02:29:56.111634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.111745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.111772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.493 qpair failed and we were unable to recover it. 00:27:28.493 [2024-12-08 02:29:56.111891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.112012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.112038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.493 qpair failed and we were unable to recover it. 00:27:28.493 [2024-12-08 02:29:56.112182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.493 [2024-12-08 02:29:56.112293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.112318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.494 qpair failed and we were unable to recover it. 00:27:28.494 [2024-12-08 02:29:56.112435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.112516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.112546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.494 qpair failed and we were unable to recover it. 00:27:28.494 [2024-12-08 02:29:56.112681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.112842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.112867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.494 qpair failed and we were unable to recover it. 00:27:28.494 [2024-12-08 02:29:56.112947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.113058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.113084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.494 qpair failed and we were unable to recover it. 00:27:28.494 [2024-12-08 02:29:56.113204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.113320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.113345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.494 qpair failed and we were unable to recover it. 00:27:28.494 [2024-12-08 02:29:56.113460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.113573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.113600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.494 qpair failed and we were unable to recover it. 00:27:28.494 [2024-12-08 02:29:56.113756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.113924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.113970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.494 qpair failed and we were unable to recover it. 00:27:28.494 [2024-12-08 02:29:56.114094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.114184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.114209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.494 qpair failed and we were unable to recover it. 00:27:28.494 [2024-12-08 02:29:56.114350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.114435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.114461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.494 qpair failed and we were unable to recover it. 00:27:28.494 [2024-12-08 02:29:56.114570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.114708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.114733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.494 qpair failed and we were unable to recover it. 00:27:28.494 [2024-12-08 02:29:56.114811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.114920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.114945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.494 qpair failed and we were unable to recover it. 00:27:28.494 [2024-12-08 02:29:56.115032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.115143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.115168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.494 qpair failed and we were unable to recover it. 00:27:28.494 [2024-12-08 02:29:56.115248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.115339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.115364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.494 qpair failed and we were unable to recover it. 00:27:28.494 [2024-12-08 02:29:56.115453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.115567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.115594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.494 qpair failed and we were unable to recover it. 00:27:28.494 [2024-12-08 02:29:56.115737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.115853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.115879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.494 qpair failed and we were unable to recover it. 00:27:28.494 [2024-12-08 02:29:56.115993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.116112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.116138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.494 qpair failed and we were unable to recover it. 00:27:28.494 [2024-12-08 02:29:56.116279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.116393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.116418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.494 qpair failed and we were unable to recover it. 00:27:28.494 [2024-12-08 02:29:56.116562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.116650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.116675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.494 qpair failed and we were unable to recover it. 00:27:28.494 [2024-12-08 02:29:56.116768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.116852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.116877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.494 qpair failed and we were unable to recover it. 00:27:28.494 [2024-12-08 02:29:56.116969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.117117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.117142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.494 qpair failed and we were unable to recover it. 00:27:28.494 [2024-12-08 02:29:56.117220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.117297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.117323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.494 qpair failed and we were unable to recover it. 00:27:28.494 [2024-12-08 02:29:56.117407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.117524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.117555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.494 qpair failed and we were unable to recover it. 00:27:28.494 [2024-12-08 02:29:56.117665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.117776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.117802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.494 qpair failed and we were unable to recover it. 00:27:28.494 [2024-12-08 02:29:56.117920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.118032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.118059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.494 qpair failed and we were unable to recover it. 00:27:28.494 [2024-12-08 02:29:56.118206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.118318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.118344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.494 qpair failed and we were unable to recover it. 00:27:28.494 [2024-12-08 02:29:56.118454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.118546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.118573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.494 qpair failed and we were unable to recover it. 00:27:28.494 [2024-12-08 02:29:56.118686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.118778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.118805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.494 qpair failed and we were unable to recover it. 00:27:28.494 [2024-12-08 02:29:56.118934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.119038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.119067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.494 qpair failed and we were unable to recover it. 00:27:28.494 [2024-12-08 02:29:56.119178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.119258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.494 [2024-12-08 02:29:56.119283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.494 qpair failed and we were unable to recover it. 00:27:28.495 [2024-12-08 02:29:56.119391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.119502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.119528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.495 qpair failed and we were unable to recover it. 00:27:28.495 [2024-12-08 02:29:56.119657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.119767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.119793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.495 qpair failed and we were unable to recover it. 00:27:28.495 [2024-12-08 02:29:56.119905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.120000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.120026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.495 qpair failed and we were unable to recover it. 00:27:28.495 [2024-12-08 02:29:56.120125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.120232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.120258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.495 qpair failed and we were unable to recover it. 00:27:28.495 [2024-12-08 02:29:56.120400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.120507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.120533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.495 qpair failed and we were unable to recover it. 00:27:28.495 [2024-12-08 02:29:56.120653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.120766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.120792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.495 qpair failed and we were unable to recover it. 00:27:28.495 [2024-12-08 02:29:56.120899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.121014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.121039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.495 qpair failed and we were unable to recover it. 00:27:28.495 [2024-12-08 02:29:56.121122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.121257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.121282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.495 qpair failed and we were unable to recover it. 00:27:28.495 [2024-12-08 02:29:56.121387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.121526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.121586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.495 qpair failed and we were unable to recover it. 00:27:28.495 [2024-12-08 02:29:56.121698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.121839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.121865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.495 qpair failed and we were unable to recover it. 00:27:28.495 [2024-12-08 02:29:56.122007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.122125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.122150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.495 qpair failed and we were unable to recover it. 00:27:28.495 [2024-12-08 02:29:56.122236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.122391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.122416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.495 qpair failed and we were unable to recover it. 00:27:28.495 [2024-12-08 02:29:56.122529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.122700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.122744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.495 qpair failed and we were unable to recover it. 00:27:28.495 [2024-12-08 02:29:56.122843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.122994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.123039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.495 qpair failed and we were unable to recover it. 00:27:28.495 [2024-12-08 02:29:56.123181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.123273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.123299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.495 qpair failed and we were unable to recover it. 00:27:28.495 [2024-12-08 02:29:56.123416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.123522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.123556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.495 qpair failed and we were unable to recover it. 00:27:28.495 [2024-12-08 02:29:56.123658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.123789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.123820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.495 qpair failed and we were unable to recover it. 00:27:28.495 [2024-12-08 02:29:56.123929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.124019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.124047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.495 qpair failed and we were unable to recover it. 00:27:28.495 [2024-12-08 02:29:56.124162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.124303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.124333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.495 qpair failed and we were unable to recover it. 00:27:28.495 [2024-12-08 02:29:56.124455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.124566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.124593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.495 qpair failed and we were unable to recover it. 00:27:28.495 [2024-12-08 02:29:56.124705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.124791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.124816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.495 qpair failed and we were unable to recover it. 00:27:28.495 [2024-12-08 02:29:56.124939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.125019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.125044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.495 qpair failed and we were unable to recover it. 00:27:28.495 [2024-12-08 02:29:56.125158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.125246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.125270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.495 qpair failed and we were unable to recover it. 00:27:28.495 [2024-12-08 02:29:56.125355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.125469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.125495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.495 qpair failed and we were unable to recover it. 00:27:28.495 [2024-12-08 02:29:56.125582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.125723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.125748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.495 qpair failed and we were unable to recover it. 00:27:28.495 [2024-12-08 02:29:56.125874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.125995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.126020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.495 qpair failed and we were unable to recover it. 00:27:28.495 [2024-12-08 02:29:56.126108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.126188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.126213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.495 qpair failed and we were unable to recover it. 00:27:28.495 [2024-12-08 02:29:56.126335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.126444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.126469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.495 qpair failed and we were unable to recover it. 00:27:28.495 [2024-12-08 02:29:56.126586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.495 [2024-12-08 02:29:56.126678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.126709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.496 qpair failed and we were unable to recover it. 00:27:28.496 [2024-12-08 02:29:56.126825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.126948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.126974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.496 qpair failed and we were unable to recover it. 00:27:28.496 [2024-12-08 02:29:56.127087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.127200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.127225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.496 qpair failed and we were unable to recover it. 00:27:28.496 [2024-12-08 02:29:56.127337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.127426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.127451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.496 qpair failed and we were unable to recover it. 00:27:28.496 [2024-12-08 02:29:56.127545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.127627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.127652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.496 qpair failed and we were unable to recover it. 00:27:28.496 [2024-12-08 02:29:56.127769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.127850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.127874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.496 qpair failed and we were unable to recover it. 00:27:28.496 [2024-12-08 02:29:56.127957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.128077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.128102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.496 qpair failed and we were unable to recover it. 00:27:28.496 [2024-12-08 02:29:56.128200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.128312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.128337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.496 qpair failed and we were unable to recover it. 00:27:28.496 [2024-12-08 02:29:56.128447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.128590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.128615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.496 qpair failed and we were unable to recover it. 00:27:28.496 [2024-12-08 02:29:56.128708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.128829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.128854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.496 qpair failed and we were unable to recover it. 00:27:28.496 [2024-12-08 02:29:56.128973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.129084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.129110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.496 qpair failed and we were unable to recover it. 00:27:28.496 [2024-12-08 02:29:56.129193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.129304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.129329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.496 qpair failed and we were unable to recover it. 00:27:28.496 [2024-12-08 02:29:56.129441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.129602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.129628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.496 qpair failed and we were unable to recover it. 00:27:28.496 [2024-12-08 02:29:56.129737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.129864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.129889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.496 qpair failed and we were unable to recover it. 00:27:28.496 [2024-12-08 02:29:56.129984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.130095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.130120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.496 qpair failed and we were unable to recover it. 00:27:28.496 [2024-12-08 02:29:56.130205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.130322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.130347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.496 qpair failed and we were unable to recover it. 00:27:28.496 [2024-12-08 02:29:56.130456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.130574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.130600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.496 qpair failed and we were unable to recover it. 00:27:28.496 [2024-12-08 02:29:56.130718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.130829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.130854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.496 qpair failed and we were unable to recover it. 00:27:28.496 [2024-12-08 02:29:56.131008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.131092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.131117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.496 qpair failed and we were unable to recover it. 00:27:28.496 [2024-12-08 02:29:56.131231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.131352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.131378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.496 qpair failed and we were unable to recover it. 00:27:28.496 [2024-12-08 02:29:56.131494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.131606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.131632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.496 qpair failed and we were unable to recover it. 00:27:28.496 [2024-12-08 02:29:56.131727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.131847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.131873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.496 qpair failed and we were unable to recover it. 00:27:28.496 [2024-12-08 02:29:56.131989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.132128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.132153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.496 qpair failed and we were unable to recover it. 00:27:28.496 [2024-12-08 02:29:56.132259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.132341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.132366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.496 qpair failed and we were unable to recover it. 00:27:28.496 [2024-12-08 02:29:56.132485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.132588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.132614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.496 qpair failed and we were unable to recover it. 00:27:28.496 [2024-12-08 02:29:56.132698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.132814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.132839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.496 qpair failed and we were unable to recover it. 00:27:28.496 [2024-12-08 02:29:56.132919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.132998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.133023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.496 qpair failed and we were unable to recover it. 00:27:28.496 [2024-12-08 02:29:56.133135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.133274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.133300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.496 qpair failed and we were unable to recover it. 00:27:28.496 [2024-12-08 02:29:56.133417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.133529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.496 [2024-12-08 02:29:56.133562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.496 qpair failed and we were unable to recover it. 00:27:28.497 [2024-12-08 02:29:56.133676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.133793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.133819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.497 qpair failed and we were unable to recover it. 00:27:28.497 [2024-12-08 02:29:56.133899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.133972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.133997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.497 qpair failed and we were unable to recover it. 00:27:28.497 [2024-12-08 02:29:56.134084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.134200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.134225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.497 qpair failed and we were unable to recover it. 00:27:28.497 [2024-12-08 02:29:56.134340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.134478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.134503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.497 qpair failed and we were unable to recover it. 00:27:28.497 [2024-12-08 02:29:56.134596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.134679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.134704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.497 qpair failed and we were unable to recover it. 00:27:28.497 [2024-12-08 02:29:56.134784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.134897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.134923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.497 qpair failed and we were unable to recover it. 00:27:28.497 [2024-12-08 02:29:56.135004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.135147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.135174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.497 qpair failed and we were unable to recover it. 00:27:28.497 [2024-12-08 02:29:56.135289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.135376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.135402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.497 qpair failed and we were unable to recover it. 00:27:28.497 [2024-12-08 02:29:56.135548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.135667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.135693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.497 qpair failed and we were unable to recover it. 00:27:28.497 [2024-12-08 02:29:56.135783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.135898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.135924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.497 qpair failed and we were unable to recover it. 00:27:28.497 [2024-12-08 02:29:56.136074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.136214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.136239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.497 qpair failed and we were unable to recover it. 00:27:28.497 [2024-12-08 02:29:56.136350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.136439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.136464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.497 qpair failed and we were unable to recover it. 00:27:28.497 [2024-12-08 02:29:56.136556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.136640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.136666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.497 qpair failed and we were unable to recover it. 00:27:28.497 [2024-12-08 02:29:56.136755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.136892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.136917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.497 qpair failed and we were unable to recover it. 00:27:28.497 [2024-12-08 02:29:56.137009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.137129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.137153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.497 qpair failed and we were unable to recover it. 00:27:28.497 [2024-12-08 02:29:56.137234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.137345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.137370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.497 qpair failed and we were unable to recover it. 00:27:28.497 [2024-12-08 02:29:56.137510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.138160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.138221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.497 qpair failed and we were unable to recover it. 00:27:28.497 [2024-12-08 02:29:56.138414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.138524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.138583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.497 qpair failed and we were unable to recover it. 00:27:28.497 [2024-12-08 02:29:56.138674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.138794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.138819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.497 qpair failed and we were unable to recover it. 00:27:28.497 [2024-12-08 02:29:56.138932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.139046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.139071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.497 qpair failed and we were unable to recover it. 00:27:28.497 [2024-12-08 02:29:56.139162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.139285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.139310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.497 qpair failed and we were unable to recover it. 00:27:28.497 [2024-12-08 02:29:56.139453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.139541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.139567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.497 qpair failed and we were unable to recover it. 00:27:28.497 [2024-12-08 02:29:56.139670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.139753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.139778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.497 qpair failed and we were unable to recover it. 00:27:28.497 [2024-12-08 02:29:56.139892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.140033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.140058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.497 qpair failed and we were unable to recover it. 00:27:28.497 [2024-12-08 02:29:56.140177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.140324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.497 [2024-12-08 02:29:56.140349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.497 qpair failed and we were unable to recover it. 00:27:28.497 [2024-12-08 02:29:56.140449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.140533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.140567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.498 qpair failed and we were unable to recover it. 00:27:28.498 [2024-12-08 02:29:56.140658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.140768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.140793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.498 qpair failed and we were unable to recover it. 00:27:28.498 [2024-12-08 02:29:56.140913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.141056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.141080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.498 qpair failed and we were unable to recover it. 00:27:28.498 [2024-12-08 02:29:56.141171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.141288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.141313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.498 qpair failed and we were unable to recover it. 00:27:28.498 [2024-12-08 02:29:56.141427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.141509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.141544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.498 qpair failed and we were unable to recover it. 00:27:28.498 [2024-12-08 02:29:56.141659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.141777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.141802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.498 qpair failed and we were unable to recover it. 00:27:28.498 [2024-12-08 02:29:56.141917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.142060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.142086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.498 qpair failed and we were unable to recover it. 00:27:28.498 [2024-12-08 02:29:56.142182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.142295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.142322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.498 qpair failed and we were unable to recover it. 00:27:28.498 [2024-12-08 02:29:56.142463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.142579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.142606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.498 qpair failed and we were unable to recover it. 00:27:28.498 [2024-12-08 02:29:56.142695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.142784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.142810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.498 qpair failed and we were unable to recover it. 00:27:28.498 [2024-12-08 02:29:56.142916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.143022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.143047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.498 qpair failed and we were unable to recover it. 00:27:28.498 [2024-12-08 02:29:56.143134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.143241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.143266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.498 qpair failed and we were unable to recover it. 00:27:28.498 [2024-12-08 02:29:56.143349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.143455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.143480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.498 qpair failed and we were unable to recover it. 00:27:28.498 [2024-12-08 02:29:56.143601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.143726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.143751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.498 qpair failed and we were unable to recover it. 00:27:28.498 [2024-12-08 02:29:56.143844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.143983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.144008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.498 qpair failed and we were unable to recover it. 00:27:28.498 [2024-12-08 02:29:56.144124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.144204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.144229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.498 qpair failed and we were unable to recover it. 00:27:28.498 [2024-12-08 02:29:56.144315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.144409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.144435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.498 qpair failed and we were unable to recover it. 00:27:28.498 [2024-12-08 02:29:56.144556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.144697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.144722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.498 qpair failed and we were unable to recover it. 00:27:28.498 [2024-12-08 02:29:56.144859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.144983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.145008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.498 qpair failed and we were unable to recover it. 00:27:28.498 [2024-12-08 02:29:56.145126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.145262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.145295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.498 qpair failed and we were unable to recover it. 00:27:28.498 [2024-12-08 02:29:56.145425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.145547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.145573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.498 qpair failed and we were unable to recover it. 00:27:28.498 [2024-12-08 02:29:56.145692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.145780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.145813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.498 qpair failed and we were unable to recover it. 00:27:28.498 [2024-12-08 02:29:56.145917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.146001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.146026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.498 qpair failed and we were unable to recover it. 00:27:28.498 [2024-12-08 02:29:56.146132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.146218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.146243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.498 qpair failed and we were unable to recover it. 00:27:28.498 [2024-12-08 02:29:56.146326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.146462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.146487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.498 qpair failed and we were unable to recover it. 00:27:28.498 [2024-12-08 02:29:56.146577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.146692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.146718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.498 qpair failed and we were unable to recover it. 00:27:28.498 [2024-12-08 02:29:56.146873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.146981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.147006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.498 qpair failed and we were unable to recover it. 00:27:28.498 [2024-12-08 02:29:56.147128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.147236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.147261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.498 qpair failed and we were unable to recover it. 00:27:28.498 [2024-12-08 02:29:56.147372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.147455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.498 [2024-12-08 02:29:56.147480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.498 qpair failed and we were unable to recover it. 00:27:28.499 [2024-12-08 02:29:56.147613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.147698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.147723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.499 qpair failed and we were unable to recover it. 00:27:28.499 [2024-12-08 02:29:56.147808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.147913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.147939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.499 qpair failed and we were unable to recover it. 00:27:28.499 [2024-12-08 02:29:56.148085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.148194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.148219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.499 qpair failed and we were unable to recover it. 00:27:28.499 [2024-12-08 02:29:56.148335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.148416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.148441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.499 qpair failed and we were unable to recover it. 00:27:28.499 [2024-12-08 02:29:56.148562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.148655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.148680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.499 qpair failed and we were unable to recover it. 00:27:28.499 [2024-12-08 02:29:56.148793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.148905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.148931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.499 qpair failed and we were unable to recover it. 00:27:28.499 [2024-12-08 02:29:56.149080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.149189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.149214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.499 qpair failed and we were unable to recover it. 00:27:28.499 [2024-12-08 02:29:56.149356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.149439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.149464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.499 qpair failed and we were unable to recover it. 00:27:28.499 [2024-12-08 02:29:56.149592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.149719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.149744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.499 qpair failed and we were unable to recover it. 00:27:28.499 [2024-12-08 02:29:56.149835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.149947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.149973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.499 qpair failed and we were unable to recover it. 00:27:28.499 [2024-12-08 02:29:56.150086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.150199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.150224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.499 qpair failed and we were unable to recover it. 00:27:28.499 [2024-12-08 02:29:56.150339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.150430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.150457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.499 qpair failed and we were unable to recover it. 00:27:28.499 [2024-12-08 02:29:56.150580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.150689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.150715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.499 qpair failed and we were unable to recover it. 00:27:28.499 [2024-12-08 02:29:56.150825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.150912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.150939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.499 qpair failed and we were unable to recover it. 00:27:28.499 [2024-12-08 02:29:56.151077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.151183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.151209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.499 qpair failed and we were unable to recover it. 00:27:28.499 [2024-12-08 02:29:56.151322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.151439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.151465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.499 qpair failed and we were unable to recover it. 00:27:28.499 [2024-12-08 02:29:56.151588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.151671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.151697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.499 qpair failed and we were unable to recover it. 00:27:28.499 [2024-12-08 02:29:56.151791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.151930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.151956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.499 qpair failed and we were unable to recover it. 00:27:28.499 [2024-12-08 02:29:56.152037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.152131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.152156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.499 qpair failed and we were unable to recover it. 00:27:28.499 [2024-12-08 02:29:56.152298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.152385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.152409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.499 qpair failed and we were unable to recover it. 00:27:28.499 [2024-12-08 02:29:56.152525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.152661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.152688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.499 qpair failed and we were unable to recover it. 00:27:28.499 [2024-12-08 02:29:56.152803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.152943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.152968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.499 qpair failed and we were unable to recover it. 00:27:28.499 [2024-12-08 02:29:56.153048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.153126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.153151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.499 qpair failed and we were unable to recover it. 00:27:28.499 [2024-12-08 02:29:56.153292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.153432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.153457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.499 qpair failed and we were unable to recover it. 00:27:28.499 [2024-12-08 02:29:56.153569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.153661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.153687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.499 qpair failed and we were unable to recover it. 00:27:28.499 [2024-12-08 02:29:56.153771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.153878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.153903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.499 qpair failed and we were unable to recover it. 00:27:28.499 [2024-12-08 02:29:56.154017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.154160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.154186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.499 qpair failed and we were unable to recover it. 00:27:28.499 [2024-12-08 02:29:56.154329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.154440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.499 [2024-12-08 02:29:56.154465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.499 qpair failed and we were unable to recover it. 00:27:28.499 [2024-12-08 02:29:56.154560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.154675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.154701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.500 qpair failed and we were unable to recover it. 00:27:28.500 [2024-12-08 02:29:56.154815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.154895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.154921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.500 qpair failed and we were unable to recover it. 00:27:28.500 [2024-12-08 02:29:56.155006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.155113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.155139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.500 qpair failed and we were unable to recover it. 00:27:28.500 [2024-12-08 02:29:56.155249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.155333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.155359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.500 qpair failed and we were unable to recover it. 00:27:28.500 [2024-12-08 02:29:56.155501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.155608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.155633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.500 qpair failed and we were unable to recover it. 00:27:28.500 [2024-12-08 02:29:56.155745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.155886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.155911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.500 qpair failed and we were unable to recover it. 00:27:28.500 [2024-12-08 02:29:56.156023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.156134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.156160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.500 qpair failed and we were unable to recover it. 00:27:28.500 [2024-12-08 02:29:56.156249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.156386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.156411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.500 qpair failed and we were unable to recover it. 00:27:28.500 [2024-12-08 02:29:56.156518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.156684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.156709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.500 qpair failed and we were unable to recover it. 00:27:28.500 [2024-12-08 02:29:56.156808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.156948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.156973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.500 qpair failed and we were unable to recover it. 00:27:28.500 [2024-12-08 02:29:56.157120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.157239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.157265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.500 qpair failed and we were unable to recover it. 00:27:28.500 [2024-12-08 02:29:56.157411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.157497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.157522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.500 qpair failed and we were unable to recover it. 00:27:28.500 [2024-12-08 02:29:56.157659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.157776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.157804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.500 qpair failed and we were unable to recover it. 00:27:28.500 [2024-12-08 02:29:56.157927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.158065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.158091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.500 qpair failed and we were unable to recover it. 00:27:28.500 [2024-12-08 02:29:56.158205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.158343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.158368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.500 qpair failed and we were unable to recover it. 00:27:28.500 [2024-12-08 02:29:56.158485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.158580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.158607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.500 qpair failed and we were unable to recover it. 00:27:28.500 [2024-12-08 02:29:56.158716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.158820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.158850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.500 qpair failed and we were unable to recover it. 00:27:28.500 [2024-12-08 02:29:56.159018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.159173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.159198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.500 qpair failed and we were unable to recover it. 00:27:28.500 [2024-12-08 02:29:56.159317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.159427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.159453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.500 qpair failed and we were unable to recover it. 00:27:28.500 [2024-12-08 02:29:56.159594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.159713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.159739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.500 qpair failed and we were unable to recover it. 00:27:28.500 [2024-12-08 02:29:56.159825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.159936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.159966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.500 qpair failed and we were unable to recover it. 00:27:28.500 [2024-12-08 02:29:56.160107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.160245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.160272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.500 qpair failed and we were unable to recover it. 00:27:28.500 [2024-12-08 02:29:56.160360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.160498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.160523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.500 qpair failed and we were unable to recover it. 00:27:28.500 [2024-12-08 02:29:56.160620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.160709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.160735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.500 qpair failed and we were unable to recover it. 00:27:28.500 [2024-12-08 02:29:56.160816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.160929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.160955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.500 qpair failed and we were unable to recover it. 00:27:28.500 [2024-12-08 02:29:56.161044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.161136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.161161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.500 qpair failed and we were unable to recover it. 00:27:28.500 [2024-12-08 02:29:56.161245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.161395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.161421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.500 qpair failed and we were unable to recover it. 00:27:28.500 [2024-12-08 02:29:56.161514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.161608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.161634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.500 qpair failed and we were unable to recover it. 00:27:28.500 [2024-12-08 02:29:56.161728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.161808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.500 [2024-12-08 02:29:56.161835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-12-08 02:29:56.161920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.162004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.162030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-12-08 02:29:56.162123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.162247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.162277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-12-08 02:29:56.162391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.162481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.162507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-12-08 02:29:56.162643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.162728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.162754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-12-08 02:29:56.162841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.162954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.162979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-12-08 02:29:56.163071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.163160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.163186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-12-08 02:29:56.163278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.163391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.163417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-12-08 02:29:56.163528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.163658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.163684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-12-08 02:29:56.163790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.163878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.163906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-12-08 02:29:56.163997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.164103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.164128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-12-08 02:29:56.164241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.164349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.164375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-12-08 02:29:56.164464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.164599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.164631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-12-08 02:29:56.164721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.164796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.164823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-12-08 02:29:56.164939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.165058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.165084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-12-08 02:29:56.165225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.165344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.165369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-12-08 02:29:56.165458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.165571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.165597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-12-08 02:29:56.165679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.165764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.165789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-12-08 02:29:56.165906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.165988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.166015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-12-08 02:29:56.166102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.166222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.166248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-12-08 02:29:56.166387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.166468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.166492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-12-08 02:29:56.166624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.166726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.166751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-12-08 02:29:56.166864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.166975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.167005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-12-08 02:29:56.167102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.167213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.167239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-12-08 02:29:56.167350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.167465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.167491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-12-08 02:29:56.167608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.167693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.501 [2024-12-08 02:29:56.167719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.501 qpair failed and we were unable to recover it. 00:27:28.501 [2024-12-08 02:29:56.167863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.167982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.168006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.502 qpair failed and we were unable to recover it. 00:27:28.502 [2024-12-08 02:29:56.168148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.168259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.168285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.502 qpair failed and we were unable to recover it. 00:27:28.502 [2024-12-08 02:29:56.168401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.168509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.168534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.502 qpair failed and we were unable to recover it. 00:27:28.502 [2024-12-08 02:29:56.168660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.168839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.168881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.502 qpair failed and we were unable to recover it. 00:27:28.502 [2024-12-08 02:29:56.168996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.169134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.169159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.502 qpair failed and we were unable to recover it. 00:27:28.502 [2024-12-08 02:29:56.169282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.169394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.169419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.502 qpair failed and we were unable to recover it. 00:27:28.502 [2024-12-08 02:29:56.169533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.169643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.169671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.502 qpair failed and we were unable to recover it. 00:27:28.502 [2024-12-08 02:29:56.169784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.169917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.169943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.502 qpair failed and we were unable to recover it. 00:27:28.502 [2024-12-08 02:29:56.170056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.170199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.170224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.502 qpair failed and we were unable to recover it. 00:27:28.502 [2024-12-08 02:29:56.170337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.170420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.170445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.502 qpair failed and we were unable to recover it. 00:27:28.502 [2024-12-08 02:29:56.170582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.170669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.170695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.502 qpair failed and we were unable to recover it. 00:27:28.502 [2024-12-08 02:29:56.170834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.170921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.170947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.502 qpair failed and we were unable to recover it. 00:27:28.502 [2024-12-08 02:29:56.171033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.171120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.171145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.502 qpair failed and we were unable to recover it. 00:27:28.502 [2024-12-08 02:29:56.171283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.171424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.171449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.502 qpair failed and we were unable to recover it. 00:27:28.502 [2024-12-08 02:29:56.171543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.171685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.171711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.502 qpair failed and we were unable to recover it. 00:27:28.502 [2024-12-08 02:29:56.171861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.171943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.171968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.502 qpair failed and we were unable to recover it. 00:27:28.502 [2024-12-08 02:29:56.172048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.172159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.172183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.502 qpair failed and we were unable to recover it. 00:27:28.502 [2024-12-08 02:29:56.172274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.172387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.172412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.502 qpair failed and we were unable to recover it. 00:27:28.502 [2024-12-08 02:29:56.172533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.172629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.172654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.502 qpair failed and we were unable to recover it. 00:27:28.502 [2024-12-08 02:29:56.172741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.172853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.172877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.502 qpair failed and we were unable to recover it. 00:27:28.502 [2024-12-08 02:29:56.172988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.173133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.173158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.502 qpair failed and we were unable to recover it. 00:27:28.502 [2024-12-08 02:29:56.173272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.173352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.173376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.502 qpair failed and we were unable to recover it. 00:27:28.502 [2024-12-08 02:29:56.173490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.173575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.173601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.502 qpair failed and we were unable to recover it. 00:27:28.502 [2024-12-08 02:29:56.173719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.173881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.173906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.502 qpair failed and we were unable to recover it. 00:27:28.502 [2024-12-08 02:29:56.174044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.174182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.174207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.502 qpair failed and we were unable to recover it. 00:27:28.502 [2024-12-08 02:29:56.174417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.174566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.174592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.502 qpair failed and we were unable to recover it. 00:27:28.502 [2024-12-08 02:29:56.174697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.174831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.174856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.502 qpair failed and we were unable to recover it. 00:27:28.502 [2024-12-08 02:29:56.174975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.175094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.175120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.502 qpair failed and we were unable to recover it. 00:27:28.502 [2024-12-08 02:29:56.175238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.175348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.502 [2024-12-08 02:29:56.175373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.502 qpair failed and we were unable to recover it. 00:27:28.503 [2024-12-08 02:29:56.175485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.175602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.175628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.503 qpair failed and we were unable to recover it. 00:27:28.503 [2024-12-08 02:29:56.175740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.175830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.175855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.503 qpair failed and we were unable to recover it. 00:27:28.503 [2024-12-08 02:29:56.175934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.176061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.176086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.503 qpair failed and we were unable to recover it. 00:27:28.503 [2024-12-08 02:29:56.176197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.176313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.176338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.503 qpair failed and we were unable to recover it. 00:27:28.503 [2024-12-08 02:29:56.176474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.176557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.176582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.503 qpair failed and we were unable to recover it. 00:27:28.503 [2024-12-08 02:29:56.176675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.176814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.176839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.503 qpair failed and we were unable to recover it. 00:27:28.503 [2024-12-08 02:29:56.176950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.177091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.177116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.503 qpair failed and we were unable to recover it. 00:27:28.503 [2024-12-08 02:29:56.177207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.177297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.177322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.503 qpair failed and we were unable to recover it. 00:27:28.503 [2024-12-08 02:29:56.177417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.177560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.177586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.503 qpair failed and we were unable to recover it. 00:27:28.503 [2024-12-08 02:29:56.177677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.177785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.177809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.503 qpair failed and we were unable to recover it. 00:27:28.503 [2024-12-08 02:29:56.177920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.178031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.178056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.503 qpair failed and we were unable to recover it. 00:27:28.503 [2024-12-08 02:29:56.178168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.178277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.178301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.503 qpair failed and we were unable to recover it. 00:27:28.503 [2024-12-08 02:29:56.178400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.178508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.178532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.503 qpair failed and we were unable to recover it. 00:27:28.503 [2024-12-08 02:29:56.178652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.178740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.178766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.503 qpair failed and we were unable to recover it. 00:27:28.503 [2024-12-08 02:29:56.178850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.178988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.179013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.503 qpair failed and we were unable to recover it. 00:27:28.503 [2024-12-08 02:29:56.179136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.179256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.179281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.503 qpair failed and we were unable to recover it. 00:27:28.503 [2024-12-08 02:29:56.179422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.179503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.179529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.503 qpair failed and we were unable to recover it. 00:27:28.503 [2024-12-08 02:29:56.179662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.179792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.179818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.503 qpair failed and we were unable to recover it. 00:27:28.503 [2024-12-08 02:29:56.179934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.180046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.180071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.503 qpair failed and we were unable to recover it. 00:27:28.503 [2024-12-08 02:29:56.180184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.180267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.180292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.503 qpair failed and we were unable to recover it. 00:27:28.503 [2024-12-08 02:29:56.180434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.180519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.180552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.503 qpair failed and we were unable to recover it. 00:27:28.503 [2024-12-08 02:29:56.180642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.180747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.180773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.503 qpair failed and we were unable to recover it. 00:27:28.503 [2024-12-08 02:29:56.180885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.180998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.181024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.503 qpair failed and we were unable to recover it. 00:27:28.503 [2024-12-08 02:29:56.181107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.181248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.181274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.503 qpair failed and we were unable to recover it. 00:27:28.503 [2024-12-08 02:29:56.181393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.181473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.181503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.503 qpair failed and we were unable to recover it. 00:27:28.503 [2024-12-08 02:29:56.181626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.181717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.181742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.503 qpair failed and we were unable to recover it. 00:27:28.503 [2024-12-08 02:29:56.181890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.181964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.181989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.503 qpair failed and we were unable to recover it. 00:27:28.503 [2024-12-08 02:29:56.182104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.182190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.503 [2024-12-08 02:29:56.182215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.503 qpair failed and we were unable to recover it. 00:27:28.504 [2024-12-08 02:29:56.182308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.182427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.182453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.504 qpair failed and we were unable to recover it. 00:27:28.504 [2024-12-08 02:29:56.182551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.182654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.182680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.504 qpair failed and we were unable to recover it. 00:27:28.504 [2024-12-08 02:29:56.182825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.182966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.182992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.504 qpair failed and we were unable to recover it. 00:27:28.504 [2024-12-08 02:29:56.183108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.183232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.183259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.504 qpair failed and we were unable to recover it. 00:27:28.504 [2024-12-08 02:29:56.183376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.183489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.183515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.504 qpair failed and we were unable to recover it. 00:27:28.504 [2024-12-08 02:29:56.183608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.183700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.183725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.504 qpair failed and we were unable to recover it. 00:27:28.504 [2024-12-08 02:29:56.183803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.183942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.183968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.504 qpair failed and we were unable to recover it. 00:27:28.504 [2024-12-08 02:29:56.184077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.184154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.184178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.504 qpair failed and we were unable to recover it. 00:27:28.504 [2024-12-08 02:29:56.184293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.184383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.184407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.504 qpair failed and we were unable to recover it. 00:27:28.504 [2024-12-08 02:29:56.184498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.184640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.184668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.504 qpair failed and we were unable to recover it. 00:27:28.504 [2024-12-08 02:29:56.184855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.184993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.185022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.504 qpair failed and we were unable to recover it. 00:27:28.504 [2024-12-08 02:29:56.185122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.185236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.185263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.504 qpair failed and we were unable to recover it. 00:27:28.504 [2024-12-08 02:29:56.185350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.185433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.185458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.504 qpair failed and we were unable to recover it. 00:27:28.504 [2024-12-08 02:29:56.185589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.185715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.185741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.504 qpair failed and we were unable to recover it. 00:27:28.504 [2024-12-08 02:29:56.185855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.185940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.185965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.504 qpair failed and we were unable to recover it. 00:27:28.504 [2024-12-08 02:29:56.186043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.186192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.186217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.504 qpair failed and we were unable to recover it. 00:27:28.504 [2024-12-08 02:29:56.186330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.186434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.186458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.504 qpair failed and we were unable to recover it. 00:27:28.504 [2024-12-08 02:29:56.186550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.186645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.186670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.504 qpair failed and we were unable to recover it. 00:27:28.504 [2024-12-08 02:29:56.186760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.186866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.186890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.504 qpair failed and we were unable to recover it. 00:27:28.504 [2024-12-08 02:29:56.187007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.187085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.187109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.504 qpair failed and we were unable to recover it. 00:27:28.504 [2024-12-08 02:29:56.187195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.187287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.187312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.504 qpair failed and we were unable to recover it. 00:27:28.504 [2024-12-08 02:29:56.187420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.187528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.187563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.504 qpair failed and we were unable to recover it. 00:27:28.504 [2024-12-08 02:29:56.187709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.187793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.187817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.504 qpair failed and we were unable to recover it. 00:27:28.504 [2024-12-08 02:29:56.187904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.188019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.188044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.504 qpair failed and we were unable to recover it. 00:27:28.504 [2024-12-08 02:29:56.188163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.188246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.188270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.504 qpair failed and we were unable to recover it. 00:27:28.504 [2024-12-08 02:29:56.188389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.188493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.188517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.504 qpair failed and we were unable to recover it. 00:27:28.504 [2024-12-08 02:29:56.188682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.188791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.188817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.504 qpair failed and we were unable to recover it. 00:27:28.504 [2024-12-08 02:29:56.188951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.189105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.189134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.504 qpair failed and we were unable to recover it. 00:27:28.504 [2024-12-08 02:29:56.189282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.189416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.189441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.504 qpair failed and we were unable to recover it. 00:27:28.504 [2024-12-08 02:29:56.189560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.189659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.504 [2024-12-08 02:29:56.189684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.504 qpair failed and we were unable to recover it. 00:27:28.504 [2024-12-08 02:29:56.189772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.189925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.189950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.505 qpair failed and we were unable to recover it. 00:27:28.505 [2024-12-08 02:29:56.190094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.190205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.190230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.505 qpair failed and we were unable to recover it. 00:27:28.505 [2024-12-08 02:29:56.190332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.190443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.190468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.505 qpair failed and we were unable to recover it. 00:27:28.505 [2024-12-08 02:29:56.190583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.190674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.190699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.505 qpair failed and we were unable to recover it. 00:27:28.505 [2024-12-08 02:29:56.190789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.190901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.190925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.505 qpair failed and we were unable to recover it. 00:27:28.505 [2024-12-08 02:29:56.191007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.191149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.191176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.505 qpair failed and we were unable to recover it. 00:27:28.505 [2024-12-08 02:29:56.191263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.191377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.191403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.505 qpair failed and we were unable to recover it. 00:27:28.505 [2024-12-08 02:29:56.191516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.191608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.191634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.505 qpair failed and we were unable to recover it. 00:27:28.505 [2024-12-08 02:29:56.191775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.191847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.191872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.505 qpair failed and we were unable to recover it. 00:27:28.505 [2024-12-08 02:29:56.191981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.192100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.192125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.505 qpair failed and we were unable to recover it. 00:27:28.505 [2024-12-08 02:29:56.192268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.192395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.192425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.505 qpair failed and we were unable to recover it. 00:27:28.505 [2024-12-08 02:29:56.192587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.192715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.192745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.505 qpair failed and we were unable to recover it. 00:27:28.505 [2024-12-08 02:29:56.192878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.193017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.193043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.505 qpair failed and we were unable to recover it. 00:27:28.505 [2024-12-08 02:29:56.193188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.193297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.193325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.505 qpair failed and we were unable to recover it. 00:27:28.505 [2024-12-08 02:29:56.193413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.193507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.193533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.505 qpair failed and we were unable to recover it. 00:27:28.505 [2024-12-08 02:29:56.193670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.193773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.193798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.505 qpair failed and we were unable to recover it. 00:27:28.505 [2024-12-08 02:29:56.193884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.193996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.194022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.505 qpair failed and we were unable to recover it. 00:27:28.505 [2024-12-08 02:29:56.194133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.194251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.194276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.505 qpair failed and we were unable to recover it. 00:27:28.505 [2024-12-08 02:29:56.194363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.194479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.194504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.505 qpair failed and we were unable to recover it. 00:27:28.505 [2024-12-08 02:29:56.194623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.194745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.194770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.505 qpair failed and we were unable to recover it. 00:27:28.505 [2024-12-08 02:29:56.194882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.194988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.195017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.505 qpair failed and we were unable to recover it. 00:27:28.505 [2024-12-08 02:29:56.195161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.195271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.195296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.505 qpair failed and we were unable to recover it. 00:27:28.505 [2024-12-08 02:29:56.195416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.195511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.195545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.505 qpair failed and we were unable to recover it. 00:27:28.505 [2024-12-08 02:29:56.195664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.195749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.195773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.505 qpair failed and we were unable to recover it. 00:27:28.505 [2024-12-08 02:29:56.195863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.195971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.195997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.505 qpair failed and we were unable to recover it. 00:27:28.505 [2024-12-08 02:29:56.196084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.196195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.196220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.505 qpair failed and we were unable to recover it. 00:27:28.505 [2024-12-08 02:29:56.196308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.196450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.196476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.505 qpair failed and we were unable to recover it. 00:27:28.505 [2024-12-08 02:29:56.196579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.196730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.196755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.505 qpair failed and we were unable to recover it. 00:27:28.505 [2024-12-08 02:29:56.196845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.196924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.196949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.505 qpair failed and we were unable to recover it. 00:27:28.505 [2024-12-08 02:29:56.197063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.197190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.197215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.505 qpair failed and we were unable to recover it. 00:27:28.505 [2024-12-08 02:29:56.197329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.197440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.505 [2024-12-08 02:29:56.197469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.505 qpair failed and we were unable to recover it. 00:27:28.505 [2024-12-08 02:29:56.197583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.197706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.197732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.506 qpair failed and we were unable to recover it. 00:27:28.506 [2024-12-08 02:29:56.197843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.197988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.198013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.506 qpair failed and we were unable to recover it. 00:27:28.506 [2024-12-08 02:29:56.198098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.198210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.198236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.506 qpair failed and we were unable to recover it. 00:27:28.506 [2024-12-08 02:29:56.198354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.198463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.198488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.506 qpair failed and we were unable to recover it. 00:27:28.506 [2024-12-08 02:29:56.198567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.198657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.198682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.506 qpair failed and we were unable to recover it. 00:27:28.506 [2024-12-08 02:29:56.198770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.198886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.198910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.506 qpair failed and we were unable to recover it. 00:27:28.506 [2024-12-08 02:29:56.199053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.199164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.199189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.506 qpair failed and we were unable to recover it. 00:27:28.506 [2024-12-08 02:29:56.199311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.199422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.199446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.506 qpair failed and we were unable to recover it. 00:27:28.506 [2024-12-08 02:29:56.199562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.199652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.199677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.506 qpair failed and we were unable to recover it. 00:27:28.506 [2024-12-08 02:29:56.199818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.199922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.199946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.506 qpair failed and we were unable to recover it. 00:27:28.506 [2024-12-08 02:29:56.200039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.200130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.200156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.506 qpair failed and we were unable to recover it. 00:27:28.506 [2024-12-08 02:29:56.200278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.200405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.200430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.506 qpair failed and we were unable to recover it. 00:27:28.506 [2024-12-08 02:29:56.200512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.200608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.200633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.506 qpair failed and we were unable to recover it. 00:27:28.506 [2024-12-08 02:29:56.200776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.200894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.200920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.506 qpair failed and we were unable to recover it. 00:27:28.506 [2024-12-08 02:29:56.201002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.201083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.201108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.506 qpair failed and we were unable to recover it. 00:27:28.506 [2024-12-08 02:29:56.201254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.201338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.201363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.506 qpair failed and we were unable to recover it. 00:27:28.506 [2024-12-08 02:29:56.201470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.201574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.201600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.506 qpair failed and we were unable to recover it. 00:27:28.506 [2024-12-08 02:29:56.201714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.201799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.201824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.506 qpair failed and we were unable to recover it. 00:27:28.506 [2024-12-08 02:29:56.201946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.202084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.202109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.506 qpair failed and we were unable to recover it. 00:27:28.506 [2024-12-08 02:29:56.202222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.202332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.202357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.506 qpair failed and we were unable to recover it. 00:27:28.506 [2024-12-08 02:29:56.202472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.506 [2024-12-08 02:29:56.202594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.202619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.507 qpair failed and we were unable to recover it. 00:27:28.507 [2024-12-08 02:29:56.202741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.202830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.202856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.507 qpair failed and we were unable to recover it. 00:27:28.507 [2024-12-08 02:29:56.202941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.203059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.203085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.507 qpair failed and we were unable to recover it. 00:27:28.507 [2024-12-08 02:29:56.203202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.203309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.203334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.507 qpair failed and we were unable to recover it. 00:27:28.507 [2024-12-08 02:29:56.203418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.203535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.203568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.507 qpair failed and we were unable to recover it. 00:27:28.507 [2024-12-08 02:29:56.203655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.203762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.203788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.507 qpair failed and we were unable to recover it. 00:27:28.507 [2024-12-08 02:29:56.203868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.203955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.203979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.507 qpair failed and we were unable to recover it. 00:27:28.507 [2024-12-08 02:29:56.204073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.204211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.204237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.507 qpair failed and we were unable to recover it. 00:27:28.507 [2024-12-08 02:29:56.204351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.204444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.204470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.507 qpair failed and we were unable to recover it. 00:27:28.507 [2024-12-08 02:29:56.204576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.204691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.204717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.507 qpair failed and we were unable to recover it. 00:27:28.507 [2024-12-08 02:29:56.204813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.204919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.204944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.507 qpair failed and we were unable to recover it. 00:27:28.507 [2024-12-08 02:29:56.205056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.205168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.205193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.507 qpair failed and we were unable to recover it. 00:27:28.507 [2024-12-08 02:29:56.205315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.205424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.205450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.507 qpair failed and we were unable to recover it. 00:27:28.507 [2024-12-08 02:29:56.205593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.205712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.205738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.507 qpair failed and we were unable to recover it. 00:27:28.507 [2024-12-08 02:29:56.205828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.205937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.205962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.507 qpair failed and we were unable to recover it. 00:27:28.507 [2024-12-08 02:29:56.206054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.206192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.206218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.507 qpair failed and we were unable to recover it. 00:27:28.507 [2024-12-08 02:29:56.206332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.206421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.206446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.507 qpair failed and we were unable to recover it. 00:27:28.507 [2024-12-08 02:29:56.206569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.206656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.206681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.507 qpair failed and we were unable to recover it. 00:27:28.507 [2024-12-08 02:29:56.206772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.206911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.206935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.507 qpair failed and we were unable to recover it. 00:27:28.507 [2024-12-08 02:29:56.207078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.207190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.207218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.507 qpair failed and we were unable to recover it. 00:27:28.507 [2024-12-08 02:29:56.207338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.207448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.207473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.507 qpair failed and we were unable to recover it. 00:27:28.507 [2024-12-08 02:29:56.207585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.207715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.207740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.507 qpair failed and we were unable to recover it. 00:27:28.507 [2024-12-08 02:29:56.207878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.207959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.207984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.507 qpair failed and we were unable to recover it. 00:27:28.507 [2024-12-08 02:29:56.208072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.208183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.208209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.507 qpair failed and we were unable to recover it. 00:27:28.507 [2024-12-08 02:29:56.208334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.208446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.208471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.507 qpair failed and we were unable to recover it. 00:27:28.507 [2024-12-08 02:29:56.208612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.208703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.208728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.507 qpair failed and we were unable to recover it. 00:27:28.507 [2024-12-08 02:29:56.208871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.208957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.208981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.507 qpair failed and we were unable to recover it. 00:27:28.507 [2024-12-08 02:29:56.209091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.209172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.209196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.507 qpair failed and we were unable to recover it. 00:27:28.507 [2024-12-08 02:29:56.209289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.507 [2024-12-08 02:29:56.209364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.209390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.508 qpair failed and we were unable to recover it. 00:27:28.508 [2024-12-08 02:29:56.209473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.209590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.209617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.508 qpair failed and we were unable to recover it. 00:27:28.508 [2024-12-08 02:29:56.209739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.209851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.209877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.508 qpair failed and we were unable to recover it. 00:27:28.508 [2024-12-08 02:29:56.209994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.210099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.210125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.508 qpair failed and we were unable to recover it. 00:27:28.508 [2024-12-08 02:29:56.210242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.210359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.210385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.508 qpair failed and we were unable to recover it. 00:27:28.508 [2024-12-08 02:29:56.210509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.210624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.210650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.508 qpair failed and we were unable to recover it. 00:27:28.508 [2024-12-08 02:29:56.210776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.210946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.210972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.508 qpair failed and we were unable to recover it. 00:27:28.508 [2024-12-08 02:29:56.211082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.211191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.211216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.508 qpair failed and we were unable to recover it. 00:27:28.508 [2024-12-08 02:29:56.211355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.211478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.211503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.508 qpair failed and we were unable to recover it. 00:27:28.508 [2024-12-08 02:29:56.211649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.211796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.211824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.508 qpair failed and we were unable to recover it. 00:27:28.508 [2024-12-08 02:29:56.211930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.212007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.212033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.508 qpair failed and we were unable to recover it. 00:27:28.508 [2024-12-08 02:29:56.212151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.212290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.212315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.508 qpair failed and we were unable to recover it. 00:27:28.508 [2024-12-08 02:29:56.212403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.212491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.212516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.508 qpair failed and we were unable to recover it. 00:27:28.508 [2024-12-08 02:29:56.212659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.212816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.212844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.508 qpair failed and we were unable to recover it. 00:27:28.508 [2024-12-08 02:29:56.212987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.213097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.213122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.508 qpair failed and we were unable to recover it. 00:27:28.508 [2024-12-08 02:29:56.213215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.213297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.213322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.508 qpair failed and we were unable to recover it. 00:27:28.508 [2024-12-08 02:29:56.213413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.213497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.213521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.508 qpair failed and we were unable to recover it. 00:27:28.508 [2024-12-08 02:29:56.213625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.213732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.213757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.508 qpair failed and we were unable to recover it. 00:27:28.508 [2024-12-08 02:29:56.213884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.213966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.213991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.508 qpair failed and we were unable to recover it. 00:27:28.508 [2024-12-08 02:29:56.214111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.214216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.214241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.508 qpair failed and we were unable to recover it. 00:27:28.508 [2024-12-08 02:29:56.214354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.214507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.508 [2024-12-08 02:29:56.214531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.508 qpair failed and we were unable to recover it. 00:27:28.508 [2024-12-08 02:29:56.214684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.214806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.214834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.803 qpair failed and we were unable to recover it. 00:27:28.803 [2024-12-08 02:29:56.214957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.215080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.215109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.803 qpair failed and we were unable to recover it. 00:27:28.803 [2024-12-08 02:29:56.215196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.215325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.215349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.803 qpair failed and we were unable to recover it. 00:27:28.803 [2024-12-08 02:29:56.215468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.215578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.215605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.803 qpair failed and we were unable to recover it. 00:27:28.803 [2024-12-08 02:29:56.215697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.215818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.215842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.803 qpair failed and we were unable to recover it. 00:27:28.803 [2024-12-08 02:29:56.215993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.216108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.216135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.803 qpair failed and we were unable to recover it. 00:27:28.803 [2024-12-08 02:29:56.216255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.216342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.216369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.803 qpair failed and we were unable to recover it. 00:27:28.803 [2024-12-08 02:29:56.216464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.216560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.216611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.803 qpair failed and we were unable to recover it. 00:27:28.803 [2024-12-08 02:29:56.216702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.216820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.216845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.803 qpair failed and we were unable to recover it. 00:27:28.803 [2024-12-08 02:29:56.216973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.217103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.217130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.803 qpair failed and we were unable to recover it. 00:27:28.803 [2024-12-08 02:29:56.217218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.217334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.217360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.803 qpair failed and we were unable to recover it. 00:27:28.803 [2024-12-08 02:29:56.217461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.217602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.217628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.803 qpair failed and we were unable to recover it. 00:27:28.803 [2024-12-08 02:29:56.217746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.217855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.217879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.803 qpair failed and we were unable to recover it. 00:27:28.803 [2024-12-08 02:29:56.218027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.218145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.218172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.803 qpair failed and we were unable to recover it. 00:27:28.803 [2024-12-08 02:29:56.218262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.218376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.218404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.803 qpair failed and we were unable to recover it. 00:27:28.803 [2024-12-08 02:29:56.218502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.218619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.218644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.803 qpair failed and we were unable to recover it. 00:27:28.803 [2024-12-08 02:29:56.218735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.218830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.218855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.803 qpair failed and we were unable to recover it. 00:27:28.803 [2024-12-08 02:29:56.218983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.219129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.219157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.803 qpair failed and we were unable to recover it. 00:27:28.803 [2024-12-08 02:29:56.219280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.219440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.803 [2024-12-08 02:29:56.219468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.803 qpair failed and we were unable to recover it. 00:27:28.803 [2024-12-08 02:29:56.219604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.219695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.219719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.804 qpair failed and we were unable to recover it. 00:27:28.804 [2024-12-08 02:29:56.219820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.219935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.219963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.804 qpair failed and we were unable to recover it. 00:27:28.804 [2024-12-08 02:29:56.220081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.220209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.220242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.804 qpair failed and we were unable to recover it. 00:27:28.804 [2024-12-08 02:29:56.220335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.220455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.220483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.804 qpair failed and we were unable to recover it. 00:27:28.804 [2024-12-08 02:29:56.220614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.220705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.220731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.804 qpair failed and we were unable to recover it. 00:27:28.804 [2024-12-08 02:29:56.220843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.220954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.220979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.804 qpair failed and we were unable to recover it. 00:27:28.804 [2024-12-08 02:29:56.221123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.221226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.221254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.804 qpair failed and we were unable to recover it. 00:27:28.804 [2024-12-08 02:29:56.221377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.221499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.221527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.804 qpair failed and we were unable to recover it. 00:27:28.804 [2024-12-08 02:29:56.221648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.221729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.221754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.804 qpair failed and we were unable to recover it. 00:27:28.804 [2024-12-08 02:29:56.221845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.221967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.221995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.804 qpair failed and we were unable to recover it. 00:27:28.804 [2024-12-08 02:29:56.222106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.222223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.222251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.804 qpair failed and we were unable to recover it. 00:27:28.804 [2024-12-08 02:29:56.222344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.222456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.222484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.804 qpair failed and we were unable to recover it. 00:27:28.804 [2024-12-08 02:29:56.222669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.222759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.222784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.804 qpair failed and we were unable to recover it. 00:27:28.804 [2024-12-08 02:29:56.223020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.223108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.223135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.804 qpair failed and we were unable to recover it. 00:27:28.804 [2024-12-08 02:29:56.223287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.223377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.223405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.804 qpair failed and we were unable to recover it. 00:27:28.804 [2024-12-08 02:29:56.223543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.223676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.223700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.804 qpair failed and we were unable to recover it. 00:27:28.804 [2024-12-08 02:29:56.223791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.223932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.223959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.804 qpair failed and we were unable to recover it. 00:27:28.804 [2024-12-08 02:29:56.224097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.224264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.224292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.804 qpair failed and we were unable to recover it. 00:27:28.804 [2024-12-08 02:29:56.224385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.224534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.224586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.804 qpair failed and we were unable to recover it. 00:27:28.804 [2024-12-08 02:29:56.224697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.224784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.224808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.804 qpair failed and we were unable to recover it. 00:27:28.804 [2024-12-08 02:29:56.224895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.225009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.225034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.804 qpair failed and we were unable to recover it. 00:27:28.804 [2024-12-08 02:29:56.225143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.225260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.225288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.804 qpair failed and we were unable to recover it. 00:27:28.804 [2024-12-08 02:29:56.225418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.225513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.225554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.804 qpair failed and we were unable to recover it. 00:27:28.804 [2024-12-08 02:29:56.225697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.225783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.225809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.804 qpair failed and we were unable to recover it. 00:27:28.804 [2024-12-08 02:29:56.225892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.226017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.226045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.804 qpair failed and we were unable to recover it. 00:27:28.804 [2024-12-08 02:29:56.226144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.226307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.226334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.804 qpair failed and we were unable to recover it. 00:27:28.804 [2024-12-08 02:29:56.226456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.226555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.226595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.804 qpair failed and we were unable to recover it. 00:27:28.804 [2024-12-08 02:29:56.226706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.226787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.226812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.804 qpair failed and we were unable to recover it. 00:27:28.804 [2024-12-08 02:29:56.226986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.227105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.804 [2024-12-08 02:29:56.227132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.804 qpair failed and we were unable to recover it. 00:27:28.805 [2024-12-08 02:29:56.227295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.227382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.227406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.805 qpair failed and we were unable to recover it. 00:27:28.805 [2024-12-08 02:29:56.227523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.227651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.227676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.805 qpair failed and we were unable to recover it. 00:27:28.805 [2024-12-08 02:29:56.227758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.227840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.227865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.805 qpair failed and we were unable to recover it. 00:27:28.805 [2024-12-08 02:29:56.227950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.228037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.228061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.805 qpair failed and we were unable to recover it. 00:27:28.805 [2024-12-08 02:29:56.228142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.228223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.228248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.805 qpair failed and we were unable to recover it. 00:27:28.805 [2024-12-08 02:29:56.228360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.228502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.228530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.805 qpair failed and we were unable to recover it. 00:27:28.805 [2024-12-08 02:29:56.228685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.228775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.228800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.805 qpair failed and we were unable to recover it. 00:27:28.805 [2024-12-08 02:29:56.228885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.229024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.229049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.805 qpair failed and we were unable to recover it. 00:27:28.805 [2024-12-08 02:29:56.229189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.229295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.229319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.805 qpair failed and we were unable to recover it. 00:27:28.805 [2024-12-08 02:29:56.229401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.229474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.229500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.805 qpair failed and we were unable to recover it. 00:27:28.805 [2024-12-08 02:29:56.229648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.229727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.229752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.805 qpair failed and we were unable to recover it. 00:27:28.805 [2024-12-08 02:29:56.229836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.229916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.229940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.805 qpair failed and we were unable to recover it. 00:27:28.805 [2024-12-08 02:29:56.230081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.230186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.230210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.805 qpair failed and we were unable to recover it. 00:27:28.805 [2024-12-08 02:29:56.230339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.230425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.230453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.805 qpair failed and we were unable to recover it. 00:27:28.805 [2024-12-08 02:29:56.230573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.230722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.230751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.805 qpair failed and we were unable to recover it. 00:27:28.805 [2024-12-08 02:29:56.230855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.230975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.231003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.805 qpair failed and we were unable to recover it. 00:27:28.805 [2024-12-08 02:29:56.231109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.231199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.231224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.805 qpair failed and we were unable to recover it. 00:27:28.805 [2024-12-08 02:29:56.231308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.231425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.231450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.805 qpair failed and we were unable to recover it. 00:27:28.805 [2024-12-08 02:29:56.231546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.231684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.231712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.805 qpair failed and we were unable to recover it. 00:27:28.805 [2024-12-08 02:29:56.231843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.231939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.231966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.805 qpair failed and we were unable to recover it. 00:27:28.805 [2024-12-08 02:29:56.232072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.232188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.232212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.805 qpair failed and we were unable to recover it. 00:27:28.805 [2024-12-08 02:29:56.232302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.232411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.232435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.805 qpair failed and we were unable to recover it. 00:27:28.805 [2024-12-08 02:29:56.232521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.232632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.232657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.805 qpair failed and we were unable to recover it. 00:27:28.805 [2024-12-08 02:29:56.232742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.232852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.232877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.805 qpair failed and we were unable to recover it. 00:27:28.805 [2024-12-08 02:29:56.233028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.233101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.233129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.805 qpair failed and we were unable to recover it. 00:27:28.805 [2024-12-08 02:29:56.233212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.233298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.233323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.805 qpair failed and we were unable to recover it. 00:27:28.805 [2024-12-08 02:29:56.233487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.233607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.233635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.805 qpair failed and we were unable to recover it. 00:27:28.805 [2024-12-08 02:29:56.233753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.233847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.233874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.805 qpair failed and we were unable to recover it. 00:27:28.805 [2024-12-08 02:29:56.233987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.234067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.805 [2024-12-08 02:29:56.234092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.805 qpair failed and we were unable to recover it. 00:27:28.806 [2024-12-08 02:29:56.234199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.234336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.234363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.806 qpair failed and we were unable to recover it. 00:27:28.806 [2024-12-08 02:29:56.234488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.234640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.234669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.806 qpair failed and we were unable to recover it. 00:27:28.806 [2024-12-08 02:29:56.234791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.234909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.234937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.806 qpair failed and we were unable to recover it. 00:27:28.806 [2024-12-08 02:29:56.235100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.235213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.235237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.806 qpair failed and we were unable to recover it. 00:27:28.806 [2024-12-08 02:29:56.235377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.235488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.235512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.806 qpair failed and we were unable to recover it. 00:27:28.806 [2024-12-08 02:29:56.235619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.235740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.235767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.806 qpair failed and we were unable to recover it. 00:27:28.806 [2024-12-08 02:29:56.235899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.236043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.236070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.806 qpair failed and we were unable to recover it. 00:27:28.806 [2024-12-08 02:29:56.236201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.236315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.236339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.806 qpair failed and we were unable to recover it. 00:27:28.806 [2024-12-08 02:29:56.236468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.236615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.236643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.806 qpair failed and we were unable to recover it. 00:27:28.806 [2024-12-08 02:29:56.236762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.236854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.236881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.806 qpair failed and we were unable to recover it. 00:27:28.806 [2024-12-08 02:29:56.236982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.237107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.237131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.806 qpair failed and we were unable to recover it. 00:27:28.806 [2024-12-08 02:29:56.237220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.237292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.237316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.806 qpair failed and we were unable to recover it. 00:27:28.806 [2024-12-08 02:29:56.237423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.237495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.237519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.806 qpair failed and we were unable to recover it. 00:27:28.806 [2024-12-08 02:29:56.237633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.237719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.237747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.806 qpair failed and we were unable to recover it. 00:27:28.806 [2024-12-08 02:29:56.237879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.238006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.238034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.806 qpair failed and we were unable to recover it. 00:27:28.806 [2024-12-08 02:29:56.238149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.238224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.238249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.806 qpair failed and we were unable to recover it. 00:27:28.806 [2024-12-08 02:29:56.238332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.238494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.238521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.806 qpair failed and we were unable to recover it. 00:27:28.806 [2024-12-08 02:29:56.238639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.238768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.238796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.806 qpair failed and we were unable to recover it. 00:27:28.806 [2024-12-08 02:29:56.238882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.239001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.239029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.806 qpair failed and we were unable to recover it. 00:27:28.806 [2024-12-08 02:29:56.239163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.239242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.239266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.806 qpair failed and we were unable to recover it. 00:27:28.806 [2024-12-08 02:29:56.239389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.239501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.239529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.806 qpair failed and we were unable to recover it. 00:27:28.806 [2024-12-08 02:29:56.239639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.239755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.239782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.806 qpair failed and we were unable to recover it. 00:27:28.806 [2024-12-08 02:29:56.239905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.239998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.240025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.806 qpair failed and we were unable to recover it. 00:27:28.806 [2024-12-08 02:29:56.240156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.240297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.240321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.806 qpair failed and we were unable to recover it. 00:27:28.806 [2024-12-08 02:29:56.240467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.240565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.240593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.806 qpair failed and we were unable to recover it. 00:27:28.806 [2024-12-08 02:29:56.240715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.240872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.240900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.806 qpair failed and we were unable to recover it. 00:27:28.806 [2024-12-08 02:29:56.241021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.241182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.241207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.806 qpair failed and we were unable to recover it. 00:27:28.806 [2024-12-08 02:29:56.241347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.241466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.806 [2024-12-08 02:29:56.241490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.806 qpair failed and we were unable to recover it. 00:27:28.806 [2024-12-08 02:29:56.241605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.241701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.241726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.807 qpair failed and we were unable to recover it. 00:27:28.807 [2024-12-08 02:29:56.241837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.241998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.242025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.807 qpair failed and we were unable to recover it. 00:27:28.807 [2024-12-08 02:29:56.242153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.242254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.242281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.807 qpair failed and we were unable to recover it. 00:27:28.807 [2024-12-08 02:29:56.242392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.242530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.242559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.807 qpair failed and we were unable to recover it. 00:27:28.807 [2024-12-08 02:29:56.242684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.242803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.242830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.807 qpair failed and we were unable to recover it. 00:27:28.807 [2024-12-08 02:29:56.242950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.243085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.243109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.807 qpair failed and we were unable to recover it. 00:27:28.807 [2024-12-08 02:29:56.243193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.243279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.243303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.807 qpair failed and we were unable to recover it. 00:27:28.807 [2024-12-08 02:29:56.243446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.243565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.243590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.807 qpair failed and we were unable to recover it. 00:27:28.807 [2024-12-08 02:29:56.243692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.243808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.243836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.807 qpair failed and we were unable to recover it. 00:27:28.807 [2024-12-08 02:29:56.243927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.244045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.244073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.807 qpair failed and we were unable to recover it. 00:27:28.807 [2024-12-08 02:29:56.244158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.244288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.244313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.807 qpair failed and we were unable to recover it. 00:27:28.807 [2024-12-08 02:29:56.244427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.244565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.244590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.807 qpair failed and we were unable to recover it. 00:27:28.807 [2024-12-08 02:29:56.244751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.244845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.244871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.807 qpair failed and we were unable to recover it. 00:27:28.807 [2024-12-08 02:29:56.244995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.245139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.245166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.807 qpair failed and we were unable to recover it. 00:27:28.807 [2024-12-08 02:29:56.245285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.245436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.245464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.807 qpair failed and we were unable to recover it. 00:27:28.807 [2024-12-08 02:29:56.245562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.245694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.245719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.807 qpair failed and we were unable to recover it. 00:27:28.807 [2024-12-08 02:29:56.245807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.245938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.245966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.807 qpair failed and we were unable to recover it. 00:27:28.807 [2024-12-08 02:29:56.246120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.246244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.246273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.807 qpair failed and we were unable to recover it. 00:27:28.807 [2024-12-08 02:29:56.246371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.246519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.246566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.807 qpair failed and we were unable to recover it. 00:27:28.807 [2024-12-08 02:29:56.246676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.246823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.246848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.807 qpair failed and we were unable to recover it. 00:27:28.807 [2024-12-08 02:29:56.246975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.247102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.247130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.807 qpair failed and we were unable to recover it. 00:27:28.807 [2024-12-08 02:29:56.247268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.247347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.247371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.807 qpair failed and we were unable to recover it. 00:27:28.807 [2024-12-08 02:29:56.247445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.247584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.247610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.807 qpair failed and we were unable to recover it. 00:27:28.807 [2024-12-08 02:29:56.247727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.247809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.247834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.807 qpair failed and we were unable to recover it. 00:27:28.807 [2024-12-08 02:29:56.247931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.248051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.807 [2024-12-08 02:29:56.248078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.807 qpair failed and we were unable to recover it. 00:27:28.807 [2024-12-08 02:29:56.248225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.248313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.248341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.808 qpair failed and we were unable to recover it. 00:27:28.808 [2024-12-08 02:29:56.248465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.248587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.248615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.808 qpair failed and we were unable to recover it. 00:27:28.808 [2024-12-08 02:29:56.248722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.248831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.248856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.808 qpair failed and we were unable to recover it. 00:27:28.808 [2024-12-08 02:29:56.248984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.249079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.249128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.808 qpair failed and we were unable to recover it. 00:27:28.808 [2024-12-08 02:29:56.249237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.249313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.249352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.808 qpair failed and we were unable to recover it. 00:27:28.808 [2024-12-08 02:29:56.249438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.249525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.249560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.808 qpair failed and we were unable to recover it. 00:27:28.808 [2024-12-08 02:29:56.249668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.249781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.249807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.808 qpair failed and we were unable to recover it. 00:27:28.808 [2024-12-08 02:29:56.249891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.249988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.250016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.808 qpair failed and we were unable to recover it. 00:27:28.808 [2024-12-08 02:29:56.250148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.250297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.250322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.808 qpair failed and we were unable to recover it. 00:27:28.808 [2024-12-08 02:29:56.250424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.250558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.250587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.808 qpair failed and we were unable to recover it. 00:27:28.808 [2024-12-08 02:29:56.250694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.250801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.250826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.808 qpair failed and we were unable to recover it. 00:27:28.808 [2024-12-08 02:29:56.250899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.251028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.251056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.808 qpair failed and we were unable to recover it. 00:27:28.808 [2024-12-08 02:29:56.251219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.251359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.251384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.808 qpair failed and we were unable to recover it. 00:27:28.808 [2024-12-08 02:29:56.251516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.251657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.251687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.808 qpair failed and we were unable to recover it. 00:27:28.808 [2024-12-08 02:29:56.251826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.251943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.251968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.808 qpair failed and we were unable to recover it. 00:27:28.808 [2024-12-08 02:29:56.252052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.252161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.252186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.808 qpair failed and we were unable to recover it. 00:27:28.808 [2024-12-08 02:29:56.252266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.252380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.252404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.808 qpair failed and we were unable to recover it. 00:27:28.808 [2024-12-08 02:29:56.252488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.252568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.252593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.808 qpair failed and we were unable to recover it. 00:27:28.808 [2024-12-08 02:29:56.252707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.252787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.252812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.808 qpair failed and we were unable to recover it. 00:27:28.808 [2024-12-08 02:29:56.252897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.253000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.253024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.808 qpair failed and we were unable to recover it. 00:27:28.808 [2024-12-08 02:29:56.253102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.253259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.253287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.808 qpair failed and we were unable to recover it. 00:27:28.808 [2024-12-08 02:29:56.253429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.253567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.253593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.808 qpair failed and we were unable to recover it. 00:27:28.808 [2024-12-08 02:29:56.253733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.253845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.253870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.808 qpair failed and we were unable to recover it. 00:27:28.808 [2024-12-08 02:29:56.254035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.254126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.254153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.808 qpair failed and we were unable to recover it. 00:27:28.808 [2024-12-08 02:29:56.254281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.254361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.254389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.808 qpair failed and we were unable to recover it. 00:27:28.808 [2024-12-08 02:29:56.254527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.254680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.254705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.808 qpair failed and we were unable to recover it. 00:27:28.808 [2024-12-08 02:29:56.254816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.254926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.254951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.808 qpair failed and we were unable to recover it. 00:27:28.808 [2024-12-08 02:29:56.255046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.255158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.255186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.808 qpair failed and we were unable to recover it. 00:27:28.808 [2024-12-08 02:29:56.255310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.255429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.808 [2024-12-08 02:29:56.255457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.808 qpair failed and we were unable to recover it. 00:27:28.808 [2024-12-08 02:29:56.255579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.255717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.255741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.809 qpair failed and we were unable to recover it. 00:27:28.809 [2024-12-08 02:29:56.255857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.255966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.255992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.809 qpair failed and we were unable to recover it. 00:27:28.809 [2024-12-08 02:29:56.256091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.256242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.256269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.809 qpair failed and we were unable to recover it. 00:27:28.809 [2024-12-08 02:29:56.256402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.256525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.256558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.809 qpair failed and we were unable to recover it. 00:27:28.809 [2024-12-08 02:29:56.256682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.256778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.256805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.809 qpair failed and we were unable to recover it. 00:27:28.809 [2024-12-08 02:29:56.256903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.256993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.257017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.809 qpair failed and we were unable to recover it. 00:27:28.809 [2024-12-08 02:29:56.257126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.257243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.257269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.809 qpair failed and we were unable to recover it. 00:27:28.809 [2024-12-08 02:29:56.257386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.257493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.257521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.809 qpair failed and we were unable to recover it. 00:27:28.809 [2024-12-08 02:29:56.257628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.257751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.257779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.809 qpair failed and we were unable to recover it. 00:27:28.809 [2024-12-08 02:29:56.257886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.257964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.257988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.809 qpair failed and we were unable to recover it. 00:27:28.809 [2024-12-08 02:29:56.258104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.258234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.258263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.809 qpair failed and we were unable to recover it. 00:27:28.809 [2024-12-08 02:29:56.258424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.258566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.258592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.809 qpair failed and we were unable to recover it. 00:27:28.809 [2024-12-08 02:29:56.258753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.258847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.258875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.809 qpair failed and we were unable to recover it. 00:27:28.809 [2024-12-08 02:29:56.258981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.259118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.259143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.809 qpair failed and we were unable to recover it. 00:27:28.809 [2024-12-08 02:29:56.259231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.259315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.259339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.809 qpair failed and we were unable to recover it. 00:27:28.809 [2024-12-08 02:29:56.259454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.259598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.259624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.809 qpair failed and we were unable to recover it. 00:27:28.809 [2024-12-08 02:29:56.259710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.259821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.259846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.809 qpair failed and we were unable to recover it. 00:27:28.809 [2024-12-08 02:29:56.259960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.260047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.260072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.809 qpair failed and we were unable to recover it. 00:27:28.809 [2024-12-08 02:29:56.260154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.260252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.260278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.809 qpair failed and we were unable to recover it. 00:27:28.809 [2024-12-08 02:29:56.260404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.260498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.260525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.809 qpair failed and we were unable to recover it. 00:27:28.809 [2024-12-08 02:29:56.260645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.260770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.260796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.809 qpair failed and we were unable to recover it. 00:27:28.809 [2024-12-08 02:29:56.260924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.261059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.261082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.809 qpair failed and we were unable to recover it. 00:27:28.809 [2024-12-08 02:29:56.261164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.261287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.261314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.809 qpair failed and we were unable to recover it. 00:27:28.809 [2024-12-08 02:29:56.261438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.261565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.261602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.809 qpair failed and we were unable to recover it. 00:27:28.809 [2024-12-08 02:29:56.261697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.261788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.261814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.809 qpair failed and we were unable to recover it. 00:27:28.809 [2024-12-08 02:29:56.261948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.262083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.262112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.809 qpair failed and we were unable to recover it. 00:27:28.809 [2024-12-08 02:29:56.262254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.262347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.262375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.809 qpair failed and we were unable to recover it. 00:27:28.809 [2024-12-08 02:29:56.262505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.262640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.262669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.809 qpair failed and we were unable to recover it. 00:27:28.809 [2024-12-08 02:29:56.262763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.262879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.809 [2024-12-08 02:29:56.262907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.809 qpair failed and we were unable to recover it. 00:27:28.810 [2024-12-08 02:29:56.263022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.263137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.263161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.810 qpair failed and we were unable to recover it. 00:27:28.810 [2024-12-08 02:29:56.263286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.263381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.263409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.810 qpair failed and we were unable to recover it. 00:27:28.810 [2024-12-08 02:29:56.263565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.263723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.263751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.810 qpair failed and we were unable to recover it. 00:27:28.810 [2024-12-08 02:29:56.263842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.263974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.263999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.810 qpair failed and we were unable to recover it. 00:27:28.810 [2024-12-08 02:29:56.264139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.264255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.264280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.810 qpair failed and we were unable to recover it. 00:27:28.810 [2024-12-08 02:29:56.264416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.264507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.264533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.810 qpair failed and we were unable to recover it. 00:27:28.810 [2024-12-08 02:29:56.264628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.264790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.264815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.810 qpair failed and we were unable to recover it. 00:27:28.810 [2024-12-08 02:29:56.264896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.264979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.265004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.810 qpair failed and we were unable to recover it. 00:27:28.810 [2024-12-08 02:29:56.265115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.265226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.265250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.810 qpair failed and we were unable to recover it. 00:27:28.810 [2024-12-08 02:29:56.265342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.265481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.265505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.810 qpair failed and we were unable to recover it. 00:27:28.810 [2024-12-08 02:29:56.265627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.265712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.265736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.810 qpair failed and we were unable to recover it. 00:27:28.810 [2024-12-08 02:29:56.265879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.265963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.265990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.810 qpair failed and we were unable to recover it. 00:27:28.810 [2024-12-08 02:29:56.266088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.266205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.266230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.810 qpair failed and we were unable to recover it. 00:27:28.810 [2024-12-08 02:29:56.266315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.266428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.266456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.810 qpair failed and we were unable to recover it. 00:27:28.810 [2024-12-08 02:29:56.266621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.266740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.266764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.810 qpair failed and we were unable to recover it. 00:27:28.810 [2024-12-08 02:29:56.266878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.267009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.267049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.810 qpair failed and we were unable to recover it. 00:27:28.810 [2024-12-08 02:29:56.267188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.267300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.267324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.810 qpair failed and we were unable to recover it. 00:27:28.810 [2024-12-08 02:29:56.267439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.267560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.267588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.810 qpair failed and we were unable to recover it. 00:27:28.810 [2024-12-08 02:29:56.267738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.267817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.267841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.810 qpair failed and we were unable to recover it. 00:27:28.810 [2024-12-08 02:29:56.267947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.268043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.268067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.810 qpair failed and we were unable to recover it. 00:27:28.810 [2024-12-08 02:29:56.268147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.268258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.268283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.810 qpair failed and we were unable to recover it. 00:27:28.810 [2024-12-08 02:29:56.268423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.268495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.268519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.810 qpair failed and we were unable to recover it. 00:27:28.810 [2024-12-08 02:29:56.268618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.268731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.268756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.810 qpair failed and we were unable to recover it. 00:27:28.810 [2024-12-08 02:29:56.268888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.268986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.269027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.810 qpair failed and we were unable to recover it. 00:27:28.810 [2024-12-08 02:29:56.269142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.269280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.269305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.810 qpair failed and we were unable to recover it. 00:27:28.810 [2024-12-08 02:29:56.269404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.269521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.269555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.810 qpair failed and we were unable to recover it. 00:27:28.810 [2024-12-08 02:29:56.269643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.269746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.269774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.810 qpair failed and we were unable to recover it. 00:27:28.810 [2024-12-08 02:29:56.269879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.270001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.270029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.810 qpair failed and we were unable to recover it. 00:27:28.810 [2024-12-08 02:29:56.270164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.810 [2024-12-08 02:29:56.270282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.270308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.811 qpair failed and we were unable to recover it. 00:27:28.811 [2024-12-08 02:29:56.270407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.270527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.270563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.811 qpair failed and we were unable to recover it. 00:27:28.811 [2024-12-08 02:29:56.270682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.270824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.270849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.811 qpair failed and we were unable to recover it. 00:27:28.811 [2024-12-08 02:29:56.270951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.271065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.271106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.811 qpair failed and we were unable to recover it. 00:27:28.811 [2024-12-08 02:29:56.271221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.271331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.271356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.811 qpair failed and we were unable to recover it. 00:27:28.811 [2024-12-08 02:29:56.271455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.271618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.271644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.811 qpair failed and we were unable to recover it. 00:27:28.811 [2024-12-08 02:29:56.271760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.271907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.271931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.811 qpair failed and we were unable to recover it. 00:27:28.811 [2024-12-08 02:29:56.272012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.272147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.272188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.811 qpair failed and we were unable to recover it. 00:27:28.811 [2024-12-08 02:29:56.272354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.272470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.272494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.811 qpair failed and we were unable to recover it. 00:27:28.811 [2024-12-08 02:29:56.272681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.272805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.272830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.811 qpair failed and we were unable to recover it. 00:27:28.811 [2024-12-08 02:29:56.272991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.273088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.273116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.811 qpair failed and we were unable to recover it. 00:27:28.811 [2024-12-08 02:29:56.273268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.273419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.273446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.811 qpair failed and we were unable to recover it. 00:27:28.811 [2024-12-08 02:29:56.273555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.273668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.273693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.811 qpair failed and we were unable to recover it. 00:27:28.811 [2024-12-08 02:29:56.273828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.273917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.273944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.811 qpair failed and we were unable to recover it. 00:27:28.811 [2024-12-08 02:29:56.274037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.274154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.274181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.811 qpair failed and we were unable to recover it. 00:27:28.811 [2024-12-08 02:29:56.274283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.274409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.274437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.811 qpair failed and we were unable to recover it. 00:27:28.811 [2024-12-08 02:29:56.274551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.274655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.274680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.811 qpair failed and we were unable to recover it. 00:27:28.811 [2024-12-08 02:29:56.274773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.274876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.274903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.811 qpair failed and we were unable to recover it. 00:27:28.811 [2024-12-08 02:29:56.274993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.275108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.275135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.811 qpair failed and we were unable to recover it. 00:27:28.811 [2024-12-08 02:29:56.275245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.275351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.275380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.811 qpair failed and we were unable to recover it. 00:27:28.811 [2024-12-08 02:29:56.275488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.275571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.275597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.811 qpair failed and we were unable to recover it. 00:27:28.811 [2024-12-08 02:29:56.275768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.275928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.275952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.811 qpair failed and we were unable to recover it. 00:27:28.811 [2024-12-08 02:29:56.276029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.276166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.276191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.811 qpair failed and we were unable to recover it. 00:27:28.811 [2024-12-08 02:29:56.276296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.276443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.276467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.811 qpair failed and we were unable to recover it. 00:27:28.811 [2024-12-08 02:29:56.276578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.276680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.276704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.811 qpair failed and we were unable to recover it. 00:27:28.811 [2024-12-08 02:29:56.276797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.276905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.276929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.811 qpair failed and we were unable to recover it. 00:27:28.811 [2024-12-08 02:29:56.277044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.277179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.277206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.811 qpair failed and we were unable to recover it. 00:27:28.811 [2024-12-08 02:29:56.277323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.277417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.277445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.811 qpair failed and we were unable to recover it. 00:27:28.811 [2024-12-08 02:29:56.277558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.277675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.277700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.811 qpair failed and we were unable to recover it. 00:27:28.811 [2024-12-08 02:29:56.277813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.811 [2024-12-08 02:29:56.277922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.277946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.812 qpair failed and we were unable to recover it. 00:27:28.812 [2024-12-08 02:29:56.278090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.278216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.278243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.812 qpair failed and we were unable to recover it. 00:27:28.812 [2024-12-08 02:29:56.278366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.278467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.278495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.812 qpair failed and we were unable to recover it. 00:27:28.812 [2024-12-08 02:29:56.278616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.278696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.278721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.812 qpair failed and we were unable to recover it. 00:27:28.812 [2024-12-08 02:29:56.278802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.278913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.278937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.812 qpair failed and we were unable to recover it. 00:27:28.812 [2024-12-08 02:29:56.279079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.279209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.279235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.812 qpair failed and we were unable to recover it. 00:27:28.812 [2024-12-08 02:29:56.279387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.279468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.279496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.812 qpair failed and we were unable to recover it. 00:27:28.812 [2024-12-08 02:29:56.279637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.279717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.279742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.812 qpair failed and we were unable to recover it. 00:27:28.812 [2024-12-08 02:29:56.279828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.279971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.279998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.812 qpair failed and we were unable to recover it. 00:27:28.812 [2024-12-08 02:29:56.280087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.280172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.280198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.812 qpair failed and we were unable to recover it. 00:27:28.812 [2024-12-08 02:29:56.280285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.280408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.280435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.812 qpair failed and we were unable to recover it. 00:27:28.812 [2024-12-08 02:29:56.280573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.280667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.280692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.812 qpair failed and we were unable to recover it. 00:27:28.812 [2024-12-08 02:29:56.280781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.280884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.280912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.812 qpair failed and we were unable to recover it. 00:27:28.812 [2024-12-08 02:29:56.281011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.281163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.281190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.812 qpair failed and we were unable to recover it. 00:27:28.812 [2024-12-08 02:29:56.281306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.281407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.281436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.812 qpair failed and we were unable to recover it. 00:27:28.812 [2024-12-08 02:29:56.281602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.281714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.281739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.812 qpair failed and we were unable to recover it. 00:27:28.812 [2024-12-08 02:29:56.281902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.282051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.282078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.812 qpair failed and we were unable to recover it. 00:27:28.812 [2024-12-08 02:29:56.282215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.282335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.282359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.812 qpair failed and we were unable to recover it. 00:27:28.812 [2024-12-08 02:29:56.282478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.282591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.282619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.812 qpair failed and we were unable to recover it. 00:27:28.812 [2024-12-08 02:29:56.282744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.282857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.282881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.812 qpair failed and we were unable to recover it. 00:27:28.812 [2024-12-08 02:29:56.283005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.283125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.283152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.812 qpair failed and we were unable to recover it. 00:27:28.812 [2024-12-08 02:29:56.283309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.283426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.283451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.812 qpair failed and we were unable to recover it. 00:27:28.812 [2024-12-08 02:29:56.283569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.283687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.283712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.812 qpair failed and we were unable to recover it. 00:27:28.812 [2024-12-08 02:29:56.283815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.283926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.283951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.812 qpair failed and we were unable to recover it. 00:27:28.812 [2024-12-08 02:29:56.284080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.284175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.284208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.812 qpair failed and we were unable to recover it. 00:27:28.812 [2024-12-08 02:29:56.284361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.284515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.284548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.812 qpair failed and we were unable to recover it. 00:27:28.812 [2024-12-08 02:29:56.284639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.812 [2024-12-08 02:29:56.284726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.284754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.813 qpair failed and we were unable to recover it. 00:27:28.813 [2024-12-08 02:29:56.284893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.284999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.285024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.813 qpair failed and we were unable to recover it. 00:27:28.813 [2024-12-08 02:29:56.285137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.285219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.285245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.813 qpair failed and we were unable to recover it. 00:27:28.813 [2024-12-08 02:29:56.285354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.285451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.285478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.813 qpair failed and we were unable to recover it. 00:27:28.813 [2024-12-08 02:29:56.285612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.285732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.285760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.813 qpair failed and we were unable to recover it. 00:27:28.813 [2024-12-08 02:29:56.285864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.286004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.286029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.813 qpair failed and we were unable to recover it. 00:27:28.813 [2024-12-08 02:29:56.286178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.286285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.286311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.813 qpair failed and we were unable to recover it. 00:27:28.813 [2024-12-08 02:29:56.286418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.286507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.286532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.813 qpair failed and we were unable to recover it. 00:27:28.813 [2024-12-08 02:29:56.286633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.286738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.286766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.813 qpair failed and we were unable to recover it. 00:27:28.813 [2024-12-08 02:29:56.286867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.286982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.287007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.813 qpair failed and we were unable to recover it. 00:27:28.813 [2024-12-08 02:29:56.287136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.287230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.287257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.813 qpair failed and we were unable to recover it. 00:27:28.813 [2024-12-08 02:29:56.287407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.287578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.287619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.813 qpair failed and we were unable to recover it. 00:27:28.813 [2024-12-08 02:29:56.287734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.287862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.287890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.813 qpair failed and we were unable to recover it. 00:27:28.813 [2024-12-08 02:29:56.288017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.288129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.288154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.813 qpair failed and we were unable to recover it. 00:27:28.813 [2024-12-08 02:29:56.288286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.288422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.288447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.813 qpair failed and we were unable to recover it. 00:27:28.813 [2024-12-08 02:29:56.288559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.288697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.288729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.813 qpair failed and we were unable to recover it. 00:27:28.813 [2024-12-08 02:29:56.288894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.289010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.289036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.813 qpair failed and we were unable to recover it. 00:27:28.813 [2024-12-08 02:29:56.289175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.289255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.289280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.813 qpair failed and we were unable to recover it. 00:27:28.813 [2024-12-08 02:29:56.289388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.289503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.289531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.813 qpair failed and we were unable to recover it. 00:27:28.813 [2024-12-08 02:29:56.289666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.289762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.289790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.813 qpair failed and we were unable to recover it. 00:27:28.813 [2024-12-08 02:29:56.289885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.290051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.290076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.813 qpair failed and we were unable to recover it. 00:27:28.813 [2024-12-08 02:29:56.290183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.290260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.290285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.813 qpair failed and we were unable to recover it. 00:27:28.813 [2024-12-08 02:29:56.290402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.290491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.290516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.813 qpair failed and we were unable to recover it. 00:27:28.813 [2024-12-08 02:29:56.290645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.290732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.290759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.813 qpair failed and we were unable to recover it. 00:27:28.813 [2024-12-08 02:29:56.290848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.290928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.290956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.813 qpair failed and we were unable to recover it. 00:27:28.813 [2024-12-08 02:29:56.291088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.291166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.291194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.813 qpair failed and we were unable to recover it. 00:27:28.813 [2024-12-08 02:29:56.291357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.291480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.291508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.813 qpair failed and we were unable to recover it. 00:27:28.813 [2024-12-08 02:29:56.291672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.291788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.291812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.813 qpair failed and we were unable to recover it. 00:27:28.813 [2024-12-08 02:29:56.291951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.292038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.813 [2024-12-08 02:29:56.292066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.813 qpair failed and we were unable to recover it. 00:27:28.813 [2024-12-08 02:29:56.292208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.292291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.292315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.814 qpair failed and we were unable to recover it. 00:27:28.814 [2024-12-08 02:29:56.292424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.292575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.292604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.814 qpair failed and we were unable to recover it. 00:27:28.814 [2024-12-08 02:29:56.292726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.292829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.292853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.814 qpair failed and we were unable to recover it. 00:27:28.814 [2024-12-08 02:29:56.292983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.293151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.293175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.814 qpair failed and we were unable to recover it. 00:27:28.814 [2024-12-08 02:29:56.293289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.293366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.293390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.814 qpair failed and we were unable to recover it. 00:27:28.814 [2024-12-08 02:29:56.293504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.293594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.293619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.814 qpair failed and we were unable to recover it. 00:27:28.814 [2024-12-08 02:29:56.293788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.293878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.293906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.814 qpair failed and we were unable to recover it. 00:27:28.814 [2024-12-08 02:29:56.294034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.294187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.294214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.814 qpair failed and we were unable to recover it. 00:27:28.814 [2024-12-08 02:29:56.294373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.294528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.294561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.814 qpair failed and we were unable to recover it. 00:27:28.814 [2024-12-08 02:29:56.294667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.294820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.294844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.814 qpair failed and we were unable to recover it. 00:27:28.814 [2024-12-08 02:29:56.294934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.295041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.295084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.814 qpair failed and we were unable to recover it. 00:27:28.814 [2024-12-08 02:29:56.295202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.295317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.295344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.814 qpair failed and we were unable to recover it. 00:27:28.814 [2024-12-08 02:29:56.295469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.295559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.295600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.814 qpair failed and we were unable to recover it. 00:27:28.814 [2024-12-08 02:29:56.295717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.295852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.295880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.814 qpair failed and we were unable to recover it. 00:27:28.814 [2024-12-08 02:29:56.296011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.296153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.296180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.814 qpair failed and we were unable to recover it. 00:27:28.814 [2024-12-08 02:29:56.296273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.296391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.296418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.814 qpair failed and we were unable to recover it. 00:27:28.814 [2024-12-08 02:29:56.296577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.296689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.296713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.814 qpair failed and we were unable to recover it. 00:27:28.814 [2024-12-08 02:29:56.296863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.296998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.297022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.814 qpair failed and we were unable to recover it. 00:27:28.814 [2024-12-08 02:29:56.297143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.297225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.297249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.814 qpair failed and we were unable to recover it. 00:27:28.814 [2024-12-08 02:29:56.297364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.297454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.297481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.814 qpair failed and we were unable to recover it. 00:27:28.814 [2024-12-08 02:29:56.297605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.297692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.297716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.814 qpair failed and we were unable to recover it. 00:27:28.814 [2024-12-08 02:29:56.297859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.297994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.298021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.814 qpair failed and we were unable to recover it. 00:27:28.814 [2024-12-08 02:29:56.298156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.298270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.298294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.814 qpair failed and we were unable to recover it. 00:27:28.814 [2024-12-08 02:29:56.298430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.298523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.298556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.814 qpair failed and we were unable to recover it. 00:27:28.814 [2024-12-08 02:29:56.298690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.298781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.298804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.814 qpair failed and we were unable to recover it. 00:27:28.814 [2024-12-08 02:29:56.298892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.298964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.298988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.814 qpair failed and we were unable to recover it. 00:27:28.814 [2024-12-08 02:29:56.299069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.299157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.299182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.814 qpair failed and we were unable to recover it. 00:27:28.814 [2024-12-08 02:29:56.299287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.299438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.299466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.814 qpair failed and we were unable to recover it. 00:27:28.814 [2024-12-08 02:29:56.299626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.299742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.814 [2024-12-08 02:29:56.299768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.814 qpair failed and we were unable to recover it. 00:27:28.814 [2024-12-08 02:29:56.299856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.299981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.300009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.815 qpair failed and we were unable to recover it. 00:27:28.815 [2024-12-08 02:29:56.300135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.300250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.300278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.815 qpair failed and we were unable to recover it. 00:27:28.815 [2024-12-08 02:29:56.300404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.300525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.300560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.815 qpair failed and we were unable to recover it. 00:27:28.815 [2024-12-08 02:29:56.300690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.300803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.300828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.815 qpair failed and we were unable to recover it. 00:27:28.815 [2024-12-08 02:29:56.300960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.301076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.301105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.815 qpair failed and we were unable to recover it. 00:27:28.815 [2024-12-08 02:29:56.301226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.301355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.301383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.815 qpair failed and we were unable to recover it. 00:27:28.815 [2024-12-08 02:29:56.301508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.301622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.301649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.815 qpair failed and we were unable to recover it. 00:27:28.815 [2024-12-08 02:29:56.301762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.301865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.301889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.815 qpair failed and we were unable to recover it. 00:27:28.815 [2024-12-08 02:29:56.302051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.302150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.302178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.815 qpair failed and we were unable to recover it. 00:27:28.815 [2024-12-08 02:29:56.302284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.302402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.302429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.815 qpair failed and we were unable to recover it. 00:27:28.815 [2024-12-08 02:29:56.302554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.302652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.302680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.815 qpair failed and we were unable to recover it. 00:27:28.815 [2024-12-08 02:29:56.302784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.302923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.302948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.815 qpair failed and we were unable to recover it. 00:27:28.815 [2024-12-08 02:29:56.303076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.303221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.303248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.815 qpair failed and we were unable to recover it. 00:27:28.815 [2024-12-08 02:29:56.303407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.303567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.303592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.815 qpair failed and we were unable to recover it. 00:27:28.815 [2024-12-08 02:29:56.303730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.303859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.303886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.815 qpair failed and we were unable to recover it. 00:27:28.815 [2024-12-08 02:29:56.304025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.304164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.304190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.815 qpair failed and we were unable to recover it. 00:27:28.815 [2024-12-08 02:29:56.304320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.304448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.304476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.815 qpair failed and we were unable to recover it. 00:27:28.815 [2024-12-08 02:29:56.304641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.304785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.304809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.815 qpair failed and we were unable to recover it. 00:27:28.815 [2024-12-08 02:29:56.304948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.305045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.305076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.815 qpair failed and we were unable to recover it. 00:27:28.815 [2024-12-08 02:29:56.305204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.305314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.305338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.815 qpair failed and we were unable to recover it. 00:27:28.815 [2024-12-08 02:29:56.305457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.305592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.305616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.815 qpair failed and we were unable to recover it. 00:27:28.815 [2024-12-08 02:29:56.305711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.305871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.305899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.815 qpair failed and we were unable to recover it. 00:27:28.815 [2024-12-08 02:29:56.306027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.306145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.306172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.815 qpair failed and we were unable to recover it. 00:27:28.815 [2024-12-08 02:29:56.306346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.306459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.306483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.815 qpair failed and we were unable to recover it. 00:27:28.815 [2024-12-08 02:29:56.306569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.306683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.306707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.815 qpair failed and we were unable to recover it. 00:27:28.815 [2024-12-08 02:29:56.306801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.306935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.306962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.815 qpair failed and we were unable to recover it. 00:27:28.815 [2024-12-08 02:29:56.307084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.307172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.307198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.815 qpair failed and we were unable to recover it. 00:27:28.815 [2024-12-08 02:29:56.307335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.307439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.307463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.815 qpair failed and we were unable to recover it. 00:27:28.815 [2024-12-08 02:29:56.307566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.307715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.815 [2024-12-08 02:29:56.307742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.815 qpair failed and we were unable to recover it. 00:27:28.815 [2024-12-08 02:29:56.307848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.307967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.307993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.816 qpair failed and we were unable to recover it. 00:27:28.816 [2024-12-08 02:29:56.308093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.308213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.308240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.816 qpair failed and we were unable to recover it. 00:27:28.816 [2024-12-08 02:29:56.308405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.308520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.308551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.816 qpair failed and we were unable to recover it. 00:27:28.816 [2024-12-08 02:29:56.308651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.308757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.308781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.816 qpair failed and we were unable to recover it. 00:27:28.816 [2024-12-08 02:29:56.308862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.308973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.308998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.816 qpair failed and we were unable to recover it. 00:27:28.816 [2024-12-08 02:29:56.309087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.309221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.309249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 wit/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 2230311 Killed "${NVMF_APP[@]}" "$@" 00:27:28.816 h addr=10.0.0.2, port=4420 00:27:28.816 qpair failed and we were unable to recover it. 00:27:28.816 [2024-12-08 02:29:56.309428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.309549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.309574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.816 qpair failed and we were unable to recover it. 00:27:28.816 [2024-12-08 02:29:56.309689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.309767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.309792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.816 qpair failed and we were unable to recover it. 00:27:28.816 02:29:56 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:27:28.816 [2024-12-08 02:29:56.309915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.310006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.310030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.816 qpair failed and we were unable to recover it. 00:27:28.816 [2024-12-08 02:29:56.310122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 02:29:56 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:28.816 [2024-12-08 02:29:56.310281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.310310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.816 qpair failed and we were unable to recover it. 00:27:28.816 [2024-12-08 02:29:56.310464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 02:29:56 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:28.816 [2024-12-08 02:29:56.310610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.310636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.816 qpair failed and we were unable to recover it. 00:27:28.816 02:29:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:28.816 [2024-12-08 02:29:56.310740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.310877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.310905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.816 02:29:56 -- common/autotest_common.sh@10 -- # set +x 00:27:28.816 qpair failed and we were unable to recover it. 00:27:28.816 [2024-12-08 02:29:56.311035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.311130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.311157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.816 qpair failed and we were unable to recover it. 00:27:28.816 [2024-12-08 02:29:56.311256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.311386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.311411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.816 qpair failed and we were unable to recover it. 00:27:28.816 [2024-12-08 02:29:56.311495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.311632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.311658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.816 qpair failed and we were unable to recover it. 00:27:28.816 [2024-12-08 02:29:56.311817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.311944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.311973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.816 qpair failed and we were unable to recover it. 00:27:28.816 [2024-12-08 02:29:56.312097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.312228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.312252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.816 qpair failed and we were unable to recover it. 00:27:28.816 [2024-12-08 02:29:56.312325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.312436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.312462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.816 qpair failed and we were unable to recover it. 00:27:28.816 [2024-12-08 02:29:56.312586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.312698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.312723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.816 qpair failed and we were unable to recover it. 00:27:28.816 [2024-12-08 02:29:56.312843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.312967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.312994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.816 qpair failed and we were unable to recover it. 00:27:28.816 [2024-12-08 02:29:56.313077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.313196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.313223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.816 qpair failed and we were unable to recover it. 00:27:28.816 [2024-12-08 02:29:56.313340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.313494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.313535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.816 qpair failed and we were unable to recover it. 00:27:28.816 [2024-12-08 02:29:56.313635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.313778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.313803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.816 qpair failed and we were unable to recover it. 00:27:28.816 [2024-12-08 02:29:56.313911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.314023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.314047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.816 qpair failed and we were unable to recover it. 00:27:28.816 [2024-12-08 02:29:56.314139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.314253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.314280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.816 qpair failed and we were unable to recover it. 00:27:28.816 [2024-12-08 02:29:56.314428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.314547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.314574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.816 qpair failed and we were unable to recover it. 00:27:28.816 [2024-12-08 02:29:56.314702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.816 [2024-12-08 02:29:56.314786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.314810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.817 qpair failed and we were unable to recover it. 00:27:28.817 [2024-12-08 02:29:56.314967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.315093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.315120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.817 qpair failed and we were unable to recover it. 00:27:28.817 [2024-12-08 02:29:56.315241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.315364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.315392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.817 02:29:56 -- nvmf/common.sh@469 -- # nvmfpid=2230879 00:27:28.817 qpair failed and we were unable to recover it. 00:27:28.817 [2024-12-08 02:29:56.315563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 02:29:56 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:28.817 02:29:56 -- nvmf/common.sh@470 -- # waitforlisten 2230879 00:27:28.817 [2024-12-08 02:29:56.315696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.315724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.817 qpair failed and we were unable to recover it. 00:27:28.817 [2024-12-08 02:29:56.315884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.315978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 02:29:56 -- common/autotest_common.sh@829 -- # '[' -z 2230879 ']' 00:27:28.817 [2024-12-08 02:29:56.316002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.817 qpair failed and we were unable to recover it. 00:27:28.817 [2024-12-08 02:29:56.316136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.316235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.316263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.817 02:29:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:28.817 qpair failed and we were unable to recover it. 00:27:28.817 [2024-12-08 02:29:56.316361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 02:29:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:28.817 [2024-12-08 02:29:56.316460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.316492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.817 qpair failed and we were unable to recover it. 00:27:28.817 [2024-12-08 02:29:56.316617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 02:29:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:28.817 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:28.817 [2024-12-08 02:29:56.316716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.316744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.817 qpair failed and we were unable to recover it. 00:27:28.817 02:29:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:28.817 [2024-12-08 02:29:56.316884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 02:29:56 -- common/autotest_common.sh@10 -- # set +x 00:27:28.817 [2024-12-08 02:29:56.317026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.317052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.817 qpair failed and we were unable to recover it. 00:27:28.817 [2024-12-08 02:29:56.317164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.317320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.317344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.817 qpair failed and we were unable to recover it. 00:27:28.817 [2024-12-08 02:29:56.317429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.317513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.317544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.817 qpair failed and we were unable to recover it. 00:27:28.817 [2024-12-08 02:29:56.317635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.317758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.317787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.817 qpair failed and we were unable to recover it. 00:27:28.817 [2024-12-08 02:29:56.317942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.318060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.318090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.817 qpair failed and we were unable to recover it. 00:27:28.817 [2024-12-08 02:29:56.318240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.318358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.318385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.817 qpair failed and we were unable to recover it. 00:27:28.817 [2024-12-08 02:29:56.318541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.318674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.318699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.817 qpair failed and we were unable to recover it. 00:27:28.817 [2024-12-08 02:29:56.318803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.318938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.318968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.817 qpair failed and we were unable to recover it. 00:27:28.817 [2024-12-08 02:29:56.319140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.319246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.319270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.817 qpair failed and we were unable to recover it. 00:27:28.817 [2024-12-08 02:29:56.319364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.319475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.319500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.817 qpair failed and we were unable to recover it. 00:27:28.817 [2024-12-08 02:29:56.319620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.319740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.319764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.817 qpair failed and we were unable to recover it. 00:27:28.817 [2024-12-08 02:29:56.319866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.319971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.320000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.817 qpair failed and we were unable to recover it. 00:27:28.817 [2024-12-08 02:29:56.320114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.320195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.320222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.817 qpair failed and we were unable to recover it. 00:27:28.817 [2024-12-08 02:29:56.320356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.320436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.320465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.817 qpair failed and we were unable to recover it. 00:27:28.817 [2024-12-08 02:29:56.320550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.320638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.320664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.817 qpair failed and we were unable to recover it. 00:27:28.817 [2024-12-08 02:29:56.320750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.320827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.320851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.817 qpair failed and we were unable to recover it. 00:27:28.817 [2024-12-08 02:29:56.320935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.321039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.321065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.817 qpair failed and we were unable to recover it. 00:27:28.817 [2024-12-08 02:29:56.321165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.817 [2024-12-08 02:29:56.321266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.321293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.818 qpair failed and we were unable to recover it. 00:27:28.818 [2024-12-08 02:29:56.321428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.321513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.321554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.818 qpair failed and we were unable to recover it. 00:27:28.818 [2024-12-08 02:29:56.321688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.321816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.321841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.818 qpair failed and we were unable to recover it. 00:27:28.818 [2024-12-08 02:29:56.321956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.322081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.322108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.818 qpair failed and we were unable to recover it. 00:27:28.818 [2024-12-08 02:29:56.322241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.322378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.322405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.818 qpair failed and we were unable to recover it. 00:27:28.818 [2024-12-08 02:29:56.322551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.322641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.322666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.818 qpair failed and we were unable to recover it. 00:27:28.818 [2024-12-08 02:29:56.322785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.322898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.322929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.818 qpair failed and we were unable to recover it. 00:27:28.818 [2024-12-08 02:29:56.323058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.323149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.323176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.818 qpair failed and we were unable to recover it. 00:27:28.818 [2024-12-08 02:29:56.323311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.323423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.323449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.818 qpair failed and we were unable to recover it. 00:27:28.818 [2024-12-08 02:29:56.323572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.323657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.323682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.818 qpair failed and we were unable to recover it. 00:27:28.818 [2024-12-08 02:29:56.323767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.323933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.323958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.818 qpair failed and we were unable to recover it. 00:27:28.818 [2024-12-08 02:29:56.324075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.324175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.324205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.818 qpair failed and we were unable to recover it. 00:27:28.818 [2024-12-08 02:29:56.324296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.324421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.324450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.818 qpair failed and we were unable to recover it. 00:27:28.818 [2024-12-08 02:29:56.324569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.324674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.324700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.818 qpair failed and we were unable to recover it. 00:27:28.818 [2024-12-08 02:29:56.324871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.324978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.325006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.818 qpair failed and we were unable to recover it. 00:27:28.818 [2024-12-08 02:29:56.325107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.325195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.325222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.818 qpair failed and we were unable to recover it. 00:27:28.818 [2024-12-08 02:29:56.325379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.325499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.325526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.818 qpair failed and we were unable to recover it. 00:27:28.818 [2024-12-08 02:29:56.325653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.325751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.325776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.818 qpair failed and we were unable to recover it. 00:27:28.818 [2024-12-08 02:29:56.325883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.326001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.326031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.818 qpair failed and we were unable to recover it. 00:27:28.818 [2024-12-08 02:29:56.326176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.326297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.326328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.818 qpair failed and we were unable to recover it. 00:27:28.818 [2024-12-08 02:29:56.326464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.326564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.326593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.818 qpair failed and we were unable to recover it. 00:27:28.818 [2024-12-08 02:29:56.326721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.326809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.326833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.818 qpair failed and we were unable to recover it. 00:27:28.818 [2024-12-08 02:29:56.326966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.327083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.327118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.818 qpair failed and we were unable to recover it. 00:27:28.818 [2024-12-08 02:29:56.327247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.327387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.327411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.818 qpair failed and we were unable to recover it. 00:27:28.818 [2024-12-08 02:29:56.327525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.327624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.327650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.818 qpair failed and we were unable to recover it. 00:27:28.818 [2024-12-08 02:29:56.327735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.327821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.327846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.818 qpair failed and we were unable to recover it. 00:27:28.818 [2024-12-08 02:29:56.327968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.328054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.328081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.818 qpair failed and we were unable to recover it. 00:27:28.818 [2024-12-08 02:29:56.328184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.328319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.328343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.818 qpair failed and we were unable to recover it. 00:27:28.818 [2024-12-08 02:29:56.328487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.328625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.328652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.818 qpair failed and we were unable to recover it. 00:27:28.818 [2024-12-08 02:29:56.328764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.818 [2024-12-08 02:29:56.328844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.328872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.819 qpair failed and we were unable to recover it. 00:27:28.819 [2024-12-08 02:29:56.329012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.329171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.329197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.819 qpair failed and we were unable to recover it. 00:27:28.819 [2024-12-08 02:29:56.329330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.329430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.329458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.819 qpair failed and we were unable to recover it. 00:27:28.819 [2024-12-08 02:29:56.329564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.329702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.329729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.819 qpair failed and we were unable to recover it. 00:27:28.819 [2024-12-08 02:29:56.329870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.329953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.329979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.819 qpair failed and we were unable to recover it. 00:27:28.819 [2024-12-08 02:29:56.330088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.330213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.330257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.819 qpair failed and we were unable to recover it. 00:27:28.819 [2024-12-08 02:29:56.330412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.330545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.330574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.819 qpair failed and we were unable to recover it. 00:27:28.819 [2024-12-08 02:29:56.330675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.330758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.330790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.819 qpair failed and we were unable to recover it. 00:27:28.819 [2024-12-08 02:29:56.330878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.330974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.331000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.819 qpair failed and we were unable to recover it. 00:27:28.819 [2024-12-08 02:29:56.331119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.331199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.331225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.819 qpair failed and we were unable to recover it. 00:27:28.819 [2024-12-08 02:29:56.331355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.331481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.331509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.819 qpair failed and we were unable to recover it. 00:27:28.819 [2024-12-08 02:29:56.331657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.331736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.331761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.819 qpair failed and we were unable to recover it. 00:27:28.819 [2024-12-08 02:29:56.331878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.331970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.331997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.819 qpair failed and we were unable to recover it. 00:27:28.819 [2024-12-08 02:29:56.332121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.332209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.332237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.819 qpair failed and we were unable to recover it. 00:27:28.819 [2024-12-08 02:29:56.332386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.332497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.332525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.819 qpair failed and we were unable to recover it. 00:27:28.819 [2024-12-08 02:29:56.332673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.332750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.332776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.819 qpair failed and we were unable to recover it. 00:27:28.819 [2024-12-08 02:29:56.332866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.333006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.333032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.819 qpair failed and we were unable to recover it. 00:27:28.819 [2024-12-08 02:29:56.333167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.333285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.333317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.819 qpair failed and we were unable to recover it. 00:27:28.819 [2024-12-08 02:29:56.333470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.333575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.333605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.819 qpair failed and we were unable to recover it. 00:27:28.819 [2024-12-08 02:29:56.333736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.333883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.333911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.819 qpair failed and we were unable to recover it. 00:27:28.819 [2024-12-08 02:29:56.334022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.334144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.334170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.819 qpair failed and we were unable to recover it. 00:27:28.819 [2024-12-08 02:29:56.334282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.334386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.334411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.819 qpair failed and we were unable to recover it. 00:27:28.819 [2024-12-08 02:29:56.334509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.334603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.334629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.819 qpair failed and we were unable to recover it. 00:27:28.819 [2024-12-08 02:29:56.334728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.334820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.334845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.819 qpair failed and we were unable to recover it. 00:27:28.819 [2024-12-08 02:29:56.334953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.335079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.335104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.819 qpair failed and we were unable to recover it. 00:27:28.819 [2024-12-08 02:29:56.335193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.335319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.335354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.819 qpair failed and we were unable to recover it. 00:27:28.819 [2024-12-08 02:29:56.335489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.335639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.335665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.819 qpair failed and we were unable to recover it. 00:27:28.819 [2024-12-08 02:29:56.335782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.335915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.335943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.819 qpair failed and we were unable to recover it. 00:27:28.819 [2024-12-08 02:29:56.336056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.336170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.336199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.819 qpair failed and we were unable to recover it. 00:27:28.819 [2024-12-08 02:29:56.336315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.819 [2024-12-08 02:29:56.336476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.336504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.820 qpair failed and we were unable to recover it. 00:27:28.820 [2024-12-08 02:29:56.336623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.336762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.336789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.820 qpair failed and we were unable to recover it. 00:27:28.820 [2024-12-08 02:29:56.336878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.336985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.337010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.820 qpair failed and we were unable to recover it. 00:27:28.820 [2024-12-08 02:29:56.337124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.337265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.337292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.820 qpair failed and we were unable to recover it. 00:27:28.820 [2024-12-08 02:29:56.337429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.337590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.337620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.820 qpair failed and we were unable to recover it. 00:27:28.820 [2024-12-08 02:29:56.337716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.337831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.337858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.820 qpair failed and we were unable to recover it. 00:27:28.820 [2024-12-08 02:29:56.337990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.338080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.338112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.820 qpair failed and we were unable to recover it. 00:27:28.820 [2024-12-08 02:29:56.338229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.338347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.338373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.820 qpair failed and we were unable to recover it. 00:27:28.820 [2024-12-08 02:29:56.338497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.338604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.338632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.820 qpair failed and we were unable to recover it. 00:27:28.820 [2024-12-08 02:29:56.338754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.338885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.338914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.820 qpair failed and we were unable to recover it. 00:27:28.820 [2024-12-08 02:29:56.339071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.339200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.339234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.820 qpair failed and we were unable to recover it. 00:27:28.820 [2024-12-08 02:29:56.339375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.339488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.339516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.820 qpair failed and we were unable to recover it. 00:27:28.820 [2024-12-08 02:29:56.339692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.339834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.339860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.820 qpair failed and we were unable to recover it. 00:27:28.820 [2024-12-08 02:29:56.339995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.340086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.340114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.820 qpair failed and we were unable to recover it. 00:27:28.820 [2024-12-08 02:29:56.340238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.340352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.340381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.820 qpair failed and we were unable to recover it. 00:27:28.820 [2024-12-08 02:29:56.340504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.340624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.340650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.820 qpair failed and we were unable to recover it. 00:27:28.820 [2024-12-08 02:29:56.340761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.340913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.340942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.820 qpair failed and we were unable to recover it. 00:27:28.820 [2024-12-08 02:29:56.341092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.341239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.341265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.820 qpair failed and we were unable to recover it. 00:27:28.820 [2024-12-08 02:29:56.341359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.341478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.341512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.820 qpair failed and we were unable to recover it. 00:27:28.820 [2024-12-08 02:29:56.341639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.341754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.341779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.820 qpair failed and we were unable to recover it. 00:27:28.820 [2024-12-08 02:29:56.341874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.342051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.342078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.820 qpair failed and we were unable to recover it. 00:27:28.820 [2024-12-08 02:29:56.342164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.342287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.342315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.820 qpair failed and we were unable to recover it. 00:27:28.820 [2024-12-08 02:29:56.342501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.342647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.342677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.820 qpair failed and we were unable to recover it. 00:27:28.820 [2024-12-08 02:29:56.342772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.342922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.342948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.820 qpair failed and we were unable to recover it. 00:27:28.820 [2024-12-08 02:29:56.343093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.343180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.343209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.820 qpair failed and we were unable to recover it. 00:27:28.820 [2024-12-08 02:29:56.343338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.343428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.343455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.820 qpair failed and we were unable to recover it. 00:27:28.820 [2024-12-08 02:29:56.343565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.343659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.343686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.820 qpair failed and we were unable to recover it. 00:27:28.820 [2024-12-08 02:29:56.343792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.343904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.343930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.820 qpair failed and we were unable to recover it. 00:27:28.820 [2024-12-08 02:29:56.344095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.344225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.344250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.820 qpair failed and we were unable to recover it. 00:27:28.820 [2024-12-08 02:29:56.344362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.820 [2024-12-08 02:29:56.344478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.344517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.821 qpair failed and we were unable to recover it. 00:27:28.821 [2024-12-08 02:29:56.344683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.344829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.344859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.821 qpair failed and we were unable to recover it. 00:27:28.821 [2024-12-08 02:29:56.344985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.345095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.345120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.821 qpair failed and we were unable to recover it. 00:27:28.821 [2024-12-08 02:29:56.345271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.345424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.345452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.821 qpair failed and we were unable to recover it. 00:27:28.821 [2024-12-08 02:29:56.345592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.345709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.345734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.821 qpair failed and we were unable to recover it. 00:27:28.821 [2024-12-08 02:29:56.345872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.345980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.346008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.821 qpair failed and we were unable to recover it. 00:27:28.821 [2024-12-08 02:29:56.346177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.346264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.346288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.821 qpair failed and we were unable to recover it. 00:27:28.821 [2024-12-08 02:29:56.346429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.346558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.346587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.821 qpair failed and we were unable to recover it. 00:27:28.821 [2024-12-08 02:29:56.346714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.346831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.346862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.821 qpair failed and we were unable to recover it. 00:27:28.821 [2024-12-08 02:29:56.347023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.347150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.347177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.821 qpair failed and we were unable to recover it. 00:27:28.821 [2024-12-08 02:29:56.347296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.347434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.347465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.821 qpair failed and we were unable to recover it. 00:27:28.821 [2024-12-08 02:29:56.347614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.347768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.347795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.821 qpair failed and we were unable to recover it. 00:27:28.821 [2024-12-08 02:29:56.347900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.347999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.348028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.821 qpair failed and we were unable to recover it. 00:27:28.821 [2024-12-08 02:29:56.348188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.348284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.348312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.821 qpair failed and we were unable to recover it. 00:27:28.821 [2024-12-08 02:29:56.348452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.348591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.348616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.821 qpair failed and we were unable to recover it. 00:27:28.821 [2024-12-08 02:29:56.348792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.348917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.348946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.821 qpair failed and we were unable to recover it. 00:27:28.821 [2024-12-08 02:29:56.349068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.349198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.349225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.821 qpair failed and we were unable to recover it. 00:27:28.821 [2024-12-08 02:29:56.349351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.349478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.349510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.821 qpair failed and we were unable to recover it. 00:27:28.821 [2024-12-08 02:29:56.349661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.349772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.349797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.821 qpair failed and we were unable to recover it. 00:27:28.821 [2024-12-08 02:29:56.349938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.350067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.350108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.821 qpair failed and we were unable to recover it. 00:27:28.821 [2024-12-08 02:29:56.350199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.350314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.350355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.821 qpair failed and we were unable to recover it. 00:27:28.821 [2024-12-08 02:29:56.350484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.350590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.350638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.821 qpair failed and we were unable to recover it. 00:27:28.821 [2024-12-08 02:29:56.350789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.350886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.350910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.821 qpair failed and we were unable to recover it. 00:27:28.821 [2024-12-08 02:29:56.351046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.351197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.351226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.821 qpair failed and we were unable to recover it. 00:27:28.821 [2024-12-08 02:29:56.351330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.351449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.351476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.821 qpair failed and we were unable to recover it. 00:27:28.821 [2024-12-08 02:29:56.351633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.351764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.351799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.821 qpair failed and we were unable to recover it. 00:27:28.821 [2024-12-08 02:29:56.351934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.352091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.821 [2024-12-08 02:29:56.352116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.821 qpair failed and we were unable to recover it. 00:27:28.822 [2024-12-08 02:29:56.352224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.352373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.352400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.822 qpair failed and we were unable to recover it. 00:27:28.822 [2024-12-08 02:29:56.352566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.352708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.352734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.822 qpair failed and we were unable to recover it. 00:27:28.822 [2024-12-08 02:29:56.352915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.353030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.353056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.822 qpair failed and we were unable to recover it. 00:27:28.822 [2024-12-08 02:29:56.353168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.353279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.353305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.822 qpair failed and we were unable to recover it. 00:27:28.822 [2024-12-08 02:29:56.353484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.353612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.353638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.822 qpair failed and we were unable to recover it. 00:27:28.822 [2024-12-08 02:29:56.353766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.353885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.353913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.822 qpair failed and we were unable to recover it. 00:27:28.822 [2024-12-08 02:29:56.354051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.354172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.354200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.822 qpair failed and we were unable to recover it. 00:27:28.822 [2024-12-08 02:29:56.354367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.354457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.354482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.822 qpair failed and we were unable to recover it. 00:27:28.822 [2024-12-08 02:29:56.354624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.354718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.354745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.822 qpair failed and we were unable to recover it. 00:27:28.822 [2024-12-08 02:29:56.354876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.355040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.355068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.822 qpair failed and we were unable to recover it. 00:27:28.822 [2024-12-08 02:29:56.355191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.355326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.355354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.822 qpair failed and we were unable to recover it. 00:27:28.822 [2024-12-08 02:29:56.355454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.355573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.355598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.822 qpair failed and we were unable to recover it. 00:27:28.822 [2024-12-08 02:29:56.355680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.355801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.355831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.822 qpair failed and we were unable to recover it. 00:27:28.822 [2024-12-08 02:29:56.355965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.356061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.356089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.822 qpair failed and we were unable to recover it. 00:27:28.822 [2024-12-08 02:29:56.356186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.356314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.356341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.822 qpair failed and we were unable to recover it. 00:27:28.822 [2024-12-08 02:29:56.356532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.356685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.356711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.822 qpair failed and we were unable to recover it. 00:27:28.822 [2024-12-08 02:29:56.356834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.356925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.356954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.822 qpair failed and we were unable to recover it. 00:27:28.822 [2024-12-08 02:29:56.357097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.357184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.357209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.822 qpair failed and we were unable to recover it. 00:27:28.822 [2024-12-08 02:29:56.357293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.357446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.357471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.822 qpair failed and we were unable to recover it. 00:27:28.822 [2024-12-08 02:29:56.357599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.357682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.357707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.822 qpair failed and we were unable to recover it. 00:27:28.822 [2024-12-08 02:29:56.357890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.358008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.358033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.822 qpair failed and we were unable to recover it. 00:27:28.822 [2024-12-08 02:29:56.358149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.358257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.358282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.822 qpair failed and we were unable to recover it. 00:27:28.822 [2024-12-08 02:29:56.358431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.358568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.358597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.822 qpair failed and we were unable to recover it. 00:27:28.822 [2024-12-08 02:29:56.358736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.358845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.358870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.822 qpair failed and we were unable to recover it. 00:27:28.822 [2024-12-08 02:29:56.359011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.359120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.359146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.822 qpair failed and we were unable to recover it. 00:27:28.822 [2024-12-08 02:29:56.359296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.359375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.359418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.822 qpair failed and we were unable to recover it. 00:27:28.822 [2024-12-08 02:29:56.359580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.359687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.359713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.822 qpair failed and we were unable to recover it. 00:27:28.822 [2024-12-08 02:29:56.359826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.360000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.360026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.822 qpair failed and we were unable to recover it. 00:27:28.822 [2024-12-08 02:29:56.360138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.822 [2024-12-08 02:29:56.360248] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:28.822 [2024-12-08 02:29:56.360291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.360324] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:28.823 [2024-12-08 02:29:56.360326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.823 qpair failed and we were unable to recover it. 00:27:28.823 [2024-12-08 02:29:56.360478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.360599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.360627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.823 qpair failed and we were unable to recover it. 00:27:28.823 [2024-12-08 02:29:56.360761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.360844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.360878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.823 qpair failed and we were unable to recover it. 00:27:28.823 [2024-12-08 02:29:56.361041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.361154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.361179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.823 qpair failed and we were unable to recover it. 00:27:28.823 [2024-12-08 02:29:56.361276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.361430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.361459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.823 qpair failed and we were unable to recover it. 00:27:28.823 [2024-12-08 02:29:56.361588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.361727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.361752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.823 qpair failed and we were unable to recover it. 00:27:28.823 [2024-12-08 02:29:56.361873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.362029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.362061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.823 qpair failed and we were unable to recover it. 00:27:28.823 [2024-12-08 02:29:56.362216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.362365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.362391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.823 qpair failed and we were unable to recover it. 00:27:28.823 [2024-12-08 02:29:56.362505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.362665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.362695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.823 qpair failed and we were unable to recover it. 00:27:28.823 [2024-12-08 02:29:56.362830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.362949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.362977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.823 qpair failed and we were unable to recover it. 00:27:28.823 [2024-12-08 02:29:56.363127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.363276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.363303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.823 qpair failed and we were unable to recover it. 00:27:28.823 [2024-12-08 02:29:56.363474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.363574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.363599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.823 qpair failed and we were unable to recover it. 00:27:28.823 [2024-12-08 02:29:56.363717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.363833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.363878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.823 qpair failed and we were unable to recover it. 00:27:28.823 [2024-12-08 02:29:56.363999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.364093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.364122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.823 qpair failed and we were unable to recover it. 00:27:28.823 [2024-12-08 02:29:56.364212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.364332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.364359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.823 qpair failed and we were unable to recover it. 00:27:28.823 [2024-12-08 02:29:56.364481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.364652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.364684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.823 qpair failed and we were unable to recover it. 00:27:28.823 [2024-12-08 02:29:56.364779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.364914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.364961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.823 qpair failed and we were unable to recover it. 00:27:28.823 [2024-12-08 02:29:56.365099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.365254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.365284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.823 qpair failed and we were unable to recover it. 00:27:28.823 [2024-12-08 02:29:56.365383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.365465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.365492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.823 qpair failed and we were unable to recover it. 00:27:28.823 [2024-12-08 02:29:56.365619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.365741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.365766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.823 qpair failed and we were unable to recover it. 00:27:28.823 [2024-12-08 02:29:56.365881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.365994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.366024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.823 qpair failed and we were unable to recover it. 00:27:28.823 [2024-12-08 02:29:56.366124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.366242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.366278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.823 qpair failed and we were unable to recover it. 00:27:28.823 [2024-12-08 02:29:56.366368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.366464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.366493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.823 qpair failed and we were unable to recover it. 00:27:28.823 [2024-12-08 02:29:56.366611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.366715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.366739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.823 qpair failed and we were unable to recover it. 00:27:28.823 [2024-12-08 02:29:56.366849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.366967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.366995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.823 qpair failed and we were unable to recover it. 00:27:28.823 [2024-12-08 02:29:56.367161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.367283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.367312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.823 qpair failed and we were unable to recover it. 00:27:28.823 [2024-12-08 02:29:56.367416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.367548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.367577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.823 qpair failed and we were unable to recover it. 00:27:28.823 [2024-12-08 02:29:56.367709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.367847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.367873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.823 qpair failed and we were unable to recover it. 00:27:28.823 [2024-12-08 02:29:56.368025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.823 [2024-12-08 02:29:56.368115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.368142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.824 qpair failed and we were unable to recover it. 00:27:28.824 [2024-12-08 02:29:56.368283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.368392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.368421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.824 qpair failed and we were unable to recover it. 00:27:28.824 [2024-12-08 02:29:56.368567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.368700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.368729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.824 qpair failed and we were unable to recover it. 00:27:28.824 [2024-12-08 02:29:56.368872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.369008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.369033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.824 qpair failed and we were unable to recover it. 00:27:28.824 [2024-12-08 02:29:56.369195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.369297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.369325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.824 qpair failed and we were unable to recover it. 00:27:28.824 [2024-12-08 02:29:56.369482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.369604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.369633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.824 qpair failed and we were unable to recover it. 00:27:28.824 [2024-12-08 02:29:56.369736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.369864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.369894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.824 qpair failed and we were unable to recover it. 00:27:28.824 [2024-12-08 02:29:56.370032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.370111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.370136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.824 qpair failed and we were unable to recover it. 00:27:28.824 [2024-12-08 02:29:56.370262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.370390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.370430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.824 qpair failed and we were unable to recover it. 00:27:28.824 [2024-12-08 02:29:56.370542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.370654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.370683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.824 qpair failed and we were unable to recover it. 00:27:28.824 [2024-12-08 02:29:56.370782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.370886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.370915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.824 qpair failed and we were unable to recover it. 00:27:28.824 [2024-12-08 02:29:56.371050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.371160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.371190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.824 qpair failed and we were unable to recover it. 00:27:28.824 [2024-12-08 02:29:56.371319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.371471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.371499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.824 qpair failed and we were unable to recover it. 00:27:28.824 [2024-12-08 02:29:56.371593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.371692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.371721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.824 qpair failed and we were unable to recover it. 00:27:28.824 [2024-12-08 02:29:56.371826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.371954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.371983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.824 qpair failed and we were unable to recover it. 00:27:28.824 [2024-12-08 02:29:56.372104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.372214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.372240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.824 qpair failed and we were unable to recover it. 00:27:28.824 [2024-12-08 02:29:56.372349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.372520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.372576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.824 qpair failed and we were unable to recover it. 00:27:28.824 [2024-12-08 02:29:56.372736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.372842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.372870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.824 qpair failed and we were unable to recover it. 00:27:28.824 [2024-12-08 02:29:56.372999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.373143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.373168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.824 qpair failed and we were unable to recover it. 00:27:28.824 [2024-12-08 02:29:56.373285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.373406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.373433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.824 qpair failed and we were unable to recover it. 00:27:28.824 [2024-12-08 02:29:56.373553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.373642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.373667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.824 qpair failed and we were unable to recover it. 00:27:28.824 [2024-12-08 02:29:56.373805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.373882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.373921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.824 qpair failed and we were unable to recover it. 00:27:28.824 [2024-12-08 02:29:56.374021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.374114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.374139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.824 qpair failed and we were unable to recover it. 00:27:28.824 [2024-12-08 02:29:56.374231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.374356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.374381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.824 qpair failed and we were unable to recover it. 00:27:28.824 [2024-12-08 02:29:56.374500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.374636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.374665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.824 qpair failed and we were unable to recover it. 00:27:28.824 [2024-12-08 02:29:56.374805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.374890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.374921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.824 qpair failed and we were unable to recover it. 00:27:28.824 [2024-12-08 02:29:56.375055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.375152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.375180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.824 qpair failed and we were unable to recover it. 00:27:28.824 [2024-12-08 02:29:56.375290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.375397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.375421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.824 qpair failed and we were unable to recover it. 00:27:28.824 [2024-12-08 02:29:56.375533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.375635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.824 [2024-12-08 02:29:56.375662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.824 qpair failed and we were unable to recover it. 00:27:28.824 [2024-12-08 02:29:56.375787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.375890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.375918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.825 qpair failed and we were unable to recover it. 00:27:28.825 [2024-12-08 02:29:56.376042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.376203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.376228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.825 qpair failed and we were unable to recover it. 00:27:28.825 [2024-12-08 02:29:56.376390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.376499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.376527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.825 qpair failed and we were unable to recover it. 00:27:28.825 [2024-12-08 02:29:56.376639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.376751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.376777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.825 qpair failed and we were unable to recover it. 00:27:28.825 [2024-12-08 02:29:56.376900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.376979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.377004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.825 qpair failed and we were unable to recover it. 00:27:28.825 [2024-12-08 02:29:56.377113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.377223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.377264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.825 qpair failed and we were unable to recover it. 00:27:28.825 [2024-12-08 02:29:56.377361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.377502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.377533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.825 qpair failed and we were unable to recover it. 00:27:28.825 [2024-12-08 02:29:56.377671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.377791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.377818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.825 qpair failed and we were unable to recover it. 00:27:28.825 [2024-12-08 02:29:56.377975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.378067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.378096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.825 qpair failed and we were unable to recover it. 00:27:28.825 [2024-12-08 02:29:56.378195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.378318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.378346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.825 qpair failed and we were unable to recover it. 00:27:28.825 [2024-12-08 02:29:56.378477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.378599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.378630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.825 qpair failed and we were unable to recover it. 00:27:28.825 [2024-12-08 02:29:56.378765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.378894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.378920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.825 qpair failed and we were unable to recover it. 00:27:28.825 [2024-12-08 02:29:56.379034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.379116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.379145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.825 qpair failed and we were unable to recover it. 00:27:28.825 [2024-12-08 02:29:56.379247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.379351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.379376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.825 qpair failed and we were unable to recover it. 00:27:28.825 [2024-12-08 02:29:56.379471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.379586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.379613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.825 qpair failed and we were unable to recover it. 00:27:28.825 [2024-12-08 02:29:56.379731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.379826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.379851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.825 qpair failed and we were unable to recover it. 00:27:28.825 [2024-12-08 02:29:56.379963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.380074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.380114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.825 qpair failed and we were unable to recover it. 00:27:28.825 [2024-12-08 02:29:56.380245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.380343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.380378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.825 qpair failed and we were unable to recover it. 00:27:28.825 [2024-12-08 02:29:56.380496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.380647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.380672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.825 qpair failed and we were unable to recover it. 00:27:28.825 [2024-12-08 02:29:56.380804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.380904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.380933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.825 qpair failed and we were unable to recover it. 00:27:28.825 [2024-12-08 02:29:56.381062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.381218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.381246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.825 qpair failed and we were unable to recover it. 00:27:28.825 [2024-12-08 02:29:56.381354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.381441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.381476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.825 qpair failed and we were unable to recover it. 00:27:28.825 [2024-12-08 02:29:56.381597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.381689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.381715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.825 qpair failed and we were unable to recover it. 00:27:28.825 [2024-12-08 02:29:56.381830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.381973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.381998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.825 qpair failed and we were unable to recover it. 00:27:28.825 [2024-12-08 02:29:56.382117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.382205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.382232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.825 qpair failed and we were unable to recover it. 00:27:28.825 [2024-12-08 02:29:56.382347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.382459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.382487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.825 qpair failed and we were unable to recover it. 00:27:28.825 [2024-12-08 02:29:56.382625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.382737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.382763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.825 qpair failed and we were unable to recover it. 00:27:28.825 [2024-12-08 02:29:56.382907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.383033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.383060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.825 qpair failed and we were unable to recover it. 00:27:28.825 [2024-12-08 02:29:56.383150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.825 [2024-12-08 02:29:56.383278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.383305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.826 qpair failed and we were unable to recover it. 00:27:28.826 [2024-12-08 02:29:56.383405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.383569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.383615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.826 qpair failed and we were unable to recover it. 00:27:28.826 [2024-12-08 02:29:56.383759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.383848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.383875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.826 qpair failed and we were unable to recover it. 00:27:28.826 [2024-12-08 02:29:56.383987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.384107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.384135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.826 qpair failed and we were unable to recover it. 00:27:28.826 [2024-12-08 02:29:56.384232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.384390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.384415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.826 qpair failed and we were unable to recover it. 00:27:28.826 [2024-12-08 02:29:56.384499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.384661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.384691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.826 qpair failed and we were unable to recover it. 00:27:28.826 [2024-12-08 02:29:56.384834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.384916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.384943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.826 qpair failed and we were unable to recover it. 00:27:28.826 [2024-12-08 02:29:56.385055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.385235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.385264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.826 qpair failed and we were unable to recover it. 00:27:28.826 [2024-12-08 02:29:56.385374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.385505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.385530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.826 qpair failed and we were unable to recover it. 00:27:28.826 [2024-12-08 02:29:56.385655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.385797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.385822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.826 qpair failed and we were unable to recover it. 00:27:28.826 [2024-12-08 02:29:56.385970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.386126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.386150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.826 qpair failed and we were unable to recover it. 00:27:28.826 [2024-12-08 02:29:56.386262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.386376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.386411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.826 qpair failed and we were unable to recover it. 00:27:28.826 [2024-12-08 02:29:56.386496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.386599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.386640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.826 qpair failed and we were unable to recover it. 00:27:28.826 [2024-12-08 02:29:56.386781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.386868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.386893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.826 qpair failed and we were unable to recover it. 00:27:28.826 [2024-12-08 02:29:56.387011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.387127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.387153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.826 qpair failed and we were unable to recover it. 00:27:28.826 [2024-12-08 02:29:56.387282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.387421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.387451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.826 qpair failed and we were unable to recover it. 00:27:28.826 [2024-12-08 02:29:56.387568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.387712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.387738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.826 qpair failed and we were unable to recover it. 00:27:28.826 [2024-12-08 02:29:56.387823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.387928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.387953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.826 qpair failed and we were unable to recover it. 00:27:28.826 [2024-12-08 02:29:56.388049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.388162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.388187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.826 qpair failed and we were unable to recover it. 00:27:28.826 [2024-12-08 02:29:56.388278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.388402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.388428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.826 qpair failed and we were unable to recover it. 00:27:28.826 [2024-12-08 02:29:56.388564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.388651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.388678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.826 qpair failed and we were unable to recover it. 00:27:28.826 [2024-12-08 02:29:56.388768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.388879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.388905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.826 qpair failed and we were unable to recover it. 00:27:28.826 [2024-12-08 02:29:56.389027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.389141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.389166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.826 qpair failed and we were unable to recover it. 00:27:28.826 [2024-12-08 02:29:56.389288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.389412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.389438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.826 qpair failed and we were unable to recover it. 00:27:28.826 [2024-12-08 02:29:56.389553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.389647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.389672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.826 qpair failed and we were unable to recover it. 00:27:28.826 [2024-12-08 02:29:56.389762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.389876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.826 [2024-12-08 02:29:56.389901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.826 qpair failed and we were unable to recover it. 00:27:28.826 [2024-12-08 02:29:56.390018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.390123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.390149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.827 qpair failed and we were unable to recover it. 00:27:28.827 [2024-12-08 02:29:56.390252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.390356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.390382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.827 qpair failed and we were unable to recover it. 00:27:28.827 [2024-12-08 02:29:56.390470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.390609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.390634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.827 qpair failed and we were unable to recover it. 00:27:28.827 [2024-12-08 02:29:56.390715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.390806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.390830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.827 qpair failed and we were unable to recover it. 00:27:28.827 [2024-12-08 02:29:56.390918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.391005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.391031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.827 qpair failed and we were unable to recover it. 00:27:28.827 [2024-12-08 02:29:56.391125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.391235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.391260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.827 qpair failed and we were unable to recover it. 00:27:28.827 [2024-12-08 02:29:56.391378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.391491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.391517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.827 qpair failed and we were unable to recover it. 00:27:28.827 [2024-12-08 02:29:56.391639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.391721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.391751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.827 qpair failed and we were unable to recover it. 00:27:28.827 [2024-12-08 02:29:56.391865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.391977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.392001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.827 qpair failed and we were unable to recover it. 00:27:28.827 [2024-12-08 02:29:56.392125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.392224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.392253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.827 qpair failed and we were unable to recover it. 00:27:28.827 [2024-12-08 02:29:56.392405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.392561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.392587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.827 qpair failed and we were unable to recover it. 00:27:28.827 [2024-12-08 02:29:56.392667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.392769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.392793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.827 qpair failed and we were unable to recover it. 00:27:28.827 [2024-12-08 02:29:56.392912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.393020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.393051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.827 qpair failed and we were unable to recover it. 00:27:28.827 [2024-12-08 02:29:56.393186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.393277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.393302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.827 qpair failed and we were unable to recover it. 00:27:28.827 [2024-12-08 02:29:56.393392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.393474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.393499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.827 qpair failed and we were unable to recover it. 00:27:28.827 [2024-12-08 02:29:56.393652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.393764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.393788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.827 qpair failed and we were unable to recover it. 00:27:28.827 [2024-12-08 02:29:56.393902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.394014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.394039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.827 qpair failed and we were unable to recover it. 00:27:28.827 [2024-12-08 02:29:56.394147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.394287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.394312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.827 qpair failed and we were unable to recover it. 00:27:28.827 [2024-12-08 02:29:56.394443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.394597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.394624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.827 qpair failed and we were unable to recover it. 00:27:28.827 [2024-12-08 02:29:56.394747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.394867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.394892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.827 qpair failed and we were unable to recover it. 00:27:28.827 [2024-12-08 02:29:56.395005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.395089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.395113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.827 qpair failed and we were unable to recover it. 00:27:28.827 [2024-12-08 02:29:56.395246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.395401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.395436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.827 qpair failed and we were unable to recover it. 00:27:28.827 [2024-12-08 02:29:56.395529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.395611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.395636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.827 qpair failed and we were unable to recover it. 00:27:28.827 [2024-12-08 02:29:56.395719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.395805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.395831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.827 qpair failed and we were unable to recover it. 00:27:28.827 [2024-12-08 02:29:56.395940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.396023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.396048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.827 qpair failed and we were unable to recover it. 00:27:28.827 [2024-12-08 02:29:56.396183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.396294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.396318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.827 qpair failed and we were unable to recover it. 00:27:28.827 [2024-12-08 02:29:56.396440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 EAL: No free 2048 kB hugepages reported on node 1 00:27:28.827 [2024-12-08 02:29:56.396559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.396587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.827 qpair failed and we were unable to recover it. 00:27:28.827 [2024-12-08 02:29:56.396710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.396799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.396824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.827 qpair failed and we were unable to recover it. 00:27:28.827 [2024-12-08 02:29:56.396975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.827 [2024-12-08 02:29:56.397089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.397121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.828 qpair failed and we were unable to recover it. 00:27:28.828 [2024-12-08 02:29:56.397241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.397384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.397411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.828 qpair failed and we were unable to recover it. 00:27:28.828 [2024-12-08 02:29:56.397565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.397677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.397702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.828 qpair failed and we were unable to recover it. 00:27:28.828 [2024-12-08 02:29:56.397808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.397923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.397948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.828 qpair failed and we were unable to recover it. 00:27:28.828 [2024-12-08 02:29:56.398041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.398156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.398183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.828 qpair failed and we were unable to recover it. 00:27:28.828 [2024-12-08 02:29:56.398315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.398437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.398463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.828 qpair failed and we were unable to recover it. 00:27:28.828 [2024-12-08 02:29:56.398554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.398670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.398695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.828 qpair failed and we were unable to recover it. 00:27:28.828 [2024-12-08 02:29:56.398817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.398929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.398962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.828 qpair failed and we were unable to recover it. 00:27:28.828 [2024-12-08 02:29:56.399102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.399251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.399277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.828 qpair failed and we were unable to recover it. 00:27:28.828 [2024-12-08 02:29:56.399394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.399506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.399531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.828 qpair failed and we were unable to recover it. 00:27:28.828 [2024-12-08 02:29:56.399639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.399757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.399783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.828 qpair failed and we were unable to recover it. 00:27:28.828 [2024-12-08 02:29:56.399884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.400007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.400032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.828 qpair failed and we were unable to recover it. 00:27:28.828 [2024-12-08 02:29:56.400172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.400295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.400320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.828 qpair failed and we were unable to recover it. 00:27:28.828 [2024-12-08 02:29:56.400436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.400556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.400582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.828 qpair failed and we were unable to recover it. 00:27:28.828 [2024-12-08 02:29:56.400695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.400781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.400806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.828 qpair failed and we were unable to recover it. 00:27:28.828 [2024-12-08 02:29:56.400929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.401015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.401040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.828 qpair failed and we were unable to recover it. 00:27:28.828 [2024-12-08 02:29:56.401149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.401257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.401281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.828 qpair failed and we were unable to recover it. 00:27:28.828 [2024-12-08 02:29:56.401438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.401567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.401593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.828 qpair failed and we were unable to recover it. 00:27:28.828 [2024-12-08 02:29:56.401704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.401796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.401823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.828 qpair failed and we were unable to recover it. 00:27:28.828 [2024-12-08 02:29:56.401904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.401988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.402012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.828 qpair failed and we were unable to recover it. 00:27:28.828 [2024-12-08 02:29:56.402146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.402237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.402269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.828 qpair failed and we were unable to recover it. 00:27:28.828 [2024-12-08 02:29:56.402368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.402485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.402513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.828 qpair failed and we were unable to recover it. 00:27:28.828 [2024-12-08 02:29:56.402643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.402781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.402807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.828 qpair failed and we were unable to recover it. 00:27:28.828 [2024-12-08 02:29:56.402906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.403003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.403028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.828 qpair failed and we were unable to recover it. 00:27:28.828 [2024-12-08 02:29:56.403172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.403282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.403307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.828 qpair failed and we were unable to recover it. 00:27:28.828 [2024-12-08 02:29:56.403425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.403569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.403599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.828 qpair failed and we were unable to recover it. 00:27:28.828 [2024-12-08 02:29:56.403714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.403824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.403856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.828 qpair failed and we were unable to recover it. 00:27:28.828 [2024-12-08 02:29:56.403996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.404080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.404105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.828 qpair failed and we were unable to recover it. 00:27:28.828 [2024-12-08 02:29:56.404260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.404373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.828 [2024-12-08 02:29:56.404399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.828 qpair failed and we were unable to recover it. 00:27:28.828 [2024-12-08 02:29:56.404498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.404621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.404647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.829 qpair failed and we were unable to recover it. 00:27:28.829 [2024-12-08 02:29:56.404766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.404877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.404903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.829 qpair failed and we were unable to recover it. 00:27:28.829 [2024-12-08 02:29:56.404987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.405106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.405132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.829 qpair failed and we were unable to recover it. 00:27:28.829 [2024-12-08 02:29:56.405273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.405352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.405378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.829 qpair failed and we were unable to recover it. 00:27:28.829 [2024-12-08 02:29:56.405517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.405641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.405668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.829 qpair failed and we were unable to recover it. 00:27:28.829 [2024-12-08 02:29:56.405749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.405848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.405872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.829 qpair failed and we were unable to recover it. 00:27:28.829 [2024-12-08 02:29:56.405985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.406099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.406123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.829 qpair failed and we were unable to recover it. 00:27:28.829 [2024-12-08 02:29:56.406211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.406305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.406329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.829 qpair failed and we were unable to recover it. 00:27:28.829 [2024-12-08 02:29:56.406469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.406621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.406648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.829 qpair failed and we were unable to recover it. 00:27:28.829 [2024-12-08 02:29:56.406760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.406907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.406933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.829 qpair failed and we were unable to recover it. 00:27:28.829 [2024-12-08 02:29:56.407049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.407172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.407197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.829 qpair failed and we were unable to recover it. 00:27:28.829 [2024-12-08 02:29:56.407285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.407425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.407454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.829 qpair failed and we were unable to recover it. 00:27:28.829 [2024-12-08 02:29:56.407581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.407700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.407728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.829 qpair failed and we were unable to recover it. 00:27:28.829 [2024-12-08 02:29:56.407825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.407940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.407965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.829 qpair failed and we were unable to recover it. 00:27:28.829 [2024-12-08 02:29:56.408087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.408202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.408227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.829 qpair failed and we were unable to recover it. 00:27:28.829 [2024-12-08 02:29:56.408325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.408438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.408462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.829 qpair failed and we were unable to recover it. 00:27:28.829 [2024-12-08 02:29:56.408581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.408660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.408684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.829 qpair failed and we were unable to recover it. 00:27:28.829 [2024-12-08 02:29:56.408802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.408886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.408911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.829 qpair failed and we were unable to recover it. 00:27:28.829 [2024-12-08 02:29:56.409022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.409111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.409136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.829 qpair failed and we were unable to recover it. 00:27:28.829 [2024-12-08 02:29:56.409235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.409316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.409341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.829 qpair failed and we were unable to recover it. 00:27:28.829 [2024-12-08 02:29:56.409425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.409544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.409570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.829 qpair failed and we were unable to recover it. 00:27:28.829 [2024-12-08 02:29:56.409690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.409774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.409800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.829 qpair failed and we were unable to recover it. 00:27:28.829 [2024-12-08 02:29:56.409922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.410007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.410035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.829 qpair failed and we were unable to recover it. 00:27:28.829 [2024-12-08 02:29:56.410131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.410271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.410296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.829 qpair failed and we were unable to recover it. 00:27:28.829 [2024-12-08 02:29:56.410414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.410499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.410524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.829 qpair failed and we were unable to recover it. 00:27:28.829 [2024-12-08 02:29:56.410650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.410743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.410774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.829 qpair failed and we were unable to recover it. 00:27:28.829 [2024-12-08 02:29:56.410876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.410962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.410987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.829 qpair failed and we were unable to recover it. 00:27:28.829 [2024-12-08 02:29:56.411124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.411212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.411237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.829 qpair failed and we were unable to recover it. 00:27:28.829 [2024-12-08 02:29:56.411352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.411474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.829 [2024-12-08 02:29:56.411498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.830 qpair failed and we were unable to recover it. 00:27:28.830 [2024-12-08 02:29:56.411595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.411685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.411710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.830 qpair failed and we were unable to recover it. 00:27:28.830 [2024-12-08 02:29:56.411828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.411945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.411970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.830 qpair failed and we were unable to recover it. 00:27:28.830 [2024-12-08 02:29:56.412081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.412192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.412218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.830 qpair failed and we were unable to recover it. 00:27:28.830 [2024-12-08 02:29:56.412335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.412420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.412452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.830 qpair failed and we were unable to recover it. 00:27:28.830 [2024-12-08 02:29:56.412602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.412693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.412719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.830 qpair failed and we were unable to recover it. 00:27:28.830 [2024-12-08 02:29:56.412829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.412948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.412974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.830 qpair failed and we were unable to recover it. 00:27:28.830 [2024-12-08 02:29:56.413088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.413178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.413203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.830 qpair failed and we were unable to recover it. 00:27:28.830 [2024-12-08 02:29:56.413344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.413467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.413490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.830 qpair failed and we were unable to recover it. 00:27:28.830 [2024-12-08 02:29:56.413614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.413697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.413722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.830 qpair failed and we were unable to recover it. 00:27:28.830 [2024-12-08 02:29:56.413858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.413937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.413961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.830 qpair failed and we were unable to recover it. 00:27:28.830 [2024-12-08 02:29:56.414047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.414170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.414197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.830 qpair failed and we were unable to recover it. 00:27:28.830 [2024-12-08 02:29:56.414294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.414440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.414465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.830 qpair failed and we were unable to recover it. 00:27:28.830 [2024-12-08 02:29:56.414603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.414685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.414710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.830 qpair failed and we were unable to recover it. 00:27:28.830 [2024-12-08 02:29:56.414808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.414915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.414941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.830 qpair failed and we were unable to recover it. 00:27:28.830 [2024-12-08 02:29:56.415020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.415141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.415165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.830 qpair failed and we were unable to recover it. 00:27:28.830 [2024-12-08 02:29:56.415305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.415422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.415447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.830 qpair failed and we were unable to recover it. 00:27:28.830 [2024-12-08 02:29:56.415597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.415707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.415732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.830 qpair failed and we were unable to recover it. 00:27:28.830 [2024-12-08 02:29:56.415860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.415976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.416006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.830 qpair failed and we were unable to recover it. 00:27:28.830 [2024-12-08 02:29:56.416133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.416246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.416271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.830 qpair failed and we were unable to recover it. 00:27:28.830 [2024-12-08 02:29:56.416405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.416491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.416518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.830 qpair failed and we were unable to recover it. 00:27:28.830 [2024-12-08 02:29:56.416665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.416783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.416809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.830 qpair failed and we were unable to recover it. 00:27:28.830 [2024-12-08 02:29:56.416936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.417015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.417039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.830 qpair failed and we were unable to recover it. 00:27:28.830 [2024-12-08 02:29:56.417121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.417198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.417222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.830 qpair failed and we were unable to recover it. 00:27:28.830 [2024-12-08 02:29:56.417374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.417488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.417513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.830 qpair failed and we were unable to recover it. 00:27:28.830 [2024-12-08 02:29:56.417633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.417754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.417780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.830 qpair failed and we were unable to recover it. 00:27:28.830 [2024-12-08 02:29:56.417872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.417990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.830 [2024-12-08 02:29:56.418019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.831 qpair failed and we were unable to recover it. 00:27:28.831 [2024-12-08 02:29:56.418117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.418223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.418253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.831 qpair failed and we were unable to recover it. 00:27:28.831 [2024-12-08 02:29:56.418334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.418444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.418468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.831 qpair failed and we were unable to recover it. 00:27:28.831 [2024-12-08 02:29:56.418602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.418713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.418738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.831 qpair failed and we were unable to recover it. 00:27:28.831 [2024-12-08 02:29:56.418858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.418981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.419006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.831 qpair failed and we were unable to recover it. 00:27:28.831 [2024-12-08 02:29:56.419113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.419193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.419218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.831 qpair failed and we were unable to recover it. 00:27:28.831 [2024-12-08 02:29:56.419302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.419388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.419413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.831 qpair failed and we were unable to recover it. 00:27:28.831 [2024-12-08 02:29:56.419542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.419665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.419691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.831 qpair failed and we were unable to recover it. 00:27:28.831 [2024-12-08 02:29:56.419809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.419951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.419982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.831 qpair failed and we were unable to recover it. 00:27:28.831 [2024-12-08 02:29:56.420099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.420213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.420239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.831 qpair failed and we were unable to recover it. 00:27:28.831 [2024-12-08 02:29:56.420329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.420415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.420439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.831 qpair failed and we were unable to recover it. 00:27:28.831 [2024-12-08 02:29:56.420581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.420726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.420751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.831 qpair failed and we were unable to recover it. 00:27:28.831 [2024-12-08 02:29:56.420899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.421019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.421044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.831 qpair failed and we were unable to recover it. 00:27:28.831 [2024-12-08 02:29:56.421195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.421305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.421329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.831 qpair failed and we were unable to recover it. 00:27:28.831 [2024-12-08 02:29:56.421421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.421501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.421526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.831 qpair failed and we were unable to recover it. 00:27:28.831 [2024-12-08 02:29:56.421620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.421763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.421788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.831 qpair failed and we were unable to recover it. 00:27:28.831 [2024-12-08 02:29:56.421907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.421987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.422011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.831 qpair failed and we were unable to recover it. 00:27:28.831 [2024-12-08 02:29:56.422124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.422235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.422259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.831 qpair failed and we were unable to recover it. 00:27:28.831 [2024-12-08 02:29:56.422374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.422510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.422583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.831 qpair failed and we were unable to recover it. 00:27:28.831 [2024-12-08 02:29:56.422674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.422766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.422791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.831 qpair failed and we were unable to recover it. 00:27:28.831 [2024-12-08 02:29:56.422902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.423009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.423033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.831 qpair failed and we were unable to recover it. 00:27:28.831 [2024-12-08 02:29:56.423110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.423222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.423247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.831 qpair failed and we were unable to recover it. 00:27:28.831 [2024-12-08 02:29:56.423348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.423473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.423500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.831 qpair failed and we were unable to recover it. 00:27:28.831 [2024-12-08 02:29:56.423660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.423745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.423770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.831 qpair failed and we were unable to recover it. 00:27:28.831 [2024-12-08 02:29:56.423896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.423977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.424002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.831 qpair failed and we were unable to recover it. 00:27:28.831 [2024-12-08 02:29:56.424097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.424204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.424229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.831 qpair failed and we were unable to recover it. 00:27:28.831 [2024-12-08 02:29:56.424346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.424447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.424474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.831 qpair failed and we were unable to recover it. 00:27:28.831 [2024-12-08 02:29:56.424596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.424680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.424704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.831 qpair failed and we were unable to recover it. 00:27:28.831 [2024-12-08 02:29:56.424783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.424895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.831 [2024-12-08 02:29:56.424920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.831 qpair failed and we were unable to recover it. 00:27:28.831 [2024-12-08 02:29:56.425012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.425122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.425147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.832 qpair failed and we were unable to recover it. 00:27:28.832 [2024-12-08 02:29:56.425261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.425378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.425402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.832 qpair failed and we were unable to recover it. 00:27:28.832 [2024-12-08 02:29:56.425480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.425637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.425663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.832 qpair failed and we were unable to recover it. 00:27:28.832 [2024-12-08 02:29:56.425752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.425835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.425861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.832 qpair failed and we were unable to recover it. 00:27:28.832 [2024-12-08 02:29:56.425979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.426057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.426082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.832 qpair failed and we were unable to recover it. 00:27:28.832 [2024-12-08 02:29:56.426190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.426274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.426299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.832 qpair failed and we were unable to recover it. 00:27:28.832 [2024-12-08 02:29:56.426380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.426533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.426566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.832 qpair failed and we were unable to recover it. 00:27:28.832 [2024-12-08 02:29:56.426653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.426746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.426776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.832 qpair failed and we were unable to recover it. 00:27:28.832 [2024-12-08 02:29:56.426852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.426972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.426997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.832 qpair failed and we were unable to recover it. 00:27:28.832 [2024-12-08 02:29:56.427116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.427225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.427250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.832 qpair failed and we were unable to recover it. 00:27:28.832 [2024-12-08 02:29:56.427336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.427445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.427470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.832 qpair failed and we were unable to recover it. 00:27:28.832 [2024-12-08 02:29:56.427562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.427682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.427707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.832 qpair failed and we were unable to recover it. 00:27:28.832 [2024-12-08 02:29:56.427806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.427909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.427935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.832 qpair failed and we were unable to recover it. 00:27:28.832 [2024-12-08 02:29:56.428050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.428126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.428151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.832 qpair failed and we were unable to recover it. 00:27:28.832 [2024-12-08 02:29:56.428271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.428362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.428387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.832 qpair failed and we were unable to recover it. 00:27:28.832 [2024-12-08 02:29:56.428474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.428557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.428583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.832 qpair failed and we were unable to recover it. 00:27:28.832 [2024-12-08 02:29:56.428670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.428818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.428843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.832 qpair failed and we were unable to recover it. 00:27:28.832 [2024-12-08 02:29:56.428941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.429061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.429087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.832 qpair failed and we were unable to recover it. 00:27:28.832 [2024-12-08 02:29:56.429215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.429301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.429327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.832 qpair failed and we were unable to recover it. 00:27:28.832 [2024-12-08 02:29:56.429460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.429573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.429599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.832 qpair failed and we were unable to recover it. 00:27:28.832 [2024-12-08 02:29:56.429685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.429762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.429787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.832 qpair failed and we were unable to recover it. 00:27:28.832 [2024-12-08 02:29:56.429908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.430038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.430063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.832 qpair failed and we were unable to recover it. 00:27:28.832 [2024-12-08 02:29:56.430176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.430257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.430282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.832 qpair failed and we were unable to recover it. 00:27:28.832 [2024-12-08 02:29:56.430366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.430482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.430509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.832 qpair failed and we were unable to recover it. 00:27:28.832 [2024-12-08 02:29:56.430633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.430748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.430774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.832 qpair failed and we were unable to recover it. 00:27:28.832 [2024-12-08 02:29:56.430896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.431026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.431036] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:28.832 [2024-12-08 02:29:56.431052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.832 qpair failed and we were unable to recover it. 00:27:28.832 [2024-12-08 02:29:56.431164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.431241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.431267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.832 qpair failed and we were unable to recover it. 00:27:28.832 [2024-12-08 02:29:56.431381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.431525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.431559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.832 qpair failed and we were unable to recover it. 00:27:28.832 [2024-12-08 02:29:56.431704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.431849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.832 [2024-12-08 02:29:56.431875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.833 qpair failed and we were unable to recover it. 00:27:28.833 [2024-12-08 02:29:56.431988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.432102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.432127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.833 qpair failed and we were unable to recover it. 00:27:28.833 [2024-12-08 02:29:56.432214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.432336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.432362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.833 qpair failed and we were unable to recover it. 00:27:28.833 [2024-12-08 02:29:56.432470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.432556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.432583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.833 qpair failed and we were unable to recover it. 00:27:28.833 [2024-12-08 02:29:56.432689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.432796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.432821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.833 qpair failed and we were unable to recover it. 00:27:28.833 [2024-12-08 02:29:56.432895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.433013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.433039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.833 qpair failed and we were unable to recover it. 00:27:28.833 [2024-12-08 02:29:56.433126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.433268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.433292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.833 qpair failed and we were unable to recover it. 00:27:28.833 [2024-12-08 02:29:56.433407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.433560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.433585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.833 qpair failed and we were unable to recover it. 00:27:28.833 [2024-12-08 02:29:56.433685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.433774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.433799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.833 qpair failed and we were unable to recover it. 00:27:28.833 [2024-12-08 02:29:56.433928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.434000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.434030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.833 qpair failed and we were unable to recover it. 00:27:28.833 [2024-12-08 02:29:56.434156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.434269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.434295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.833 qpair failed and we were unable to recover it. 00:27:28.833 [2024-12-08 02:29:56.434410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.434499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.434524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.833 qpair failed and we were unable to recover it. 00:27:28.833 [2024-12-08 02:29:56.434659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.434750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.434776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.833 qpair failed and we were unable to recover it. 00:27:28.833 [2024-12-08 02:29:56.434895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.435043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.435069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.833 qpair failed and we were unable to recover it. 00:27:28.833 [2024-12-08 02:29:56.435148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.435256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.435285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.833 qpair failed and we were unable to recover it. 00:27:28.833 [2024-12-08 02:29:56.435417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.435525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.435559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.833 qpair failed and we were unable to recover it. 00:27:28.833 [2024-12-08 02:29:56.435684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.435826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.435852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.833 qpair failed and we were unable to recover it. 00:27:28.833 [2024-12-08 02:29:56.435940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.436051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.436076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.833 qpair failed and we were unable to recover it. 00:27:28.833 [2024-12-08 02:29:56.436203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.436321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.436347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.833 qpair failed and we were unable to recover it. 00:27:28.833 [2024-12-08 02:29:56.436466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.436594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.436622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.833 qpair failed and we were unable to recover it. 00:27:28.833 [2024-12-08 02:29:56.436711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.436801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.436827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.833 qpair failed and we were unable to recover it. 00:27:28.833 [2024-12-08 02:29:56.436944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.437063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.437087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.833 qpair failed and we were unable to recover it. 00:27:28.833 [2024-12-08 02:29:56.437164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.437286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.437315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.833 qpair failed and we were unable to recover it. 00:27:28.833 [2024-12-08 02:29:56.437425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.437502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.437527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.833 qpair failed and we were unable to recover it. 00:27:28.833 [2024-12-08 02:29:56.437674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.437763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.437793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.833 qpair failed and we were unable to recover it. 00:27:28.833 [2024-12-08 02:29:56.437951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.438064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.438088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.833 qpair failed and we were unable to recover it. 00:27:28.833 [2024-12-08 02:29:56.438215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.438324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.438348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.833 qpair failed and we were unable to recover it. 00:27:28.833 [2024-12-08 02:29:56.438459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.438600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.438626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.833 qpair failed and we were unable to recover it. 00:27:28.833 [2024-12-08 02:29:56.438774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.438900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.438925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.833 qpair failed and we were unable to recover it. 00:27:28.833 [2024-12-08 02:29:56.439024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.833 [2024-12-08 02:29:56.439166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.439190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.834 qpair failed and we were unable to recover it. 00:27:28.834 [2024-12-08 02:29:56.439284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.439370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.439396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.834 qpair failed and we were unable to recover it. 00:27:28.834 [2024-12-08 02:29:56.439484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.439614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.439640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.834 qpair failed and we were unable to recover it. 00:27:28.834 [2024-12-08 02:29:56.439738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.439832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.439857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.834 qpair failed and we were unable to recover it. 00:27:28.834 [2024-12-08 02:29:56.439973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.440084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.440110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.834 qpair failed and we were unable to recover it. 00:27:28.834 [2024-12-08 02:29:56.440233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.440344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.440368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.834 qpair failed and we were unable to recover it. 00:27:28.834 [2024-12-08 02:29:56.440458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.440582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.440614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.834 qpair failed and we were unable to recover it. 00:27:28.834 [2024-12-08 02:29:56.440697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.440789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.440816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.834 qpair failed and we were unable to recover it. 00:27:28.834 [2024-12-08 02:29:56.440924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.441033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.441059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.834 qpair failed and we were unable to recover it. 00:27:28.834 [2024-12-08 02:29:56.441146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.441265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.441290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.834 qpair failed and we were unable to recover it. 00:27:28.834 [2024-12-08 02:29:56.441384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.441504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.441529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.834 qpair failed and we were unable to recover it. 00:27:28.834 [2024-12-08 02:29:56.441629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.441716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.441741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.834 qpair failed and we were unable to recover it. 00:27:28.834 [2024-12-08 02:29:56.441854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.441962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.441987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.834 qpair failed and we were unable to recover it. 00:27:28.834 [2024-12-08 02:29:56.442109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.442248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.442274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.834 qpair failed and we were unable to recover it. 00:27:28.834 [2024-12-08 02:29:56.442393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.442505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.442530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.834 qpair failed and we were unable to recover it. 00:27:28.834 [2024-12-08 02:29:56.442690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.442801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.442829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.834 qpair failed and we were unable to recover it. 00:27:28.834 [2024-12-08 02:29:56.442918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.443055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.443080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.834 qpair failed and we were unable to recover it. 00:27:28.834 [2024-12-08 02:29:56.443204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.443317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.443343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.834 qpair failed and we were unable to recover it. 00:27:28.834 [2024-12-08 02:29:56.443481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.443609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.443634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.834 qpair failed and we were unable to recover it. 00:27:28.834 [2024-12-08 02:29:56.443746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.443874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.443900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.834 qpair failed and we were unable to recover it. 00:27:28.834 [2024-12-08 02:29:56.444013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.444099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.444123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.834 qpair failed and we were unable to recover it. 00:27:28.834 [2024-12-08 02:29:56.444236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.444310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.444335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.834 qpair failed and we were unable to recover it. 00:27:28.834 [2024-12-08 02:29:56.444438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.444524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.444559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.834 qpair failed and we were unable to recover it. 00:27:28.834 [2024-12-08 02:29:56.444674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.444787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.444812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.834 qpair failed and we were unable to recover it. 00:27:28.834 [2024-12-08 02:29:56.444913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.445004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.445031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.834 qpair failed and we were unable to recover it. 00:27:28.834 [2024-12-08 02:29:56.445105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.445190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.445215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.834 qpair failed and we were unable to recover it. 00:27:28.834 [2024-12-08 02:29:56.445333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.445416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.445441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.834 qpair failed and we were unable to recover it. 00:27:28.834 [2024-12-08 02:29:56.445548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.445634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.445662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.834 qpair failed and we were unable to recover it. 00:27:28.834 [2024-12-08 02:29:56.445760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.445880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.834 [2024-12-08 02:29:56.445905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.834 qpair failed and we were unable to recover it. 00:27:28.834 [2024-12-08 02:29:56.446020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.446128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.446153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.835 qpair failed and we were unable to recover it. 00:27:28.835 [2024-12-08 02:29:56.446244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.446339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.446364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.835 qpair failed and we were unable to recover it. 00:27:28.835 [2024-12-08 02:29:56.446482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.446596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.446624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.835 qpair failed and we were unable to recover it. 00:27:28.835 [2024-12-08 02:29:56.446723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.446837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.446863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.835 qpair failed and we were unable to recover it. 00:27:28.835 [2024-12-08 02:29:56.446944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.447066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.447091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.835 qpair failed and we were unable to recover it. 00:27:28.835 [2024-12-08 02:29:56.447178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.447275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.447301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.835 qpair failed and we were unable to recover it. 00:27:28.835 [2024-12-08 02:29:56.447421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.447576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.447602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.835 qpair failed and we were unable to recover it. 00:27:28.835 [2024-12-08 02:29:56.447712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.447831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.447856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.835 qpair failed and we were unable to recover it. 00:27:28.835 [2024-12-08 02:29:56.447951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.448074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.448100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.835 qpair failed and we were unable to recover it. 00:27:28.835 [2024-12-08 02:29:56.448202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.448318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.448345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.835 qpair failed and we were unable to recover it. 00:27:28.835 [2024-12-08 02:29:56.448436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.448550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.448577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.835 qpair failed and we were unable to recover it. 00:27:28.835 [2024-12-08 02:29:56.448664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.448774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.448800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.835 qpair failed and we were unable to recover it. 00:27:28.835 [2024-12-08 02:29:56.448917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.449007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.449033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.835 qpair failed and we were unable to recover it. 00:27:28.835 [2024-12-08 02:29:56.449119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.449212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.449238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.835 qpair failed and we were unable to recover it. 00:27:28.835 [2024-12-08 02:29:56.449323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.449463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.449490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.835 qpair failed and we were unable to recover it. 00:27:28.835 [2024-12-08 02:29:56.449574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.449650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.449685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.835 qpair failed and we were unable to recover it. 00:27:28.835 [2024-12-08 02:29:56.449798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.449921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.449947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.835 qpair failed and we were unable to recover it. 00:27:28.835 [2024-12-08 02:29:56.450063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.450222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.450247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.835 qpair failed and we were unable to recover it. 00:27:28.835 [2024-12-08 02:29:56.450356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.450439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.450463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.835 qpair failed and we were unable to recover it. 00:27:28.835 [2024-12-08 02:29:56.450573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.450685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.450710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.835 qpair failed and we were unable to recover it. 00:27:28.835 [2024-12-08 02:29:56.450821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.450913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.450938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.835 qpair failed and we were unable to recover it. 00:27:28.835 [2024-12-08 02:29:56.451081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.451169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.451194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.835 qpair failed and we were unable to recover it. 00:27:28.835 [2024-12-08 02:29:56.451305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.451443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.451467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.835 qpair failed and we were unable to recover it. 00:27:28.835 [2024-12-08 02:29:56.451562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.451689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.451715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.835 qpair failed and we were unable to recover it. 00:27:28.835 [2024-12-08 02:29:56.451821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.451959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.451984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.835 qpair failed and we were unable to recover it. 00:27:28.835 [2024-12-08 02:29:56.452078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.452189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.452213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.835 qpair failed and we were unable to recover it. 00:27:28.835 [2024-12-08 02:29:56.452344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.835 [2024-12-08 02:29:56.452435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.452461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.836 qpair failed and we were unable to recover it. 00:27:28.836 [2024-12-08 02:29:56.452573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.452686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.452713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.836 qpair failed and we were unable to recover it. 00:27:28.836 [2024-12-08 02:29:56.452847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.452957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.452981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.836 qpair failed and we were unable to recover it. 00:27:28.836 [2024-12-08 02:29:56.453097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.453209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.453244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.836 qpair failed and we were unable to recover it. 00:27:28.836 [2024-12-08 02:29:56.453353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.453472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.453496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.836 qpair failed and we were unable to recover it. 00:27:28.836 [2024-12-08 02:29:56.453629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.453737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.453762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.836 qpair failed and we were unable to recover it. 00:27:28.836 [2024-12-08 02:29:56.453912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.453988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.454012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.836 qpair failed and we were unable to recover it. 00:27:28.836 [2024-12-08 02:29:56.454141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.454283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.454309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.836 qpair failed and we were unable to recover it. 00:27:28.836 [2024-12-08 02:29:56.454430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.454514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.454548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.836 qpair failed and we were unable to recover it. 00:27:28.836 [2024-12-08 02:29:56.454679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.454806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.454832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.836 qpair failed and we were unable to recover it. 00:27:28.836 [2024-12-08 02:29:56.454928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.455047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.455072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.836 qpair failed and we were unable to recover it. 00:27:28.836 [2024-12-08 02:29:56.455182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.455261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.455287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.836 qpair failed and we were unable to recover it. 00:27:28.836 [2024-12-08 02:29:56.455386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.455469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.455510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.836 qpair failed and we were unable to recover it. 00:27:28.836 [2024-12-08 02:29:56.455653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.455766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.455792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.836 qpair failed and we were unable to recover it. 00:27:28.836 [2024-12-08 02:29:56.455914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.456036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.456061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.836 qpair failed and we were unable to recover it. 00:27:28.836 [2024-12-08 02:29:56.456142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.456255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.456281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.836 qpair failed and we were unable to recover it. 00:27:28.836 [2024-12-08 02:29:56.456401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.456484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.456510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.836 qpair failed and we were unable to recover it. 00:27:28.836 [2024-12-08 02:29:56.456639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.456740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.456765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.836 qpair failed and we were unable to recover it. 00:27:28.836 [2024-12-08 02:29:56.456905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.457022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.457057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.836 qpair failed and we were unable to recover it. 00:27:28.836 [2024-12-08 02:29:56.457178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.457287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.457312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.836 qpair failed and we were unable to recover it. 00:27:28.836 [2024-12-08 02:29:56.457450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.457594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.457624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.836 qpair failed and we were unable to recover it. 00:27:28.836 [2024-12-08 02:29:56.457722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.457853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.457879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.836 qpair failed and we were unable to recover it. 00:27:28.836 [2024-12-08 02:29:56.457976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.458119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.458145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.836 qpair failed and we were unable to recover it. 00:27:28.836 [2024-12-08 02:29:56.458224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.458336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.458362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.836 qpair failed and we were unable to recover it. 00:27:28.836 [2024-12-08 02:29:56.458474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.458617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.458644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.836 qpair failed and we were unable to recover it. 00:27:28.836 [2024-12-08 02:29:56.458758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.458846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.458874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.836 qpair failed and we were unable to recover it. 00:27:28.836 [2024-12-08 02:29:56.458994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.459133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.459158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.836 qpair failed and we were unable to recover it. 00:27:28.836 [2024-12-08 02:29:56.459280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.459372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.459398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.836 qpair failed and we were unable to recover it. 00:27:28.836 [2024-12-08 02:29:56.459546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.459659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.836 [2024-12-08 02:29:56.459685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.836 qpair failed and we were unable to recover it. 00:27:28.836 [2024-12-08 02:29:56.459799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.459896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.459923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.837 qpair failed and we were unable to recover it. 00:27:28.837 [2024-12-08 02:29:56.460046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.460133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.460160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.837 qpair failed and we were unable to recover it. 00:27:28.837 [2024-12-08 02:29:56.460266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.460354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.460379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.837 qpair failed and we were unable to recover it. 00:27:28.837 [2024-12-08 02:29:56.460486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.460645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.460671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.837 qpair failed and we were unable to recover it. 00:27:28.837 [2024-12-08 02:29:56.460786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.460898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.460924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.837 qpair failed and we were unable to recover it. 00:27:28.837 [2024-12-08 02:29:56.461009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.461123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.461149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.837 qpair failed and we were unable to recover it. 00:27:28.837 [2024-12-08 02:29:56.461263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.461386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.461410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.837 qpair failed and we were unable to recover it. 00:27:28.837 [2024-12-08 02:29:56.461507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.461602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.461628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.837 qpair failed and we were unable to recover it. 00:27:28.837 [2024-12-08 02:29:56.461750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.461867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.461892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.837 qpair failed and we were unable to recover it. 00:27:28.837 [2024-12-08 02:29:56.462009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.462088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.462115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.837 qpair failed and we were unable to recover it. 00:27:28.837 [2024-12-08 02:29:56.462201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.462312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.462339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.837 qpair failed and we were unable to recover it. 00:27:28.837 [2024-12-08 02:29:56.462432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.462549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.462577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.837 qpair failed and we were unable to recover it. 00:27:28.837 [2024-12-08 02:29:56.462696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.462807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.462833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.837 qpair failed and we were unable to recover it. 00:27:28.837 [2024-12-08 02:29:56.462946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.463034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.463059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.837 qpair failed and we were unable to recover it. 00:27:28.837 [2024-12-08 02:29:56.463170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.463253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.463286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.837 qpair failed and we were unable to recover it. 00:27:28.837 [2024-12-08 02:29:56.463428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.463571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.463607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.837 qpair failed and we were unable to recover it. 00:27:28.837 [2024-12-08 02:29:56.463721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.463863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.463890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.837 qpair failed and we were unable to recover it. 00:27:28.837 [2024-12-08 02:29:56.463983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.464094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.464120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.837 qpair failed and we were unable to recover it. 00:27:28.837 [2024-12-08 02:29:56.464209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.464301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.464327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.837 qpair failed and we were unable to recover it. 00:27:28.837 [2024-12-08 02:29:56.464478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.464591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.464618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.837 qpair failed and we were unable to recover it. 00:27:28.837 [2024-12-08 02:29:56.464734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.464848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.464875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.837 qpair failed and we were unable to recover it. 00:27:28.837 [2024-12-08 02:29:56.464987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.465082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.465108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.837 qpair failed and we were unable to recover it. 00:27:28.837 [2024-12-08 02:29:56.465217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.465340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.465365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.837 qpair failed and we were unable to recover it. 00:27:28.837 [2024-12-08 02:29:56.465454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.465574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.465600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.837 qpair failed and we were unable to recover it. 00:27:28.837 [2024-12-08 02:29:56.465712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.465818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.465844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.837 qpair failed and we were unable to recover it. 00:27:28.837 [2024-12-08 02:29:56.465982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.466063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.466088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.837 qpair failed and we were unable to recover it. 00:27:28.837 [2024-12-08 02:29:56.466205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.466322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.466348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.837 qpair failed and we were unable to recover it. 00:27:28.837 [2024-12-08 02:29:56.466457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.466544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.466571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.837 qpair failed and we were unable to recover it. 00:27:28.837 [2024-12-08 02:29:56.466661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.837 [2024-12-08 02:29:56.466802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.466828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.838 qpair failed and we were unable to recover it. 00:27:28.838 [2024-12-08 02:29:56.466943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.467036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.467061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.838 qpair failed and we were unable to recover it. 00:27:28.838 [2024-12-08 02:29:56.467177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.467296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.467321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.838 qpair failed and we were unable to recover it. 00:27:28.838 [2024-12-08 02:29:56.467439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.467571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.467597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.838 qpair failed and we were unable to recover it. 00:27:28.838 [2024-12-08 02:29:56.467680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.467793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.467819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.838 qpair failed and we were unable to recover it. 00:27:28.838 [2024-12-08 02:29:56.467977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.468066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.468091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.838 qpair failed and we were unable to recover it. 00:27:28.838 [2024-12-08 02:29:56.468171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.468272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.468298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.838 qpair failed and we were unable to recover it. 00:27:28.838 [2024-12-08 02:29:56.468409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.468528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.468561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.838 qpair failed and we were unable to recover it. 00:27:28.838 [2024-12-08 02:29:56.468648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.468739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.468764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.838 qpair failed and we were unable to recover it. 00:27:28.838 [2024-12-08 02:29:56.468841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.468947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.468973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.838 qpair failed and we were unable to recover it. 00:27:28.838 [2024-12-08 02:29:56.469094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.469210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.469236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.838 qpair failed and we were unable to recover it. 00:27:28.838 [2024-12-08 02:29:56.469351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.469481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.469507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.838 qpair failed and we were unable to recover it. 00:27:28.838 [2024-12-08 02:29:56.469597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.469715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.469741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.838 qpair failed and we were unable to recover it. 00:27:28.838 [2024-12-08 02:29:56.469883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.470007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.470034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.838 qpair failed and we were unable to recover it. 00:27:28.838 [2024-12-08 02:29:56.470150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.470235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.470262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.838 qpair failed and we were unable to recover it. 00:27:28.838 [2024-12-08 02:29:56.470402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.470550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.470576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.838 qpair failed and we were unable to recover it. 00:27:28.838 [2024-12-08 02:29:56.470692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.470779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.470805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.838 qpair failed and we were unable to recover it. 00:27:28.838 [2024-12-08 02:29:56.470934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.471049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.471075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.838 qpair failed and we were unable to recover it. 00:27:28.838 [2024-12-08 02:29:56.471224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.471334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.471359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.838 qpair failed and we were unable to recover it. 00:27:28.838 [2024-12-08 02:29:56.471437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.471569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.471597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.838 qpair failed and we were unable to recover it. 00:27:28.838 [2024-12-08 02:29:56.471715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.471827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.471853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.838 qpair failed and we were unable to recover it. 00:27:28.838 [2024-12-08 02:29:56.471970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.472091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.472117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.838 qpair failed and we were unable to recover it. 00:27:28.838 [2024-12-08 02:29:56.472203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.472314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.472341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.838 qpair failed and we were unable to recover it. 00:27:28.838 [2024-12-08 02:29:56.472453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.472565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.472596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.838 qpair failed and we were unable to recover it. 00:27:28.838 [2024-12-08 02:29:56.472685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.472798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.472823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.838 qpair failed and we were unable to recover it. 00:27:28.838 [2024-12-08 02:29:56.472973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.473116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.473142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.838 qpair failed and we were unable to recover it. 00:27:28.838 [2024-12-08 02:29:56.473252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.473368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.473395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.838 qpair failed and we were unable to recover it. 00:27:28.838 [2024-12-08 02:29:56.473501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.473590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.473617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.838 qpair failed and we were unable to recover it. 00:27:28.838 [2024-12-08 02:29:56.473703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.473845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.838 [2024-12-08 02:29:56.473871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.838 qpair failed and we were unable to recover it. 00:27:28.839 [2024-12-08 02:29:56.474005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.474089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.474113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.839 qpair failed and we were unable to recover it. 00:27:28.839 [2024-12-08 02:29:56.474258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.474353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.474379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.839 qpair failed and we were unable to recover it. 00:27:28.839 [2024-12-08 02:29:56.474469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.474552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.474578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.839 qpair failed and we were unable to recover it. 00:27:28.839 [2024-12-08 02:29:56.474693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.474807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.474833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.839 qpair failed and we were unable to recover it. 00:27:28.839 [2024-12-08 02:29:56.474947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.475031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.475062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.839 qpair failed and we were unable to recover it. 00:27:28.839 [2024-12-08 02:29:56.475225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.475341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.475367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.839 qpair failed and we were unable to recover it. 00:27:28.839 [2024-12-08 02:29:56.475487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.475581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.475607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.839 qpair failed and we were unable to recover it. 00:27:28.839 [2024-12-08 02:29:56.475692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.475774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.475799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.839 qpair failed and we were unable to recover it. 00:27:28.839 [2024-12-08 02:29:56.475942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.476028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.476053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.839 qpair failed and we were unable to recover it. 00:27:28.839 [2024-12-08 02:29:56.476168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.476245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.476271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.839 qpair failed and we were unable to recover it. 00:27:28.839 [2024-12-08 02:29:56.476354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.476435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.476460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.839 qpair failed and we were unable to recover it. 00:27:28.839 [2024-12-08 02:29:56.476599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.476718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.476743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.839 qpair failed and we were unable to recover it. 00:27:28.839 [2024-12-08 02:29:56.476823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.476936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.476961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.839 qpair failed and we were unable to recover it. 00:27:28.839 [2024-12-08 02:29:56.477082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.477166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.477192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.839 qpair failed and we were unable to recover it. 00:27:28.839 [2024-12-08 02:29:56.477312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.477433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.477464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.839 qpair failed and we were unable to recover it. 00:27:28.839 [2024-12-08 02:29:56.477606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.477697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.477722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.839 qpair failed and we were unable to recover it. 00:27:28.839 [2024-12-08 02:29:56.477814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.477932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.477958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.839 qpair failed and we were unable to recover it. 00:27:28.839 [2024-12-08 02:29:56.478048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.478164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.478190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.839 qpair failed and we were unable to recover it. 00:27:28.839 [2024-12-08 02:29:56.478340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.478449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.478475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.839 qpair failed and we were unable to recover it. 00:27:28.839 [2024-12-08 02:29:56.478607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.478752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.478778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.839 qpair failed and we were unable to recover it. 00:27:28.839 [2024-12-08 02:29:56.478894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.478993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.479019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.839 qpair failed and we were unable to recover it. 00:27:28.839 [2024-12-08 02:29:56.479134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.479221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.479247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.839 qpair failed and we were unable to recover it. 00:27:28.839 [2024-12-08 02:29:56.479369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.479516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.479547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.839 qpair failed and we were unable to recover it. 00:27:28.839 [2024-12-08 02:29:56.479629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.479728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.479755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.839 qpair failed and we were unable to recover it. 00:27:28.839 [2024-12-08 02:29:56.479846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.839 [2024-12-08 02:29:56.479932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.479961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.840 qpair failed and we were unable to recover it. 00:27:28.840 [2024-12-08 02:29:56.480076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.480161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.480186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.840 qpair failed and we were unable to recover it. 00:27:28.840 [2024-12-08 02:29:56.480318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.480404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.480429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.840 qpair failed and we were unable to recover it. 00:27:28.840 [2024-12-08 02:29:56.480522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.480662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.480688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.840 qpair failed and we were unable to recover it. 00:27:28.840 [2024-12-08 02:29:56.480802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.480891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.480917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.840 qpair failed and we were unable to recover it. 00:27:28.840 [2024-12-08 02:29:56.481002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.481117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.481144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.840 qpair failed and we were unable to recover it. 00:27:28.840 [2024-12-08 02:29:56.481231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.481318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.481345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.840 qpair failed and we were unable to recover it. 00:27:28.840 [2024-12-08 02:29:56.481458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.481550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.481576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.840 qpair failed and we were unable to recover it. 00:27:28.840 [2024-12-08 02:29:56.481700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.481815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.481842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.840 qpair failed and we were unable to recover it. 00:27:28.840 [2024-12-08 02:29:56.481979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.482089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.482115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.840 qpair failed and we were unable to recover it. 00:27:28.840 [2024-12-08 02:29:56.482202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.482314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.482339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.840 qpair failed and we were unable to recover it. 00:27:28.840 [2024-12-08 02:29:56.482456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.482566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.482592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.840 qpair failed and we were unable to recover it. 00:27:28.840 [2024-12-08 02:29:56.482702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.482792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.482817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.840 qpair failed and we were unable to recover it. 00:27:28.840 [2024-12-08 02:29:56.482928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.483014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.483039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.840 qpair failed and we were unable to recover it. 00:27:28.840 [2024-12-08 02:29:56.483165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.483239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.483264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.840 qpair failed and we were unable to recover it. 00:27:28.840 [2024-12-08 02:29:56.483405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.483520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.483558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.840 qpair failed and we were unable to recover it. 00:27:28.840 [2024-12-08 02:29:56.483678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.483789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.483813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.840 qpair failed and we were unable to recover it. 00:27:28.840 [2024-12-08 02:29:56.483920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.484041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.484067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.840 qpair failed and we were unable to recover it. 00:27:28.840 [2024-12-08 02:29:56.484154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.484261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.484287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.840 qpair failed and we were unable to recover it. 00:27:28.840 [2024-12-08 02:29:56.484376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.484486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.484513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.840 qpair failed and we were unable to recover it. 00:27:28.840 [2024-12-08 02:29:56.484641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.484756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.484781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.840 qpair failed and we were unable to recover it. 00:27:28.840 [2024-12-08 02:29:56.484876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.484965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.484991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.840 qpair failed and we were unable to recover it. 00:27:28.840 [2024-12-08 02:29:56.485096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.485200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.485226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.840 qpair failed and we were unable to recover it. 00:27:28.840 [2024-12-08 02:29:56.485334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.485475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.485500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.840 qpair failed and we were unable to recover it. 00:27:28.840 [2024-12-08 02:29:56.485594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.485710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.485736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.840 qpair failed and we were unable to recover it. 00:27:28.840 [2024-12-08 02:29:56.485853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.485948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.485975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.840 qpair failed and we were unable to recover it. 00:27:28.840 [2024-12-08 02:29:56.486105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.486220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.486246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.840 qpair failed and we were unable to recover it. 00:27:28.840 [2024-12-08 02:29:56.486339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.486481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.840 [2024-12-08 02:29:56.486508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.840 qpair failed and we were unable to recover it. 00:27:28.841 [2024-12-08 02:29:56.486601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.486709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.486736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.841 qpair failed and we were unable to recover it. 00:27:28.841 [2024-12-08 02:29:56.486850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.486954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.486979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.841 qpair failed and we were unable to recover it. 00:27:28.841 [2024-12-08 02:29:56.487058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.487197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.487223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.841 qpair failed and we were unable to recover it. 00:27:28.841 [2024-12-08 02:29:56.487331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.487424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.487450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.841 qpair failed and we were unable to recover it. 00:27:28.841 [2024-12-08 02:29:56.487571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.487649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.487675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.841 qpair failed and we were unable to recover it. 00:27:28.841 [2024-12-08 02:29:56.487790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.487905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.487931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.841 qpair failed and we were unable to recover it. 00:27:28.841 [2024-12-08 02:29:56.488044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.488159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.488185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.841 qpair failed and we were unable to recover it. 00:27:28.841 [2024-12-08 02:29:56.488264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.488356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.488381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.841 qpair failed and we were unable to recover it. 00:27:28.841 [2024-12-08 02:29:56.488464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.488585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.488612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.841 qpair failed and we were unable to recover it. 00:27:28.841 [2024-12-08 02:29:56.488697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.488812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.488838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.841 qpair failed and we were unable to recover it. 00:27:28.841 [2024-12-08 02:29:56.488933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.489040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.489065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.841 qpair failed and we were unable to recover it. 00:27:28.841 [2024-12-08 02:29:56.489155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.489243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.489268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.841 qpair failed and we were unable to recover it. 00:27:28.841 [2024-12-08 02:29:56.489362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.489451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.489476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.841 qpair failed and we were unable to recover it. 00:27:28.841 [2024-12-08 02:29:56.489567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.489676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.489701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.841 qpair failed and we were unable to recover it. 00:27:28.841 [2024-12-08 02:29:56.489812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.489924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.489949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.841 qpair failed and we were unable to recover it. 00:27:28.841 [2024-12-08 02:29:56.490060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.490213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.490239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.841 qpair failed and we were unable to recover it. 00:27:28.841 [2024-12-08 02:29:56.490359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.490503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.490529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.841 qpair failed and we were unable to recover it. 00:27:28.841 [2024-12-08 02:29:56.490677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.490791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.490816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.841 qpair failed and we were unable to recover it. 00:27:28.841 [2024-12-08 02:29:56.490929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.491042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.491068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.841 qpair failed and we were unable to recover it. 00:27:28.841 [2024-12-08 02:29:56.491185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.491301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.491327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.841 qpair failed and we were unable to recover it. 00:27:28.841 [2024-12-08 02:29:56.491476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.491577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.491605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.841 qpair failed and we were unable to recover it. 00:27:28.841 [2024-12-08 02:29:56.491697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.491813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.491839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.841 qpair failed and we were unable to recover it. 00:27:28.841 [2024-12-08 02:29:56.491933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.492045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.492071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.841 qpair failed and we were unable to recover it. 00:27:28.841 [2024-12-08 02:29:56.492194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.492348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.492374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.841 qpair failed and we were unable to recover it. 00:27:28.841 [2024-12-08 02:29:56.492494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.492584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.492610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.841 qpair failed and we were unable to recover it. 00:27:28.841 [2024-12-08 02:29:56.492690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.492809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.492835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.841 qpair failed and we were unable to recover it. 00:27:28.841 [2024-12-08 02:29:56.492928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.493047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.493072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.841 qpair failed and we were unable to recover it. 00:27:28.841 [2024-12-08 02:29:56.493163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.493347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.493373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.841 qpair failed and we were unable to recover it. 00:27:28.841 [2024-12-08 02:29:56.493472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.493609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.493635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.841 qpair failed and we were unable to recover it. 00:27:28.841 [2024-12-08 02:29:56.493748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.493865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.493892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.841 qpair failed and we were unable to recover it. 00:27:28.841 [2024-12-08 02:29:56.493990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.841 [2024-12-08 02:29:56.494106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.494134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.842 qpair failed and we were unable to recover it. 00:27:28.842 [2024-12-08 02:29:56.494231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.494314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.494339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.842 qpair failed and we were unable to recover it. 00:27:28.842 [2024-12-08 02:29:56.494448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.494570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.494596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.842 qpair failed and we were unable to recover it. 00:27:28.842 [2024-12-08 02:29:56.494714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.494800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.494825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.842 qpair failed and we were unable to recover it. 00:27:28.842 [2024-12-08 02:29:56.494904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.495020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.495047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.842 qpair failed and we were unable to recover it. 00:27:28.842 [2024-12-08 02:29:56.495166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.495253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.495280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.842 qpair failed and we were unable to recover it. 00:27:28.842 [2024-12-08 02:29:56.495371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.495459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.495485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.842 qpair failed and we were unable to recover it. 00:27:28.842 [2024-12-08 02:29:56.495574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.495652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.495678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.842 qpair failed and we were unable to recover it. 00:27:28.842 [2024-12-08 02:29:56.495760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.495902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.495929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.842 qpair failed and we were unable to recover it. 00:27:28.842 [2024-12-08 02:29:56.496050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.496170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.496196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.842 qpair failed and we were unable to recover it. 00:27:28.842 [2024-12-08 02:29:56.496288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.496378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.496403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.842 qpair failed and we were unable to recover it. 00:27:28.842 [2024-12-08 02:29:56.496546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.496636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.496661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.842 qpair failed and we were unable to recover it. 00:27:28.842 [2024-12-08 02:29:56.496751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.496895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.496921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.842 qpair failed and we were unable to recover it. 00:27:28.842 [2024-12-08 02:29:56.497045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.497166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.497192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.842 qpair failed and we were unable to recover it. 00:27:28.842 [2024-12-08 02:29:56.497282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.497368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.497396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.842 qpair failed and we were unable to recover it. 00:27:28.842 [2024-12-08 02:29:56.497519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.497649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.497676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.842 qpair failed and we were unable to recover it. 00:27:28.842 [2024-12-08 02:29:56.497760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.497838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.497863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.842 qpair failed and we were unable to recover it. 00:27:28.842 [2024-12-08 02:29:56.497952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.498037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.498064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.842 qpair failed and we were unable to recover it. 00:27:28.842 [2024-12-08 02:29:56.498155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.498266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.498293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.842 qpair failed and we were unable to recover it. 00:27:28.842 [2024-12-08 02:29:56.498382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.498509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.498540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.842 qpair failed and we were unable to recover it. 00:27:28.842 [2024-12-08 02:29:56.498630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.498771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.498797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.842 qpair failed and we were unable to recover it. 00:27:28.842 [2024-12-08 02:29:56.498914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.498996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.499022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.842 qpair failed and we were unable to recover it. 00:27:28.842 [2024-12-08 02:29:56.499109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.499202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.499227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.842 qpair failed and we were unable to recover it. 00:27:28.842 [2024-12-08 02:29:56.499318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.499433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.499459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.842 qpair failed and we were unable to recover it. 00:27:28.842 [2024-12-08 02:29:56.499583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.499668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.499693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.842 qpair failed and we were unable to recover it. 00:27:28.842 [2024-12-08 02:29:56.499772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.499886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.499913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.842 qpair failed and we were unable to recover it. 00:27:28.842 [2024-12-08 02:29:56.500064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.500208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.500234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.842 qpair failed and we were unable to recover it. 00:27:28.842 [2024-12-08 02:29:56.500357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.500471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.500496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.842 qpair failed and we were unable to recover it. 00:27:28.842 [2024-12-08 02:29:56.500648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.500774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.500799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.842 qpair failed and we were unable to recover it. 00:27:28.842 [2024-12-08 02:29:56.500887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.500998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.842 [2024-12-08 02:29:56.501025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.842 qpair failed and we were unable to recover it. 00:27:28.842 [2024-12-08 02:29:56.501116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.501236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.501262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.843 qpair failed and we were unable to recover it. 00:27:28.843 [2024-12-08 02:29:56.501354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.501467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.501495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.843 qpair failed and we were unable to recover it. 00:27:28.843 [2024-12-08 02:29:56.501632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.501774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.501800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.843 qpair failed and we were unable to recover it. 00:27:28.843 [2024-12-08 02:29:56.501952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.502057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.502083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.843 qpair failed and we were unable to recover it. 00:27:28.843 [2024-12-08 02:29:56.502197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.502286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.502312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.843 qpair failed and we were unable to recover it. 00:27:28.843 [2024-12-08 02:29:56.502420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.502511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.502542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.843 qpair failed and we were unable to recover it. 00:27:28.843 [2024-12-08 02:29:56.502626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.502754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.502780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.843 qpair failed and we were unable to recover it. 00:27:28.843 [2024-12-08 02:29:56.502870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.502985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.503011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.843 qpair failed and we were unable to recover it. 00:27:28.843 [2024-12-08 02:29:56.503123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.503235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.503260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.843 qpair failed and we were unable to recover it. 00:27:28.843 [2024-12-08 02:29:56.503379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.503498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.503523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.843 qpair failed and we were unable to recover it. 00:27:28.843 [2024-12-08 02:29:56.503663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.503809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.503834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.843 qpair failed and we were unable to recover it. 00:27:28.843 [2024-12-08 02:29:56.503961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.504075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.504101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.843 qpair failed and we were unable to recover it. 00:27:28.843 [2024-12-08 02:29:56.504250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.504377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.504403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.843 qpair failed and we were unable to recover it. 00:27:28.843 [2024-12-08 02:29:56.504519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.504610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.504637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.843 qpair failed and we were unable to recover it. 00:27:28.843 [2024-12-08 02:29:56.504725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.504870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.504895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.843 qpair failed and we were unable to recover it. 00:27:28.843 [2024-12-08 02:29:56.504981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.505070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.505096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.843 qpair failed and we were unable to recover it. 00:27:28.843 [2024-12-08 02:29:56.505184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.505298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.505329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.843 qpair failed and we were unable to recover it. 00:27:28.843 [2024-12-08 02:29:56.505453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.505599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.505626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.843 qpair failed and we were unable to recover it. 00:27:28.843 [2024-12-08 02:29:56.505715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.505856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.505881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.843 qpair failed and we were unable to recover it. 00:27:28.843 [2024-12-08 02:29:56.505967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.506077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.506102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.843 qpair failed and we were unable to recover it. 00:27:28.843 [2024-12-08 02:29:56.506200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.506348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.506375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.843 qpair failed and we were unable to recover it. 00:27:28.843 [2024-12-08 02:29:56.506507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.506627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.506652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.843 qpair failed and we were unable to recover it. 00:27:28.843 [2024-12-08 02:29:56.506741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.506831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.506856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.843 qpair failed and we were unable to recover it. 00:27:28.843 [2024-12-08 02:29:56.506938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.507061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.507087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.843 qpair failed and we were unable to recover it. 00:27:28.843 [2024-12-08 02:29:56.507174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.507318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.507345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.843 qpair failed and we were unable to recover it. 00:27:28.843 [2024-12-08 02:29:56.507472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.507582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.507609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.843 qpair failed and we were unable to recover it. 00:27:28.843 [2024-12-08 02:29:56.507703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.507818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.507846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.843 qpair failed and we were unable to recover it. 00:27:28.843 [2024-12-08 02:29:56.507960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.508076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.508103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.843 qpair failed and we were unable to recover it. 00:27:28.843 [2024-12-08 02:29:56.508201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.508309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.508335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.843 qpair failed and we were unable to recover it. 00:27:28.843 [2024-12-08 02:29:56.508458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.508544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.508571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.843 qpair failed and we were unable to recover it. 00:27:28.843 [2024-12-08 02:29:56.508685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.508822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.508853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.843 qpair failed and we were unable to recover it. 00:27:28.843 [2024-12-08 02:29:56.508966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.509053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.509079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.843 qpair failed and we were unable to recover it. 00:27:28.843 [2024-12-08 02:29:56.509173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.509291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.509316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.843 qpair failed and we were unable to recover it. 00:27:28.843 [2024-12-08 02:29:56.509406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.843 [2024-12-08 02:29:56.509519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.509558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.844 qpair failed and we were unable to recover it. 00:27:28.844 [2024-12-08 02:29:56.509676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.509764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.509789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.844 qpair failed and we were unable to recover it. 00:27:28.844 [2024-12-08 02:29:56.509900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.510008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.510033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.844 qpair failed and we were unable to recover it. 00:27:28.844 [2024-12-08 02:29:56.510180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.510266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.510291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.844 qpair failed and we were unable to recover it. 00:27:28.844 [2024-12-08 02:29:56.510382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.510490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.510515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.844 qpair failed and we were unable to recover it. 00:27:28.844 [2024-12-08 02:29:56.510644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.510770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.510796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.844 qpair failed and we were unable to recover it. 00:27:28.844 [2024-12-08 02:29:56.510915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.511006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.511032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.844 qpair failed and we were unable to recover it. 00:27:28.844 [2024-12-08 02:29:56.511159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.511249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.511274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.844 qpair failed and we were unable to recover it. 00:27:28.844 [2024-12-08 02:29:56.511385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.511466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.511492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.844 qpair failed and we were unable to recover it. 00:27:28.844 [2024-12-08 02:29:56.511623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.511734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.511764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.844 qpair failed and we were unable to recover it. 00:27:28.844 [2024-12-08 02:29:56.511924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.512036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.512069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.844 qpair failed and we were unable to recover it. 00:27:28.844 [2024-12-08 02:29:56.512189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.512291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.512321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.844 qpair failed and we were unable to recover it. 00:27:28.844 [2024-12-08 02:29:56.512442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.512529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.512563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.844 qpair failed and we were unable to recover it. 00:27:28.844 [2024-12-08 02:29:56.512689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.512775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.512803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.844 qpair failed and we were unable to recover it. 00:27:28.844 [2024-12-08 02:29:56.512884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.512993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.513017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.844 qpair failed and we were unable to recover it. 00:27:28.844 [2024-12-08 02:29:56.513139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.513237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.513264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.844 qpair failed and we were unable to recover it. 00:27:28.844 [2024-12-08 02:29:56.513394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.513511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.513544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.844 qpair failed and we were unable to recover it. 00:27:28.844 [2024-12-08 02:29:56.513661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.513741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.513767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.844 qpair failed and we were unable to recover it. 00:27:28.844 [2024-12-08 02:29:56.513880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.513973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.513999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.844 qpair failed and we were unable to recover it. 00:27:28.844 [2024-12-08 02:29:56.514116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.514235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.514260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.844 qpair failed and we were unable to recover it. 00:27:28.844 [2024-12-08 02:29:56.514361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.514472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.514497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.844 qpair failed and we were unable to recover it. 00:27:28.844 [2024-12-08 02:29:56.514599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.514713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.514739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.844 qpair failed and we were unable to recover it. 00:27:28.844 [2024-12-08 02:29:56.514879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.514978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.515003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.844 qpair failed and we were unable to recover it. 00:27:28.844 [2024-12-08 02:29:56.515115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.515262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.515304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.844 qpair failed and we were unable to recover it. 00:27:28.844 [2024-12-08 02:29:56.515419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.515511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.515545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.844 qpair failed and we were unable to recover it. 00:27:28.844 [2024-12-08 02:29:56.515686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.515812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.515837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.844 qpair failed and we were unable to recover it. 00:27:28.844 [2024-12-08 02:29:56.515960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.516079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.516110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.844 qpair failed and we were unable to recover it. 00:27:28.844 [2024-12-08 02:29:56.516234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.516345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.516373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.844 qpair failed and we were unable to recover it. 00:27:28.844 [2024-12-08 02:29:56.516526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.516667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.516693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.844 qpair failed and we were unable to recover it. 00:27:28.844 [2024-12-08 02:29:56.516782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.516871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.516908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.844 qpair failed and we were unable to recover it. 00:27:28.844 [2024-12-08 02:29:56.517024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.844 [2024-12-08 02:29:56.517164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.517189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.845 qpair failed and we were unable to recover it. 00:27:28.845 [2024-12-08 02:29:56.517346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.517460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.517486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.845 qpair failed and we were unable to recover it. 00:27:28.845 [2024-12-08 02:29:56.517609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.517736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.517762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.845 qpair failed and we were unable to recover it. 00:27:28.845 [2024-12-08 02:29:56.517843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.517964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.517990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.845 qpair failed and we were unable to recover it. 00:27:28.845 [2024-12-08 02:29:56.518115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.518202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.518229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.845 qpair failed and we were unable to recover it. 00:27:28.845 [2024-12-08 02:29:56.518316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.518423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.518450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.845 qpair failed and we were unable to recover it. 00:27:28.845 [2024-12-08 02:29:56.518589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.518679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.518704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.845 qpair failed and we were unable to recover it. 00:27:28.845 [2024-12-08 02:29:56.518787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.518876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.518901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.845 qpair failed and we were unable to recover it. 00:27:28.845 [2024-12-08 02:29:56.519010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.519126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.519157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.845 qpair failed and we were unable to recover it. 00:27:28.845 [2024-12-08 02:29:56.519305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.519417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.519442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.845 qpair failed and we were unable to recover it. 00:27:28.845 [2024-12-08 02:29:56.519528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.519633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.519658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.845 qpair failed and we were unable to recover it. 00:27:28.845 [2024-12-08 02:29:56.519740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.519861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.519887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.845 qpair failed and we were unable to recover it. 00:27:28.845 [2024-12-08 02:29:56.520006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.520117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.520143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.845 qpair failed and we were unable to recover it. 00:27:28.845 [2024-12-08 02:29:56.520219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.520304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.520342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.845 qpair failed and we were unable to recover it. 00:27:28.845 [2024-12-08 02:29:56.520455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.520550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.520577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.845 qpair failed and we were unable to recover it. 00:27:28.845 [2024-12-08 02:29:56.520670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.520807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.520833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.845 qpair failed and we were unable to recover it. 00:27:28.845 [2024-12-08 02:29:56.520924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.521061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.521088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.845 qpair failed and we were unable to recover it. 00:27:28.845 [2024-12-08 02:29:56.521213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.521288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.521315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.845 qpair failed and we were unable to recover it. 00:27:28.845 [2024-12-08 02:29:56.521434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.521558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.521585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.845 qpair failed and we were unable to recover it. 00:27:28.845 [2024-12-08 02:29:56.521670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.521789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.521815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.845 qpair failed and we were unable to recover it. 00:27:28.845 [2024-12-08 02:29:56.521928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.522041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.522067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.845 qpair failed and we were unable to recover it. 00:27:28.845 [2024-12-08 02:29:56.522158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.522278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.522305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.845 qpair failed and we were unable to recover it. 00:27:28.845 [2024-12-08 02:29:56.522430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.522511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.522542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.845 qpair failed and we were unable to recover it. 00:27:28.845 [2024-12-08 02:29:56.522664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.522777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.522803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.845 qpair failed and we were unable to recover it. 00:27:28.845 [2024-12-08 02:29:56.522889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.523008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.523041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.845 qpair failed and we were unable to recover it. 00:27:28.845 [2024-12-08 02:29:56.523121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.523241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.523267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.845 qpair failed and we were unable to recover it. 00:27:28.845 [2024-12-08 02:29:56.523348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.523462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.523488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.845 qpair failed and we were unable to recover it. 00:27:28.845 [2024-12-08 02:29:56.523576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.523686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.523712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.845 qpair failed and we were unable to recover it. 00:27:28.845 [2024-12-08 02:29:56.523828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.523917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.523945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.845 qpair failed and we were unable to recover it. 00:27:28.845 [2024-12-08 02:29:56.524062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.524200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.524226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.845 qpair failed and we were unable to recover it. 00:27:28.845 [2024-12-08 02:29:56.524367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.524450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.524476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.845 qpair failed and we were unable to recover it. 00:27:28.845 [2024-12-08 02:29:56.524601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.524690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.524716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.845 qpair failed and we were unable to recover it. 00:27:28.845 [2024-12-08 02:29:56.524797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.524880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.845 [2024-12-08 02:29:56.524905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.846 qpair failed and we were unable to recover it. 00:27:28.846 [2024-12-08 02:29:56.525015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.525123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.525149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.846 qpair failed and we were unable to recover it. 00:27:28.846 [2024-12-08 02:29:56.525242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.525320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.525346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.846 qpair failed and we were unable to recover it. 00:27:28.846 [2024-12-08 02:29:56.525434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.525508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.525534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.846 qpair failed and we were unable to recover it. 00:27:28.846 [2024-12-08 02:29:56.525686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.525766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.525792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.846 qpair failed and we were unable to recover it. 00:27:28.846 [2024-12-08 02:29:56.525876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.525960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.525985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.846 qpair failed and we were unable to recover it. 00:27:28.846 [2024-12-08 02:29:56.526087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.526194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.526220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.846 qpair failed and we were unable to recover it. 00:27:28.846 [2024-12-08 02:29:56.526338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.526425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.526451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.846 qpair failed and we were unable to recover it. 00:27:28.846 [2024-12-08 02:29:56.526566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.526655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.526681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.846 qpair failed and we were unable to recover it. 00:27:28.846 [2024-12-08 02:29:56.526768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.526893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.526919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.846 qpair failed and we were unable to recover it. 00:27:28.846 [2024-12-08 02:29:56.527010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.527122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.527149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.846 qpair failed and we were unable to recover it. 00:27:28.846 [2024-12-08 02:29:56.527286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.527438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.527464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.846 qpair failed and we were unable to recover it. 00:27:28.846 [2024-12-08 02:29:56.527583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.527694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.527720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.846 qpair failed and we were unable to recover it. 00:27:28.846 [2024-12-08 02:29:56.527863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.527950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.527979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.846 qpair failed and we were unable to recover it. 00:27:28.846 [2024-12-08 02:29:56.528069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.528186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.528212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.846 qpair failed and we were unable to recover it. 00:27:28.846 [2024-12-08 02:29:56.528302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.528440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.528466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.846 qpair failed and we were unable to recover it. 00:27:28.846 [2024-12-08 02:29:56.528613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.528727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.528752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.846 qpair failed and we were unable to recover it. 00:27:28.846 [2024-12-08 02:29:56.528896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.529011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.529037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.846 qpair failed and we were unable to recover it. 00:27:28.846 [2024-12-08 02:29:56.529152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.529236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.529262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.846 qpair failed and we were unable to recover it. 00:27:28.846 [2024-12-08 02:29:56.529346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.529471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.529497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.846 qpair failed and we were unable to recover it. 00:27:28.846 [2024-12-08 02:29:56.529587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.529681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.529707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.846 qpair failed and we were unable to recover it. 00:27:28.846 [2024-12-08 02:29:56.529801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.529920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.529945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.846 qpair failed and we were unable to recover it. 00:27:28.846 [2024-12-08 02:29:56.530065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.530152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.530179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.846 qpair failed and we were unable to recover it. 00:27:28.846 [2024-12-08 02:29:56.530258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.530416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.530441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.846 qpair failed and we were unable to recover it. 00:27:28.846 [2024-12-08 02:29:56.530560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.530671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.530697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.846 qpair failed and we were unable to recover it. 00:27:28.846 [2024-12-08 02:29:56.530789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.530877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.530902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.846 qpair failed and we were unable to recover it. 00:27:28.846 [2024-12-08 02:29:56.531018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.531100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.531126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.846 qpair failed and we were unable to recover it. 00:27:28.846 [2024-12-08 02:29:56.531236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.531314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.531340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.846 qpair failed and we were unable to recover it. 00:27:28.846 [2024-12-08 02:29:56.531449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.531558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.531585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.846 qpair failed and we were unable to recover it. 00:27:28.846 [2024-12-08 02:29:56.531676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.531784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.531810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.846 qpair failed and we were unable to recover it. 00:27:28.846 [2024-12-08 02:29:56.531925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.532068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.532094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.846 qpair failed and we were unable to recover it. 00:27:28.846 [2024-12-08 02:29:56.532211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.532294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.532320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.846 qpair failed and we were unable to recover it. 00:27:28.846 [2024-12-08 02:29:56.532402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.532480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.532506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.846 qpair failed and we were unable to recover it. 00:27:28.846 [2024-12-08 02:29:56.532636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.532720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.846 [2024-12-08 02:29:56.532747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.846 qpair failed and we were unable to recover it. 00:27:28.847 [2024-12-08 02:29:56.532827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.532944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.532969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.847 qpair failed and we were unable to recover it. 00:27:28.847 [2024-12-08 02:29:56.533109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.533250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.533276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.847 qpair failed and we were unable to recover it. 00:27:28.847 [2024-12-08 02:29:56.533389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.533469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.533495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.847 qpair failed and we were unable to recover it. 00:27:28.847 [2024-12-08 02:29:56.533612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.533753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.533779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.847 qpair failed and we were unable to recover it. 00:27:28.847 [2024-12-08 02:29:56.533867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.533983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.534020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.847 qpair failed and we were unable to recover it. 00:27:28.847 [2024-12-08 02:29:56.534110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.534250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.534281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.847 qpair failed and we were unable to recover it. 00:27:28.847 [2024-12-08 02:29:56.534401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.534493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.534519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.847 qpair failed and we were unable to recover it. 00:27:28.847 [2024-12-08 02:29:56.534619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.534709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.534735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.847 qpair failed and we were unable to recover it. 00:27:28.847 [2024-12-08 02:29:56.534831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.534917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.534944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.847 qpair failed and we were unable to recover it. 00:27:28.847 [2024-12-08 02:29:56.535054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.535144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.535170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.847 qpair failed and we were unable to recover it. 00:27:28.847 [2024-12-08 02:29:56.535249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.535388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.535413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.847 qpair failed and we were unable to recover it. 00:27:28.847 [2024-12-08 02:29:56.535505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.535621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.535647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.847 qpair failed and we were unable to recover it. 00:27:28.847 [2024-12-08 02:29:56.535740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.535850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.535876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:28.847 qpair failed and we were unable to recover it. 00:27:28.847 [2024-12-08 02:29:56.535975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.536066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.536094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.847 qpair failed and we were unable to recover it. 00:27:28.847 [2024-12-08 02:29:56.536185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.536273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.536299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.847 qpair failed and we were unable to recover it. 00:27:28.847 [2024-12-08 02:29:56.536384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.536458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.536489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.847 qpair failed and we were unable to recover it. 00:27:28.847 [2024-12-08 02:29:56.536587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.536707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.536733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.847 qpair failed and we were unable to recover it. 00:27:28.847 [2024-12-08 02:29:56.536853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.536931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.536956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.847 qpair failed and we were unable to recover it. 00:27:28.847 [2024-12-08 02:29:56.537108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.537184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.537215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.847 qpair failed and we were unable to recover it. 00:27:28.847 [2024-12-08 02:29:56.537339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.537420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.537445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.847 qpair failed and we were unable to recover it. 00:27:28.847 [2024-12-08 02:29:56.537568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.537679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.537704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.847 qpair failed and we were unable to recover it. 00:27:28.847 [2024-12-08 02:29:56.537815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.537926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.537952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.847 qpair failed and we were unable to recover it. 00:27:28.847 [2024-12-08 02:29:56.538060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.538144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.538169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.847 qpair failed and we were unable to recover it. 00:27:28.847 [2024-12-08 02:29:56.538261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.538342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.538367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.847 qpair failed and we were unable to recover it. 00:27:28.847 [2024-12-08 02:29:56.538480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.538596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.538622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.847 qpair failed and we were unable to recover it. 00:27:28.847 [2024-12-08 02:29:56.538704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.538784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.538809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.847 qpair failed and we were unable to recover it. 00:27:28.847 [2024-12-08 02:29:56.538923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.538999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.539024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.847 qpair failed and we were unable to recover it. 00:27:28.847 [2024-12-08 02:29:56.539131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.539209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.539234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.847 qpair failed and we were unable to recover it. 00:27:28.847 [2024-12-08 02:29:56.539343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.539445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.539470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.847 qpair failed and we were unable to recover it. 00:27:28.847 [2024-12-08 02:29:56.539563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.539644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.539670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.847 qpair failed and we were unable to recover it. 00:27:28.847 [2024-12-08 02:29:56.539755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.539858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.539883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.847 qpair failed and we were unable to recover it. 00:27:28.847 [2024-12-08 02:29:56.539964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.540041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.540066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.847 qpair failed and we were unable to recover it. 00:27:28.847 [2024-12-08 02:29:56.540141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.540226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.847 [2024-12-08 02:29:56.540251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.847 qpair failed and we were unable to recover it. 00:27:28.847 [2024-12-08 02:29:56.540393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.540482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.540507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.848 qpair failed and we were unable to recover it. 00:27:28.848 [2024-12-08 02:29:56.540602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.540715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.540740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.848 qpair failed and we were unable to recover it. 00:27:28.848 [2024-12-08 02:29:56.540825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.540916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.540942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.848 qpair failed and we were unable to recover it. 00:27:28.848 [2024-12-08 02:29:56.541065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.541148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.541173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.848 qpair failed and we were unable to recover it. 00:27:28.848 [2024-12-08 02:29:56.541252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.541327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.541352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.848 qpair failed and we were unable to recover it. 00:27:28.848 [2024-12-08 02:29:56.541459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.541551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.541577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.848 qpair failed and we were unable to recover it. 00:27:28.848 [2024-12-08 02:29:56.541698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.541782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.541807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.848 qpair failed and we were unable to recover it. 00:27:28.848 [2024-12-08 02:29:56.541946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.542020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.542045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.848 qpair failed and we were unable to recover it. 00:27:28.848 [2024-12-08 02:29:56.542164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.542304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.542329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.848 qpair failed and we were unable to recover it. 00:27:28.848 [2024-12-08 02:29:56.542409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.542495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.542520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.848 qpair failed and we were unable to recover it. 00:27:28.848 [2024-12-08 02:29:56.542649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.542738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.542763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.848 qpair failed and we were unable to recover it. 00:27:28.848 [2024-12-08 02:29:56.542875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.542986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.543011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.848 qpair failed and we were unable to recover it. 00:27:28.848 [2024-12-08 02:29:56.543088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.543194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.543219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.848 qpair failed and we were unable to recover it. 00:27:28.848 [2024-12-08 02:29:56.543340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.543466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.543492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.848 qpair failed and we were unable to recover it. 00:27:28.848 [2024-12-08 02:29:56.543612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.543714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.543738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.848 qpair failed and we were unable to recover it. 00:27:28.848 [2024-12-08 02:29:56.543827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.543931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.543956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.848 qpair failed and we were unable to recover it. 00:27:28.848 [2024-12-08 02:29:56.544100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.544208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.544233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.848 qpair failed and we were unable to recover it. 00:27:28.848 [2024-12-08 02:29:56.544338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.544411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.544436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.848 qpair failed and we were unable to recover it. 00:27:28.848 [2024-12-08 02:29:56.544517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.544607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.544632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.848 qpair failed and we were unable to recover it. 00:27:28.848 [2024-12-08 02:29:56.544713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.544797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.544823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.848 qpair failed and we were unable to recover it. 00:27:28.848 [2024-12-08 02:29:56.544902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.544987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.545012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.848 qpair failed and we were unable to recover it. 00:27:28.848 [2024-12-08 02:29:56.545133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.545246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.545271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.848 qpair failed and we were unable to recover it. 00:27:28.848 [2024-12-08 02:29:56.545360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.545477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.545503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.848 qpair failed and we were unable to recover it. 00:27:28.848 [2024-12-08 02:29:56.545595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.545717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.545742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.848 qpair failed and we were unable to recover it. 00:27:28.848 [2024-12-08 02:29:56.545825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.545906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.848 [2024-12-08 02:29:56.545931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.849 qpair failed and we were unable to recover it. 00:27:28.849 [2024-12-08 02:29:56.546018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.849 [2024-12-08 02:29:56.546106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.849 [2024-12-08 02:29:56.546132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.849 qpair failed and we were unable to recover it. 00:27:28.849 [2024-12-08 02:29:56.546219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.849 [2024-12-08 02:29:56.546300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.849 [2024-12-08 02:29:56.546325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:28.849 qpair failed and we were unable to recover it. 00:27:28.849 [2024-12-08 02:29:56.546420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.849 [2024-12-08 02:29:56.546498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.130 [2024-12-08 02:29:56.546522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.130 qpair failed and we were unable to recover it. 00:27:29.131 [2024-12-08 02:29:56.546643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.546753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.546779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.131 qpair failed and we were unable to recover it. 00:27:29.131 [2024-12-08 02:29:56.546918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.547056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.547081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.131 qpair failed and we were unable to recover it. 00:27:29.131 [2024-12-08 02:29:56.547194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.547336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.547362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.131 qpair failed and we were unable to recover it. 00:27:29.131 [2024-12-08 02:29:56.547457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.547562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.547588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.131 qpair failed and we were unable to recover it. 00:27:29.131 [2024-12-08 02:29:56.547700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.547787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.547812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.131 qpair failed and we were unable to recover it. 00:27:29.131 [2024-12-08 02:29:56.547904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.547985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.548014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.131 qpair failed and we were unable to recover it. 00:27:29.131 [2024-12-08 02:29:56.548158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.548242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.548267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.131 qpair failed and we were unable to recover it. 00:27:29.131 [2024-12-08 02:29:56.548347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.548429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.548454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.131 qpair failed and we were unable to recover it. 00:27:29.131 [2024-12-08 02:29:56.548554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.548647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.548673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.131 qpair failed and we were unable to recover it. 00:27:29.131 [2024-12-08 02:29:56.548760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.548849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.548874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.131 qpair failed and we were unable to recover it. 00:27:29.131 [2024-12-08 02:29:56.548988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.549066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.549091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.131 qpair failed and we were unable to recover it. 00:27:29.131 [2024-12-08 02:29:56.549207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.549318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.549343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.131 qpair failed and we were unable to recover it. 00:27:29.131 [2024-12-08 02:29:56.549460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.549553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.549579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.131 qpair failed and we were unable to recover it. 00:27:29.131 [2024-12-08 02:29:56.549688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.549771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.549796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.131 qpair failed and we were unable to recover it. 00:27:29.131 [2024-12-08 02:29:56.549879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.550025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.550050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.131 qpair failed and we were unable to recover it. 00:27:29.131 [2024-12-08 02:29:56.550164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.550254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.550279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.131 qpair failed and we were unable to recover it. 00:27:29.131 [2024-12-08 02:29:56.550371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.550454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.550481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.131 qpair failed and we were unable to recover it. 00:27:29.131 [2024-12-08 02:29:56.550581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.550663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.550688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.131 qpair failed and we were unable to recover it. 00:27:29.131 [2024-12-08 02:29:56.550774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.550860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.550885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.131 qpair failed and we were unable to recover it. 00:27:29.131 [2024-12-08 02:29:56.550960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.551039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.551064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.131 qpair failed and we were unable to recover it. 00:27:29.131 [2024-12-08 02:29:56.551111] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:29.131 [2024-12-08 02:29:56.551147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.551224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.551235] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:29.131 [2024-12-08 02:29:56.551249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.131 [2024-12-08 02:29:56.551253] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:29.131 qpair failed and we were unable to recover it. 00:27:29.131 [2024-12-08 02:29:56.551266] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:29.131 [2024-12-08 02:29:56.551334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.551329] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:29.131 [2024-12-08 02:29:56.551419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.551443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.131 [2024-12-08 02:29:56.551360] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:29.131 qpair failed and we were unable to recover it. 00:27:29.131 [2024-12-08 02:29:56.551404] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:29.131 [2024-12-08 02:29:56.551406] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:29.131 [2024-12-08 02:29:56.551542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.551633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.551657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.131 qpair failed and we were unable to recover it. 00:27:29.131 [2024-12-08 02:29:56.551769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.551857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.551883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.131 qpair failed and we were unable to recover it. 00:27:29.131 [2024-12-08 02:29:56.551984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.552069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.131 [2024-12-08 02:29:56.552094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.131 qpair failed and we were unable to recover it. 00:27:29.131 [2024-12-08 02:29:56.552209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.552321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.552346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.132 qpair failed and we were unable to recover it. 00:27:29.132 [2024-12-08 02:29:56.552441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.552551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.552577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.132 qpair failed and we were unable to recover it. 00:27:29.132 [2024-12-08 02:29:56.552666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.552758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.552784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.132 qpair failed and we were unable to recover it. 00:27:29.132 [2024-12-08 02:29:56.552873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.552985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.553011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.132 qpair failed and we were unable to recover it. 00:27:29.132 [2024-12-08 02:29:56.553121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.553241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.553266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.132 qpair failed and we were unable to recover it. 00:27:29.132 [2024-12-08 02:29:56.553351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.553465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.553490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.132 qpair failed and we were unable to recover it. 00:27:29.132 [2024-12-08 02:29:56.553586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.553664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.553689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.132 qpair failed and we were unable to recover it. 00:27:29.132 [2024-12-08 02:29:56.553784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.553896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.553921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.132 qpair failed and we were unable to recover it. 00:27:29.132 [2024-12-08 02:29:56.554001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.554117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.554142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.132 qpair failed and we were unable to recover it. 00:27:29.132 [2024-12-08 02:29:56.554232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.554312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.554337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.132 qpair failed and we were unable to recover it. 00:27:29.132 [2024-12-08 02:29:56.554417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.554528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.554559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.132 qpair failed and we were unable to recover it. 00:27:29.132 [2024-12-08 02:29:56.554644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.554731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.554757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.132 qpair failed and we were unable to recover it. 00:27:29.132 [2024-12-08 02:29:56.554869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.554947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.554972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.132 qpair failed and we were unable to recover it. 00:27:29.132 [2024-12-08 02:29:56.555056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.555137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.555162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.132 qpair failed and we were unable to recover it. 00:27:29.132 [2024-12-08 02:29:56.555276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.555387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.555413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.132 qpair failed and we were unable to recover it. 00:27:29.132 [2024-12-08 02:29:56.555499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.555597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.555624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.132 qpair failed and we were unable to recover it. 00:27:29.132 [2024-12-08 02:29:56.555712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.555802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.555827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.132 qpair failed and we were unable to recover it. 00:27:29.132 [2024-12-08 02:29:56.555910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.555997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.556021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.132 qpair failed and we were unable to recover it. 00:27:29.132 [2024-12-08 02:29:56.556104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.556188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.556213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.132 qpair failed and we were unable to recover it. 00:27:29.132 [2024-12-08 02:29:56.556308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.556388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.556413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.132 qpair failed and we were unable to recover it. 00:27:29.132 [2024-12-08 02:29:56.556499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.556582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.556608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.132 qpair failed and we were unable to recover it. 00:27:29.132 [2024-12-08 02:29:56.556723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.556802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.556827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.132 qpair failed and we were unable to recover it. 00:27:29.132 [2024-12-08 02:29:56.556941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.557050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.557086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.132 qpair failed and we were unable to recover it. 00:27:29.132 [2024-12-08 02:29:56.557171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.557277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.557302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.132 qpair failed and we were unable to recover it. 00:27:29.132 [2024-12-08 02:29:56.557385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.557464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.557489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.132 qpair failed and we were unable to recover it. 00:27:29.132 [2024-12-08 02:29:56.557598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.557691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.557716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.132 qpair failed and we were unable to recover it. 00:27:29.132 [2024-12-08 02:29:56.557799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.557872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.557897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.132 qpair failed and we were unable to recover it. 00:27:29.132 [2024-12-08 02:29:56.557975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.558084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.558109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.132 qpair failed and we were unable to recover it. 00:27:29.132 [2024-12-08 02:29:56.558198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.132 [2024-12-08 02:29:56.558315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.558340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.133 qpair failed and we were unable to recover it. 00:27:29.133 [2024-12-08 02:29:56.558450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.558547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.558574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.133 qpair failed and we were unable to recover it. 00:27:29.133 [2024-12-08 02:29:56.558656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.558735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.558760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.133 qpair failed and we were unable to recover it. 00:27:29.133 [2024-12-08 02:29:56.558865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.558947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.558972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.133 qpair failed and we were unable to recover it. 00:27:29.133 [2024-12-08 02:29:56.559049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.559189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.559214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.133 qpair failed and we were unable to recover it. 00:27:29.133 [2024-12-08 02:29:56.559294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.559376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.559402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.133 qpair failed and we were unable to recover it. 00:27:29.133 [2024-12-08 02:29:56.559513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.559630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.559656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.133 qpair failed and we were unable to recover it. 00:27:29.133 [2024-12-08 02:29:56.559730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.559813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.559838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.133 qpair failed and we were unable to recover it. 00:27:29.133 [2024-12-08 02:29:56.559964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.560052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.560078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.133 qpair failed and we were unable to recover it. 00:27:29.133 [2024-12-08 02:29:56.560166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.560275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.560300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.133 qpair failed and we were unable to recover it. 00:27:29.133 [2024-12-08 02:29:56.560406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.560486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.560511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.133 qpair failed and we were unable to recover it. 00:27:29.133 [2024-12-08 02:29:56.560598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.560716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.560745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.133 qpair failed and we were unable to recover it. 00:27:29.133 [2024-12-08 02:29:56.560825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.560907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.560933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.133 qpair failed and we were unable to recover it. 00:27:29.133 [2024-12-08 02:29:56.561052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.561159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.561184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.133 qpair failed and we were unable to recover it. 00:27:29.133 [2024-12-08 02:29:56.561272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.561380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.561405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.133 qpair failed and we were unable to recover it. 00:27:29.133 [2024-12-08 02:29:56.561486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.561567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.561591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.133 qpair failed and we were unable to recover it. 00:27:29.133 [2024-12-08 02:29:56.561715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.561854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.561879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.133 qpair failed and we were unable to recover it. 00:27:29.133 [2024-12-08 02:29:56.561952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.562063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.562089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.133 qpair failed and we were unable to recover it. 00:27:29.133 [2024-12-08 02:29:56.562230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.562308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.562333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.133 qpair failed and we were unable to recover it. 00:27:29.133 [2024-12-08 02:29:56.562443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.562528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.562559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.133 qpair failed and we were unable to recover it. 00:27:29.133 [2024-12-08 02:29:56.562667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.562782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.562808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.133 qpair failed and we were unable to recover it. 00:27:29.133 [2024-12-08 02:29:56.562897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.563020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.563049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.133 qpair failed and we were unable to recover it. 00:27:29.133 [2024-12-08 02:29:56.563139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.563224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.563249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.133 qpair failed and we were unable to recover it. 00:27:29.133 [2024-12-08 02:29:56.563366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.563454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.563479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.133 qpair failed and we were unable to recover it. 00:27:29.133 [2024-12-08 02:29:56.563623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.563696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.563721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.133 qpair failed and we were unable to recover it. 00:27:29.133 [2024-12-08 02:29:56.563809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.563896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.563922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.133 qpair failed and we were unable to recover it. 00:27:29.133 [2024-12-08 02:29:56.564004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.564109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.564134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.133 qpair failed and we were unable to recover it. 00:27:29.133 [2024-12-08 02:29:56.564221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.564336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.564362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.133 qpair failed and we were unable to recover it. 00:27:29.133 [2024-12-08 02:29:56.564443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.564526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.564558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.133 qpair failed and we were unable to recover it. 00:27:29.133 [2024-12-08 02:29:56.564647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.133 [2024-12-08 02:29:56.564766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.564791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.134 qpair failed and we were unable to recover it. 00:27:29.134 [2024-12-08 02:29:56.564929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.565074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.565099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.134 qpair failed and we were unable to recover it. 00:27:29.134 [2024-12-08 02:29:56.565185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.565325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.565350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.134 qpair failed and we were unable to recover it. 00:27:29.134 [2024-12-08 02:29:56.565442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.565554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.565579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.134 qpair failed and we were unable to recover it. 00:27:29.134 [2024-12-08 02:29:56.565663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.565741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.565765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.134 qpair failed and we were unable to recover it. 00:27:29.134 [2024-12-08 02:29:56.565862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.565971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.565996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.134 qpair failed and we were unable to recover it. 00:27:29.134 [2024-12-08 02:29:56.566078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.566195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.566221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.134 qpair failed and we were unable to recover it. 00:27:29.134 [2024-12-08 02:29:56.566313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.566390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.566415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.134 qpair failed and we were unable to recover it. 00:27:29.134 [2024-12-08 02:29:56.566503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.566584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.566610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.134 qpair failed and we were unable to recover it. 00:27:29.134 [2024-12-08 02:29:56.566686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.566772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.566796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.134 qpair failed and we were unable to recover it. 00:27:29.134 [2024-12-08 02:29:56.566889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.567002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.567029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.134 qpair failed and we were unable to recover it. 00:27:29.134 [2024-12-08 02:29:56.567111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.567195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.567220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.134 qpair failed and we were unable to recover it. 00:27:29.134 [2024-12-08 02:29:56.567302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.567416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.567441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.134 qpair failed and we were unable to recover it. 00:27:29.134 [2024-12-08 02:29:56.567521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.567643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.567671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.134 qpair failed and we were unable to recover it. 00:27:29.134 [2024-12-08 02:29:56.567765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.567852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.567878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.134 qpair failed and we were unable to recover it. 00:27:29.134 [2024-12-08 02:29:56.568004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.568096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.568122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.134 qpair failed and we were unable to recover it. 00:27:29.134 [2024-12-08 02:29:56.568232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.568326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.568359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.134 qpair failed and we were unable to recover it. 00:27:29.134 [2024-12-08 02:29:56.568449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.568527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.568559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.134 qpair failed and we were unable to recover it. 00:27:29.134 [2024-12-08 02:29:56.568645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.568717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.568742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.134 qpair failed and we were unable to recover it. 00:27:29.134 [2024-12-08 02:29:56.568864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.568953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.568978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.134 qpair failed and we were unable to recover it. 00:27:29.134 [2024-12-08 02:29:56.569076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.569154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.569179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.134 qpair failed and we were unable to recover it. 00:27:29.134 [2024-12-08 02:29:56.569336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.569419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.569444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.134 qpair failed and we were unable to recover it. 00:27:29.134 [2024-12-08 02:29:56.569523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.569621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.569653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.134 qpair failed and we were unable to recover it. 00:27:29.134 [2024-12-08 02:29:56.569751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.569869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.569895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.134 qpair failed and we were unable to recover it. 00:27:29.134 [2024-12-08 02:29:56.570018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.570100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.570126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.134 qpair failed and we were unable to recover it. 00:27:29.134 [2024-12-08 02:29:56.570219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.570307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.570332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.134 qpair failed and we were unable to recover it. 00:27:29.134 [2024-12-08 02:29:56.570413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.570506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.570531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.134 qpair failed and we were unable to recover it. 00:27:29.134 [2024-12-08 02:29:56.570672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.570758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.570790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.134 qpair failed and we were unable to recover it. 00:27:29.134 [2024-12-08 02:29:56.570916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.571012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.134 [2024-12-08 02:29:56.571038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.134 qpair failed and we were unable to recover it. 00:27:29.135 [2024-12-08 02:29:56.571123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.571245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.571272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.135 qpair failed and we were unable to recover it. 00:27:29.135 [2024-12-08 02:29:56.571354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.571466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.571491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.135 qpair failed and we were unable to recover it. 00:27:29.135 [2024-12-08 02:29:56.571587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.571701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.571726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.135 qpair failed and we were unable to recover it. 00:27:29.135 [2024-12-08 02:29:56.571823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.571905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.571934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.135 qpair failed and we were unable to recover it. 00:27:29.135 [2024-12-08 02:29:56.572023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.572135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.572161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.135 qpair failed and we were unable to recover it. 00:27:29.135 [2024-12-08 02:29:56.572243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.572319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.572344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.135 qpair failed and we were unable to recover it. 00:27:29.135 [2024-12-08 02:29:56.572431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.572542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.572569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.135 qpair failed and we were unable to recover it. 00:27:29.135 [2024-12-08 02:29:56.572652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.572733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.572759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.135 qpair failed and we were unable to recover it. 00:27:29.135 [2024-12-08 02:29:56.572876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.572991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.573016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.135 qpair failed and we were unable to recover it. 00:27:29.135 [2024-12-08 02:29:56.573100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.573188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.573214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.135 qpair failed and we were unable to recover it. 00:27:29.135 [2024-12-08 02:29:56.573344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.573450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.573481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.135 qpair failed and we were unable to recover it. 00:27:29.135 [2024-12-08 02:29:56.573610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.573698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.573723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.135 qpair failed and we were unable to recover it. 00:27:29.135 [2024-12-08 02:29:56.573838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.573956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.573982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.135 qpair failed and we were unable to recover it. 00:27:29.135 [2024-12-08 02:29:56.574072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.574150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.574176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.135 qpair failed and we were unable to recover it. 00:27:29.135 [2024-12-08 02:29:56.574262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.574358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.574389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.135 qpair failed and we were unable to recover it. 00:27:29.135 [2024-12-08 02:29:56.574516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.574611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.574638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.135 qpair failed and we were unable to recover it. 00:27:29.135 [2024-12-08 02:29:56.574738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.574856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.574881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.135 qpair failed and we were unable to recover it. 00:27:29.135 [2024-12-08 02:29:56.574994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.575125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.575151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.135 qpair failed and we were unable to recover it. 00:27:29.135 [2024-12-08 02:29:56.575232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.575350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.575376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.135 qpair failed and we were unable to recover it. 00:27:29.135 [2024-12-08 02:29:56.575460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.575559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.575584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.135 qpair failed and we were unable to recover it. 00:27:29.135 [2024-12-08 02:29:56.575676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.575765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.575792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.135 qpair failed and we were unable to recover it. 00:27:29.135 [2024-12-08 02:29:56.575909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.576000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.576025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.135 qpair failed and we were unable to recover it. 00:27:29.135 [2024-12-08 02:29:56.576115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.576254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.576280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.135 qpair failed and we were unable to recover it. 00:27:29.135 [2024-12-08 02:29:56.576394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.576476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.576503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.135 qpair failed and we were unable to recover it. 00:27:29.135 [2024-12-08 02:29:56.576588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.135 [2024-12-08 02:29:56.576677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.576702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.136 qpair failed and we were unable to recover it. 00:27:29.136 [2024-12-08 02:29:56.576786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.576918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.576944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.136 qpair failed and we were unable to recover it. 00:27:29.136 [2024-12-08 02:29:56.577032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.577112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.577137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.136 qpair failed and we were unable to recover it. 00:27:29.136 [2024-12-08 02:29:56.577256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.577346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.577371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.136 qpair failed and we were unable to recover it. 00:27:29.136 [2024-12-08 02:29:56.577479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.577556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.577582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.136 qpair failed and we were unable to recover it. 00:27:29.136 [2024-12-08 02:29:56.577683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.577765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.577789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.136 qpair failed and we were unable to recover it. 00:27:29.136 [2024-12-08 02:29:56.577891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.577974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.578001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.136 qpair failed and we were unable to recover it. 00:27:29.136 [2024-12-08 02:29:56.578131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.578207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.578232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.136 qpair failed and we were unable to recover it. 00:27:29.136 [2024-12-08 02:29:56.578325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.578428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.578453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.136 qpair failed and we were unable to recover it. 00:27:29.136 [2024-12-08 02:29:56.578567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.578660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.578685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.136 qpair failed and we were unable to recover it. 00:27:29.136 [2024-12-08 02:29:56.578779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.578899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.578929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.136 qpair failed and we were unable to recover it. 00:27:29.136 [2024-12-08 02:29:56.579051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.579132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.579157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.136 qpair failed and we were unable to recover it. 00:27:29.136 [2024-12-08 02:29:56.579244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.579352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.579378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.136 qpair failed and we were unable to recover it. 00:27:29.136 [2024-12-08 02:29:56.579486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.579610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.579637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.136 qpair failed and we were unable to recover it. 00:27:29.136 [2024-12-08 02:29:56.579724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.579838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.579862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.136 qpair failed and we were unable to recover it. 00:27:29.136 [2024-12-08 02:29:56.579987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.580068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.580094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.136 qpair failed and we were unable to recover it. 00:27:29.136 [2024-12-08 02:29:56.580185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.580280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.580305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.136 qpair failed and we were unable to recover it. 00:27:29.136 [2024-12-08 02:29:56.580378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.580459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.580484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.136 qpair failed and we were unable to recover it. 00:27:29.136 [2024-12-08 02:29:56.580597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.580693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.580718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.136 qpair failed and we were unable to recover it. 00:27:29.136 [2024-12-08 02:29:56.580838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.580927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.580952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.136 qpair failed and we were unable to recover it. 00:27:29.136 [2024-12-08 02:29:56.581097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.581190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.581215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.136 qpair failed and we were unable to recover it. 00:27:29.136 [2024-12-08 02:29:56.581310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.581390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.581415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.136 qpair failed and we were unable to recover it. 00:27:29.136 [2024-12-08 02:29:56.581502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.581606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.581631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.136 qpair failed and we were unable to recover it. 00:27:29.136 [2024-12-08 02:29:56.581759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.581862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.581890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.136 qpair failed and we were unable to recover it. 00:27:29.136 [2024-12-08 02:29:56.582029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.582106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.582135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.136 qpair failed and we were unable to recover it. 00:27:29.136 [2024-12-08 02:29:56.582213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.582306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.582332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.136 qpair failed and we were unable to recover it. 00:27:29.136 [2024-12-08 02:29:56.582418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.582514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.582547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.136 qpair failed and we were unable to recover it. 00:27:29.136 [2024-12-08 02:29:56.582655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.582767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.582793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.136 qpair failed and we were unable to recover it. 00:27:29.136 [2024-12-08 02:29:56.582911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.582998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.136 [2024-12-08 02:29:56.583027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.136 qpair failed and we were unable to recover it. 00:27:29.137 [2024-12-08 02:29:56.583127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.583213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.583238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.137 qpair failed and we were unable to recover it. 00:27:29.137 [2024-12-08 02:29:56.583316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.583394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.583420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.137 qpair failed and we were unable to recover it. 00:27:29.137 [2024-12-08 02:29:56.583499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.583604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.583630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.137 qpair failed and we were unable to recover it. 00:27:29.137 [2024-12-08 02:29:56.583717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.583795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.583820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.137 qpair failed and we were unable to recover it. 00:27:29.137 [2024-12-08 02:29:56.583929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.584019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.584045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.137 qpair failed and we were unable to recover it. 00:27:29.137 [2024-12-08 02:29:56.584163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.584245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.584270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.137 qpair failed and we were unable to recover it. 00:27:29.137 [2024-12-08 02:29:56.584382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.584493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.584518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.137 qpair failed and we were unable to recover it. 00:27:29.137 [2024-12-08 02:29:56.584676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.584814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.584839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.137 qpair failed and we were unable to recover it. 00:27:29.137 [2024-12-08 02:29:56.584915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.584992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.585017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.137 qpair failed and we were unable to recover it. 00:27:29.137 [2024-12-08 02:29:56.585120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.585235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.585261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.137 qpair failed and we were unable to recover it. 00:27:29.137 [2024-12-08 02:29:56.585341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.585434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.585459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.137 qpair failed and we were unable to recover it. 00:27:29.137 [2024-12-08 02:29:56.585549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.585643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.585668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.137 qpair failed and we were unable to recover it. 00:27:29.137 [2024-12-08 02:29:56.585752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.585840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.585881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.137 qpair failed and we were unable to recover it. 00:27:29.137 [2024-12-08 02:29:56.585992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.586071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.586096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.137 qpair failed and we were unable to recover it. 00:27:29.137 [2024-12-08 02:29:56.586202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.586292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.586318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.137 qpair failed and we were unable to recover it. 00:27:29.137 [2024-12-08 02:29:56.586410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.586503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.586529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.137 qpair failed and we were unable to recover it. 00:27:29.137 [2024-12-08 02:29:56.586658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.586747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.586772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.137 qpair failed and we were unable to recover it. 00:27:29.137 [2024-12-08 02:29:56.586851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.586958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.586984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.137 qpair failed and we were unable to recover it. 00:27:29.137 [2024-12-08 02:29:56.587074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.587155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.587180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.137 qpair failed and we were unable to recover it. 00:27:29.137 [2024-12-08 02:29:56.587263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.587375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.587400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.137 qpair failed and we were unable to recover it. 00:27:29.137 [2024-12-08 02:29:56.587482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.587605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.587630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.137 qpair failed and we were unable to recover it. 00:27:29.137 [2024-12-08 02:29:56.587717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.587801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.587834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.137 qpair failed and we were unable to recover it. 00:27:29.137 [2024-12-08 02:29:56.587976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.588055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.588086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.137 qpair failed and we were unable to recover it. 00:27:29.137 [2024-12-08 02:29:56.588203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.588281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.588306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.137 qpair failed and we were unable to recover it. 00:27:29.137 [2024-12-08 02:29:56.588421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.588498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.588523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.137 qpair failed and we were unable to recover it. 00:27:29.137 [2024-12-08 02:29:56.588624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.588729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.588754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.137 qpair failed and we were unable to recover it. 00:27:29.137 [2024-12-08 02:29:56.588877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.589003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.589029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.137 qpair failed and we were unable to recover it. 00:27:29.137 [2024-12-08 02:29:56.589116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.589204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.589230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.137 qpair failed and we were unable to recover it. 00:27:29.137 [2024-12-08 02:29:56.589315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.137 [2024-12-08 02:29:56.589392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.589417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.138 qpair failed and we were unable to recover it. 00:27:29.138 [2024-12-08 02:29:56.589491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.589577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.589604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.138 qpair failed and we were unable to recover it. 00:27:29.138 [2024-12-08 02:29:56.589686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.589760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.589786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.138 qpair failed and we were unable to recover it. 00:27:29.138 [2024-12-08 02:29:56.589896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.590008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.590034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.138 qpair failed and we were unable to recover it. 00:27:29.138 [2024-12-08 02:29:56.590145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.590258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.590283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.138 qpair failed and we were unable to recover it. 00:27:29.138 [2024-12-08 02:29:56.590409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.590483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.590508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.138 qpair failed and we were unable to recover it. 00:27:29.138 [2024-12-08 02:29:56.590634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.590726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.590751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.138 qpair failed and we were unable to recover it. 00:27:29.138 [2024-12-08 02:29:56.590870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.590955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.590984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.138 qpair failed and we were unable to recover it. 00:27:29.138 [2024-12-08 02:29:56.591090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.591173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.591198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.138 qpair failed and we were unable to recover it. 00:27:29.138 [2024-12-08 02:29:56.591274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.591370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.591395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.138 qpair failed and we were unable to recover it. 00:27:29.138 [2024-12-08 02:29:56.591472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.591591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.591617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.138 qpair failed and we were unable to recover it. 00:27:29.138 [2024-12-08 02:29:56.591726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.591837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.591864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.138 qpair failed and we were unable to recover it. 00:27:29.138 [2024-12-08 02:29:56.591974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.592058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.592085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.138 qpair failed and we were unable to recover it. 00:27:29.138 [2024-12-08 02:29:56.592175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.592283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.592308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.138 qpair failed and we were unable to recover it. 00:27:29.138 [2024-12-08 02:29:56.592398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.592512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.592545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.138 qpair failed and we were unable to recover it. 00:27:29.138 [2024-12-08 02:29:56.592644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.592750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.592775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.138 qpair failed and we were unable to recover it. 00:27:29.138 [2024-12-08 02:29:56.592883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.593000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.593026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.138 qpair failed and we were unable to recover it. 00:27:29.138 [2024-12-08 02:29:56.593108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.593214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.593240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.138 qpair failed and we were unable to recover it. 00:27:29.138 [2024-12-08 02:29:56.593328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.593407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.593435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.138 qpair failed and we were unable to recover it. 00:27:29.138 [2024-12-08 02:29:56.593599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.593684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.593709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.138 qpair failed and we were unable to recover it. 00:27:29.138 [2024-12-08 02:29:56.593788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.593877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.593905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.138 qpair failed and we were unable to recover it. 00:27:29.138 [2024-12-08 02:29:56.593997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.594089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.594115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.138 qpair failed and we were unable to recover it. 00:27:29.138 [2024-12-08 02:29:56.594195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.594308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.594334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.138 qpair failed and we were unable to recover it. 00:27:29.138 [2024-12-08 02:29:56.594422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.594530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.594567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.138 qpair failed and we were unable to recover it. 00:27:29.138 [2024-12-08 02:29:56.594651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.594732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.594759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.138 qpair failed and we were unable to recover it. 00:27:29.138 [2024-12-08 02:29:56.594910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.595009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.595035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.138 qpair failed and we were unable to recover it. 00:27:29.138 [2024-12-08 02:29:56.595114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.595197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.595223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.138 qpair failed and we were unable to recover it. 00:27:29.138 [2024-12-08 02:29:56.595305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.595387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.595412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.138 qpair failed and we were unable to recover it. 00:27:29.138 [2024-12-08 02:29:56.595488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.595578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.595604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.138 qpair failed and we were unable to recover it. 00:27:29.138 [2024-12-08 02:29:56.595701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.138 [2024-12-08 02:29:56.595790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.595815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.139 qpair failed and we were unable to recover it. 00:27:29.139 [2024-12-08 02:29:56.595941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.596016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.596042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.139 qpair failed and we were unable to recover it. 00:27:29.139 [2024-12-08 02:29:56.596133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.596240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.596265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.139 qpair failed and we were unable to recover it. 00:27:29.139 [2024-12-08 02:29:56.596343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.596482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.596508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.139 qpair failed and we were unable to recover it. 00:27:29.139 [2024-12-08 02:29:56.596616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.596696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.596722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.139 qpair failed and we were unable to recover it. 00:27:29.139 [2024-12-08 02:29:56.596818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.596899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.596928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.139 qpair failed and we were unable to recover it. 00:27:29.139 [2024-12-08 02:29:56.597042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.597124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.597154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.139 qpair failed and we were unable to recover it. 00:27:29.139 [2024-12-08 02:29:56.597240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.597356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.597381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.139 qpair failed and we were unable to recover it. 00:27:29.139 [2024-12-08 02:29:56.597473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.597561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.597586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.139 qpair failed and we were unable to recover it. 00:27:29.139 [2024-12-08 02:29:56.597666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.597772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.597798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.139 qpair failed and we were unable to recover it. 00:27:29.139 [2024-12-08 02:29:56.597892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.597970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.597995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.139 qpair failed and we were unable to recover it. 00:27:29.139 [2024-12-08 02:29:56.598115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.598206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.598231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.139 qpair failed and we were unable to recover it. 00:27:29.139 [2024-12-08 02:29:56.598326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.598402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.598427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.139 qpair failed and we were unable to recover it. 00:27:29.139 [2024-12-08 02:29:56.598505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.598603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.598629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.139 qpair failed and we were unable to recover it. 00:27:29.139 [2024-12-08 02:29:56.598729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.598810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.598835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.139 qpair failed and we were unable to recover it. 00:27:29.139 [2024-12-08 02:29:56.598914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.599000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.599025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.139 qpair failed and we were unable to recover it. 00:27:29.139 [2024-12-08 02:29:56.599113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.599189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.599214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.139 qpair failed and we were unable to recover it. 00:27:29.139 [2024-12-08 02:29:56.599307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.599385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.599410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.139 qpair failed and we were unable to recover it. 00:27:29.139 [2024-12-08 02:29:56.599495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.599612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.599638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.139 qpair failed and we were unable to recover it. 00:27:29.139 [2024-12-08 02:29:56.599732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.599850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.599876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.139 qpair failed and we were unable to recover it. 00:27:29.139 [2024-12-08 02:29:56.599959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.600032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.600058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.139 qpair failed and we were unable to recover it. 00:27:29.139 [2024-12-08 02:29:56.600153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.600234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.600259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.139 qpair failed and we were unable to recover it. 00:27:29.139 [2024-12-08 02:29:56.600369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.600463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.600488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.139 qpair failed and we were unable to recover it. 00:27:29.139 [2024-12-08 02:29:56.600591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.600688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.600714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.139 qpair failed and we were unable to recover it. 00:27:29.139 [2024-12-08 02:29:56.600797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.600888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.600913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.139 qpair failed and we were unable to recover it. 00:27:29.139 [2024-12-08 02:29:56.601001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.601093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.601118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.139 qpair failed and we were unable to recover it. 00:27:29.139 [2024-12-08 02:29:56.601197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.601273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.601301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.139 qpair failed and we were unable to recover it. 00:27:29.139 [2024-12-08 02:29:56.601394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.601478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.601510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.139 qpair failed and we were unable to recover it. 00:27:29.139 [2024-12-08 02:29:56.601602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.139 [2024-12-08 02:29:56.601709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.601735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.140 qpair failed and we were unable to recover it. 00:27:29.140 [2024-12-08 02:29:56.601823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.601936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.601961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.140 qpair failed and we were unable to recover it. 00:27:29.140 [2024-12-08 02:29:56.602050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.602134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.602159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.140 qpair failed and we were unable to recover it. 00:27:29.140 [2024-12-08 02:29:56.602241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.602354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.602379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.140 qpair failed and we were unable to recover it. 00:27:29.140 [2024-12-08 02:29:56.602460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.602553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.602579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.140 qpair failed and we were unable to recover it. 00:27:29.140 [2024-12-08 02:29:56.602662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.602775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.602800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.140 qpair failed and we were unable to recover it. 00:27:29.140 [2024-12-08 02:29:56.602884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.602961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.602986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.140 qpair failed and we were unable to recover it. 00:27:29.140 [2024-12-08 02:29:56.603106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.603190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.603216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.140 qpair failed and we were unable to recover it. 00:27:29.140 [2024-12-08 02:29:56.603329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.603418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.603444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.140 qpair failed and we were unable to recover it. 00:27:29.140 [2024-12-08 02:29:56.603545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.603626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.603652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.140 qpair failed and we were unable to recover it. 00:27:29.140 [2024-12-08 02:29:56.603773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.603853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.603878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.140 qpair failed and we were unable to recover it. 00:27:29.140 [2024-12-08 02:29:56.603963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.604103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.604132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.140 qpair failed and we were unable to recover it. 00:27:29.140 [2024-12-08 02:29:56.604251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.604361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.604385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.140 qpair failed and we were unable to recover it. 00:27:29.140 [2024-12-08 02:29:56.604500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.604602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.604628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.140 qpair failed and we were unable to recover it. 00:27:29.140 [2024-12-08 02:29:56.604708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.604817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.604842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.140 qpair failed and we were unable to recover it. 00:27:29.140 [2024-12-08 02:29:56.604954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.605043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.605069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.140 qpair failed and we were unable to recover it. 00:27:29.140 [2024-12-08 02:29:56.605156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.605234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.605259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.140 qpair failed and we were unable to recover it. 00:27:29.140 [2024-12-08 02:29:56.605343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.605453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.605478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.140 qpair failed and we were unable to recover it. 00:27:29.140 [2024-12-08 02:29:56.605589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.605694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.605719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.140 qpair failed and we were unable to recover it. 00:27:29.140 [2024-12-08 02:29:56.605799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.605881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.605906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.140 qpair failed and we were unable to recover it. 00:27:29.140 [2024-12-08 02:29:56.606008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.606114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.606139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.140 qpair failed and we were unable to recover it. 00:27:29.140 [2024-12-08 02:29:56.606223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.606299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.606324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.140 qpair failed and we were unable to recover it. 00:27:29.140 [2024-12-08 02:29:56.606406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.606489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.606515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.140 qpair failed and we were unable to recover it. 00:27:29.140 [2024-12-08 02:29:56.606604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.606677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.606703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.140 qpair failed and we were unable to recover it. 00:27:29.140 [2024-12-08 02:29:56.606783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.606874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.606899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.140 qpair failed and we were unable to recover it. 00:27:29.140 [2024-12-08 02:29:56.606978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.140 [2024-12-08 02:29:56.607092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.607117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.141 qpair failed and we were unable to recover it. 00:27:29.141 [2024-12-08 02:29:56.607200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.607320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.607352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.141 qpair failed and we were unable to recover it. 00:27:29.141 [2024-12-08 02:29:56.607441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.607550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.607575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.141 qpair failed and we were unable to recover it. 00:27:29.141 [2024-12-08 02:29:56.607652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.607737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.607763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.141 qpair failed and we were unable to recover it. 00:27:29.141 [2024-12-08 02:29:56.607852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.607967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.608002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.141 qpair failed and we were unable to recover it. 00:27:29.141 [2024-12-08 02:29:56.608077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.608159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.608185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.141 qpair failed and we were unable to recover it. 00:27:29.141 [2024-12-08 02:29:56.608302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.608412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.608437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.141 qpair failed and we were unable to recover it. 00:27:29.141 [2024-12-08 02:29:56.608519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.608641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.608668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.141 qpair failed and we were unable to recover it. 00:27:29.141 [2024-12-08 02:29:56.608815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.608894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.608920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.141 qpair failed and we were unable to recover it. 00:27:29.141 [2024-12-08 02:29:56.608998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.609074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.609100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.141 qpair failed and we were unable to recover it. 00:27:29.141 [2024-12-08 02:29:56.609188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.609272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.609297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.141 qpair failed and we were unable to recover it. 00:27:29.141 [2024-12-08 02:29:56.609407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.609500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.609526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.141 qpair failed and we were unable to recover it. 00:27:29.141 [2024-12-08 02:29:56.609609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.609693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.609719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.141 qpair failed and we were unable to recover it. 00:27:29.141 [2024-12-08 02:29:56.609798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.609877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.609903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.141 qpair failed and we were unable to recover it. 00:27:29.141 [2024-12-08 02:29:56.609990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.610069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.610098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.141 qpair failed and we were unable to recover it. 00:27:29.141 [2024-12-08 02:29:56.610186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.610311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.610337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.141 qpair failed and we were unable to recover it. 00:27:29.141 [2024-12-08 02:29:56.610422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.610500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.610525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.141 qpair failed and we were unable to recover it. 00:27:29.141 [2024-12-08 02:29:56.610633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.610747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.610774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.141 qpair failed and we were unable to recover it. 00:27:29.141 [2024-12-08 02:29:56.610868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.610964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.610990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.141 qpair failed and we were unable to recover it. 00:27:29.141 [2024-12-08 02:29:56.611132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.611208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.611233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.141 qpair failed and we were unable to recover it. 00:27:29.141 [2024-12-08 02:29:56.611321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.611440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.611465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.141 qpair failed and we were unable to recover it. 00:27:29.141 [2024-12-08 02:29:56.611552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.611642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.611668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.141 qpair failed and we were unable to recover it. 00:27:29.141 [2024-12-08 02:29:56.611783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.611891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.611916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.141 qpair failed and we were unable to recover it. 00:27:29.141 [2024-12-08 02:29:56.611995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.612104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.612129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.141 qpair failed and we were unable to recover it. 00:27:29.141 [2024-12-08 02:29:56.612208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.612291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.612316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.141 qpair failed and we were unable to recover it. 00:27:29.141 [2024-12-08 02:29:56.612401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.612492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.612518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.141 qpair failed and we were unable to recover it. 00:27:29.141 [2024-12-08 02:29:56.612620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.612693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.612718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.141 qpair failed and we were unable to recover it. 00:27:29.141 [2024-12-08 02:29:56.612804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.612913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.612938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.141 qpair failed and we were unable to recover it. 00:27:29.141 [2024-12-08 02:29:56.613016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.613098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.141 [2024-12-08 02:29:56.613124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.142 qpair failed and we were unable to recover it. 00:27:29.142 [2024-12-08 02:29:56.613215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.613296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.613321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.142 qpair failed and we were unable to recover it. 00:27:29.142 [2024-12-08 02:29:56.613413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.613530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.613563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.142 qpair failed and we were unable to recover it. 00:27:29.142 [2024-12-08 02:29:56.613679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.613786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.613811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.142 qpair failed and we were unable to recover it. 00:27:29.142 [2024-12-08 02:29:56.613920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.614029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.614055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.142 qpair failed and we were unable to recover it. 00:27:29.142 [2024-12-08 02:29:56.614142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.614235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.614260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.142 qpair failed and we were unable to recover it. 00:27:29.142 [2024-12-08 02:29:56.614351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.614457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.614482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.142 qpair failed and we were unable to recover it. 00:27:29.142 [2024-12-08 02:29:56.614576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.614687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.614712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.142 qpair failed and we were unable to recover it. 00:27:29.142 [2024-12-08 02:29:56.614799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.614905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.614930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.142 qpair failed and we were unable to recover it. 00:27:29.142 [2024-12-08 02:29:56.615039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.615110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.615136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.142 qpair failed and we were unable to recover it. 00:27:29.142 [2024-12-08 02:29:56.615248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.615326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.615353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.142 qpair failed and we were unable to recover it. 00:27:29.142 [2024-12-08 02:29:56.615439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.615554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.615581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.142 qpair failed and we were unable to recover it. 00:27:29.142 [2024-12-08 02:29:56.615681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.615765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.615790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.142 qpair failed and we were unable to recover it. 00:27:29.142 [2024-12-08 02:29:56.615874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.615950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.615975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.142 qpair failed and we were unable to recover it. 00:27:29.142 [2024-12-08 02:29:56.616060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.616139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.616165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.142 qpair failed and we were unable to recover it. 00:27:29.142 [2024-12-08 02:29:56.616267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.616344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.616369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.142 qpair failed and we were unable to recover it. 00:27:29.142 [2024-12-08 02:29:56.616444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.616586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.616612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.142 qpair failed and we were unable to recover it. 00:27:29.142 [2024-12-08 02:29:56.616690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.616803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.616828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.142 qpair failed and we were unable to recover it. 00:27:29.142 [2024-12-08 02:29:56.616924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.617039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.617076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.142 qpair failed and we were unable to recover it. 00:27:29.142 [2024-12-08 02:29:56.617186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.617262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.617288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.142 qpair failed and we were unable to recover it. 00:27:29.142 [2024-12-08 02:29:56.617370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.617462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.617488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.142 qpair failed and we were unable to recover it. 00:27:29.142 [2024-12-08 02:29:56.617614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.617711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.617736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.142 qpair failed and we were unable to recover it. 00:27:29.142 [2024-12-08 02:29:56.617822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.617897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.617922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.142 qpair failed and we were unable to recover it. 00:27:29.142 [2024-12-08 02:29:56.618005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.618115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.618140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.142 qpair failed and we were unable to recover it. 00:27:29.142 [2024-12-08 02:29:56.618238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.618318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.618343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.142 qpair failed and we were unable to recover it. 00:27:29.142 [2024-12-08 02:29:56.618469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.618564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.618598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.142 qpair failed and we were unable to recover it. 00:27:29.142 [2024-12-08 02:29:56.618675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.618786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.618812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.142 qpair failed and we were unable to recover it. 00:27:29.142 [2024-12-08 02:29:56.618921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.619006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.619032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.142 qpair failed and we were unable to recover it. 00:27:29.142 [2024-12-08 02:29:56.619113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.142 [2024-12-08 02:29:56.619187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.619212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.143 qpair failed and we were unable to recover it. 00:27:29.143 [2024-12-08 02:29:56.619300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.619394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.619418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.143 qpair failed and we were unable to recover it. 00:27:29.143 [2024-12-08 02:29:56.619500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.619598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.619631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.143 qpair failed and we were unable to recover it. 00:27:29.143 [2024-12-08 02:29:56.619713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.619788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.619820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.143 qpair failed and we were unable to recover it. 00:27:29.143 [2024-12-08 02:29:56.619919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.619996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.620021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.143 qpair failed and we were unable to recover it. 00:27:29.143 [2024-12-08 02:29:56.620160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.620242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.620267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.143 qpair failed and we were unable to recover it. 00:27:29.143 [2024-12-08 02:29:56.620361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.620469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.620494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.143 qpair failed and we were unable to recover it. 00:27:29.143 [2024-12-08 02:29:56.620588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.620670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.620695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.143 qpair failed and we were unable to recover it. 00:27:29.143 [2024-12-08 02:29:56.620817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.620900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.620925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.143 qpair failed and we were unable to recover it. 00:27:29.143 [2024-12-08 02:29:56.621015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.621125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.621154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.143 qpair failed and we were unable to recover it. 00:27:29.143 [2024-12-08 02:29:56.621260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.621350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.621376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.143 qpair failed and we were unable to recover it. 00:27:29.143 [2024-12-08 02:29:56.621451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.621546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.621571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.143 qpair failed and we were unable to recover it. 00:27:29.143 [2024-12-08 02:29:56.621661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.621739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.621765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.143 qpair failed and we were unable to recover it. 00:27:29.143 [2024-12-08 02:29:56.621848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.621991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.622016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.143 qpair failed and we were unable to recover it. 00:27:29.143 [2024-12-08 02:29:56.622124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.622197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.622222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.143 qpair failed and we were unable to recover it. 00:27:29.143 [2024-12-08 02:29:56.622340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.622447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.622472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.143 qpair failed and we were unable to recover it. 00:27:29.143 [2024-12-08 02:29:56.622551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.622635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.622660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.143 qpair failed and we were unable to recover it. 00:27:29.143 [2024-12-08 02:29:56.622739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.622822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.622849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.143 qpair failed and we were unable to recover it. 00:27:29.143 [2024-12-08 02:29:56.622927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.623003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.623027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.143 qpair failed and we were unable to recover it. 00:27:29.143 [2024-12-08 02:29:56.623112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.623194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.623219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.143 qpair failed and we were unable to recover it. 00:27:29.143 [2024-12-08 02:29:56.623311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.623455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.623482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.143 qpair failed and we were unable to recover it. 00:27:29.143 [2024-12-08 02:29:56.623570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.623663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.623689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.143 qpair failed and we were unable to recover it. 00:27:29.143 [2024-12-08 02:29:56.623768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.623873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.623899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.143 qpair failed and we were unable to recover it. 00:27:29.143 [2024-12-08 02:29:56.623978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.624087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.624113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.143 qpair failed and we were unable to recover it. 00:27:29.143 [2024-12-08 02:29:56.624210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.624323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.624351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.143 qpair failed and we were unable to recover it. 00:27:29.143 [2024-12-08 02:29:56.624441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.624520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.624594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.143 qpair failed and we were unable to recover it. 00:27:29.143 [2024-12-08 02:29:56.624675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.624784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.624810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.143 qpair failed and we were unable to recover it. 00:27:29.143 [2024-12-08 02:29:56.624923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.624998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.625023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.143 qpair failed and we were unable to recover it. 00:27:29.143 [2024-12-08 02:29:56.625126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.625233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.143 [2024-12-08 02:29:56.625264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.143 qpair failed and we were unable to recover it. 00:27:29.143 [2024-12-08 02:29:56.625373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.625453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.625479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.144 qpair failed and we were unable to recover it. 00:27:29.144 [2024-12-08 02:29:56.625574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.625684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.625710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.144 qpair failed and we were unable to recover it. 00:27:29.144 [2024-12-08 02:29:56.625793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.625908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.625934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.144 qpair failed and we were unable to recover it. 00:27:29.144 [2024-12-08 02:29:56.626013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.626119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.626144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.144 qpair failed and we were unable to recover it. 00:27:29.144 [2024-12-08 02:29:56.626223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.626335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.626360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.144 qpair failed and we were unable to recover it. 00:27:29.144 [2024-12-08 02:29:56.626439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.626572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.626598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.144 qpair failed and we were unable to recover it. 00:27:29.144 [2024-12-08 02:29:56.626682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.626770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.626796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.144 qpair failed and we were unable to recover it. 00:27:29.144 [2024-12-08 02:29:56.626883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.626992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.627018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.144 qpair failed and we were unable to recover it. 00:27:29.144 [2024-12-08 02:29:56.627105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.627219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.627244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.144 qpair failed and we were unable to recover it. 00:27:29.144 [2024-12-08 02:29:56.627324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.627406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.627431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.144 qpair failed and we were unable to recover it. 00:27:29.144 [2024-12-08 02:29:56.627521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.627608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.627634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.144 qpair failed and we were unable to recover it. 00:27:29.144 [2024-12-08 02:29:56.627725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.627837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.627864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.144 qpair failed and we were unable to recover it. 00:27:29.144 [2024-12-08 02:29:56.627943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.628029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.628056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.144 qpair failed and we were unable to recover it. 00:27:29.144 [2024-12-08 02:29:56.628135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.628227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.628253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.144 qpair failed and we were unable to recover it. 00:27:29.144 [2024-12-08 02:29:56.628339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.628479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.628505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.144 qpair failed and we were unable to recover it. 00:27:29.144 [2024-12-08 02:29:56.628614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.628722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.628748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.144 qpair failed and we were unable to recover it. 00:27:29.144 [2024-12-08 02:29:56.628833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.628915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.628940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.144 qpair failed and we were unable to recover it. 00:27:29.144 [2024-12-08 02:29:56.629045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.629126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.629151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.144 qpair failed and we were unable to recover it. 00:27:29.144 [2024-12-08 02:29:56.629232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.629340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.629365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.144 qpair failed and we were unable to recover it. 00:27:29.144 [2024-12-08 02:29:56.629512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.629600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.629626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.144 qpair failed and we were unable to recover it. 00:27:29.144 [2024-12-08 02:29:56.629707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.629802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.629837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.144 qpair failed and we were unable to recover it. 00:27:29.144 [2024-12-08 02:29:56.629935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.630071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.630099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.144 qpair failed and we were unable to recover it. 00:27:29.144 [2024-12-08 02:29:56.630185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.630307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.630335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.144 qpair failed and we were unable to recover it. 00:27:29.144 [2024-12-08 02:29:56.630421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.630528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.630615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.144 qpair failed and we were unable to recover it. 00:27:29.144 [2024-12-08 02:29:56.630704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.630823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.630858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.144 qpair failed and we were unable to recover it. 00:27:29.144 [2024-12-08 02:29:56.630958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.631090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.144 [2024-12-08 02:29:56.631126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.145 qpair failed and we were unable to recover it. 00:27:29.145 [2024-12-08 02:29:56.631233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.631347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.631373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.145 qpair failed and we were unable to recover it. 00:27:29.145 [2024-12-08 02:29:56.631504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.631604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.631630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.145 qpair failed and we were unable to recover it. 00:27:29.145 [2024-12-08 02:29:56.631726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.631818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.631843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.145 qpair failed and we were unable to recover it. 00:27:29.145 [2024-12-08 02:29:56.631935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.632027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.632052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.145 qpair failed and we were unable to recover it. 00:27:29.145 [2024-12-08 02:29:56.632161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.632273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.632298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.145 qpair failed and we were unable to recover it. 00:27:29.145 [2024-12-08 02:29:56.632417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.632504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.632534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.145 qpair failed and we were unable to recover it. 00:27:29.145 [2024-12-08 02:29:56.632669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.632755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.632781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.145 qpair failed and we were unable to recover it. 00:27:29.145 [2024-12-08 02:29:56.632865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.632943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.632968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.145 qpair failed and we were unable to recover it. 00:27:29.145 [2024-12-08 02:29:56.633063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.633180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.633206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.145 qpair failed and we were unable to recover it. 00:27:29.145 [2024-12-08 02:29:56.633286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.633391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.633416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.145 qpair failed and we were unable to recover it. 00:27:29.145 [2024-12-08 02:29:56.633521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.633652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.633677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.145 qpair failed and we were unable to recover it. 00:27:29.145 [2024-12-08 02:29:56.633766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.633878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.633903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.145 qpair failed and we were unable to recover it. 00:27:29.145 [2024-12-08 02:29:56.634017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.634094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.634120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.145 qpair failed and we were unable to recover it. 00:27:29.145 [2024-12-08 02:29:56.634206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.634312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.634346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.145 qpair failed and we were unable to recover it. 00:27:29.145 [2024-12-08 02:29:56.634435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.634520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.634589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.145 qpair failed and we were unable to recover it. 00:27:29.145 [2024-12-08 02:29:56.634681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.634823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.634849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.145 qpair failed and we were unable to recover it. 00:27:29.145 [2024-12-08 02:29:56.634972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.635067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.635093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.145 qpair failed and we were unable to recover it. 00:27:29.145 [2024-12-08 02:29:56.635286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.635395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.635420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.145 qpair failed and we were unable to recover it. 00:27:29.145 [2024-12-08 02:29:56.635612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.635702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.635727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.145 qpair failed and we were unable to recover it. 00:27:29.145 [2024-12-08 02:29:56.635807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.635887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.635913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.145 qpair failed and we were unable to recover it. 00:27:29.145 [2024-12-08 02:29:56.636021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.636128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.636153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.145 qpair failed and we were unable to recover it. 00:27:29.145 [2024-12-08 02:29:56.636241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.636346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.636371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.145 qpair failed and we were unable to recover it. 00:27:29.145 [2024-12-08 02:29:56.636469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.636560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.636586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.145 qpair failed and we were unable to recover it. 00:27:29.145 [2024-12-08 02:29:56.636674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.636780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.636806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.145 qpair failed and we were unable to recover it. 00:27:29.145 [2024-12-08 02:29:56.636899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.636973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.636999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.145 qpair failed and we were unable to recover it. 00:27:29.145 [2024-12-08 02:29:56.637086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.637195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.637220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.145 qpair failed and we were unable to recover it. 00:27:29.145 [2024-12-08 02:29:56.637301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.637408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.637433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.145 qpair failed and we were unable to recover it. 00:27:29.145 [2024-12-08 02:29:56.637526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.637620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.637645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.145 qpair failed and we were unable to recover it. 00:27:29.145 [2024-12-08 02:29:56.637731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.637818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.145 [2024-12-08 02:29:56.637844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.146 qpair failed and we were unable to recover it. 00:27:29.146 [2024-12-08 02:29:56.637938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.638019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.638044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.146 qpair failed and we were unable to recover it. 00:27:29.146 [2024-12-08 02:29:56.638153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.638234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.638260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.146 qpair failed and we were unable to recover it. 00:27:29.146 [2024-12-08 02:29:56.638343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.638430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.638456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.146 qpair failed and we were unable to recover it. 00:27:29.146 [2024-12-08 02:29:56.638588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.638668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.638695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.146 qpair failed and we were unable to recover it. 00:27:29.146 [2024-12-08 02:29:56.638778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.638892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.638917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.146 qpair failed and we were unable to recover it. 00:27:29.146 [2024-12-08 02:29:56.639029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.639107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.639132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.146 qpair failed and we were unable to recover it. 00:27:29.146 [2024-12-08 02:29:56.639241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.639327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.639352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.146 qpair failed and we were unable to recover it. 00:27:29.146 [2024-12-08 02:29:56.639438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.639516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.639552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.146 qpair failed and we were unable to recover it. 00:27:29.146 [2024-12-08 02:29:56.639671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.639766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.639792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.146 qpair failed and we were unable to recover it. 00:27:29.146 [2024-12-08 02:29:56.639881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.639954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.639979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.146 qpair failed and we were unable to recover it. 00:27:29.146 [2024-12-08 02:29:56.640060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.640147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.640172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.146 qpair failed and we were unable to recover it. 00:27:29.146 [2024-12-08 02:29:56.640257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.640363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.640389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.146 qpair failed and we were unable to recover it. 00:27:29.146 [2024-12-08 02:29:56.640501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.640597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.640623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.146 qpair failed and we were unable to recover it. 00:27:29.146 [2024-12-08 02:29:56.640705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.640894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.640920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.146 qpair failed and we were unable to recover it. 00:27:29.146 [2024-12-08 02:29:56.641016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.641121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.641146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.146 qpair failed and we were unable to recover it. 00:27:29.146 [2024-12-08 02:29:56.641224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.641307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.641332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.146 qpair failed and we were unable to recover it. 00:27:29.146 [2024-12-08 02:29:56.641522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.641619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.641645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.146 qpair failed and we were unable to recover it. 00:27:29.146 [2024-12-08 02:29:56.641727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.641839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.641864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.146 qpair failed and we were unable to recover it. 00:27:29.146 [2024-12-08 02:29:56.641947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.642065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.642090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.146 qpair failed and we were unable to recover it. 00:27:29.146 [2024-12-08 02:29:56.642165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.642240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.642265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.146 qpair failed and we were unable to recover it. 00:27:29.146 [2024-12-08 02:29:56.642372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.642458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.642485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.146 qpair failed and we were unable to recover it. 00:27:29.146 [2024-12-08 02:29:56.642573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.642699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.642725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.146 qpair failed and we were unable to recover it. 00:27:29.146 [2024-12-08 02:29:56.642920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.643110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.643135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.146 qpair failed and we were unable to recover it. 00:27:29.146 [2024-12-08 02:29:56.643221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.643360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.643385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.146 qpair failed and we were unable to recover it. 00:27:29.146 [2024-12-08 02:29:56.643464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.643581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.643607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.146 qpair failed and we were unable to recover it. 00:27:29.146 [2024-12-08 02:29:56.643688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.643779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.643804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.146 qpair failed and we were unable to recover it. 00:27:29.146 [2024-12-08 02:29:56.643888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.643962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.643987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.146 qpair failed and we were unable to recover it. 00:27:29.146 [2024-12-08 02:29:56.644081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.644189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.644219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.146 qpair failed and we were unable to recover it. 00:27:29.146 [2024-12-08 02:29:56.644412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.146 [2024-12-08 02:29:56.644498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.644523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.147 qpair failed and we were unable to recover it. 00:27:29.147 [2024-12-08 02:29:56.644654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.644729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.644754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.147 qpair failed and we were unable to recover it. 00:27:29.147 [2024-12-08 02:29:56.644836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.644961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.644987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.147 qpair failed and we were unable to recover it. 00:27:29.147 [2024-12-08 02:29:56.645070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.645147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.645172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.147 qpair failed and we were unable to recover it. 00:27:29.147 [2024-12-08 02:29:56.645254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.645328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.645354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.147 qpair failed and we were unable to recover it. 00:27:29.147 [2024-12-08 02:29:56.645444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.645523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.645553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.147 qpair failed and we were unable to recover it. 00:27:29.147 [2024-12-08 02:29:56.645663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.645748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.645773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.147 qpair failed and we were unable to recover it. 00:27:29.147 [2024-12-08 02:29:56.645857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.645965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.645990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.147 qpair failed and we were unable to recover it. 00:27:29.147 [2024-12-08 02:29:56.646083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.646155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.646179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.147 qpair failed and we were unable to recover it. 00:27:29.147 [2024-12-08 02:29:56.646302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.646408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.646445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.147 qpair failed and we were unable to recover it. 00:27:29.147 [2024-12-08 02:29:56.646570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.646657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.646682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.147 qpair failed and we were unable to recover it. 00:27:29.147 [2024-12-08 02:29:56.646772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.646851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.646877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.147 qpair failed and we were unable to recover it. 00:27:29.147 [2024-12-08 02:29:56.646977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.647062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.647088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.147 qpair failed and we were unable to recover it. 00:27:29.147 [2024-12-08 02:29:56.647199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.647281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.647306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.147 qpair failed and we were unable to recover it. 00:27:29.147 [2024-12-08 02:29:56.647386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.647473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.647499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.147 qpair failed and we were unable to recover it. 00:27:29.147 [2024-12-08 02:29:56.647594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.647685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.647710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.147 qpair failed and we were unable to recover it. 00:27:29.147 [2024-12-08 02:29:56.647819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.647903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.647928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.147 qpair failed and we were unable to recover it. 00:27:29.147 [2024-12-08 02:29:56.648020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.648210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.648235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.147 qpair failed and we were unable to recover it. 00:27:29.147 [2024-12-08 02:29:56.648325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.648440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.648466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.147 qpair failed and we were unable to recover it. 00:27:29.147 [2024-12-08 02:29:56.648575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.648651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.648676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.147 qpair failed and we were unable to recover it. 00:27:29.147 [2024-12-08 02:29:56.648760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.648853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.648879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.147 qpair failed and we were unable to recover it. 00:27:29.147 [2024-12-08 02:29:56.648960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.649071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.649096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.147 qpair failed and we were unable to recover it. 00:27:29.147 [2024-12-08 02:29:56.649186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.649264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.649290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.147 qpair failed and we were unable to recover it. 00:27:29.147 [2024-12-08 02:29:56.649376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.649470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.649495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.147 qpair failed and we were unable to recover it. 00:27:29.147 [2024-12-08 02:29:56.649620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.649703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.649728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.147 qpair failed and we were unable to recover it. 00:27:29.147 [2024-12-08 02:29:56.649834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.649916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.649941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.147 qpair failed and we were unable to recover it. 00:27:29.147 [2024-12-08 02:29:56.650049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.650126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.650151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.147 qpair failed and we were unable to recover it. 00:27:29.147 [2024-12-08 02:29:56.650240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.650318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.650349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.147 qpair failed and we were unable to recover it. 00:27:29.147 [2024-12-08 02:29:56.650464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.650594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.650620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.147 qpair failed and we were unable to recover it. 00:27:29.147 [2024-12-08 02:29:56.650704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.147 [2024-12-08 02:29:56.650827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.650852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.148 qpair failed and we were unable to recover it. 00:27:29.148 [2024-12-08 02:29:56.650939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.651075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.651100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.148 qpair failed and we were unable to recover it. 00:27:29.148 [2024-12-08 02:29:56.651225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.651333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.651359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.148 qpair failed and we were unable to recover it. 00:27:29.148 [2024-12-08 02:29:56.651474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.651576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.651601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.148 qpair failed and we were unable to recover it. 00:27:29.148 [2024-12-08 02:29:56.651689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.651775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.651800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.148 qpair failed and we were unable to recover it. 00:27:29.148 [2024-12-08 02:29:56.651876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.651989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.652014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.148 qpair failed and we were unable to recover it. 00:27:29.148 [2024-12-08 02:29:56.652099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.652209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.652234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.148 qpair failed and we were unable to recover it. 00:27:29.148 [2024-12-08 02:29:56.652323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.652423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.652450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.148 qpair failed and we were unable to recover it. 00:27:29.148 [2024-12-08 02:29:56.652565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.652648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.652677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.148 qpair failed and we were unable to recover it. 00:27:29.148 [2024-12-08 02:29:56.652762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.652868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.652893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.148 qpair failed and we were unable to recover it. 00:27:29.148 [2024-12-08 02:29:56.652973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.653112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.653145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.148 qpair failed and we were unable to recover it. 00:27:29.148 [2024-12-08 02:29:56.653226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.653338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.653367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.148 qpair failed and we were unable to recover it. 00:27:29.148 [2024-12-08 02:29:56.653461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.653552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.653583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.148 qpair failed and we were unable to recover it. 00:27:29.148 [2024-12-08 02:29:56.653663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.653782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.653807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.148 qpair failed and we were unable to recover it. 00:27:29.148 [2024-12-08 02:29:56.653921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.654030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.654055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.148 qpair failed and we were unable to recover it. 00:27:29.148 [2024-12-08 02:29:56.654181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.654265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.654290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.148 qpair failed and we were unable to recover it. 00:27:29.148 [2024-12-08 02:29:56.654379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.654488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.654513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.148 qpair failed and we were unable to recover it. 00:27:29.148 [2024-12-08 02:29:56.654597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.654678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.654704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.148 qpair failed and we were unable to recover it. 00:27:29.148 [2024-12-08 02:29:56.654813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.654919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.654944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.148 qpair failed and we were unable to recover it. 00:27:29.148 [2024-12-08 02:29:56.655031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.655110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.655135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.148 qpair failed and we were unable to recover it. 00:27:29.148 [2024-12-08 02:29:56.655212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.655319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.655344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.148 qpair failed and we were unable to recover it. 00:27:29.148 [2024-12-08 02:29:56.655424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.655553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.655579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.148 qpair failed and we were unable to recover it. 00:27:29.148 [2024-12-08 02:29:56.655660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.655750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.655776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.148 qpair failed and we were unable to recover it. 00:27:29.148 [2024-12-08 02:29:56.655868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.655948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.655973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.148 qpair failed and we were unable to recover it. 00:27:29.148 [2024-12-08 02:29:56.656062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.656147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.656173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.148 qpair failed and we were unable to recover it. 00:27:29.148 [2024-12-08 02:29:56.656259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.656350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.656376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.148 qpair failed and we were unable to recover it. 00:27:29.148 [2024-12-08 02:29:56.656492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.656590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.656617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.148 qpair failed and we were unable to recover it. 00:27:29.148 [2024-12-08 02:29:56.656708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.656797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.656823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.148 qpair failed and we were unable to recover it. 00:27:29.148 [2024-12-08 02:29:56.656902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.656977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.657003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.148 qpair failed and we were unable to recover it. 00:27:29.148 [2024-12-08 02:29:56.657110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.148 [2024-12-08 02:29:56.657217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.657242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.149 qpair failed and we were unable to recover it. 00:27:29.149 [2024-12-08 02:29:56.657321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.657406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.657431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.149 qpair failed and we were unable to recover it. 00:27:29.149 [2024-12-08 02:29:56.657510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.657601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.657631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.149 qpair failed and we were unable to recover it. 00:27:29.149 [2024-12-08 02:29:56.657723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.657864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.657890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.149 qpair failed and we were unable to recover it. 00:27:29.149 [2024-12-08 02:29:56.657974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.658083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.658108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.149 qpair failed and we were unable to recover it. 00:27:29.149 [2024-12-08 02:29:56.658185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.658291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.658316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.149 qpair failed and we were unable to recover it. 00:27:29.149 [2024-12-08 02:29:56.658439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.658556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.658582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.149 qpair failed and we were unable to recover it. 00:27:29.149 [2024-12-08 02:29:56.658674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.658748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.658773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.149 qpair failed and we were unable to recover it. 00:27:29.149 [2024-12-08 02:29:56.658882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.658996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.659022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.149 qpair failed and we were unable to recover it. 00:27:29.149 [2024-12-08 02:29:56.659106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.659217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.659244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.149 qpair failed and we were unable to recover it. 00:27:29.149 [2024-12-08 02:29:56.659359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.659504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.659529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.149 qpair failed and we were unable to recover it. 00:27:29.149 [2024-12-08 02:29:56.659622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.659707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.659733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.149 qpair failed and we were unable to recover it. 00:27:29.149 [2024-12-08 02:29:56.659821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.659900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.659925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.149 qpair failed and we were unable to recover it. 00:27:29.149 [2024-12-08 02:29:56.660039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.660118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.660143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.149 qpair failed and we were unable to recover it. 00:27:29.149 [2024-12-08 02:29:56.660332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.660435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.660460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.149 qpair failed and we were unable to recover it. 00:27:29.149 [2024-12-08 02:29:56.660542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.660730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.660755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.149 qpair failed and we were unable to recover it. 00:27:29.149 [2024-12-08 02:29:56.660846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.660958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.660984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.149 qpair failed and we were unable to recover it. 00:27:29.149 [2024-12-08 02:29:56.661099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.661183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.661209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.149 qpair failed and we were unable to recover it. 00:27:29.149 [2024-12-08 02:29:56.661399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.661478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.661503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.149 qpair failed and we were unable to recover it. 00:27:29.149 [2024-12-08 02:29:56.661625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.661715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.661740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.149 qpair failed and we were unable to recover it. 00:27:29.149 [2024-12-08 02:29:56.661828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.661941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.661966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.149 qpair failed and we were unable to recover it. 00:27:29.149 [2024-12-08 02:29:56.662086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.662198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.662223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.149 qpair failed and we were unable to recover it. 00:27:29.149 [2024-12-08 02:29:56.662310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.662422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.662446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.149 qpair failed and we were unable to recover it. 00:27:29.149 [2024-12-08 02:29:56.662547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.662629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.662660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.149 qpair failed and we were unable to recover it. 00:27:29.149 [2024-12-08 02:29:56.662752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.149 [2024-12-08 02:29:56.662830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.662861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.150 qpair failed and we were unable to recover it. 00:27:29.150 [2024-12-08 02:29:56.662975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.663050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.663075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.150 qpair failed and we were unable to recover it. 00:27:29.150 [2024-12-08 02:29:56.663167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.663293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.663318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.150 qpair failed and we were unable to recover it. 00:27:29.150 [2024-12-08 02:29:56.663402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.663475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.663501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.150 qpair failed and we were unable to recover it. 00:27:29.150 [2024-12-08 02:29:56.663630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.663747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.663772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.150 qpair failed and we were unable to recover it. 00:27:29.150 [2024-12-08 02:29:56.663859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.663932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.663958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.150 qpair failed and we were unable to recover it. 00:27:29.150 [2024-12-08 02:29:56.664066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.664154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.664178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.150 qpair failed and we were unable to recover it. 00:27:29.150 [2024-12-08 02:29:56.664293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.664367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.664392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.150 qpair failed and we were unable to recover it. 00:27:29.150 [2024-12-08 02:29:56.664501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.664586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.664611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.150 qpair failed and we were unable to recover it. 00:27:29.150 [2024-12-08 02:29:56.664794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.664928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.664957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.150 qpair failed and we were unable to recover it. 00:27:29.150 [2024-12-08 02:29:56.665130] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1801600 is same with the state(5) to be set 00:27:29.150 [2024-12-08 02:29:56.665333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.665429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.665458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.150 qpair failed and we were unable to recover it. 00:27:29.150 [2024-12-08 02:29:56.665586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.665680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.665709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.150 qpair failed and we were unable to recover it. 00:27:29.150 [2024-12-08 02:29:56.665828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.665939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.665967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.150 qpair failed and we were unable to recover it. 00:27:29.150 [2024-12-08 02:29:56.666049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.666161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.666187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.150 qpair failed and we were unable to recover it. 00:27:29.150 [2024-12-08 02:29:56.666271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.666368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.666393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.150 qpair failed and we were unable to recover it. 00:27:29.150 [2024-12-08 02:29:56.666512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.666597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.666623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.150 qpair failed and we were unable to recover it. 00:27:29.150 [2024-12-08 02:29:56.666743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.666832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.666859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.150 qpair failed and we were unable to recover it. 00:27:29.150 [2024-12-08 02:29:56.666972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.667056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.667083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.150 qpair failed and we were unable to recover it. 00:27:29.150 [2024-12-08 02:29:56.667168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.667284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.667311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.150 qpair failed and we were unable to recover it. 00:27:29.150 [2024-12-08 02:29:56.667431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.667510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.667544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.150 qpair failed and we were unable to recover it. 00:27:29.150 [2024-12-08 02:29:56.667650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.667739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.667765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.150 qpair failed and we were unable to recover it. 00:27:29.150 [2024-12-08 02:29:56.667878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.667992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.668018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.150 qpair failed and we were unable to recover it. 00:27:29.150 [2024-12-08 02:29:56.668103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.668215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.668241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.150 qpair failed and we were unable to recover it. 00:27:29.150 [2024-12-08 02:29:56.668354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.668468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.668495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.150 qpair failed and we were unable to recover it. 00:27:29.150 [2024-12-08 02:29:56.668595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.668681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.668707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.150 qpair failed and we were unable to recover it. 00:27:29.150 [2024-12-08 02:29:56.668802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.668916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.668943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.150 qpair failed and we were unable to recover it. 00:27:29.150 [2024-12-08 02:29:56.669027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.150 [2024-12-08 02:29:56.669143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.669170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.151 qpair failed and we were unable to recover it. 00:27:29.151 [2024-12-08 02:29:56.669285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.669373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.669399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.151 qpair failed and we were unable to recover it. 00:27:29.151 [2024-12-08 02:29:56.669481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.669569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.669596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.151 qpair failed and we were unable to recover it. 00:27:29.151 [2024-12-08 02:29:56.669690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.669772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.669798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.151 qpair failed and we were unable to recover it. 00:27:29.151 [2024-12-08 02:29:56.669878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.669990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.670016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.151 qpair failed and we were unable to recover it. 00:27:29.151 [2024-12-08 02:29:56.670098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.670211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.670237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.151 qpair failed and we were unable to recover it. 00:27:29.151 [2024-12-08 02:29:56.670379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.670461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.670486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.151 qpair failed and we were unable to recover it. 00:27:29.151 [2024-12-08 02:29:56.670574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.670658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.670685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.151 qpair failed and we were unable to recover it. 00:27:29.151 [2024-12-08 02:29:56.670769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.670877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.670904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.151 qpair failed and we were unable to recover it. 00:27:29.151 [2024-12-08 02:29:56.671013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.671121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.671147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.151 qpair failed and we were unable to recover it. 00:27:29.151 [2024-12-08 02:29:56.671223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.671297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.671322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.151 qpair failed and we were unable to recover it. 00:27:29.151 [2024-12-08 02:29:56.671440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.671533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.671567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.151 qpair failed and we were unable to recover it. 00:27:29.151 [2024-12-08 02:29:56.671691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.671772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.671798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.151 qpair failed and we were unable to recover it. 00:27:29.151 [2024-12-08 02:29:56.671914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.671999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.672025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.151 qpair failed and we were unable to recover it. 00:27:29.151 [2024-12-08 02:29:56.672142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.672222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.672247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.151 qpair failed and we were unable to recover it. 00:27:29.151 [2024-12-08 02:29:56.672340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.672420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.672446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.151 qpair failed and we were unable to recover it. 00:27:29.151 [2024-12-08 02:29:56.672559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.672646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.672672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.151 qpair failed and we were unable to recover it. 00:27:29.151 [2024-12-08 02:29:56.672782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.672928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.672954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.151 qpair failed and we were unable to recover it. 00:27:29.151 [2024-12-08 02:29:56.673035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.673143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.673168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.151 qpair failed and we were unable to recover it. 00:27:29.151 [2024-12-08 02:29:56.673254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.673333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.673357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.151 qpair failed and we were unable to recover it. 00:27:29.151 [2024-12-08 02:29:56.673443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.673548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.673576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.151 qpair failed and we were unable to recover it. 00:27:29.151 [2024-12-08 02:29:56.673664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.673778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.673804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.151 qpair failed and we were unable to recover it. 00:27:29.151 [2024-12-08 02:29:56.673883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.673965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.673990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.151 qpair failed and we were unable to recover it. 00:27:29.151 [2024-12-08 02:29:56.674088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.674173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.674200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.151 qpair failed and we were unable to recover it. 00:27:29.151 [2024-12-08 02:29:56.674298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.674377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.674404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.151 qpair failed and we were unable to recover it. 00:27:29.151 [2024-12-08 02:29:56.674490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.674572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.674599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.151 qpair failed and we were unable to recover it. 00:27:29.151 [2024-12-08 02:29:56.674741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.674823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.674850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.151 qpair failed and we were unable to recover it. 00:27:29.151 [2024-12-08 02:29:56.674940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.675014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.675041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.151 qpair failed and we were unable to recover it. 00:27:29.151 [2024-12-08 02:29:56.675121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.151 [2024-12-08 02:29:56.675198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.675224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.152 qpair failed and we were unable to recover it. 00:27:29.152 [2024-12-08 02:29:56.675368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.675454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.675481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.152 qpair failed and we were unable to recover it. 00:27:29.152 [2024-12-08 02:29:56.675571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.675649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.675674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.152 qpair failed and we were unable to recover it. 00:27:29.152 [2024-12-08 02:29:56.675752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.675843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.675869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.152 qpair failed and we were unable to recover it. 00:27:29.152 [2024-12-08 02:29:56.675951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.676040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.676066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5758000b90 with addr=10.0.0.2, port=4420 00:27:29.152 qpair failed and we were unable to recover it. 00:27:29.152 [2024-12-08 02:29:56.676173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.676276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.676306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.152 qpair failed and we were unable to recover it. 00:27:29.152 [2024-12-08 02:29:56.676389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.676502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.676528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.152 qpair failed and we were unable to recover it. 00:27:29.152 [2024-12-08 02:29:56.676626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.676707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.676733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.152 qpair failed and we were unable to recover it. 00:27:29.152 [2024-12-08 02:29:56.676821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.676934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.676960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.152 qpair failed and we were unable to recover it. 00:27:29.152 [2024-12-08 02:29:56.677043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.677123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.677149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.152 qpair failed and we were unable to recover it. 00:27:29.152 [2024-12-08 02:29:56.677262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.677346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.677371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.152 qpair failed and we were unable to recover it. 00:27:29.152 [2024-12-08 02:29:56.677490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.677583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.677610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.152 qpair failed and we were unable to recover it. 00:27:29.152 [2024-12-08 02:29:56.677692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.677808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.677834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.152 qpair failed and we were unable to recover it. 00:27:29.152 [2024-12-08 02:29:56.677930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.678044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.678069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.152 qpair failed and we were unable to recover it. 00:27:29.152 [2024-12-08 02:29:56.678164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.678249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.678274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.152 qpair failed and we were unable to recover it. 00:27:29.152 [2024-12-08 02:29:56.678365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.678465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.678493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.152 qpair failed and we were unable to recover it. 00:27:29.152 [2024-12-08 02:29:56.678596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.678677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.678703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.152 qpair failed and we were unable to recover it. 00:27:29.152 [2024-12-08 02:29:56.678790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.678898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.678926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.152 qpair failed and we were unable to recover it. 00:27:29.152 [2024-12-08 02:29:56.679006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.679088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.679115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.152 qpair failed and we were unable to recover it. 00:27:29.152 [2024-12-08 02:29:56.679196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.679279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.679304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.152 qpair failed and we were unable to recover it. 00:27:29.152 [2024-12-08 02:29:56.679409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.679489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.679515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.152 qpair failed and we were unable to recover it. 00:27:29.152 [2024-12-08 02:29:56.679613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.679694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.679721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.152 qpair failed and we were unable to recover it. 00:27:29.152 [2024-12-08 02:29:56.679809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.679887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.679912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.152 qpair failed and we were unable to recover it. 00:27:29.152 [2024-12-08 02:29:56.679999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.680078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.680103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.152 qpair failed and we were unable to recover it. 00:27:29.152 [2024-12-08 02:29:56.680213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.680320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.680345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.152 qpair failed and we were unable to recover it. 00:27:29.152 [2024-12-08 02:29:56.680459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.680550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.680576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.152 qpair failed and we were unable to recover it. 00:27:29.152 [2024-12-08 02:29:56.680661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.680772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.680798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.152 qpair failed and we were unable to recover it. 00:27:29.152 [2024-12-08 02:29:56.680887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.680997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.681024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.152 qpair failed and we were unable to recover it. 00:27:29.152 [2024-12-08 02:29:56.681111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.681186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.152 [2024-12-08 02:29:56.681212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.152 qpair failed and we were unable to recover it. 00:27:29.153 [2024-12-08 02:29:56.681297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.681409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.681434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.153 qpair failed and we were unable to recover it. 00:27:29.153 [2024-12-08 02:29:56.681521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.681619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.681645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.153 qpair failed and we were unable to recover it. 00:27:29.153 [2024-12-08 02:29:56.681727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.681805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.681831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.153 qpair failed and we were unable to recover it. 00:27:29.153 [2024-12-08 02:29:56.681942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.682025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.682051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.153 qpair failed and we were unable to recover it. 00:27:29.153 [2024-12-08 02:29:56.682138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.682225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.682251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.153 qpair failed and we were unable to recover it. 00:27:29.153 [2024-12-08 02:29:56.682363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.682453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.682479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.153 qpair failed and we were unable to recover it. 00:27:29.153 [2024-12-08 02:29:56.682571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.682657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.682683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.153 qpair failed and we were unable to recover it. 00:27:29.153 [2024-12-08 02:29:56.682773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.682886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.682912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.153 qpair failed and we were unable to recover it. 00:27:29.153 [2024-12-08 02:29:56.683035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.683111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.683137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.153 qpair failed and we were unable to recover it. 00:27:29.153 [2024-12-08 02:29:56.683244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.683331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.683356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.153 qpair failed and we were unable to recover it. 00:27:29.153 [2024-12-08 02:29:56.683466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.683548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.683575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.153 qpair failed and we were unable to recover it. 00:27:29.153 [2024-12-08 02:29:56.683671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.683746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.683772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.153 qpair failed and we were unable to recover it. 00:27:29.153 [2024-12-08 02:29:56.683922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.683995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.684020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.153 qpair failed and we were unable to recover it. 00:27:29.153 [2024-12-08 02:29:56.684097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.684227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.684254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.153 qpair failed and we were unable to recover it. 00:27:29.153 [2024-12-08 02:29:56.684332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.684415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.684440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.153 qpair failed and we were unable to recover it. 00:27:29.153 [2024-12-08 02:29:56.684520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.684602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.684629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.153 qpair failed and we were unable to recover it. 00:27:29.153 [2024-12-08 02:29:56.684711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.684796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.684827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.153 qpair failed and we were unable to recover it. 00:27:29.153 [2024-12-08 02:29:56.684936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.685020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.685045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.153 qpair failed and we were unable to recover it. 00:27:29.153 [2024-12-08 02:29:56.685150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.685258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.685284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.153 qpair failed and we were unable to recover it. 00:27:29.153 [2024-12-08 02:29:56.685360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.685440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.685466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.153 qpair failed and we were unable to recover it. 00:27:29.153 [2024-12-08 02:29:56.685569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.685673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.685702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.153 qpair failed and we were unable to recover it. 00:27:29.153 [2024-12-08 02:29:56.685802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.685882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.685907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.153 qpair failed and we were unable to recover it. 00:27:29.153 [2024-12-08 02:29:56.685987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.686069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.686096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.153 qpair failed and we were unable to recover it. 00:27:29.153 [2024-12-08 02:29:56.686207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.686281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.686306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.153 qpair failed and we were unable to recover it. 00:27:29.153 [2024-12-08 02:29:56.686423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.686506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.686530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.153 qpair failed and we were unable to recover it. 00:27:29.153 [2024-12-08 02:29:56.686618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.686736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.686761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.153 qpair failed and we were unable to recover it. 00:27:29.153 [2024-12-08 02:29:56.686840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.686916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.686947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.153 qpair failed and we were unable to recover it. 00:27:29.153 [2024-12-08 02:29:56.687027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.687171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.687196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.153 qpair failed and we were unable to recover it. 00:27:29.153 [2024-12-08 02:29:56.687286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.687372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.153 [2024-12-08 02:29:56.687398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.154 qpair failed and we were unable to recover it. 00:27:29.154 [2024-12-08 02:29:56.687487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.687572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.687599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.154 qpair failed and we were unable to recover it. 00:27:29.154 [2024-12-08 02:29:56.687683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.687773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.687798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.154 qpair failed and we were unable to recover it. 00:27:29.154 [2024-12-08 02:29:56.687874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.687954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.687979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.154 qpair failed and we were unable to recover it. 00:27:29.154 [2024-12-08 02:29:56.688064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.688139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.688165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.154 qpair failed and we were unable to recover it. 00:27:29.154 [2024-12-08 02:29:56.688278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.688470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.688496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.154 qpair failed and we were unable to recover it. 00:27:29.154 [2024-12-08 02:29:56.688597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.688677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.688702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.154 qpair failed and we were unable to recover it. 00:27:29.154 [2024-12-08 02:29:56.688788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.688867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.688892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.154 qpair failed and we were unable to recover it. 00:27:29.154 [2024-12-08 02:29:56.688975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.689057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.689082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.154 qpair failed and we were unable to recover it. 00:27:29.154 [2024-12-08 02:29:56.689166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.689355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.689380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.154 qpair failed and we were unable to recover it. 00:27:29.154 [2024-12-08 02:29:56.689490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.689576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.689602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.154 qpair failed and we were unable to recover it. 00:27:29.154 [2024-12-08 02:29:56.689686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.689773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.689799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.154 qpair failed and we were unable to recover it. 00:27:29.154 [2024-12-08 02:29:56.689888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.689998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.690023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.154 qpair failed and we were unable to recover it. 00:27:29.154 [2024-12-08 02:29:56.690105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.690211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.690237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.154 qpair failed and we were unable to recover it. 00:27:29.154 [2024-12-08 02:29:56.690350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.690430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.690456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.154 qpair failed and we were unable to recover it. 00:27:29.154 [2024-12-08 02:29:56.690558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.690680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.690706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.154 qpair failed and we were unable to recover it. 00:27:29.154 [2024-12-08 02:29:56.690788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.690896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.690921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.154 qpair failed and we were unable to recover it. 00:27:29.154 [2024-12-08 02:29:56.690999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.691084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.691109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.154 qpair failed and we were unable to recover it. 00:27:29.154 [2024-12-08 02:29:56.691185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.691298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.691325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.154 qpair failed and we were unable to recover it. 00:27:29.154 [2024-12-08 02:29:56.691450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.691532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.691567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.154 qpair failed and we were unable to recover it. 00:27:29.154 [2024-12-08 02:29:56.691649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.691837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.691863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.154 qpair failed and we were unable to recover it. 00:27:29.154 [2024-12-08 02:29:56.691972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.692107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.692132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.154 qpair failed and we were unable to recover it. 00:27:29.154 [2024-12-08 02:29:56.692217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.692325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.692351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.154 qpair failed and we were unable to recover it. 00:27:29.154 [2024-12-08 02:29:56.692431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.692508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.692533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.154 qpair failed and we were unable to recover it. 00:27:29.154 [2024-12-08 02:29:56.692623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.692703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.692729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.154 qpair failed and we were unable to recover it. 00:27:29.154 [2024-12-08 02:29:56.692835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.692943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.154 [2024-12-08 02:29:56.692968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.154 qpair failed and we were unable to recover it. 00:27:29.154 [2024-12-08 02:29:56.693043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.693119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.693144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.155 qpair failed and we were unable to recover it. 00:27:29.155 [2024-12-08 02:29:56.693266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.693352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.693378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.155 qpair failed and we were unable to recover it. 00:27:29.155 [2024-12-08 02:29:56.693461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.693558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.693583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.155 qpair failed and we were unable to recover it. 00:27:29.155 [2024-12-08 02:29:56.693672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.693765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.693792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.155 qpair failed and we were unable to recover it. 00:27:29.155 [2024-12-08 02:29:56.693872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.693955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.693980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.155 qpair failed and we were unable to recover it. 00:27:29.155 [2024-12-08 02:29:56.694064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.694254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.694280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.155 qpair failed and we were unable to recover it. 00:27:29.155 [2024-12-08 02:29:56.694360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.694439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.694464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.155 qpair failed and we were unable to recover it. 00:27:29.155 [2024-12-08 02:29:56.694560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.694693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.694723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.155 qpair failed and we were unable to recover it. 00:27:29.155 [2024-12-08 02:29:56.694825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.694923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.694952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.155 qpair failed and we were unable to recover it. 00:27:29.155 [2024-12-08 02:29:56.695068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.695192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.695217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.155 qpair failed and we were unable to recover it. 00:27:29.155 [2024-12-08 02:29:56.695300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.695378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.695403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.155 qpair failed and we were unable to recover it. 00:27:29.155 [2024-12-08 02:29:56.695519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.695599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.695625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.155 qpair failed and we were unable to recover it. 00:27:29.155 [2024-12-08 02:29:56.695707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.695791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.695817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.155 qpair failed and we were unable to recover it. 00:27:29.155 [2024-12-08 02:29:56.695900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.695980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.696005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.155 qpair failed and we were unable to recover it. 00:27:29.155 [2024-12-08 02:29:56.696146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.696223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.696248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.155 qpair failed and we were unable to recover it. 00:27:29.155 [2024-12-08 02:29:56.696336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.696421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.696447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.155 qpair failed and we were unable to recover it. 00:27:29.155 [2024-12-08 02:29:56.696533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.696648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.696674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.155 qpair failed and we were unable to recover it. 00:27:29.155 [2024-12-08 02:29:56.696751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.696857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.696882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.155 qpair failed and we were unable to recover it. 00:27:29.155 [2024-12-08 02:29:56.696967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.697054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.697079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.155 qpair failed and we were unable to recover it. 00:27:29.155 [2024-12-08 02:29:56.697193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.697279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.697304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.155 qpair failed and we were unable to recover it. 00:27:29.155 [2024-12-08 02:29:56.697390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.697467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.697492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.155 qpair failed and we were unable to recover it. 00:27:29.155 [2024-12-08 02:29:56.697617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.697705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.697731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.155 qpair failed and we were unable to recover it. 00:27:29.155 [2024-12-08 02:29:56.697815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.697900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.697925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.155 qpair failed and we were unable to recover it. 00:27:29.155 [2024-12-08 02:29:56.698003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.698091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.698116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.155 qpair failed and we were unable to recover it. 00:27:29.155 [2024-12-08 02:29:56.698195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.698301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.698327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.155 qpair failed and we were unable to recover it. 00:27:29.155 [2024-12-08 02:29:56.698410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.698521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.698557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.155 qpair failed and we were unable to recover it. 00:27:29.155 [2024-12-08 02:29:56.698644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.698727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.698754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.155 qpair failed and we were unable to recover it. 00:27:29.155 [2024-12-08 02:29:56.698837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.698930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.698955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.155 qpair failed and we were unable to recover it. 00:27:29.155 [2024-12-08 02:29:56.699034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.155 [2024-12-08 02:29:56.699108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.699133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.156 qpair failed and we were unable to recover it. 00:27:29.156 [2024-12-08 02:29:56.699248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.699331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.699356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.156 qpair failed and we were unable to recover it. 00:27:29.156 [2024-12-08 02:29:56.699448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.699561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.699587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.156 qpair failed and we were unable to recover it. 00:27:29.156 [2024-12-08 02:29:56.699693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.699772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.699798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.156 qpair failed and we were unable to recover it. 00:27:29.156 [2024-12-08 02:29:56.699907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.699986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.700012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.156 qpair failed and we were unable to recover it. 00:27:29.156 [2024-12-08 02:29:56.700087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.700164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.700201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.156 qpair failed and we were unable to recover it. 00:27:29.156 [2024-12-08 02:29:56.700309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.700393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.700420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.156 qpair failed and we were unable to recover it. 00:27:29.156 [2024-12-08 02:29:56.700507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.700623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.700649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.156 qpair failed and we were unable to recover it. 00:27:29.156 [2024-12-08 02:29:56.700764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.700856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.700881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.156 qpair failed and we were unable to recover it. 00:27:29.156 [2024-12-08 02:29:56.701023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.701105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.701132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.156 qpair failed and we were unable to recover it. 00:27:29.156 [2024-12-08 02:29:56.701246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.701360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.701385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.156 qpair failed and we were unable to recover it. 00:27:29.156 [2024-12-08 02:29:56.701471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.705633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.705674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.156 qpair failed and we were unable to recover it. 00:27:29.156 [2024-12-08 02:29:56.705789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.705931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.705957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.156 qpair failed and we were unable to recover it. 00:27:29.156 [2024-12-08 02:29:56.706045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.706180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.706207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.156 qpair failed and we were unable to recover it. 00:27:29.156 [2024-12-08 02:29:56.706294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.706405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.706431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.156 qpair failed and we were unable to recover it. 00:27:29.156 [2024-12-08 02:29:56.706549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.706661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.706692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.156 qpair failed and we were unable to recover it. 00:27:29.156 [2024-12-08 02:29:56.706777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.706862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.706887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.156 qpair failed and we were unable to recover it. 00:27:29.156 [2024-12-08 02:29:56.706964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.707046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.707072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.156 qpair failed and we were unable to recover it. 00:27:29.156 [2024-12-08 02:29:56.707160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.707267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.707291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.156 qpair failed and we were unable to recover it. 00:27:29.156 [2024-12-08 02:29:56.707380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.707457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.707482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.156 qpair failed and we were unable to recover it. 00:27:29.156 [2024-12-08 02:29:56.707571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.707665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.707691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.156 qpair failed and we were unable to recover it. 00:27:29.156 [2024-12-08 02:29:56.707781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.707866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.707892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.156 qpair failed and we were unable to recover it. 00:27:29.156 [2024-12-08 02:29:56.708035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.708114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.708139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.156 qpair failed and we were unable to recover it. 00:27:29.156 [2024-12-08 02:29:56.708222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.708364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.708388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.156 qpair failed and we were unable to recover it. 00:27:29.156 [2024-12-08 02:29:56.708473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.708589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.708616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.156 qpair failed and we were unable to recover it. 00:27:29.156 [2024-12-08 02:29:56.708696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.708809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.708839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.156 qpair failed and we were unable to recover it. 00:27:29.156 [2024-12-08 02:29:56.708923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.709001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.709026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.156 qpair failed and we were unable to recover it. 00:27:29.156 [2024-12-08 02:29:56.709115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.709223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.709248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.156 qpair failed and we were unable to recover it. 00:27:29.156 [2024-12-08 02:29:56.709326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.709408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.156 [2024-12-08 02:29:56.709433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.156 qpair failed and we were unable to recover it. 00:27:29.156 [2024-12-08 02:29:56.709556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.709643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.709668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.157 qpair failed and we were unable to recover it. 00:27:29.157 [2024-12-08 02:29:56.709747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.709894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.709919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.157 qpair failed and we were unable to recover it. 00:27:29.157 [2024-12-08 02:29:56.710009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.710090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.710115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.157 qpair failed and we were unable to recover it. 00:27:29.157 [2024-12-08 02:29:56.710194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.710306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.710333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.157 qpair failed and we were unable to recover it. 00:27:29.157 [2024-12-08 02:29:56.710423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.710505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.710530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.157 qpair failed and we were unable to recover it. 00:27:29.157 [2024-12-08 02:29:56.710650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.710760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.710785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.157 qpair failed and we were unable to recover it. 00:27:29.157 [2024-12-08 02:29:56.710911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.710993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.711023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.157 qpair failed and we were unable to recover it. 00:27:29.157 [2024-12-08 02:29:56.711109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.711188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.711214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.157 qpair failed and we were unable to recover it. 00:27:29.157 [2024-12-08 02:29:56.711360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.711450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.711476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.157 qpair failed and we were unable to recover it. 00:27:29.157 [2024-12-08 02:29:56.711558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.711643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.711668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.157 qpair failed and we were unable to recover it. 00:27:29.157 [2024-12-08 02:29:56.711788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.711871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.711896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.157 qpair failed and we were unable to recover it. 00:27:29.157 [2024-12-08 02:29:56.712004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.712081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.712107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.157 qpair failed and we were unable to recover it. 00:27:29.157 [2024-12-08 02:29:56.712196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.712274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.712299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.157 qpair failed and we were unable to recover it. 00:27:29.157 [2024-12-08 02:29:56.712377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.712456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.712481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.157 qpair failed and we were unable to recover it. 00:27:29.157 [2024-12-08 02:29:56.712569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.712646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.712670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.157 qpair failed and we were unable to recover it. 00:27:29.157 [2024-12-08 02:29:56.712758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.712832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.712857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.157 qpair failed and we were unable to recover it. 00:27:29.157 [2024-12-08 02:29:56.712938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.713079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.713104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.157 qpair failed and we were unable to recover it. 00:27:29.157 [2024-12-08 02:29:56.713190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.713273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.713299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.157 qpair failed and we were unable to recover it. 00:27:29.157 [2024-12-08 02:29:56.713378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.713494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.713520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.157 qpair failed and we were unable to recover it. 00:27:29.157 [2024-12-08 02:29:56.713613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.713725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.713751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.157 qpair failed and we were unable to recover it. 00:27:29.157 [2024-12-08 02:29:56.713830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.713941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.713967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.157 qpair failed and we were unable to recover it. 00:27:29.157 [2024-12-08 02:29:56.714052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.714191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.714217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.157 qpair failed and we were unable to recover it. 00:27:29.157 [2024-12-08 02:29:56.714297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.714405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.714431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.157 qpair failed and we were unable to recover it. 00:27:29.157 [2024-12-08 02:29:56.714511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.714609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.714635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.157 qpair failed and we were unable to recover it. 00:27:29.157 [2024-12-08 02:29:56.714714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.714824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.714849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.157 qpair failed and we were unable to recover it. 00:27:29.157 [2024-12-08 02:29:56.714928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.715035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.157 [2024-12-08 02:29:56.715059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.157 qpair failed and we were unable to recover it. 00:27:29.158 [2024-12-08 02:29:56.715211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.715293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.715318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.158 qpair failed and we were unable to recover it. 00:27:29.158 [2024-12-08 02:29:56.715410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.715496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.715522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.158 qpair failed and we were unable to recover it. 00:27:29.158 [2024-12-08 02:29:56.715610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.715721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.715746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.158 qpair failed and we were unable to recover it. 00:27:29.158 [2024-12-08 02:29:56.715832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.715921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.715945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.158 qpair failed and we were unable to recover it. 00:27:29.158 [2024-12-08 02:29:56.716028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.716163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.716188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.158 qpair failed and we were unable to recover it. 00:27:29.158 [2024-12-08 02:29:56.716267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.716340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.716365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.158 qpair failed and we were unable to recover it. 00:27:29.158 [2024-12-08 02:29:56.716473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.716554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.716579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.158 qpair failed and we were unable to recover it. 00:27:29.158 [2024-12-08 02:29:56.716690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.716798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.716824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.158 qpair failed and we were unable to recover it. 00:27:29.158 [2024-12-08 02:29:56.716941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.717048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.717073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.158 qpair failed and we were unable to recover it. 00:27:29.158 [2024-12-08 02:29:56.717184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.717293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.717318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.158 qpair failed and we were unable to recover it. 00:27:29.158 [2024-12-08 02:29:56.717395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.717470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.717496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.158 qpair failed and we were unable to recover it. 00:27:29.158 [2024-12-08 02:29:56.717617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.717715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.717742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.158 qpair failed and we were unable to recover it. 00:27:29.158 [2024-12-08 02:29:56.717824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.717946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.717973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.158 qpair failed and we were unable to recover it. 00:27:29.158 [2024-12-08 02:29:56.718053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.718158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.718183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.158 qpair failed and we were unable to recover it. 00:27:29.158 [2024-12-08 02:29:56.718323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.718462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.718488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.158 qpair failed and we were unable to recover it. 00:27:29.158 [2024-12-08 02:29:56.718575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.718688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.718714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.158 qpair failed and we were unable to recover it. 00:27:29.158 [2024-12-08 02:29:56.718827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.718911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.718936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.158 qpair failed and we were unable to recover it. 00:27:29.158 [2024-12-08 02:29:56.719044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.719157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.719182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.158 qpair failed and we were unable to recover it. 00:27:29.158 [2024-12-08 02:29:56.719295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.719379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.719405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.158 qpair failed and we were unable to recover it. 00:27:29.158 [2024-12-08 02:29:56.719493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.719583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.719609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.158 qpair failed and we were unable to recover it. 00:27:29.158 [2024-12-08 02:29:56.719721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.719806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.719832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.158 qpair failed and we were unable to recover it. 00:27:29.158 [2024-12-08 02:29:56.719911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.719987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.720012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.158 qpair failed and we were unable to recover it. 00:27:29.158 [2024-12-08 02:29:56.720090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.720204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.720229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.158 qpair failed and we were unable to recover it. 00:27:29.158 [2024-12-08 02:29:56.720316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.720392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.720418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.158 qpair failed and we were unable to recover it. 00:27:29.158 [2024-12-08 02:29:56.720531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.720631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.158 [2024-12-08 02:29:56.720657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.158 qpair failed and we were unable to recover it. 00:27:29.159 [2024-12-08 02:29:56.720775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.720914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.720940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.159 qpair failed and we were unable to recover it. 00:27:29.159 [2024-12-08 02:29:56.721032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.721114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.721139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.159 qpair failed and we were unable to recover it. 00:27:29.159 [2024-12-08 02:29:56.721221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.721327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.721352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.159 qpair failed and we were unable to recover it. 00:27:29.159 [2024-12-08 02:29:56.721443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.721578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.721604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.159 qpair failed and we were unable to recover it. 00:27:29.159 [2024-12-08 02:29:56.721690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.721774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.721799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.159 qpair failed and we were unable to recover it. 00:27:29.159 [2024-12-08 02:29:56.721889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.721976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.722002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.159 qpair failed and we were unable to recover it. 00:27:29.159 [2024-12-08 02:29:56.722091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.722176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.722202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.159 qpair failed and we were unable to recover it. 00:27:29.159 [2024-12-08 02:29:56.722310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.722425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.722452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.159 qpair failed and we were unable to recover it. 00:27:29.159 [2024-12-08 02:29:56.722534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.722624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.722648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.159 qpair failed and we were unable to recover it. 00:27:29.159 [2024-12-08 02:29:56.722730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.722809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.722834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.159 qpair failed and we were unable to recover it. 00:27:29.159 [2024-12-08 02:29:56.722914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.723027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.723053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.159 qpair failed and we were unable to recover it. 00:27:29.159 [2024-12-08 02:29:56.723169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.723256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.723281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.159 qpair failed and we were unable to recover it. 00:27:29.159 [2024-12-08 02:29:56.723394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.723474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.723500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.159 qpair failed and we were unable to recover it. 00:27:29.159 [2024-12-08 02:29:56.723621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.723704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.723731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.159 qpair failed and we were unable to recover it. 00:27:29.159 [2024-12-08 02:29:56.723831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.723909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.723934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.159 qpair failed and we were unable to recover it. 00:27:29.159 [2024-12-08 02:29:56.724044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.724124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.724150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.159 qpair failed and we were unable to recover it. 00:27:29.159 [2024-12-08 02:29:56.724242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.724320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.724345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.159 qpair failed and we were unable to recover it. 00:27:29.159 [2024-12-08 02:29:56.724420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.724509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.724534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.159 qpair failed and we were unable to recover it. 00:27:29.159 [2024-12-08 02:29:56.724632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.724725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.724751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.159 qpair failed and we were unable to recover it. 00:27:29.159 [2024-12-08 02:29:56.724831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.724905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.724930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.159 qpair failed and we were unable to recover it. 00:27:29.159 [2024-12-08 02:29:56.725046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.725126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.725151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.159 qpair failed and we were unable to recover it. 00:27:29.159 [2024-12-08 02:29:56.725262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.725355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.725379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.159 qpair failed and we were unable to recover it. 00:27:29.159 [2024-12-08 02:29:56.725496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.725604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.725630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.159 qpair failed and we were unable to recover it. 00:27:29.159 [2024-12-08 02:29:56.725723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.725829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.725855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.159 qpair failed and we were unable to recover it. 00:27:29.159 [2024-12-08 02:29:56.725948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.726121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.726147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.159 qpair failed and we were unable to recover it. 00:27:29.159 [2024-12-08 02:29:56.726224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.726330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.726356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.159 qpair failed and we were unable to recover it. 00:27:29.159 [2024-12-08 02:29:56.726454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.726566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.726593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.159 qpair failed and we were unable to recover it. 00:27:29.159 [2024-12-08 02:29:56.726672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.726775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.159 [2024-12-08 02:29:56.726801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.159 qpair failed and we were unable to recover it. 00:27:29.159 [2024-12-08 02:29:56.726879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.727007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.727032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.160 qpair failed and we were unable to recover it. 00:27:29.160 [2024-12-08 02:29:56.727140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.727225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.727251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.160 qpair failed and we were unable to recover it. 00:27:29.160 [2024-12-08 02:29:56.727338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.727424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.727450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.160 qpair failed and we were unable to recover it. 00:27:29.160 [2024-12-08 02:29:56.727533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.727650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.727675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.160 qpair failed and we were unable to recover it. 00:27:29.160 [2024-12-08 02:29:56.727758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.727835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.727861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.160 qpair failed and we were unable to recover it. 00:27:29.160 [2024-12-08 02:29:56.727967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.728053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.728078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.160 qpair failed and we were unable to recover it. 00:27:29.160 [2024-12-08 02:29:56.728161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.728266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.728292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.160 qpair failed and we were unable to recover it. 00:27:29.160 [2024-12-08 02:29:56.728366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.728479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.728504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.160 qpair failed and we were unable to recover it. 00:27:29.160 [2024-12-08 02:29:56.728619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.728814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.728839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.160 qpair failed and we were unable to recover it. 00:27:29.160 [2024-12-08 02:29:56.728949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.729086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.729111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.160 qpair failed and we were unable to recover it. 00:27:29.160 [2024-12-08 02:29:56.729202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.729278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.729303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.160 qpair failed and we were unable to recover it. 00:27:29.160 [2024-12-08 02:29:56.729377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.729491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.729516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.160 qpair failed and we were unable to recover it. 00:27:29.160 [2024-12-08 02:29:56.729604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.729683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.729708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.160 qpair failed and we were unable to recover it. 00:27:29.160 [2024-12-08 02:29:56.729819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.729906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.729933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.160 qpair failed and we were unable to recover it. 00:27:29.160 [2024-12-08 02:29:56.730022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.730131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.730156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.160 qpair failed and we were unable to recover it. 00:27:29.160 [2024-12-08 02:29:56.730268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.730357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.730382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.160 qpair failed and we were unable to recover it. 00:27:29.160 [2024-12-08 02:29:56.730462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.730552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.730579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.160 qpair failed and we were unable to recover it. 00:27:29.160 [2024-12-08 02:29:56.730656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.730737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.730762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.160 qpair failed and we were unable to recover it. 00:27:29.160 [2024-12-08 02:29:56.730843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.731043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.731069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.160 qpair failed and we were unable to recover it. 00:27:29.160 [2024-12-08 02:29:56.731263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.731408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.731434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.160 qpair failed and we were unable to recover it. 00:27:29.160 [2024-12-08 02:29:56.731512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.731636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.731662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.160 qpair failed and we were unable to recover it. 00:27:29.160 [2024-12-08 02:29:56.731739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.731825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.731850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.160 qpair failed and we were unable to recover it. 00:27:29.160 [2024-12-08 02:29:56.731946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.732026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.732051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.160 qpair failed and we were unable to recover it. 00:27:29.160 [2024-12-08 02:29:56.732138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.732225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.732250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.160 qpair failed and we were unable to recover it. 00:27:29.160 [2024-12-08 02:29:56.732356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.732444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.732470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.160 qpair failed and we were unable to recover it. 00:27:29.160 [2024-12-08 02:29:56.732561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.732651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.732677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.160 qpair failed and we were unable to recover it. 00:27:29.160 [2024-12-08 02:29:56.732791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.732908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.732934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.160 qpair failed and we were unable to recover it. 00:27:29.160 [2024-12-08 02:29:56.733128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.733205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.160 [2024-12-08 02:29:56.733230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.160 qpair failed and we were unable to recover it. 00:27:29.161 [2024-12-08 02:29:56.733344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.733429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.733456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.161 qpair failed and we were unable to recover it. 00:27:29.161 [2024-12-08 02:29:56.733644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.733752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.733778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.161 qpair failed and we were unable to recover it. 00:27:29.161 [2024-12-08 02:29:56.733916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.733995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.734020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.161 qpair failed and we were unable to recover it. 00:27:29.161 [2024-12-08 02:29:56.734108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.734190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.734214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.161 qpair failed and we were unable to recover it. 00:27:29.161 [2024-12-08 02:29:56.734312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.734431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.734456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.161 qpair failed and we were unable to recover it. 00:27:29.161 [2024-12-08 02:29:56.734547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.734654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.734680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.161 qpair failed and we were unable to recover it. 00:27:29.161 [2024-12-08 02:29:56.734793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.734882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.734907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.161 qpair failed and we were unable to recover it. 00:27:29.161 [2024-12-08 02:29:56.734984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.735063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.735088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.161 qpair failed and we were unable to recover it. 00:27:29.161 [2024-12-08 02:29:56.735195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.735274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.735299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.161 qpair failed and we were unable to recover it. 00:27:29.161 [2024-12-08 02:29:56.735376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.735479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.735506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.161 qpair failed and we were unable to recover it. 00:27:29.161 [2024-12-08 02:29:56.735604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.735687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.735713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.161 qpair failed and we were unable to recover it. 00:27:29.161 [2024-12-08 02:29:56.735822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.735960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.735985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.161 qpair failed and we were unable to recover it. 00:27:29.161 [2024-12-08 02:29:56.736099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.736206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.736231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.161 qpair failed and we were unable to recover it. 00:27:29.161 [2024-12-08 02:29:56.736314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.736425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.736450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.161 qpair failed and we were unable to recover it. 00:27:29.161 [2024-12-08 02:29:56.736535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.736628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.736653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.161 qpair failed and we were unable to recover it. 00:27:29.161 [2024-12-08 02:29:56.736761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.736870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.736896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.161 qpair failed and we were unable to recover it. 00:27:29.161 [2024-12-08 02:29:56.737006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.737094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.737120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.161 qpair failed and we were unable to recover it. 00:27:29.161 [2024-12-08 02:29:56.737232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.737312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.737337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.161 qpair failed and we were unable to recover it. 00:27:29.161 [2024-12-08 02:29:56.737451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.737559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.737585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.161 qpair failed and we were unable to recover it. 00:27:29.161 [2024-12-08 02:29:56.737683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.737790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.737816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.161 qpair failed and we were unable to recover it. 00:27:29.161 [2024-12-08 02:29:56.737898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.738041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.738068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.161 qpair failed and we were unable to recover it. 00:27:29.161 [2024-12-08 02:29:56.738151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.738230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.738255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.161 qpair failed and we were unable to recover it. 00:27:29.161 [2024-12-08 02:29:56.738363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.738475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.738501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.161 qpair failed and we were unable to recover it. 00:27:29.161 [2024-12-08 02:29:56.738603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.738681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.738707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.161 qpair failed and we were unable to recover it. 00:27:29.161 [2024-12-08 02:29:56.738787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.738861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.738886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.161 qpair failed and we were unable to recover it. 00:27:29.161 [2024-12-08 02:29:56.739006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.739118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.739143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.161 qpair failed and we were unable to recover it. 00:27:29.161 [2024-12-08 02:29:56.739283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.739395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.161 [2024-12-08 02:29:56.739421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.161 qpair failed and we were unable to recover it. 00:27:29.162 [2024-12-08 02:29:56.739505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.739593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.739620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.162 qpair failed and we were unable to recover it. 00:27:29.162 [2024-12-08 02:29:56.739716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.739793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.739817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.162 qpair failed and we were unable to recover it. 00:27:29.162 [2024-12-08 02:29:56.739894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.740005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.740031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.162 qpair failed and we were unable to recover it. 00:27:29.162 [2024-12-08 02:29:56.740140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.740247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.740277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.162 qpair failed and we were unable to recover it. 00:27:29.162 [2024-12-08 02:29:56.740391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.740481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.740507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.162 qpair failed and we were unable to recover it. 00:27:29.162 [2024-12-08 02:29:56.740605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.740683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.740708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.162 qpair failed and we were unable to recover it. 00:27:29.162 [2024-12-08 02:29:56.740818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.740923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.740948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.162 qpair failed and we were unable to recover it. 00:27:29.162 [2024-12-08 02:29:56.741030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.741111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.741137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.162 qpair failed and we were unable to recover it. 00:27:29.162 [2024-12-08 02:29:56.741258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.741407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.741433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.162 qpair failed and we were unable to recover it. 00:27:29.162 [2024-12-08 02:29:56.741515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.741598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.741624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.162 qpair failed and we were unable to recover it. 00:27:29.162 [2024-12-08 02:29:56.741709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.741817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.741843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.162 qpair failed and we were unable to recover it. 00:27:29.162 [2024-12-08 02:29:56.741977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.742088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.742114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.162 qpair failed and we were unable to recover it. 00:27:29.162 [2024-12-08 02:29:56.742202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.742310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.742336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.162 qpair failed and we were unable to recover it. 00:27:29.162 [2024-12-08 02:29:56.742414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.742528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.742564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.162 qpair failed and we were unable to recover it. 00:27:29.162 [2024-12-08 02:29:56.742672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.742755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.742780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.162 qpair failed and we were unable to recover it. 00:27:29.162 [2024-12-08 02:29:56.742894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.742973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.742998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.162 qpair failed and we were unable to recover it. 00:27:29.162 [2024-12-08 02:29:56.743110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.743202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.743228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.162 qpair failed and we were unable to recover it. 00:27:29.162 [2024-12-08 02:29:56.743315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.743391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.743416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.162 qpair failed and we were unable to recover it. 00:27:29.162 [2024-12-08 02:29:56.743492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.743571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.743597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.162 qpair failed and we were unable to recover it. 00:27:29.162 [2024-12-08 02:29:56.743676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.743754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.743779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.162 qpair failed and we were unable to recover it. 00:27:29.162 [2024-12-08 02:29:56.743860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.743970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.743996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.162 qpair failed and we were unable to recover it. 00:27:29.162 [2024-12-08 02:29:56.744076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.744156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.744181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.162 qpair failed and we were unable to recover it. 00:27:29.162 [2024-12-08 02:29:56.744268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.744378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.744404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.162 qpair failed and we were unable to recover it. 00:27:29.162 [2024-12-08 02:29:56.744482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.744599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.744630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.162 qpair failed and we were unable to recover it. 00:27:29.162 [2024-12-08 02:29:56.744717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.744832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.744857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.162 qpair failed and we were unable to recover it. 00:27:29.162 [2024-12-08 02:29:56.744938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.745017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.745042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.162 qpair failed and we were unable to recover it. 00:27:29.162 [2024-12-08 02:29:56.745153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.745236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.745263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.162 qpair failed and we were unable to recover it. 00:27:29.162 [2024-12-08 02:29:56.745377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.162 [2024-12-08 02:29:56.745451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.745476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.163 qpair failed and we were unable to recover it. 00:27:29.163 [2024-12-08 02:29:56.745562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.745669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.745695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.163 qpair failed and we were unable to recover it. 00:27:29.163 [2024-12-08 02:29:56.745810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.745924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.745950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.163 qpair failed and we were unable to recover it. 00:27:29.163 [2024-12-08 02:29:56.746033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.746116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.746141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.163 qpair failed and we were unable to recover it. 00:27:29.163 [2024-12-08 02:29:56.746253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.746343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.746370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.163 qpair failed and we were unable to recover it. 00:27:29.163 [2024-12-08 02:29:56.746513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.746672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.746698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.163 qpair failed and we were unable to recover it. 00:27:29.163 [2024-12-08 02:29:56.746807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.746886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.746916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.163 qpair failed and we were unable to recover it. 00:27:29.163 [2024-12-08 02:29:56.747033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.747103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.747128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.163 qpair failed and we were unable to recover it. 00:27:29.163 [2024-12-08 02:29:56.747219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.747331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.747357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.163 qpair failed and we were unable to recover it. 00:27:29.163 [2024-12-08 02:29:56.747439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.747551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.747576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.163 qpair failed and we were unable to recover it. 00:27:29.163 [2024-12-08 02:29:56.747668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.747746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.747772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.163 qpair failed and we were unable to recover it. 00:27:29.163 [2024-12-08 02:29:56.747860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.747938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.747962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.163 qpair failed and we were unable to recover it. 00:27:29.163 [2024-12-08 02:29:56.748104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.748187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.748212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.163 qpair failed and we were unable to recover it. 00:27:29.163 [2024-12-08 02:29:56.748319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.748436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.748464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.163 qpair failed and we were unable to recover it. 00:27:29.163 [2024-12-08 02:29:56.748548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.748656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.748683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.163 qpair failed and we were unable to recover it. 00:27:29.163 [2024-12-08 02:29:56.748780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.748864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.748889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.163 qpair failed and we were unable to recover it. 00:27:29.163 [2024-12-08 02:29:56.748981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.749087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.749112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.163 qpair failed and we were unable to recover it. 00:27:29.163 [2024-12-08 02:29:56.749228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.749316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.749341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.163 qpair failed and we were unable to recover it. 00:27:29.163 [2024-12-08 02:29:56.749425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.749507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.749532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.163 qpair failed and we were unable to recover it. 00:27:29.163 [2024-12-08 02:29:56.749625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.749736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.749762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.163 qpair failed and we were unable to recover it. 00:27:29.163 [2024-12-08 02:29:56.749874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.749961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.749987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.163 qpair failed and we were unable to recover it. 00:27:29.163 [2024-12-08 02:29:56.750077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.750162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.750187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.163 qpair failed and we were unable to recover it. 00:27:29.163 [2024-12-08 02:29:56.750271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.750348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.750374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.163 qpair failed and we were unable to recover it. 00:27:29.163 [2024-12-08 02:29:56.750515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.750636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.163 [2024-12-08 02:29:56.750663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.164 qpair failed and we were unable to recover it. 00:27:29.164 [2024-12-08 02:29:56.750747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.750830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.750855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.164 qpair failed and we were unable to recover it. 00:27:29.164 [2024-12-08 02:29:56.750935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.751017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.751042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.164 qpair failed and we were unable to recover it. 00:27:29.164 [2024-12-08 02:29:56.751136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.751253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.751279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.164 qpair failed and we were unable to recover it. 00:27:29.164 [2024-12-08 02:29:56.751367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.751483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.751508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.164 qpair failed and we were unable to recover it. 00:27:29.164 [2024-12-08 02:29:56.751626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.751717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.751743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.164 qpair failed and we were unable to recover it. 00:27:29.164 [2024-12-08 02:29:56.751856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.751971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.751997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.164 qpair failed and we were unable to recover it. 00:27:29.164 [2024-12-08 02:29:56.752076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.752151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.752176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.164 qpair failed and we were unable to recover it. 00:27:29.164 [2024-12-08 02:29:56.752267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.752378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.752403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.164 qpair failed and we were unable to recover it. 00:27:29.164 [2024-12-08 02:29:56.752490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.752614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.752641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.164 qpair failed and we were unable to recover it. 00:27:29.164 [2024-12-08 02:29:56.752757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.752848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.752875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.164 qpair failed and we were unable to recover it. 00:27:29.164 [2024-12-08 02:29:56.752957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.753100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.753125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.164 qpair failed and we were unable to recover it. 00:27:29.164 [2024-12-08 02:29:56.753233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.753311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.753337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.164 qpair failed and we were unable to recover it. 00:27:29.164 [2024-12-08 02:29:56.753431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.753512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.753550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.164 qpair failed and we were unable to recover it. 00:27:29.164 [2024-12-08 02:29:56.753643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.753735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.753762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.164 qpair failed and we were unable to recover it. 00:27:29.164 [2024-12-08 02:29:56.753848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.753929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.753955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.164 qpair failed and we were unable to recover it. 00:27:29.164 [2024-12-08 02:29:56.754032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.754105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.754131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.164 qpair failed and we were unable to recover it. 00:27:29.164 [2024-12-08 02:29:56.754215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.754322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.754348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.164 qpair failed and we were unable to recover it. 00:27:29.164 [2024-12-08 02:29:56.754428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.754546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.754573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.164 qpair failed and we were unable to recover it. 00:27:29.164 [2024-12-08 02:29:56.754691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.754769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.754794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.164 qpair failed and we were unable to recover it. 00:27:29.164 [2024-12-08 02:29:56.754909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.754987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.755013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.164 qpair failed and we were unable to recover it. 00:27:29.164 [2024-12-08 02:29:56.755125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.755232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.755258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.164 qpair failed and we were unable to recover it. 00:27:29.164 [2024-12-08 02:29:56.755345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.755422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.755448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.164 qpair failed and we were unable to recover it. 00:27:29.164 [2024-12-08 02:29:56.755527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.755623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.755649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.164 qpair failed and we were unable to recover it. 00:27:29.164 [2024-12-08 02:29:56.755732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.755822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.755847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.164 qpair failed and we were unable to recover it. 00:27:29.164 [2024-12-08 02:29:56.755939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.756079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.756105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.164 qpair failed and we were unable to recover it. 00:27:29.164 [2024-12-08 02:29:56.756195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.756303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.756328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.164 qpair failed and we were unable to recover it. 00:27:29.164 [2024-12-08 02:29:56.756409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.756495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.756520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.164 qpair failed and we were unable to recover it. 00:27:29.164 [2024-12-08 02:29:56.756644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.756725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.756751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.164 qpair failed and we were unable to recover it. 00:27:29.164 [2024-12-08 02:29:56.756835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.164 [2024-12-08 02:29:56.756945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.756972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.165 qpair failed and we were unable to recover it. 00:27:29.165 [2024-12-08 02:29:56.757053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.757192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.757218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.165 qpair failed and we were unable to recover it. 00:27:29.165 [2024-12-08 02:29:56.757300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.757378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.757403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.165 qpair failed and we were unable to recover it. 00:27:29.165 [2024-12-08 02:29:56.757514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.757636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.757663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.165 qpair failed and we were unable to recover it. 00:27:29.165 [2024-12-08 02:29:56.757772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.757911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.757936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.165 qpair failed and we were unable to recover it. 00:27:29.165 [2024-12-08 02:29:56.758023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.758108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.758136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.165 qpair failed and we were unable to recover it. 00:27:29.165 [2024-12-08 02:29:56.758250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.758363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.758388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.165 qpair failed and we were unable to recover it. 00:27:29.165 [2024-12-08 02:29:56.758478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.758556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.758581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.165 qpair failed and we were unable to recover it. 00:27:29.165 [2024-12-08 02:29:56.758691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.758778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.758802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.165 qpair failed and we were unable to recover it. 00:27:29.165 [2024-12-08 02:29:56.758880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.758985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.759009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.165 qpair failed and we were unable to recover it. 00:27:29.165 [2024-12-08 02:29:56.759093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.759170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.759196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.165 qpair failed and we were unable to recover it. 00:27:29.165 [2024-12-08 02:29:56.759287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.759392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.759416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.165 qpair failed and we were unable to recover it. 00:27:29.165 [2024-12-08 02:29:56.759526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.759619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.759643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.165 qpair failed and we were unable to recover it. 00:27:29.165 [2024-12-08 02:29:56.759731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.759809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.759833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.165 qpair failed and we were unable to recover it. 00:27:29.165 [2024-12-08 02:29:56.759948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.760059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.760085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.165 qpair failed and we were unable to recover it. 00:27:29.165 [2024-12-08 02:29:56.760201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.760281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.760305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.165 qpair failed and we were unable to recover it. 00:27:29.165 [2024-12-08 02:29:56.760391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.760498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.760523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.165 qpair failed and we were unable to recover it. 00:27:29.165 [2024-12-08 02:29:56.760671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.760745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.760769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.165 qpair failed and we were unable to recover it. 00:27:29.165 [2024-12-08 02:29:56.760854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.760929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.760954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.165 qpair failed and we were unable to recover it. 00:27:29.165 [2024-12-08 02:29:56.761062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.761141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.761166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.165 qpair failed and we were unable to recover it. 00:27:29.165 [2024-12-08 02:29:56.761239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.761344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.761371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.165 qpair failed and we were unable to recover it. 00:27:29.165 [2024-12-08 02:29:56.761449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.761522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.761552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.165 qpair failed and we were unable to recover it. 00:27:29.165 [2024-12-08 02:29:56.761661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.761747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.761771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.165 qpair failed and we were unable to recover it. 00:27:29.165 [2024-12-08 02:29:56.761858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.761939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.761965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.165 qpair failed and we were unable to recover it. 00:27:29.165 [2024-12-08 02:29:56.762059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.762152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.762177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.165 qpair failed and we were unable to recover it. 00:27:29.165 [2024-12-08 02:29:56.762260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.762348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.762374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.165 qpair failed and we were unable to recover it. 00:27:29.165 [2024-12-08 02:29:56.762470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.762557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.762583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.165 qpair failed and we were unable to recover it. 00:27:29.165 [2024-12-08 02:29:56.762667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.762780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.165 [2024-12-08 02:29:56.762807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.165 qpair failed and we were unable to recover it. 00:27:29.165 [2024-12-08 02:29:56.762892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.762975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.763001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.166 qpair failed and we were unable to recover it. 00:27:29.166 [2024-12-08 02:29:56.763077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.763189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.763214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.166 qpair failed and we were unable to recover it. 00:27:29.166 [2024-12-08 02:29:56.763300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.763412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.763438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.166 qpair failed and we were unable to recover it. 00:27:29.166 [2024-12-08 02:29:56.763519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.763602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.763627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.166 qpair failed and we were unable to recover it. 00:27:29.166 [2024-12-08 02:29:56.763769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.763848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.763872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.166 qpair failed and we were unable to recover it. 00:27:29.166 [2024-12-08 02:29:56.763953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.764027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.764052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.166 qpair failed and we were unable to recover it. 00:27:29.166 [2024-12-08 02:29:56.764138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.764250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.764275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.166 qpair failed and we were unable to recover it. 00:27:29.166 [2024-12-08 02:29:56.764361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.764473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.764498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.166 qpair failed and we were unable to recover it. 00:27:29.166 [2024-12-08 02:29:56.764586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.764671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.764697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.166 qpair failed and we were unable to recover it. 00:27:29.166 [2024-12-08 02:29:56.764789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.764868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.764893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.166 qpair failed and we were unable to recover it. 00:27:29.166 [2024-12-08 02:29:56.764976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.765106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.765131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.166 qpair failed and we were unable to recover it. 00:27:29.166 [2024-12-08 02:29:56.765211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.765291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.765316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.166 qpair failed and we were unable to recover it. 00:27:29.166 [2024-12-08 02:29:56.765397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.765483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.765508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.166 qpair failed and we were unable to recover it. 00:27:29.166 [2024-12-08 02:29:56.765620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.765700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.765725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.166 qpair failed and we were unable to recover it. 00:27:29.166 [2024-12-08 02:29:56.765803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.765883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.765908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.166 qpair failed and we were unable to recover it. 00:27:29.166 [2024-12-08 02:29:56.765988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.766065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.766090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.166 qpair failed and we were unable to recover it. 00:27:29.166 [2024-12-08 02:29:56.766209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.766292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.766317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.166 qpair failed and we were unable to recover it. 00:27:29.166 [2024-12-08 02:29:56.766435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.766513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.766544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.166 qpair failed and we were unable to recover it. 00:27:29.166 [2024-12-08 02:29:56.766628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.766707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.766732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.166 qpair failed and we were unable to recover it. 00:27:29.166 [2024-12-08 02:29:56.766872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.766954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.766979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.166 qpair failed and we were unable to recover it. 00:27:29.166 [2024-12-08 02:29:56.767063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.767147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.767172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.166 qpair failed and we were unable to recover it. 00:27:29.166 [2024-12-08 02:29:56.767279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.767385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.767411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.166 qpair failed and we were unable to recover it. 00:27:29.166 [2024-12-08 02:29:56.767527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.767644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.767670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.166 qpair failed and we were unable to recover it. 00:27:29.166 [2024-12-08 02:29:56.767757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.767844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.767868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.166 qpair failed and we were unable to recover it. 00:27:29.166 [2024-12-08 02:29:56.767952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.768032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.768057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.166 qpair failed and we were unable to recover it. 00:27:29.166 [2024-12-08 02:29:56.768176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.768259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.768285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.166 qpair failed and we were unable to recover it. 00:27:29.166 [2024-12-08 02:29:56.768368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.768485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.768511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.166 qpair failed and we were unable to recover it. 00:27:29.166 [2024-12-08 02:29:56.768625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.166 [2024-12-08 02:29:56.768709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.768734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.167 qpair failed and we were unable to recover it. 00:27:29.167 [2024-12-08 02:29:56.768848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.768927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.768952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.167 qpair failed and we were unable to recover it. 00:27:29.167 [2024-12-08 02:29:56.769041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.769179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.769204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.167 qpair failed and we were unable to recover it. 00:27:29.167 [2024-12-08 02:29:56.769285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.769362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.769386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.167 qpair failed and we were unable to recover it. 00:27:29.167 [2024-12-08 02:29:56.769473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.769581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.769608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.167 qpair failed and we were unable to recover it. 00:27:29.167 [2024-12-08 02:29:56.769685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.769775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.769799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.167 qpair failed and we were unable to recover it. 00:27:29.167 [2024-12-08 02:29:56.769881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.769991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.770016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.167 qpair failed and we were unable to recover it. 00:27:29.167 [2024-12-08 02:29:56.770127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.770202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.770226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.167 qpair failed and we were unable to recover it. 00:27:29.167 [2024-12-08 02:29:56.770303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.770411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.770436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.167 qpair failed and we were unable to recover it. 00:27:29.167 [2024-12-08 02:29:56.770517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.770604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.770630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.167 qpair failed and we were unable to recover it. 00:27:29.167 [2024-12-08 02:29:56.770707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.770817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.770844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.167 qpair failed and we were unable to recover it. 00:27:29.167 [2024-12-08 02:29:56.770925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.771000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.771025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.167 qpair failed and we were unable to recover it. 00:27:29.167 [2024-12-08 02:29:56.771113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.771218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.771244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.167 qpair failed and we were unable to recover it. 00:27:29.167 [2024-12-08 02:29:56.771318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.771405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.771432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.167 qpair failed and we were unable to recover it. 00:27:29.167 [2024-12-08 02:29:56.771547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.771637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.771662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.167 qpair failed and we were unable to recover it. 00:27:29.167 [2024-12-08 02:29:56.771744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.771829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.771853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.167 qpair failed and we were unable to recover it. 00:27:29.167 [2024-12-08 02:29:56.771939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.772050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.772075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.167 qpair failed and we were unable to recover it. 00:27:29.167 [2024-12-08 02:29:56.772194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.772276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.772301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.167 qpair failed and we were unable to recover it. 00:27:29.167 [2024-12-08 02:29:56.772380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.772492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.772518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.167 qpair failed and we were unable to recover it. 00:27:29.167 [2024-12-08 02:29:56.772598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.772677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.772702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.167 qpair failed and we were unable to recover it. 00:27:29.167 [2024-12-08 02:29:56.772842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.772935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.772959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.167 qpair failed and we were unable to recover it. 00:27:29.167 [2024-12-08 02:29:56.773040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.773148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.773174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.167 qpair failed and we were unable to recover it. 00:27:29.167 [2024-12-08 02:29:56.773287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.773401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.773427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.167 qpair failed and we were unable to recover it. 00:27:29.167 [2024-12-08 02:29:56.773504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.773604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.773629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.167 qpair failed and we were unable to recover it. 00:27:29.167 [2024-12-08 02:29:56.773705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.773795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.773821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.167 qpair failed and we were unable to recover it. 00:27:29.167 [2024-12-08 02:29:56.773903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.774009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.774034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.167 qpair failed and we were unable to recover it. 00:27:29.167 [2024-12-08 02:29:56.774122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.774199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.774225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.167 qpair failed and we were unable to recover it. 00:27:29.167 [2024-12-08 02:29:56.774307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.774421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.774448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.167 qpair failed and we were unable to recover it. 00:27:29.167 [2024-12-08 02:29:56.774561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.774644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.167 [2024-12-08 02:29:56.774669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.167 qpair failed and we were unable to recover it. 00:27:29.168 [2024-12-08 02:29:56.774749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.774861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.774885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.168 qpair failed and we were unable to recover it. 00:27:29.168 [2024-12-08 02:29:56.774972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.775084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.775113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.168 qpair failed and we were unable to recover it. 00:27:29.168 [2024-12-08 02:29:56.775189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.775263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.775287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.168 qpair failed and we were unable to recover it. 00:27:29.168 [2024-12-08 02:29:56.775378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.775490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.775515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.168 qpair failed and we were unable to recover it. 00:27:29.168 [2024-12-08 02:29:56.775601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.775680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.775704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.168 qpair failed and we were unable to recover it. 00:27:29.168 [2024-12-08 02:29:56.775815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.775919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.775943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.168 qpair failed and we were unable to recover it. 00:27:29.168 [2024-12-08 02:29:56.776032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.776109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.776135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.168 qpair failed and we were unable to recover it. 00:27:29.168 [2024-12-08 02:29:56.776222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.776328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.776354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.168 qpair failed and we were unable to recover it. 00:27:29.168 [2024-12-08 02:29:56.776434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.776515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.776545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.168 qpair failed and we were unable to recover it. 00:27:29.168 [2024-12-08 02:29:56.776633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.776722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.776748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.168 qpair failed and we were unable to recover it. 00:27:29.168 [2024-12-08 02:29:56.776854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.776929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.776954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.168 qpair failed and we were unable to recover it. 00:27:29.168 [2024-12-08 02:29:56.777027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.777105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.777134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.168 qpair failed and we were unable to recover it. 00:27:29.168 [2024-12-08 02:29:56.777221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.777298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.777323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.168 qpair failed and we were unable to recover it. 00:27:29.168 [2024-12-08 02:29:56.777433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.777563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.777589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.168 qpair failed and we were unable to recover it. 00:27:29.168 [2024-12-08 02:29:56.777679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.777785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.777811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.168 qpair failed and we were unable to recover it. 00:27:29.168 [2024-12-08 02:29:56.777911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.778022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.778048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.168 qpair failed and we were unable to recover it. 00:27:29.168 [2024-12-08 02:29:56.778192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.778276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.778302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.168 qpair failed and we were unable to recover it. 00:27:29.168 [2024-12-08 02:29:56.778386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.778462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.778487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.168 qpair failed and we were unable to recover it. 00:27:29.168 [2024-12-08 02:29:56.778615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.778700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.778725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.168 qpair failed and we were unable to recover it. 00:27:29.168 [2024-12-08 02:29:56.778806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.778919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.778944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.168 qpair failed and we were unable to recover it. 00:27:29.168 [2024-12-08 02:29:56.779026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.779108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.779134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.168 qpair failed and we were unable to recover it. 00:27:29.168 [2024-12-08 02:29:56.779207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.779300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.779330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.168 qpair failed and we were unable to recover it. 00:27:29.168 [2024-12-08 02:29:56.779412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.779496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.779520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.168 qpair failed and we were unable to recover it. 00:27:29.168 [2024-12-08 02:29:56.779631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.779767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.779796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.168 qpair failed and we were unable to recover it. 00:27:29.168 [2024-12-08 02:29:56.779889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.779972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.168 [2024-12-08 02:29:56.780000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.168 qpair failed and we were unable to recover it. 00:27:29.169 [2024-12-08 02:29:56.780116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.780200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.780227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.169 qpair failed and we were unable to recover it. 00:27:29.169 [2024-12-08 02:29:56.780339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.780422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.780450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.169 qpair failed and we were unable to recover it. 00:27:29.169 [2024-12-08 02:29:56.780545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.780633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.780660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.169 qpair failed and we were unable to recover it. 00:27:29.169 [2024-12-08 02:29:56.780741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.780820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.780846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.169 qpair failed and we were unable to recover it. 00:27:29.169 [2024-12-08 02:29:56.780957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.781065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.781091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.169 qpair failed and we were unable to recover it. 00:27:29.169 [2024-12-08 02:29:56.781204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.781287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.781314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.169 qpair failed and we were unable to recover it. 00:27:29.169 [2024-12-08 02:29:56.781396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.781477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.781508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.169 qpair failed and we were unable to recover it. 00:27:29.169 [2024-12-08 02:29:56.781627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.781735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.781761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.169 qpair failed and we were unable to recover it. 00:27:29.169 [2024-12-08 02:29:56.781874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.781964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.781991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.169 qpair failed and we were unable to recover it. 00:27:29.169 [2024-12-08 02:29:56.782071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.782155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.782182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.169 qpair failed and we were unable to recover it. 00:27:29.169 [2024-12-08 02:29:56.782281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.782394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.782419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.169 qpair failed and we were unable to recover it. 00:27:29.169 [2024-12-08 02:29:56.782512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.782600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.782626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.169 qpair failed and we were unable to recover it. 00:27:29.169 [2024-12-08 02:29:56.782703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.782812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.782838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.169 qpair failed and we were unable to recover it. 00:27:29.169 [2024-12-08 02:29:56.782953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.783060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.783086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.169 qpair failed and we were unable to recover it. 00:27:29.169 [2024-12-08 02:29:56.783195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.783269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.783295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.169 qpair failed and we were unable to recover it. 00:27:29.169 [2024-12-08 02:29:56.783381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.783468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.783493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.169 qpair failed and we were unable to recover it. 00:27:29.169 [2024-12-08 02:29:56.783605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.783705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.783733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.169 qpair failed and we were unable to recover it. 00:27:29.169 [2024-12-08 02:29:56.783854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.783969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.783996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.169 qpair failed and we were unable to recover it. 00:27:29.169 [2024-12-08 02:29:56.784079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.784157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.784183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.169 qpair failed and we were unable to recover it. 00:27:29.169 [2024-12-08 02:29:56.784295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.784370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.784395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.169 qpair failed and we were unable to recover it. 00:27:29.169 [2024-12-08 02:29:56.784479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.784586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.784612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.169 qpair failed and we were unable to recover it. 00:27:29.169 [2024-12-08 02:29:56.784730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.784806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.784832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.169 qpair failed and we were unable to recover it. 00:27:29.169 [2024-12-08 02:29:56.784916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.785059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.785085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.169 qpair failed and we were unable to recover it. 00:27:29.169 [2024-12-08 02:29:56.785172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.785248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.785273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.169 qpair failed and we were unable to recover it. 00:27:29.169 [2024-12-08 02:29:56.785388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.785465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.785489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.169 qpair failed and we were unable to recover it. 00:27:29.169 [2024-12-08 02:29:56.785568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.785641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.785666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.169 qpair failed and we were unable to recover it. 00:27:29.169 [2024-12-08 02:29:56.785772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.785844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.785869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.169 qpair failed and we were unable to recover it. 00:27:29.169 [2024-12-08 02:29:56.785957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.169 [2024-12-08 02:29:56.786042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.786069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.170 qpair failed and we were unable to recover it. 00:27:29.170 [2024-12-08 02:29:56.786186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.786266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.786291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.170 qpair failed and we were unable to recover it. 00:27:29.170 [2024-12-08 02:29:56.786369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.786449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.786474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.170 qpair failed and we were unable to recover it. 00:27:29.170 [2024-12-08 02:29:56.786557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.786639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.786663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.170 qpair failed and we were unable to recover it. 00:27:29.170 [2024-12-08 02:29:56.786765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.786868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.786898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.170 qpair failed and we were unable to recover it. 00:27:29.170 [2024-12-08 02:29:56.787018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.787096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.787123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.170 qpair failed and we were unable to recover it. 00:27:29.170 [2024-12-08 02:29:56.787235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.787309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.787334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.170 qpair failed and we were unable to recover it. 00:27:29.170 [2024-12-08 02:29:56.787413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.787529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.787567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.170 qpair failed and we were unable to recover it. 00:27:29.170 [2024-12-08 02:29:56.787654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.787744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.787771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.170 qpair failed and we were unable to recover it. 00:27:29.170 [2024-12-08 02:29:56.787888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.787972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.787998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.170 qpair failed and we were unable to recover it. 00:27:29.170 [2024-12-08 02:29:56.788093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.788205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.788231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.170 qpair failed and we were unable to recover it. 00:27:29.170 [2024-12-08 02:29:56.788317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.788399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.788425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.170 qpair failed and we were unable to recover it. 00:27:29.170 [2024-12-08 02:29:56.788503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.788593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.788620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.170 qpair failed and we were unable to recover it. 00:27:29.170 [2024-12-08 02:29:56.788731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.788837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.788863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.170 qpair failed and we were unable to recover it. 00:27:29.170 [2024-12-08 02:29:56.788945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.789040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.789066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.170 qpair failed and we were unable to recover it. 00:27:29.170 [2024-12-08 02:29:56.789149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.789257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.789284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.170 qpair failed and we were unable to recover it. 00:27:29.170 [2024-12-08 02:29:56.789367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.789475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.789500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.170 qpair failed and we were unable to recover it. 00:27:29.170 [2024-12-08 02:29:56.789598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.789684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.789710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.170 qpair failed and we were unable to recover it. 00:27:29.170 [2024-12-08 02:29:56.789789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.789902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.789929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.170 qpair failed and we were unable to recover it. 00:27:29.170 [2024-12-08 02:29:56.790007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.790079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.790105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.170 qpair failed and we were unable to recover it. 00:27:29.170 [2024-12-08 02:29:56.790195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.790288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.790315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.170 qpair failed and we were unable to recover it. 00:27:29.170 [2024-12-08 02:29:56.790442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.790568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.790599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.170 qpair failed and we were unable to recover it. 00:27:29.170 [2024-12-08 02:29:56.790690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.790777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.790805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.170 qpair failed and we were unable to recover it. 00:27:29.170 [2024-12-08 02:29:56.790889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.791013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.791039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.170 qpair failed and we were unable to recover it. 00:27:29.170 [2024-12-08 02:29:56.791123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.791202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.791227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.170 qpair failed and we were unable to recover it. 00:27:29.170 [2024-12-08 02:29:56.791337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.791450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.791475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.170 qpair failed and we were unable to recover it. 00:27:29.170 [2024-12-08 02:29:56.791580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.170 [2024-12-08 02:29:56.791664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.791691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-12-08 02:29:56.791810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.791888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.791913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-12-08 02:29:56.792107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.792182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.792208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-12-08 02:29:56.792297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.792401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.792426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-12-08 02:29:56.792518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.792639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.792665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-12-08 02:29:56.792757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.792870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.792895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-12-08 02:29:56.792983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.793088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.793114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-12-08 02:29:56.793208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.793323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.793350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-12-08 02:29:56.793431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.793550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.793578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-12-08 02:29:56.793698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.793795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.793821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-12-08 02:29:56.793960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.794044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.794070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-12-08 02:29:56.794152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.794229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.794255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-12-08 02:29:56.794330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.794411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.794437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-12-08 02:29:56.794518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.794637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.794663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-12-08 02:29:56.794766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.794868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.794897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-12-08 02:29:56.794991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.795074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.795099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-12-08 02:29:56.795186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.795266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.795291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-12-08 02:29:56.795379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.795462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.795487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-12-08 02:29:56.795575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.795689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.795714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-12-08 02:29:56.795801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.795884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.795910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-12-08 02:29:56.795992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.796071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.796096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-12-08 02:29:56.796175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.796284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.796310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-12-08 02:29:56.796393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.796504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.796529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-12-08 02:29:56.796626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.796761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.796786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-12-08 02:29:56.796871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.796967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.796992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-12-08 02:29:56.797074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.797152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.797178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.171 [2024-12-08 02:29:56.797262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.797367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.171 [2024-12-08 02:29:56.797392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.171 qpair failed and we were unable to recover it. 00:27:29.172 [2024-12-08 02:29:56.797478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.797561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.797587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-12-08 02:29:56.797667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.797770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.797794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-12-08 02:29:56.797876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.797951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.797976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-12-08 02:29:56.798053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.798163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.798188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-12-08 02:29:56.798261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.798337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.798362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-12-08 02:29:56.798484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.798605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.798631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-12-08 02:29:56.798712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.798787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.798812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-12-08 02:29:56.798891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.798976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.799003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-12-08 02:29:56.799083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.799164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.799190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-12-08 02:29:56.799268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.799343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.799369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-12-08 02:29:56.799479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.799595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.799622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-12-08 02:29:56.799709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.799825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.799852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-12-08 02:29:56.799964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.800044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.800070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-12-08 02:29:56.800145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.800233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.800259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-12-08 02:29:56.800397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.800479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.800505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-12-08 02:29:56.800631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.800747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.800773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-12-08 02:29:56.800855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.800996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.801021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-12-08 02:29:56.801109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.801192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.801217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-12-08 02:29:56.801299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.801386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.801413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-12-08 02:29:56.801507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.801598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.801624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-12-08 02:29:56.801712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.801822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.801848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-12-08 02:29:56.801962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.802051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.802077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-12-08 02:29:56.802162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.802239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.802264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-12-08 02:29:56.802350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.802461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.802488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-12-08 02:29:56.802609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.802699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.802726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-12-08 02:29:56.802839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.802925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.802951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.172 qpair failed and we were unable to recover it. 00:27:29.172 [2024-12-08 02:29:56.803042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.803128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.172 [2024-12-08 02:29:56.803156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.173 qpair failed and we were unable to recover it. 00:27:29.173 [2024-12-08 02:29:56.803270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.803369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.803396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.173 qpair failed and we were unable to recover it. 00:27:29.173 [2024-12-08 02:29:56.803486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.803582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.803612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.173 qpair failed and we were unable to recover it. 00:27:29.173 [2024-12-08 02:29:56.803756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.803850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.803877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.173 qpair failed and we were unable to recover it. 00:27:29.173 [2024-12-08 02:29:56.803958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.804046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.804074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.173 qpair failed and we were unable to recover it. 00:27:29.173 [2024-12-08 02:29:56.804215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.804295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.804321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.173 qpair failed and we were unable to recover it. 00:27:29.173 [2024-12-08 02:29:56.804443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.804527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.804559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.173 qpair failed and we were unable to recover it. 00:27:29.173 [2024-12-08 02:29:56.804678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.804791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.804816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.173 qpair failed and we were unable to recover it. 00:27:29.173 [2024-12-08 02:29:56.804936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.805014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.805040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.173 qpair failed and we were unable to recover it. 00:27:29.173 [2024-12-08 02:29:56.805125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.805239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.805264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.173 qpair failed and we were unable to recover it. 00:27:29.173 [2024-12-08 02:29:56.805365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.805443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.805470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.173 qpair failed and we were unable to recover it. 00:27:29.173 [2024-12-08 02:29:56.805555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.805669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.805700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.173 qpair failed and we were unable to recover it. 00:27:29.173 [2024-12-08 02:29:56.805796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.805890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.805918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.173 qpair failed and we were unable to recover it. 00:27:29.173 [2024-12-08 02:29:56.806004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.806090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.806117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.173 qpair failed and we were unable to recover it. 00:27:29.173 [2024-12-08 02:29:56.806199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.806326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.806352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.173 qpair failed and we were unable to recover it. 00:27:29.173 [2024-12-08 02:29:56.806463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.806554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.806581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.173 qpair failed and we were unable to recover it. 00:27:29.173 [2024-12-08 02:29:56.806691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.806774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.806799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.173 qpair failed and we were unable to recover it. 00:27:29.173 [2024-12-08 02:29:56.806882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.806963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.806989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.173 qpair failed and we were unable to recover it. 00:27:29.173 [2024-12-08 02:29:56.807076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.807159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.807185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.173 qpair failed and we were unable to recover it. 00:27:29.173 [2024-12-08 02:29:56.807275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.807356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.807381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.173 qpair failed and we were unable to recover it. 00:27:29.173 [2024-12-08 02:29:56.807469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.807549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.807575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.173 qpair failed and we were unable to recover it. 00:27:29.173 [2024-12-08 02:29:56.807694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.807777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.807807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.173 qpair failed and we were unable to recover it. 00:27:29.173 [2024-12-08 02:29:56.807889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.807963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.807987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.173 qpair failed and we were unable to recover it. 00:27:29.173 [2024-12-08 02:29:56.808102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.808182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.808208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.173 qpair failed and we were unable to recover it. 00:27:29.173 [2024-12-08 02:29:56.808296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.808367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.808393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.173 qpair failed and we were unable to recover it. 00:27:29.173 [2024-12-08 02:29:56.808473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-12-08 02:29:56.808569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.808596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.174 qpair failed and we were unable to recover it. 00:27:29.174 [2024-12-08 02:29:56.808678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.808764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.808789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.174 qpair failed and we were unable to recover it. 00:27:29.174 [2024-12-08 02:29:56.808870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.808965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.808989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.174 qpair failed and we were unable to recover it. 00:27:29.174 [2024-12-08 02:29:56.809098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.809212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.809238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.174 qpair failed and we were unable to recover it. 00:27:29.174 [2024-12-08 02:29:56.809330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.809442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.809467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.174 qpair failed and we were unable to recover it. 00:27:29.174 [2024-12-08 02:29:56.809576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.809659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.809685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.174 qpair failed and we were unable to recover it. 00:27:29.174 [2024-12-08 02:29:56.809771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.809848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.809873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.174 qpair failed and we were unable to recover it. 00:27:29.174 [2024-12-08 02:29:56.809988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.810123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.810148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.174 qpair failed and we were unable to recover it. 00:27:29.174 [2024-12-08 02:29:56.810230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.810338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.810363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.174 qpair failed and we were unable to recover it. 00:27:29.174 [2024-12-08 02:29:56.810448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.810530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.810564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.174 qpair failed and we were unable to recover it. 00:27:29.174 [2024-12-08 02:29:56.810641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.810716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.810742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.174 qpair failed and we were unable to recover it. 00:27:29.174 [2024-12-08 02:29:56.810853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.810938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.810964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.174 qpair failed and we were unable to recover it. 00:27:29.174 [2024-12-08 02:29:56.811053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.811132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.811156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.174 qpair failed and we were unable to recover it. 00:27:29.174 [2024-12-08 02:29:56.811243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.811357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.811382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.174 qpair failed and we were unable to recover it. 00:27:29.174 [2024-12-08 02:29:56.811490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.811606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.811631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.174 qpair failed and we were unable to recover it. 00:27:29.174 [2024-12-08 02:29:56.811716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.811800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.811824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.174 qpair failed and we were unable to recover it. 00:27:29.174 [2024-12-08 02:29:56.811919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.811994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.812019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.174 qpair failed and we were unable to recover it. 00:27:29.174 [2024-12-08 02:29:56.812105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.812191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.812216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.174 qpair failed and we were unable to recover it. 00:27:29.174 [2024-12-08 02:29:56.812301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.812386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.812412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.174 qpair failed and we were unable to recover it. 00:27:29.174 [2024-12-08 02:29:56.812500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.812589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.812615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.174 qpair failed and we were unable to recover it. 00:27:29.174 [2024-12-08 02:29:56.812691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.812765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.812790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.174 qpair failed and we were unable to recover it. 00:27:29.174 [2024-12-08 02:29:56.812906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.812980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.813006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.174 qpair failed and we were unable to recover it. 00:27:29.174 [2024-12-08 02:29:56.813122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.813210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.813236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.174 qpair failed and we were unable to recover it. 00:27:29.174 [2024-12-08 02:29:56.813315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.813392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.813417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.174 qpair failed and we were unable to recover it. 00:27:29.174 [2024-12-08 02:29:56.813495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.813618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.813645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.174 qpair failed and we were unable to recover it. 00:27:29.174 [2024-12-08 02:29:56.813757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.813829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.813854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.174 qpair failed and we were unable to recover it. 00:27:29.174 [2024-12-08 02:29:56.813974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.814055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.814083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.174 qpair failed and we were unable to recover it. 00:27:29.174 [2024-12-08 02:29:56.814175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.814268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-12-08 02:29:56.814293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.174 qpair failed and we were unable to recover it. 00:27:29.174 [2024-12-08 02:29:56.814381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.814458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.814484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.175 qpair failed and we were unable to recover it. 00:27:29.175 [2024-12-08 02:29:56.814571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.814663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.814688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.175 qpair failed and we were unable to recover it. 00:27:29.175 [2024-12-08 02:29:56.814779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.814861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.814886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.175 qpair failed and we were unable to recover it. 00:27:29.175 [2024-12-08 02:29:56.814965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.815036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.815061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.175 qpair failed and we were unable to recover it. 00:27:29.175 [2024-12-08 02:29:56.815141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.815215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.815240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.175 qpair failed and we were unable to recover it. 00:27:29.175 [2024-12-08 02:29:56.815324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.815403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.815429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.175 qpair failed and we were unable to recover it. 00:27:29.175 [2024-12-08 02:29:56.815511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.815603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.815629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.175 qpair failed and we were unable to recover it. 00:27:29.175 [2024-12-08 02:29:56.815711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.815797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.815822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.175 qpair failed and we were unable to recover it. 00:27:29.175 [2024-12-08 02:29:56.815931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.816023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.816049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.175 qpair failed and we were unable to recover it. 00:27:29.175 [2024-12-08 02:29:56.816131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.816212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.816236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.175 qpair failed and we were unable to recover it. 00:27:29.175 [2024-12-08 02:29:56.816324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.816402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.816427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.175 qpair failed and we were unable to recover it. 00:27:29.175 [2024-12-08 02:29:56.816508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.816596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.816621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.175 qpair failed and we were unable to recover it. 00:27:29.175 [2024-12-08 02:29:56.816734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.816815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.816841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.175 qpair failed and we were unable to recover it. 00:27:29.175 [2024-12-08 02:29:56.816927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.817036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.817061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.175 qpair failed and we were unable to recover it. 00:27:29.175 [2024-12-08 02:29:56.817141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.817219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.817244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.175 qpair failed and we were unable to recover it. 00:27:29.175 [2024-12-08 02:29:56.817323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.817434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.817458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.175 qpair failed and we were unable to recover it. 00:27:29.175 [2024-12-08 02:29:56.817543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.817630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.817655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.175 qpair failed and we were unable to recover it. 00:27:29.175 [2024-12-08 02:29:56.817733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.817821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.817847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.175 qpair failed and we were unable to recover it. 00:27:29.175 [2024-12-08 02:29:56.817934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.818016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.818042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.175 qpair failed and we were unable to recover it. 00:27:29.175 [2024-12-08 02:29:56.818128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.818206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.818230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.175 qpair failed and we were unable to recover it. 00:27:29.175 [2024-12-08 02:29:56.818305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.818398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.818424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.175 qpair failed and we were unable to recover it. 00:27:29.175 [2024-12-08 02:29:56.818516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.818627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.818653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.175 qpair failed and we were unable to recover it. 00:27:29.175 [2024-12-08 02:29:56.818737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.818826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.818852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.175 qpair failed and we were unable to recover it. 00:27:29.175 [2024-12-08 02:29:56.818933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.819042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.819068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.175 qpair failed and we were unable to recover it. 00:27:29.175 [2024-12-08 02:29:56.819146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.819261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.819286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.175 qpair failed and we were unable to recover it. 00:27:29.175 [2024-12-08 02:29:56.819373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.819449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.819474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.175 qpair failed and we were unable to recover it. 00:27:29.175 [2024-12-08 02:29:56.819558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.819637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.819662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.175 qpair failed and we were unable to recover it. 00:27:29.175 [2024-12-08 02:29:56.819750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.819835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.819859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.175 qpair failed and we were unable to recover it. 00:27:29.175 [2024-12-08 02:29:56.819948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.820056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.820080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.175 qpair failed and we were unable to recover it. 00:27:29.175 [2024-12-08 02:29:56.820178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.820295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-12-08 02:29:56.820320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.175 qpair failed and we were unable to recover it. 00:27:29.175 [2024-12-08 02:29:56.820399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.820511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.820542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.176 qpair failed and we were unable to recover it. 00:27:29.176 [2024-12-08 02:29:56.820633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.820708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.820733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.176 qpair failed and we were unable to recover it. 00:27:29.176 [2024-12-08 02:29:56.820826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.820907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.820933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.176 qpair failed and we were unable to recover it. 00:27:29.176 [2024-12-08 02:29:56.821017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.821096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.821121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.176 qpair failed and we were unable to recover it. 00:27:29.176 [2024-12-08 02:29:56.821238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.821322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.821347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.176 qpair failed and we were unable to recover it. 00:27:29.176 [2024-12-08 02:29:56.821463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.821559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.821585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.176 qpair failed and we were unable to recover it. 00:27:29.176 [2024-12-08 02:29:56.821700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.821780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.821805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.176 qpair failed and we were unable to recover it. 00:27:29.176 [2024-12-08 02:29:56.821888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.821967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.821992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.176 qpair failed and we were unable to recover it. 00:27:29.176 [2024-12-08 02:29:56.822069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.822179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.822203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.176 qpair failed and we were unable to recover it. 00:27:29.176 [2024-12-08 02:29:56.822328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.822405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.822429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.176 qpair failed and we were unable to recover it. 00:27:29.176 [2024-12-08 02:29:56.822540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.822620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.822645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.176 qpair failed and we were unable to recover it. 00:27:29.176 [2024-12-08 02:29:56.822724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.822799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.822824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.176 qpair failed and we were unable to recover it. 00:27:29.176 [2024-12-08 02:29:56.822933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.823042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.823067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.176 qpair failed and we were unable to recover it. 00:27:29.176 [2024-12-08 02:29:56.823149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.823234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.823262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.176 qpair failed and we were unable to recover it. 00:27:29.176 [2024-12-08 02:29:56.823380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.823456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.823482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.176 qpair failed and we were unable to recover it. 00:27:29.176 [2024-12-08 02:29:56.823590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.823665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.823690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.176 qpair failed and we were unable to recover it. 00:27:29.176 [2024-12-08 02:29:56.823776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.823870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.823894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.176 qpair failed and we were unable to recover it. 00:27:29.176 [2024-12-08 02:29:56.823979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.824054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.824080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.176 qpair failed and we were unable to recover it. 00:27:29.176 [2024-12-08 02:29:56.824169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.824281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.824306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.176 qpair failed and we were unable to recover it. 00:27:29.176 [2024-12-08 02:29:56.824417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.824512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.824542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.176 qpair failed and we were unable to recover it. 00:27:29.176 [2024-12-08 02:29:56.824642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.824719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.824745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.176 qpair failed and we were unable to recover it. 00:27:29.176 [2024-12-08 02:29:56.824834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.824917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.824950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.176 qpair failed and we were unable to recover it. 00:27:29.176 [2024-12-08 02:29:56.825073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.825185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.825210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.176 qpair failed and we were unable to recover it. 00:27:29.176 [2024-12-08 02:29:56.825296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.825411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.825438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.176 qpair failed and we were unable to recover it. 00:27:29.176 [2024-12-08 02:29:56.825555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.825644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.825669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.176 qpair failed and we were unable to recover it. 00:27:29.176 [2024-12-08 02:29:56.825749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.825835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.825860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.176 qpair failed and we were unable to recover it. 00:27:29.176 [2024-12-08 02:29:56.825946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.826024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.826050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.176 qpair failed and we were unable to recover it. 00:27:29.176 [2024-12-08 02:29:56.826156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.826236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.826260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.176 qpair failed and we were unable to recover it. 00:27:29.176 [2024-12-08 02:29:56.826336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.826423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.826447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.176 qpair failed and we were unable to recover it. 00:27:29.176 [2024-12-08 02:29:56.826524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.826645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.826671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.176 qpair failed and we were unable to recover it. 00:27:29.176 [2024-12-08 02:29:56.826747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.826834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.826860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.176 qpair failed and we were unable to recover it. 00:27:29.176 [2024-12-08 02:29:56.826953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.176 [2024-12-08 02:29:56.827063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.827088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.177 qpair failed and we were unable to recover it. 00:27:29.177 [2024-12-08 02:29:56.827175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.827280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.827306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.177 qpair failed and we were unable to recover it. 00:27:29.177 [2024-12-08 02:29:56.827382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.827494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.827519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.177 qpair failed and we were unable to recover it. 00:27:29.177 [2024-12-08 02:29:56.827621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.827702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.827727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.177 qpair failed and we were unable to recover it. 00:27:29.177 [2024-12-08 02:29:56.827817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.827923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.827948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.177 qpair failed and we were unable to recover it. 00:27:29.177 [2024-12-08 02:29:56.828036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.828117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.828142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.177 qpair failed and we were unable to recover it. 00:27:29.177 [2024-12-08 02:29:56.828250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.828328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.828353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.177 qpair failed and we were unable to recover it. 00:27:29.177 [2024-12-08 02:29:56.828437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.828560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.828589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.177 qpair failed and we were unable to recover it. 00:27:29.177 [2024-12-08 02:29:56.828711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.828803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.828829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.177 qpair failed and we were unable to recover it. 00:27:29.177 [2024-12-08 02:29:56.828914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.828987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.829012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.177 qpair failed and we were unable to recover it. 00:27:29.177 [2024-12-08 02:29:56.829096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.829208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.829234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.177 qpair failed and we were unable to recover it. 00:27:29.177 [2024-12-08 02:29:56.829318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.829399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.829423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.177 qpair failed and we were unable to recover it. 00:27:29.177 [2024-12-08 02:29:56.829507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.829624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.829650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.177 qpair failed and we were unable to recover it. 00:27:29.177 [2024-12-08 02:29:56.829765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.829855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.829881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.177 qpair failed and we were unable to recover it. 00:27:29.177 [2024-12-08 02:29:56.829973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.830055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.830081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.177 qpair failed and we were unable to recover it. 00:27:29.177 [2024-12-08 02:29:56.830167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.830278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.830304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.177 qpair failed and we were unable to recover it. 00:27:29.177 [2024-12-08 02:29:56.830385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.830493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.830517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.177 qpair failed and we were unable to recover it. 00:27:29.177 [2024-12-08 02:29:56.830647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.830727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.830753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.177 qpair failed and we were unable to recover it. 00:27:29.177 [2024-12-08 02:29:56.830871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.830987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.831013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.177 qpair failed and we were unable to recover it. 00:27:29.177 [2024-12-08 02:29:56.831134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.831216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.831242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.177 qpair failed and we were unable to recover it. 00:27:29.177 [2024-12-08 02:29:56.831361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.831476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.831502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.177 qpair failed and we were unable to recover it. 00:27:29.177 [2024-12-08 02:29:56.831607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.831686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.831711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.177 qpair failed and we were unable to recover it. 00:27:29.177 [2024-12-08 02:29:56.831832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.831918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.831943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.177 qpair failed and we were unable to recover it. 00:27:29.177 [2024-12-08 02:29:56.832023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.832137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.832162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.177 qpair failed and we were unable to recover it. 00:27:29.177 [2024-12-08 02:29:56.832275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.832359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.832385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.177 qpair failed and we were unable to recover it. 00:27:29.177 [2024-12-08 02:29:56.832469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.832550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.832576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.177 qpair failed and we were unable to recover it. 00:27:29.177 [2024-12-08 02:29:56.832657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.832795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.832820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.177 qpair failed and we were unable to recover it. 00:27:29.177 [2024-12-08 02:29:56.832939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.177 [2024-12-08 02:29:56.833017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.833042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.178 qpair failed and we were unable to recover it. 00:27:29.178 [2024-12-08 02:29:56.833118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.833201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.833227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.178 qpair failed and we were unable to recover it. 00:27:29.178 [2024-12-08 02:29:56.833338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.833427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.833452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.178 qpair failed and we were unable to recover it. 00:27:29.178 [2024-12-08 02:29:56.833569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.833650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.833676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.178 qpair failed and we were unable to recover it. 00:27:29.178 [2024-12-08 02:29:56.833765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.833881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.833906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.178 qpair failed and we were unable to recover it. 00:27:29.178 [2024-12-08 02:29:56.833993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.834101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.834127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.178 qpair failed and we were unable to recover it. 00:27:29.178 [2024-12-08 02:29:56.834212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.834297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.834323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.178 qpair failed and we were unable to recover it. 00:27:29.178 [2024-12-08 02:29:56.834440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.834518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.834549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.178 qpair failed and we were unable to recover it. 00:27:29.178 [2024-12-08 02:29:56.834646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.834724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.834750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.178 qpair failed and we were unable to recover it. 00:27:29.178 [2024-12-08 02:29:56.834826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.834945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.834970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.178 qpair failed and we were unable to recover it. 00:27:29.178 [2024-12-08 02:29:56.835057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.835140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.835165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.178 qpair failed and we were unable to recover it. 00:27:29.178 [2024-12-08 02:29:56.835244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.835354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.835384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.178 qpair failed and we were unable to recover it. 00:27:29.178 [2024-12-08 02:29:56.835469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.835552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.835579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.178 qpair failed and we were unable to recover it. 00:27:29.178 [2024-12-08 02:29:56.835667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.835749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.835774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.178 qpair failed and we were unable to recover it. 00:27:29.178 [2024-12-08 02:29:56.835896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.836013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.836038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.178 qpair failed and we were unable to recover it. 00:27:29.178 [2024-12-08 02:29:56.836115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.836225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.836251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.178 qpair failed and we were unable to recover it. 00:27:29.178 [2024-12-08 02:29:56.836345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.836429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.836455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.178 qpair failed and we were unable to recover it. 00:27:29.178 [2024-12-08 02:29:56.836569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.836651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.836676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.178 qpair failed and we were unable to recover it. 00:27:29.178 [2024-12-08 02:29:56.836750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.836825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.836851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.178 qpair failed and we were unable to recover it. 00:27:29.178 [2024-12-08 02:29:56.836968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.837061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.837087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.178 qpair failed and we were unable to recover it. 00:27:29.178 [2024-12-08 02:29:56.837173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.837255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.837279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.178 qpair failed and we were unable to recover it. 00:27:29.178 [2024-12-08 02:29:56.837355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.178 [2024-12-08 02:29:56.837460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.837489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.179 qpair failed and we were unable to recover it. 00:27:29.179 [2024-12-08 02:29:56.837581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.837694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.837720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.179 qpair failed and we were unable to recover it. 00:27:29.179 [2024-12-08 02:29:56.837801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.837882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.837907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.179 qpair failed and we were unable to recover it. 00:27:29.179 [2024-12-08 02:29:56.838019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.838097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.838123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.179 qpair failed and we were unable to recover it. 00:27:29.179 [2024-12-08 02:29:56.838223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.838300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.838325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.179 qpair failed and we were unable to recover it. 00:27:29.179 [2024-12-08 02:29:56.838416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.838528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.838562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.179 qpair failed and we were unable to recover it. 00:27:29.179 [2024-12-08 02:29:56.838647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.838730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.838755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.179 qpair failed and we were unable to recover it. 00:27:29.179 [2024-12-08 02:29:56.838901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.838989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.839014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.179 qpair failed and we were unable to recover it. 00:27:29.179 [2024-12-08 02:29:56.839097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.839177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.839203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.179 qpair failed and we were unable to recover it. 00:27:29.179 [2024-12-08 02:29:56.839286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.839392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.839417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.179 qpair failed and we were unable to recover it. 00:27:29.179 [2024-12-08 02:29:56.839506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.839596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.839626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.179 qpair failed and we were unable to recover it. 00:27:29.179 [2024-12-08 02:29:56.839738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.839817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.839842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.179 qpair failed and we were unable to recover it. 00:27:29.179 [2024-12-08 02:29:56.839927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.840008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.840032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.179 qpair failed and we were unable to recover it. 00:27:29.179 [2024-12-08 02:29:56.840121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.840225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.840251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.179 qpair failed and we were unable to recover it. 00:27:29.179 [2024-12-08 02:29:56.840323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.840396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.840422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.179 qpair failed and we were unable to recover it. 00:27:29.179 [2024-12-08 02:29:56.840506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.840627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.840653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.179 qpair failed and we were unable to recover it. 00:27:29.179 [2024-12-08 02:29:56.840743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.840837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.840862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.179 qpair failed and we were unable to recover it. 00:27:29.179 [2024-12-08 02:29:56.840938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.841019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.841044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.179 qpair failed and we were unable to recover it. 00:27:29.179 [2024-12-08 02:29:56.841134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.841245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.841270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.179 qpair failed and we were unable to recover it. 00:27:29.179 [2024-12-08 02:29:56.841353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.841464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.841489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.179 qpair failed and we were unable to recover it. 00:27:29.179 [2024-12-08 02:29:56.841571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.841685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.841710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.179 qpair failed and we were unable to recover it. 00:27:29.179 [2024-12-08 02:29:56.841795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.841883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.841908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.179 qpair failed and we were unable to recover it. 00:27:29.179 [2024-12-08 02:29:56.841989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.842101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.842126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.179 qpair failed and we were unable to recover it. 00:27:29.179 [2024-12-08 02:29:56.842206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.842282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.842307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.179 qpair failed and we were unable to recover it. 00:27:29.179 [2024-12-08 02:29:56.842399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.842512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.842543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.179 qpair failed and we were unable to recover it. 00:27:29.179 [2024-12-08 02:29:56.842623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.842708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.842733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.179 qpair failed and we were unable to recover it. 00:27:29.179 [2024-12-08 02:29:56.842846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.842956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.842982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.179 qpair failed and we were unable to recover it. 00:27:29.179 [2024-12-08 02:29:56.843094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.843179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.843204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.179 qpair failed and we were unable to recover it. 00:27:29.179 [2024-12-08 02:29:56.843286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.179 [2024-12-08 02:29:56.843402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.843428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.180 qpair failed and we were unable to recover it. 00:27:29.180 [2024-12-08 02:29:56.843542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.843629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.843656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.180 qpair failed and we were unable to recover it. 00:27:29.180 [2024-12-08 02:29:56.843737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.843849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.843874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.180 qpair failed and we were unable to recover it. 00:27:29.180 [2024-12-08 02:29:56.843964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.844042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.844067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.180 qpair failed and we were unable to recover it. 00:27:29.180 [2024-12-08 02:29:56.844184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.844272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.844297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.180 qpair failed and we were unable to recover it. 00:27:29.180 [2024-12-08 02:29:56.844379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.844488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.844513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.180 qpair failed and we were unable to recover it. 00:27:29.180 [2024-12-08 02:29:56.844599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.844681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.844707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.180 qpair failed and we were unable to recover it. 00:27:29.180 [2024-12-08 02:29:56.844791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.844875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.844904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.180 qpair failed and we were unable to recover it. 00:27:29.180 [2024-12-08 02:29:56.845020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.845104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.845130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.180 qpair failed and we were unable to recover it. 00:27:29.180 [2024-12-08 02:29:56.845213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.845322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.845347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.180 qpair failed and we were unable to recover it. 00:27:29.180 [2024-12-08 02:29:56.845431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.845552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.845578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.180 qpair failed and we were unable to recover it. 00:27:29.180 [2024-12-08 02:29:56.845692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.845772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.845797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.180 qpair failed and we were unable to recover it. 00:27:29.180 [2024-12-08 02:29:56.845884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.845964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.845989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.180 qpair failed and we were unable to recover it. 00:27:29.180 [2024-12-08 02:29:56.846083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.846163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.846188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.180 qpair failed and we were unable to recover it. 00:27:29.180 [2024-12-08 02:29:56.846262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.846349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.846374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.180 qpair failed and we were unable to recover it. 00:27:29.180 [2024-12-08 02:29:56.846448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.846568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.846594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.180 qpair failed and we were unable to recover it. 00:27:29.180 [2024-12-08 02:29:56.846709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.846789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.846816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.180 qpair failed and we were unable to recover it. 00:27:29.180 [2024-12-08 02:29:56.846927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.847008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.847033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.180 qpair failed and we were unable to recover it. 00:27:29.180 [2024-12-08 02:29:56.847113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.847221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.847247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.180 qpair failed and we were unable to recover it. 00:27:29.180 [2024-12-08 02:29:56.847353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.847460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.847486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.180 qpair failed and we were unable to recover it. 00:27:29.180 [2024-12-08 02:29:56.847573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.847653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.847678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.180 qpair failed and we were unable to recover it. 00:27:29.180 [2024-12-08 02:29:56.847767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.847844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.847870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.180 qpair failed and we were unable to recover it. 00:27:29.180 [2024-12-08 02:29:56.847949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.848086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.848111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.180 qpair failed and we were unable to recover it. 00:27:29.180 [2024-12-08 02:29:56.848204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.848289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.848314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.180 qpair failed and we were unable to recover it. 00:27:29.180 [2024-12-08 02:29:56.848396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.848473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.848498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.180 qpair failed and we were unable to recover it. 00:27:29.180 [2024-12-08 02:29:56.848582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.848672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.848697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.180 qpair failed and we were unable to recover it. 00:27:29.180 [2024-12-08 02:29:56.848788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.848866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.848891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.180 qpair failed and we were unable to recover it. 00:27:29.180 [2024-12-08 02:29:56.848972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.849052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.849077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.180 qpair failed and we were unable to recover it. 00:27:29.180 [2024-12-08 02:29:56.849164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.180 [2024-12-08 02:29:56.849304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.849329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.181 qpair failed and we were unable to recover it. 00:27:29.181 [2024-12-08 02:29:56.849441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.849524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.849569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.181 qpair failed and we were unable to recover it. 00:27:29.181 [2024-12-08 02:29:56.849654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.849739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.849763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.181 qpair failed and we were unable to recover it. 00:27:29.181 [2024-12-08 02:29:56.849872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.849947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.849972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.181 qpair failed and we were unable to recover it. 00:27:29.181 [2024-12-08 02:29:56.850080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.850186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.850211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.181 qpair failed and we were unable to recover it. 00:27:29.181 [2024-12-08 02:29:56.850298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.850377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.850401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.181 qpair failed and we were unable to recover it. 00:27:29.181 [2024-12-08 02:29:56.850478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.850597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.850624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.181 qpair failed and we were unable to recover it. 00:27:29.181 [2024-12-08 02:29:56.850707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.850826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.850852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.181 qpair failed and we were unable to recover it. 00:27:29.181 [2024-12-08 02:29:56.850942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.851026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.851051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.181 qpair failed and we were unable to recover it. 00:27:29.181 [2024-12-08 02:29:56.851126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.851237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.851262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.181 qpair failed and we were unable to recover it. 00:27:29.181 [2024-12-08 02:29:56.851349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.851432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.851457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.181 qpair failed and we were unable to recover it. 00:27:29.181 [2024-12-08 02:29:56.851541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.851678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.851703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.181 qpair failed and we were unable to recover it. 00:27:29.181 [2024-12-08 02:29:56.851781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.851862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.851887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.181 qpair failed and we were unable to recover it. 00:27:29.181 [2024-12-08 02:29:56.852001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.852108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.852132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.181 qpair failed and we were unable to recover it. 00:27:29.181 [2024-12-08 02:29:56.852207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.852287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.852312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.181 qpair failed and we were unable to recover it. 00:27:29.181 [2024-12-08 02:29:56.852434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.852516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.852547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.181 qpair failed and we were unable to recover it. 00:27:29.181 [2024-12-08 02:29:56.852634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.852720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.852745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.181 qpair failed and we were unable to recover it. 00:27:29.181 [2024-12-08 02:29:56.852857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.852949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.852973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.181 qpair failed and we were unable to recover it. 00:27:29.181 [2024-12-08 02:29:56.853061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.853196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.853221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.181 qpair failed and we were unable to recover it. 00:27:29.181 [2024-12-08 02:29:56.853307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.853390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.853417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.181 qpair failed and we were unable to recover it. 00:27:29.181 [2024-12-08 02:29:56.853498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.853583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.853608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.181 qpair failed and we were unable to recover it. 00:27:29.181 [2024-12-08 02:29:56.853722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.853798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.853823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.181 qpair failed and we were unable to recover it. 00:27:29.181 [2024-12-08 02:29:56.853936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.854015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.854039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.181 qpair failed and we were unable to recover it. 00:27:29.181 [2024-12-08 02:29:56.854147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.854228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.854252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.181 qpair failed and we were unable to recover it. 00:27:29.181 [2024-12-08 02:29:56.854401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.854479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.854504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.181 qpair failed and we were unable to recover it. 00:27:29.181 [2024-12-08 02:29:56.854605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.854715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.854741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.181 qpair failed and we were unable to recover it. 00:27:29.181 [2024-12-08 02:29:56.854835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.854919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.854945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.181 qpair failed and we were unable to recover it. 00:27:29.181 [2024-12-08 02:29:56.855026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.855108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.855133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.181 qpair failed and we were unable to recover it. 00:27:29.181 [2024-12-08 02:29:56.855220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.855303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.181 [2024-12-08 02:29:56.855329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.181 qpair failed and we were unable to recover it. 00:27:29.182 [2024-12-08 02:29:56.855426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.855530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.855591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.182 qpair failed and we were unable to recover it. 00:27:29.182 [2024-12-08 02:29:56.855704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.855789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.855814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.182 qpair failed and we were unable to recover it. 00:27:29.182 [2024-12-08 02:29:56.855955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.856035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.856061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.182 qpair failed and we were unable to recover it. 00:27:29.182 [2024-12-08 02:29:56.856151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.856231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.856256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.182 qpair failed and we were unable to recover it. 00:27:29.182 [2024-12-08 02:29:56.856348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.856457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.856483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.182 qpair failed and we were unable to recover it. 00:27:29.182 [2024-12-08 02:29:56.856568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.856647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.856672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.182 qpair failed and we were unable to recover it. 00:27:29.182 [2024-12-08 02:29:56.856790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.856905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.856930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.182 qpair failed and we were unable to recover it. 00:27:29.182 [2024-12-08 02:29:56.857012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.857091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.857116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.182 qpair failed and we were unable to recover it. 00:27:29.182 [2024-12-08 02:29:56.857233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.857317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.857341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.182 qpair failed and we were unable to recover it. 00:27:29.182 [2024-12-08 02:29:56.857458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.857547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.857573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.182 qpair failed and we were unable to recover it. 00:27:29.182 [2024-12-08 02:29:56.857653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.857733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.857758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.182 qpair failed and we were unable to recover it. 00:27:29.182 [2024-12-08 02:29:56.857841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.857926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.857952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.182 qpair failed and we were unable to recover it. 00:27:29.182 [2024-12-08 02:29:56.858044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.858126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.858152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.182 qpair failed and we were unable to recover it. 00:27:29.182 [2024-12-08 02:29:56.858226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.858309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.858333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.182 qpair failed and we were unable to recover it. 00:27:29.182 [2024-12-08 02:29:56.858440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.858530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.858562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.182 qpair failed and we were unable to recover it. 00:27:29.182 [2024-12-08 02:29:56.858648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.858763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.858789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.182 qpair failed and we were unable to recover it. 00:27:29.182 [2024-12-08 02:29:56.858872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.858985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.859010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.182 qpair failed and we were unable to recover it. 00:27:29.182 [2024-12-08 02:29:56.859118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.859197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.859222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.182 qpair failed and we were unable to recover it. 00:27:29.182 [2024-12-08 02:29:56.859310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.859427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.859452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.182 qpair failed and we were unable to recover it. 00:27:29.182 [2024-12-08 02:29:56.859554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.859705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.859731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.182 qpair failed and we were unable to recover it. 00:27:29.182 [2024-12-08 02:29:56.859817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.859904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.859928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.182 qpair failed and we were unable to recover it. 00:27:29.182 [2024-12-08 02:29:56.860012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.860124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.860149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.182 qpair failed and we were unable to recover it. 00:27:29.182 [2024-12-08 02:29:56.860265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.860377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.860402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.182 qpair failed and we were unable to recover it. 00:27:29.182 [2024-12-08 02:29:56.860511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.860608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.860633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.182 qpair failed and we were unable to recover it. 00:27:29.182 [2024-12-08 02:29:56.860717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.860824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.182 [2024-12-08 02:29:56.860849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.182 qpair failed and we were unable to recover it. 00:27:29.182 [2024-12-08 02:29:56.860930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.861007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.861033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.183 qpair failed and we were unable to recover it. 00:27:29.183 [2024-12-08 02:29:56.861146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.861231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.861256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.183 qpair failed and we were unable to recover it. 00:27:29.183 [2024-12-08 02:29:56.861361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.861438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.861463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.183 qpair failed and we were unable to recover it. 00:27:29.183 [2024-12-08 02:29:56.861574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.861694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.861719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.183 qpair failed and we were unable to recover it. 00:27:29.183 [2024-12-08 02:29:56.861803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.861883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.861908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.183 qpair failed and we were unable to recover it. 00:27:29.183 [2024-12-08 02:29:56.861988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.862072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.862097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.183 qpair failed and we were unable to recover it. 00:27:29.183 [2024-12-08 02:29:56.862206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.862285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.862309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.183 qpair failed and we were unable to recover it. 00:27:29.183 [2024-12-08 02:29:56.862451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.862545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.862570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.183 qpair failed and we were unable to recover it. 00:27:29.183 [2024-12-08 02:29:56.862654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.862737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.862761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.183 qpair failed and we were unable to recover it. 00:27:29.183 [2024-12-08 02:29:56.862842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.862958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.862983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.183 qpair failed and we were unable to recover it. 00:27:29.183 [2024-12-08 02:29:56.863095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.863203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.863228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.183 qpair failed and we were unable to recover it. 00:27:29.183 [2024-12-08 02:29:56.863333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.863449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.863474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.183 qpair failed and we were unable to recover it. 00:27:29.183 [2024-12-08 02:29:56.863583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.863667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.863692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.183 qpair failed and we were unable to recover it. 00:27:29.183 [2024-12-08 02:29:56.863786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.863931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.863956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.183 qpair failed and we were unable to recover it. 00:27:29.183 [2024-12-08 02:29:56.864073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.864152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.864177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.183 qpair failed and we were unable to recover it. 00:27:29.183 [2024-12-08 02:29:56.864259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.864370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.864394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.183 qpair failed and we were unable to recover it. 00:27:29.183 [2024-12-08 02:29:56.864467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.864561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.864587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.183 qpair failed and we were unable to recover it. 00:27:29.183 [2024-12-08 02:29:56.864664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.864753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.864778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.183 qpair failed and we were unable to recover it. 00:27:29.183 [2024-12-08 02:29:56.864854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.864929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.864954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.183 qpair failed and we were unable to recover it. 00:27:29.183 [2024-12-08 02:29:56.865035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.865120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.865144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.183 qpair failed and we were unable to recover it. 00:27:29.183 [2024-12-08 02:29:56.865235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.865346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.865372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.183 qpair failed and we were unable to recover it. 00:27:29.183 [2024-12-08 02:29:56.865486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.865582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.865608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.183 qpair failed and we were unable to recover it. 00:27:29.183 [2024-12-08 02:29:56.865687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.865769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.865794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.183 qpair failed and we were unable to recover it. 00:27:29.183 [2024-12-08 02:29:56.865903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.865985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.866009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.183 qpair failed and we were unable to recover it. 00:27:29.183 [2024-12-08 02:29:56.866094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.866181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.866206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.183 qpair failed and we were unable to recover it. 00:27:29.183 [2024-12-08 02:29:56.866299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.866412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.866437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.183 qpair failed and we were unable to recover it. 00:27:29.183 [2024-12-08 02:29:56.866532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.866618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.866644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.183 qpair failed and we were unable to recover it. 00:27:29.183 [2024-12-08 02:29:56.866732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.866807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.866832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.183 qpair failed and we were unable to recover it. 00:27:29.183 [2024-12-08 02:29:56.866942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.183 [2024-12-08 02:29:56.867032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.867057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.184 qpair failed and we were unable to recover it. 00:27:29.184 [2024-12-08 02:29:56.867149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.867235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.867261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.184 qpair failed and we were unable to recover it. 00:27:29.184 [2024-12-08 02:29:56.867351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.867431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.867456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.184 qpair failed and we were unable to recover it. 00:27:29.184 [2024-12-08 02:29:56.867527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.867629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.867659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.184 qpair failed and we were unable to recover it. 00:27:29.184 [2024-12-08 02:29:56.867735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.867846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.867870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.184 qpair failed and we were unable to recover it. 00:27:29.184 [2024-12-08 02:29:56.867986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.868101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.868126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.184 qpair failed and we were unable to recover it. 00:27:29.184 [2024-12-08 02:29:56.868207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.868314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.868339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.184 qpair failed and we were unable to recover it. 00:27:29.184 [2024-12-08 02:29:56.868422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.868506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.868531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.184 qpair failed and we were unable to recover it. 00:27:29.184 [2024-12-08 02:29:56.868615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.868696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.868722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.184 qpair failed and we were unable to recover it. 00:27:29.184 [2024-12-08 02:29:56.868839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.869034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.869060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.184 qpair failed and we were unable to recover it. 00:27:29.184 [2024-12-08 02:29:56.869141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.869236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.869262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.184 qpair failed and we were unable to recover it. 00:27:29.184 [2024-12-08 02:29:56.869348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.869432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.869457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.184 qpair failed and we were unable to recover it. 00:27:29.184 [2024-12-08 02:29:56.869547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.869636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.869660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.184 qpair failed and we were unable to recover it. 00:27:29.184 [2024-12-08 02:29:56.869773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.869891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.869920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.184 qpair failed and we were unable to recover it. 00:27:29.184 [2024-12-08 02:29:56.870002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.870079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.870104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.184 qpair failed and we were unable to recover it. 00:27:29.184 [2024-12-08 02:29:56.870219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.870301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.870326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.184 qpair failed and we were unable to recover it. 00:27:29.184 [2024-12-08 02:29:56.870406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.870482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.870508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.184 qpair failed and we were unable to recover it. 00:27:29.184 [2024-12-08 02:29:56.870596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.870708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.870734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.184 qpair failed and we were unable to recover it. 00:27:29.184 [2024-12-08 02:29:56.870850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.870927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.870952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.184 qpair failed and we were unable to recover it. 00:27:29.184 [2024-12-08 02:29:56.871044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.871127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.871152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.184 qpair failed and we were unable to recover it. 00:27:29.184 [2024-12-08 02:29:56.871235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.871320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.871344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.184 qpair failed and we were unable to recover it. 00:27:29.184 [2024-12-08 02:29:56.871461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.871562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.871589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.184 qpair failed and we were unable to recover it. 00:27:29.184 [2024-12-08 02:29:56.871668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.871758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.871783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.184 qpair failed and we were unable to recover it. 00:27:29.184 [2024-12-08 02:29:56.871898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.871979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.872009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.184 qpair failed and we were unable to recover it. 00:27:29.184 [2024-12-08 02:29:56.872088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.872202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.872227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.184 qpair failed and we were unable to recover it. 00:27:29.184 [2024-12-08 02:29:56.872340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.872414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.872440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.184 qpair failed and we were unable to recover it. 00:27:29.184 [2024-12-08 02:29:56.872523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.872642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.872667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.184 qpair failed and we were unable to recover it. 00:27:29.184 [2024-12-08 02:29:56.872758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.872862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.184 [2024-12-08 02:29:56.872886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.184 qpair failed and we were unable to recover it. 00:27:29.185 [2024-12-08 02:29:56.872972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.873075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.873100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.185 qpair failed and we were unable to recover it. 00:27:29.185 [2024-12-08 02:29:56.873178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.873258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.873283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.185 qpair failed and we were unable to recover it. 00:27:29.185 [2024-12-08 02:29:56.873369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.873451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.873476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.185 qpair failed and we were unable to recover it. 00:27:29.185 [2024-12-08 02:29:56.873561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.873648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.873673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.185 qpair failed and we were unable to recover it. 00:27:29.185 [2024-12-08 02:29:56.873758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.873864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.873889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.185 qpair failed and we were unable to recover it. 00:27:29.185 [2024-12-08 02:29:56.873968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.874079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.874108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.185 qpair failed and we were unable to recover it. 00:27:29.185 [2024-12-08 02:29:56.874190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.874299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.874324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.185 qpair failed and we were unable to recover it. 00:27:29.185 [2024-12-08 02:29:56.874441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.874520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.874550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.185 qpair failed and we were unable to recover it. 00:27:29.185 [2024-12-08 02:29:56.874638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.874745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.874771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.185 qpair failed and we were unable to recover it. 00:27:29.185 [2024-12-08 02:29:56.874852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.874958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.874983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.185 qpair failed and we were unable to recover it. 00:27:29.185 [2024-12-08 02:29:56.875127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.875207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.875231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.185 qpair failed and we were unable to recover it. 00:27:29.185 [2024-12-08 02:29:56.875316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.875401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.875425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.185 qpair failed and we were unable to recover it. 00:27:29.185 [2024-12-08 02:29:56.875514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.875685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.875711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.185 qpair failed and we were unable to recover it. 00:27:29.185 [2024-12-08 02:29:56.875826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.875938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.875963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.185 qpair failed and we were unable to recover it. 00:27:29.185 [2024-12-08 02:29:56.876047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.876154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.876179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.185 qpair failed and we were unable to recover it. 00:27:29.185 [2024-12-08 02:29:56.876268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.876345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.876370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.185 qpair failed and we were unable to recover it. 00:27:29.185 [2024-12-08 02:29:56.876454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.876541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.876567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.185 qpair failed and we were unable to recover it. 00:27:29.185 [2024-12-08 02:29:56.876683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.876791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.876815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.185 qpair failed and we were unable to recover it. 00:27:29.185 [2024-12-08 02:29:56.876897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.877037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.877063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.185 qpair failed and we were unable to recover it. 00:27:29.185 [2024-12-08 02:29:56.877144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.877252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.877278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.185 qpair failed and we were unable to recover it. 00:27:29.185 [2024-12-08 02:29:56.877357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.877438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.877463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.185 qpair failed and we were unable to recover it. 00:27:29.185 [2024-12-08 02:29:56.877546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.877656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.877681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.185 qpair failed and we were unable to recover it. 00:27:29.185 [2024-12-08 02:29:56.877759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.877868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.877893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.185 qpair failed and we were unable to recover it. 00:27:29.185 [2024-12-08 02:29:56.878006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.878086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.878110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.185 qpair failed and we were unable to recover it. 00:27:29.185 [2024-12-08 02:29:56.878197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.878285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.878311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.185 qpair failed and we were unable to recover it. 00:27:29.185 [2024-12-08 02:29:56.878388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.878465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.878489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.185 qpair failed and we were unable to recover it. 00:27:29.185 [2024-12-08 02:29:56.878577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.878688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.878714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.185 qpair failed and we were unable to recover it. 00:27:29.185 [2024-12-08 02:29:56.878796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.878905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.878931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.185 qpair failed and we were unable to recover it. 00:27:29.185 [2024-12-08 02:29:56.879016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.185 [2024-12-08 02:29:56.879127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.879153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.186 qpair failed and we were unable to recover it. 00:27:29.186 [2024-12-08 02:29:56.879231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.879312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.879338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.186 qpair failed and we were unable to recover it. 00:27:29.186 [2024-12-08 02:29:56.879425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.879533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.879568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.186 qpair failed and we were unable to recover it. 00:27:29.186 [2024-12-08 02:29:56.879646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.879729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.879754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.186 qpair failed and we were unable to recover it. 00:27:29.186 [2024-12-08 02:29:56.879836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.879910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.879936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.186 qpair failed and we were unable to recover it. 00:27:29.186 [2024-12-08 02:29:56.880019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.880101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.880126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.186 qpair failed and we were unable to recover it. 00:27:29.186 [2024-12-08 02:29:56.880203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.880282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.880307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.186 qpair failed and we were unable to recover it. 00:27:29.186 [2024-12-08 02:29:56.880389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.880467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.880492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.186 qpair failed and we were unable to recover it. 00:27:29.186 [2024-12-08 02:29:56.880594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.880701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.880727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.186 qpair failed and we were unable to recover it. 00:27:29.186 [2024-12-08 02:29:56.880811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.880889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.880914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.186 qpair failed and we were unable to recover it. 00:27:29.186 [2024-12-08 02:29:56.880996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.881074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.881099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.186 qpair failed and we were unable to recover it. 00:27:29.186 [2024-12-08 02:29:56.881177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.881289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.881314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.186 qpair failed and we were unable to recover it. 00:27:29.186 [2024-12-08 02:29:56.881389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.881475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.881500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.186 qpair failed and we were unable to recover it. 00:27:29.186 [2024-12-08 02:29:56.881627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.881714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.881739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.186 qpair failed and we were unable to recover it. 00:27:29.186 [2024-12-08 02:29:56.881825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.881916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.881941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.186 qpair failed and we were unable to recover it. 00:27:29.186 [2024-12-08 02:29:56.882025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.882103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.882129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.186 qpair failed and we were unable to recover it. 00:27:29.186 [2024-12-08 02:29:56.882218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.882330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.882356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.186 qpair failed and we were unable to recover it. 00:27:29.186 [2024-12-08 02:29:56.882495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.882585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.882611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.186 qpair failed and we were unable to recover it. 00:27:29.186 [2024-12-08 02:29:56.882700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.882780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.882804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.186 qpair failed and we were unable to recover it. 00:27:29.186 [2024-12-08 02:29:56.882916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.882993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.883017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.186 qpair failed and we were unable to recover it. 00:27:29.186 [2024-12-08 02:29:56.883128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.883203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.883229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.186 qpair failed and we were unable to recover it. 00:27:29.186 [2024-12-08 02:29:56.883315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.883395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.883419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.186 qpair failed and we were unable to recover it. 00:27:29.186 [2024-12-08 02:29:56.883496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.883616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.883642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.186 qpair failed and we were unable to recover it. 00:27:29.186 [2024-12-08 02:29:56.883725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.883815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.883840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.186 qpair failed and we were unable to recover it. 00:27:29.186 [2024-12-08 02:29:56.883981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.884091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.884116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.186 qpair failed and we were unable to recover it. 00:27:29.186 [2024-12-08 02:29:56.884229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.884309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.186 [2024-12-08 02:29:56.884334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.186 qpair failed and we were unable to recover it. 00:27:29.187 [2024-12-08 02:29:56.884411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.187 [2024-12-08 02:29:56.884489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.187 [2024-12-08 02:29:56.884513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.187 qpair failed and we were unable to recover it. 00:27:29.187 [2024-12-08 02:29:56.884628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.187 [2024-12-08 02:29:56.884710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.187 [2024-12-08 02:29:56.884735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.187 qpair failed and we were unable to recover it. 00:27:29.187 [2024-12-08 02:29:56.884824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.187 [2024-12-08 02:29:56.884902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.187 [2024-12-08 02:29:56.884928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.187 qpair failed and we were unable to recover it. 00:27:29.187 [2024-12-08 02:29:56.885008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.187 [2024-12-08 02:29:56.885114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.187 [2024-12-08 02:29:56.885139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.187 qpair failed and we were unable to recover it. 00:27:29.187 [2024-12-08 02:29:56.885219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.187 [2024-12-08 02:29:56.885327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.187 [2024-12-08 02:29:56.885351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.187 qpair failed and we were unable to recover it. 00:27:29.187 [2024-12-08 02:29:56.885431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.187 [2024-12-08 02:29:56.885510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.187 [2024-12-08 02:29:56.885542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.187 qpair failed and we were unable to recover it. 00:27:29.187 [2024-12-08 02:29:56.885659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.187 [2024-12-08 02:29:56.885741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.187 [2024-12-08 02:29:56.885766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.187 qpair failed and we were unable to recover it. 00:27:29.187 [2024-12-08 02:29:56.885845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.187 [2024-12-08 02:29:56.885964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.187 [2024-12-08 02:29:56.885990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.187 qpair failed and we were unable to recover it. 00:27:29.187 [2024-12-08 02:29:56.886073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.187 [2024-12-08 02:29:56.886151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.187 [2024-12-08 02:29:56.886177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.187 qpair failed and we were unable to recover it. 00:27:29.187 [2024-12-08 02:29:56.886269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.187 [2024-12-08 02:29:56.886352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.187 [2024-12-08 02:29:56.886379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.187 qpair failed and we were unable to recover it. 00:27:29.187 [2024-12-08 02:29:56.886459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.187 [2024-12-08 02:29:56.886549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.187 [2024-12-08 02:29:56.886575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.187 qpair failed and we were unable to recover it. 00:27:29.187 [2024-12-08 02:29:56.886686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.187 [2024-12-08 02:29:56.886768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.187 [2024-12-08 02:29:56.886792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.187 qpair failed and we were unable to recover it. 00:27:29.187 [2024-12-08 02:29:56.886874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.187 [2024-12-08 02:29:56.886952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.187 [2024-12-08 02:29:56.886977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.187 qpair failed and we were unable to recover it. 00:27:29.187 [2024-12-08 02:29:56.887088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.470 [2024-12-08 02:29:56.887177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.470 [2024-12-08 02:29:56.887203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.470 qpair failed and we were unable to recover it. 00:27:29.470 [2024-12-08 02:29:56.887284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.470 [2024-12-08 02:29:56.887367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.470 [2024-12-08 02:29:56.887393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.470 qpair failed and we were unable to recover it. 00:27:29.470 [2024-12-08 02:29:56.887508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.470 [2024-12-08 02:29:56.887625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.470 [2024-12-08 02:29:56.887651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.470 qpair failed and we were unable to recover it. 00:27:29.470 [2024-12-08 02:29:56.887727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.470 [2024-12-08 02:29:56.887805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.470 [2024-12-08 02:29:56.887831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.470 qpair failed and we were unable to recover it. 00:27:29.470 [2024-12-08 02:29:56.887908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.470 [2024-12-08 02:29:56.887993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.470 [2024-12-08 02:29:56.888019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.470 qpair failed and we were unable to recover it. 00:27:29.470 [2024-12-08 02:29:56.888114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.470 [2024-12-08 02:29:56.888189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.470 [2024-12-08 02:29:56.888214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.470 qpair failed and we were unable to recover it. 00:27:29.470 [2024-12-08 02:29:56.888294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.470 [2024-12-08 02:29:56.888417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.470 [2024-12-08 02:29:56.888443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.470 qpair failed and we were unable to recover it. 00:27:29.470 [2024-12-08 02:29:56.888564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.470 [2024-12-08 02:29:56.888644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.470 [2024-12-08 02:29:56.888670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.470 qpair failed and we were unable to recover it. 00:27:29.470 [2024-12-08 02:29:56.888762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.470 [2024-12-08 02:29:56.888836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.470 [2024-12-08 02:29:56.888861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.470 qpair failed and we were unable to recover it. 00:27:29.470 [2024-12-08 02:29:56.888972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.470 [2024-12-08 02:29:56.889060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.470 [2024-12-08 02:29:56.889085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.470 qpair failed and we were unable to recover it. 00:27:29.470 [2024-12-08 02:29:56.889159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.470 [2024-12-08 02:29:56.889239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.470 [2024-12-08 02:29:56.889264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.470 qpair failed and we were unable to recover it. 00:27:29.470 [2024-12-08 02:29:56.889372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.470 [2024-12-08 02:29:56.889454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.470 [2024-12-08 02:29:56.889479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.470 qpair failed and we were unable to recover it. 00:27:29.470 [2024-12-08 02:29:56.889625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.470 [2024-12-08 02:29:56.889705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.470 [2024-12-08 02:29:56.889731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.470 qpair failed and we were unable to recover it. 00:27:29.470 [2024-12-08 02:29:56.889840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.470 [2024-12-08 02:29:56.889954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.470 [2024-12-08 02:29:56.889979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.470 qpair failed and we were unable to recover it. 00:27:29.470 [2024-12-08 02:29:56.890057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.890162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.890187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.471 qpair failed and we were unable to recover it. 00:27:29.471 [2024-12-08 02:29:56.890265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.890374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.890398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.471 qpair failed and we were unable to recover it. 00:27:29.471 [2024-12-08 02:29:56.890476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.890590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.890615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.471 qpair failed and we were unable to recover it. 00:27:29.471 [2024-12-08 02:29:56.890707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.890788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.890813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.471 qpair failed and we were unable to recover it. 00:27:29.471 [2024-12-08 02:29:56.890926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.891007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.891032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.471 qpair failed and we were unable to recover it. 00:27:29.471 [2024-12-08 02:29:56.891162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.891254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.891284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.471 qpair failed and we were unable to recover it. 00:27:29.471 [2024-12-08 02:29:56.891372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.891480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.891506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.471 qpair failed and we were unable to recover it. 00:27:29.471 [2024-12-08 02:29:56.891603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.891685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.891711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.471 qpair failed and we were unable to recover it. 00:27:29.471 [2024-12-08 02:29:56.891795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.891873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.891898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.471 qpair failed and we were unable to recover it. 00:27:29.471 [2024-12-08 02:29:56.891981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.892061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.892087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.471 qpair failed and we were unable to recover it. 00:27:29.471 [2024-12-08 02:29:56.892184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.892298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.892324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.471 qpair failed and we were unable to recover it. 00:27:29.471 [2024-12-08 02:29:56.892407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.892487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.892512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.471 qpair failed and we were unable to recover it. 00:27:29.471 [2024-12-08 02:29:56.892604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.892720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.892746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.471 qpair failed and we were unable to recover it. 00:27:29.471 [2024-12-08 02:29:56.892838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.892922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.892947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.471 qpair failed and we were unable to recover it. 00:27:29.471 [2024-12-08 02:29:56.893024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.893105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.893130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.471 qpair failed and we were unable to recover it. 00:27:29.471 [2024-12-08 02:29:56.893217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.893302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.893327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.471 qpair failed and we were unable to recover it. 00:27:29.471 [2024-12-08 02:29:56.893412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.893489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.893515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.471 qpair failed and we were unable to recover it. 00:27:29.471 [2024-12-08 02:29:56.893638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.893717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.893742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.471 qpair failed and we were unable to recover it. 00:27:29.471 [2024-12-08 02:29:56.893821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.893932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.893958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.471 qpair failed and we were unable to recover it. 00:27:29.471 [2024-12-08 02:29:56.894036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.894119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.894144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.471 qpair failed and we were unable to recover it. 00:27:29.471 [2024-12-08 02:29:56.894219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.894335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.894361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.471 qpair failed and we were unable to recover it. 00:27:29.471 [2024-12-08 02:29:56.894475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.894558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.894583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.471 qpair failed and we were unable to recover it. 00:27:29.471 [2024-12-08 02:29:56.894663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.894742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.894766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.471 qpair failed and we were unable to recover it. 00:27:29.471 [2024-12-08 02:29:56.894877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.894955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.894979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.471 qpair failed and we were unable to recover it. 00:27:29.471 [2024-12-08 02:29:56.895096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.895175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.895199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.471 qpair failed and we were unable to recover it. 00:27:29.471 [2024-12-08 02:29:56.895279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.895398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.895422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.471 qpair failed and we were unable to recover it. 00:27:29.471 [2024-12-08 02:29:56.895515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.895608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.895635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.471 qpair failed and we were unable to recover it. 00:27:29.471 [2024-12-08 02:29:56.895722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.895848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.471 [2024-12-08 02:29:56.895874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.472 qpair failed and we were unable to recover it. 00:27:29.472 [2024-12-08 02:29:56.895956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.896067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.896094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.472 qpair failed and we were unable to recover it. 00:27:29.472 [2024-12-08 02:29:56.896177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.896286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.896312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.472 qpair failed and we were unable to recover it. 00:27:29.472 [2024-12-08 02:29:56.896396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.896513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.896547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.472 qpair failed and we were unable to recover it. 00:27:29.472 [2024-12-08 02:29:56.896636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.896721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.896747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.472 qpair failed and we were unable to recover it. 00:27:29.472 [2024-12-08 02:29:56.896857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.896978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.897003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.472 qpair failed and we were unable to recover it. 00:27:29.472 [2024-12-08 02:29:56.897083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.897162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.897187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.472 qpair failed and we were unable to recover it. 00:27:29.472 [2024-12-08 02:29:56.897309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.897390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.897415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.472 qpair failed and we were unable to recover it. 00:27:29.472 [2024-12-08 02:29:56.897500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.897592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.897618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.472 qpair failed and we were unable to recover it. 00:27:29.472 [2024-12-08 02:29:56.897730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.897809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.897835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.472 qpair failed and we were unable to recover it. 00:27:29.472 [2024-12-08 02:29:56.897914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.898025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.898052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.472 qpair failed and we were unable to recover it. 00:27:29.472 [2024-12-08 02:29:56.898141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.898221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.898247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.472 qpair failed and we were unable to recover it. 00:27:29.472 [2024-12-08 02:29:56.898340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.898455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.898481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.472 qpair failed and we were unable to recover it. 00:27:29.472 [2024-12-08 02:29:56.898575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.898684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.898709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.472 qpair failed and we were unable to recover it. 00:27:29.472 [2024-12-08 02:29:56.898794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.898883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.898909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.472 qpair failed and we were unable to recover it. 00:27:29.472 [2024-12-08 02:29:56.898989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.899076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.899103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.472 qpair failed and we were unable to recover it. 00:27:29.472 [2024-12-08 02:29:56.899182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.899324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.899349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.472 qpair failed and we were unable to recover it. 00:27:29.472 [2024-12-08 02:29:56.899459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.899533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.899563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.472 qpair failed and we were unable to recover it. 00:27:29.472 [2024-12-08 02:29:56.899648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.899730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.899756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.472 qpair failed and we were unable to recover it. 00:27:29.472 [2024-12-08 02:29:56.899832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.899919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.899946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.472 qpair failed and we were unable to recover it. 00:27:29.472 [2024-12-08 02:29:56.900026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.900137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.900162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.472 qpair failed and we were unable to recover it. 00:27:29.472 [2024-12-08 02:29:56.900249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.900336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.900362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.472 qpair failed and we were unable to recover it. 00:27:29.472 [2024-12-08 02:29:56.900439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.900516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.900548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.472 qpair failed and we were unable to recover it. 00:27:29.472 [2024-12-08 02:29:56.900634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.900752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.900778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.472 qpair failed and we were unable to recover it. 00:27:29.472 [2024-12-08 02:29:56.900866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.900975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.901001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.472 qpair failed and we were unable to recover it. 00:27:29.472 [2024-12-08 02:29:56.901083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.901191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.901216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.472 qpair failed and we were unable to recover it. 00:27:29.472 [2024-12-08 02:29:56.901302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.901412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.901438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.472 qpair failed and we were unable to recover it. 00:27:29.472 [2024-12-08 02:29:56.901551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.901634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.901660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.472 qpair failed and we were unable to recover it. 00:27:29.472 [2024-12-08 02:29:56.901740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.901852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.472 [2024-12-08 02:29:56.901882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.472 qpair failed and we were unable to recover it. 00:27:29.472 [2024-12-08 02:29:56.901994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.902069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.902094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.473 qpair failed and we were unable to recover it. 00:27:29.473 [2024-12-08 02:29:56.902180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.902269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.902294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.473 qpair failed and we were unable to recover it. 00:27:29.473 [2024-12-08 02:29:56.902404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.902480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.902505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.473 qpair failed and we were unable to recover it. 00:27:29.473 [2024-12-08 02:29:56.902624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.902707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.902733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.473 qpair failed and we were unable to recover it. 00:27:29.473 [2024-12-08 02:29:56.902811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.902902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.902927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.473 qpair failed and we were unable to recover it. 00:27:29.473 [2024-12-08 02:29:56.903041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.903152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.903177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.473 qpair failed and we were unable to recover it. 00:27:29.473 [2024-12-08 02:29:56.903264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.903343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.903369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.473 qpair failed and we were unable to recover it. 00:27:29.473 [2024-12-08 02:29:56.903455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.903534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.903569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.473 qpair failed and we were unable to recover it. 00:27:29.473 [2024-12-08 02:29:56.903652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.903762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.903788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.473 qpair failed and we were unable to recover it. 00:27:29.473 [2024-12-08 02:29:56.903869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.903979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.904009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.473 qpair failed and we were unable to recover it. 00:27:29.473 [2024-12-08 02:29:56.904091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.904168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.904195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.473 qpair failed and we were unable to recover it. 00:27:29.473 [2024-12-08 02:29:56.904279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.904361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.904387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.473 qpair failed and we were unable to recover it. 00:27:29.473 [2024-12-08 02:29:56.904510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.904630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.904656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.473 qpair failed and we were unable to recover it. 00:27:29.473 [2024-12-08 02:29:56.904733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.904811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.904837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.473 qpair failed and we were unable to recover it. 00:27:29.473 [2024-12-08 02:29:56.904946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.905025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.905051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.473 qpair failed and we were unable to recover it. 00:27:29.473 [2024-12-08 02:29:56.905127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.905236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.905261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.473 qpair failed and we were unable to recover it. 00:27:29.473 [2024-12-08 02:29:56.905375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.905461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.905487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.473 qpair failed and we were unable to recover it. 00:27:29.473 [2024-12-08 02:29:56.905599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.905679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.905705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.473 qpair failed and we were unable to recover it. 00:27:29.473 [2024-12-08 02:29:56.905786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.905861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.905886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.473 qpair failed and we were unable to recover it. 00:27:29.473 [2024-12-08 02:29:56.905966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.906052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.906082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.473 qpair failed and we were unable to recover it. 00:27:29.473 [2024-12-08 02:29:56.906194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.906274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.906299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.473 qpair failed and we were unable to recover it. 00:27:29.473 [2024-12-08 02:29:56.906407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.906493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.906518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.473 qpair failed and we were unable to recover it. 00:27:29.473 [2024-12-08 02:29:56.906608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.906726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.906751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.473 qpair failed and we were unable to recover it. 00:27:29.473 [2024-12-08 02:29:56.906831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.906939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.906965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.473 qpair failed and we were unable to recover it. 00:27:29.473 [2024-12-08 02:29:56.907078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.907218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.907243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.473 qpair failed and we were unable to recover it. 00:27:29.473 [2024-12-08 02:29:56.907322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.907399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.907425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.473 qpair failed and we were unable to recover it. 00:27:29.473 [2024-12-08 02:29:56.907509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.907605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.907631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.473 qpair failed and we were unable to recover it. 00:27:29.473 [2024-12-08 02:29:56.907743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.907856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.473 [2024-12-08 02:29:56.907882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.473 qpair failed and we were unable to recover it. 00:27:29.473 [2024-12-08 02:29:56.907992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.908070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.908096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.474 qpair failed and we were unable to recover it. 00:27:29.474 [2024-12-08 02:29:56.908218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.908314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.908348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.474 qpair failed and we were unable to recover it. 00:27:29.474 [2024-12-08 02:29:56.908463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.908558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.908584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.474 qpair failed and we were unable to recover it. 00:27:29.474 [2024-12-08 02:29:56.908670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.908809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.908834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.474 qpair failed and we were unable to recover it. 00:27:29.474 [2024-12-08 02:29:56.908951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.909061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.909086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.474 qpair failed and we were unable to recover it. 00:27:29.474 [2024-12-08 02:29:56.909203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.909283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.909308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.474 qpair failed and we were unable to recover it. 00:27:29.474 [2024-12-08 02:29:56.909401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.909479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.909505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.474 qpair failed and we were unable to recover it. 00:27:29.474 [2024-12-08 02:29:56.909591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.909705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.909730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.474 qpair failed and we were unable to recover it. 00:27:29.474 [2024-12-08 02:29:56.909813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.909889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.909914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.474 qpair failed and we were unable to recover it. 00:27:29.474 [2024-12-08 02:29:56.910025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.910099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.910124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.474 qpair failed and we were unable to recover it. 00:27:29.474 [2024-12-08 02:29:56.910230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.910307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.910332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.474 qpair failed and we were unable to recover it. 00:27:29.474 [2024-12-08 02:29:56.910415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.910524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.910556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.474 qpair failed and we were unable to recover it. 00:27:29.474 [2024-12-08 02:29:56.910673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.910751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.910776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.474 qpair failed and we were unable to recover it. 00:27:29.474 [2024-12-08 02:29:56.910855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.910936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.910961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.474 qpair failed and we were unable to recover it. 00:27:29.474 [2024-12-08 02:29:56.911072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.911183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.911208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.474 qpair failed and we were unable to recover it. 00:27:29.474 [2024-12-08 02:29:56.911290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.911392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.911417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.474 qpair failed and we were unable to recover it. 00:27:29.474 [2024-12-08 02:29:56.911492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.911594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.911620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.474 qpair failed and we were unable to recover it. 00:27:29.474 [2024-12-08 02:29:56.911697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.911802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.911826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.474 qpair failed and we were unable to recover it. 00:27:29.474 [2024-12-08 02:29:56.911910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.912014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.912038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.474 qpair failed and we were unable to recover it. 00:27:29.474 [2024-12-08 02:29:56.912152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.912287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.912312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.474 qpair failed and we were unable to recover it. 00:27:29.474 [2024-12-08 02:29:56.912390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.912474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.912499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.474 qpair failed and we were unable to recover it. 00:27:29.474 [2024-12-08 02:29:56.912588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.912670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.912696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.474 qpair failed and we were unable to recover it. 00:27:29.474 [2024-12-08 02:29:56.912810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.912885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.912910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.474 qpair failed and we were unable to recover it. 00:27:29.474 [2024-12-08 02:29:56.912998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.913082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.913108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.474 qpair failed and we were unable to recover it. 00:27:29.474 [2024-12-08 02:29:56.913187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.913261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.913286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.474 qpair failed and we were unable to recover it. 00:27:29.474 [2024-12-08 02:29:56.913366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.913502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.913527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.474 qpair failed and we were unable to recover it. 00:27:29.474 [2024-12-08 02:29:56.913727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.913830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.913855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.474 qpair failed and we were unable to recover it. 00:27:29.474 [2024-12-08 02:29:56.913933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.914011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.914035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.474 qpair failed and we were unable to recover it. 00:27:29.474 [2024-12-08 02:29:56.914113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.474 [2024-12-08 02:29:56.914303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.914328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.475 qpair failed and we were unable to recover it. 00:27:29.475 [2024-12-08 02:29:56.914440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.914552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.914578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.475 qpair failed and we were unable to recover it. 00:27:29.475 [2024-12-08 02:29:56.914658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.914738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.914765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.475 qpair failed and we were unable to recover it. 00:27:29.475 [2024-12-08 02:29:56.914844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.914964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.914989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.475 qpair failed and we were unable to recover it. 00:27:29.475 [2024-12-08 02:29:56.915072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.915214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.915240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.475 qpair failed and we were unable to recover it. 00:27:29.475 [2024-12-08 02:29:56.915317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.915427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.915452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.475 qpair failed and we were unable to recover it. 00:27:29.475 [2024-12-08 02:29:56.915566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.915647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.915672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.475 qpair failed and we were unable to recover it. 00:27:29.475 [2024-12-08 02:29:56.915792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.915872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.915897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.475 qpair failed and we were unable to recover it. 00:27:29.475 [2024-12-08 02:29:56.916037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.916145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.916170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.475 qpair failed and we were unable to recover it. 00:27:29.475 [2024-12-08 02:29:56.916286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.916401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.916427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.475 qpair failed and we were unable to recover it. 00:27:29.475 [2024-12-08 02:29:56.916509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.916643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.916669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.475 qpair failed and we were unable to recover it. 00:27:29.475 [2024-12-08 02:29:56.916752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.916826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.916851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.475 qpair failed and we were unable to recover it. 00:27:29.475 [2024-12-08 02:29:56.916927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.917035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.917060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.475 qpair failed and we were unable to recover it. 00:27:29.475 [2024-12-08 02:29:56.917149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.917226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.917250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.475 qpair failed and we were unable to recover it. 00:27:29.475 [2024-12-08 02:29:56.917392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.917480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.917506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.475 qpair failed and we were unable to recover it. 00:27:29.475 [2024-12-08 02:29:56.917626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.917747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.917775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.475 qpair failed and we were unable to recover it. 00:27:29.475 [2024-12-08 02:29:56.917891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.917973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.917998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.475 qpair failed and we were unable to recover it. 00:27:29.475 [2024-12-08 02:29:56.918084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.918176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.918202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.475 qpair failed and we were unable to recover it. 00:27:29.475 [2024-12-08 02:29:56.918313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.918399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.918427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.475 qpair failed and we were unable to recover it. 00:27:29.475 [2024-12-08 02:29:56.918547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.918668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.918696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.475 qpair failed and we were unable to recover it. 00:27:29.475 [2024-12-08 02:29:56.918789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.918905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.918933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.475 qpair failed and we were unable to recover it. 00:27:29.475 [2024-12-08 02:29:56.919020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.919096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.919121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.475 qpair failed and we were unable to recover it. 00:27:29.475 [2024-12-08 02:29:56.919242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.919326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.919351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.475 qpair failed and we were unable to recover it. 00:27:29.475 [2024-12-08 02:29:56.919430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.919556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.919582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.475 qpair failed and we were unable to recover it. 00:27:29.475 [2024-12-08 02:29:56.919663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.919742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.475 [2024-12-08 02:29:56.919771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.475 qpair failed and we were unable to recover it. 00:27:29.476 [2024-12-08 02:29:56.919848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.919929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.919954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.476 qpair failed and we were unable to recover it. 00:27:29.476 [2024-12-08 02:29:56.920072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.920143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.920169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.476 qpair failed and we were unable to recover it. 00:27:29.476 [2024-12-08 02:29:56.920245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.920350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.920375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.476 qpair failed and we were unable to recover it. 00:27:29.476 [2024-12-08 02:29:56.920490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.920567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.920592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.476 qpair failed and we were unable to recover it. 00:27:29.476 [2024-12-08 02:29:56.920673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.920752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.920777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.476 qpair failed and we were unable to recover it. 00:27:29.476 [2024-12-08 02:29:56.920882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.920959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.920984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.476 qpair failed and we were unable to recover it. 00:27:29.476 [2024-12-08 02:29:56.921106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.921212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.921237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.476 qpair failed and we were unable to recover it. 00:27:29.476 [2024-12-08 02:29:56.921319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.921426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.921451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.476 qpair failed and we were unable to recover it. 00:27:29.476 [2024-12-08 02:29:56.921543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.921620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.921645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.476 qpair failed and we were unable to recover it. 00:27:29.476 [2024-12-08 02:29:56.921726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.921809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.921834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.476 qpair failed and we were unable to recover it. 00:27:29.476 [2024-12-08 02:29:56.921927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.922013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.922038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.476 qpair failed and we were unable to recover it. 00:27:29.476 [2024-12-08 02:29:56.922117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.922197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.922222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.476 qpair failed and we were unable to recover it. 00:27:29.476 [2024-12-08 02:29:56.922328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.922438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.922463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.476 qpair failed and we were unable to recover it. 00:27:29.476 [2024-12-08 02:29:56.922554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.922663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.922688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.476 qpair failed and we were unable to recover it. 00:27:29.476 [2024-12-08 02:29:56.922767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.922892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.922917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.476 qpair failed and we were unable to recover it. 00:27:29.476 [2024-12-08 02:29:56.923023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.923135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.923160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.476 qpair failed and we were unable to recover it. 00:27:29.476 [2024-12-08 02:29:56.923239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.923346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.923371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.476 qpair failed and we were unable to recover it. 00:27:29.476 [2024-12-08 02:29:56.923457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.923531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.923560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.476 qpair failed and we were unable to recover it. 00:27:29.476 [2024-12-08 02:29:56.923674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.923757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.923782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.476 qpair failed and we were unable to recover it. 00:27:29.476 [2024-12-08 02:29:56.923869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.923956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.923981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.476 qpair failed and we were unable to recover it. 00:27:29.476 [2024-12-08 02:29:56.924066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.924181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.924206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.476 qpair failed and we were unable to recover it. 00:27:29.476 [2024-12-08 02:29:56.924311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.924387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.924412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.476 qpair failed and we were unable to recover it. 00:27:29.476 [2024-12-08 02:29:56.924554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.924644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.924669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.476 qpair failed and we were unable to recover it. 00:27:29.476 [2024-12-08 02:29:56.924778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.924851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.924876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.476 qpair failed and we were unable to recover it. 00:27:29.476 [2024-12-08 02:29:56.924959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.925034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.925058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.476 qpair failed and we were unable to recover it. 00:27:29.476 [2024-12-08 02:29:56.925197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.925289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.925314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.476 qpair failed and we were unable to recover it. 00:27:29.476 [2024-12-08 02:29:56.925423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.925502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.925527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.476 qpair failed and we were unable to recover it. 00:27:29.476 [2024-12-08 02:29:56.925612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.925692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.925717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.476 qpair failed and we were unable to recover it. 00:27:29.476 [2024-12-08 02:29:56.925802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.925897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.476 [2024-12-08 02:29:56.925922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.477 qpair failed and we were unable to recover it. 00:27:29.477 [2024-12-08 02:29:56.925999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.926079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.926104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.477 qpair failed and we were unable to recover it. 00:27:29.477 [2024-12-08 02:29:56.926223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.926335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.926361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.477 qpair failed and we were unable to recover it. 00:27:29.477 [2024-12-08 02:29:56.926451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.926526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.926557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.477 qpair failed and we were unable to recover it. 00:27:29.477 [2024-12-08 02:29:56.926668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.926746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.926771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.477 qpair failed and we were unable to recover it. 00:27:29.477 [2024-12-08 02:29:56.926884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.926997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.927021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.477 qpair failed and we were unable to recover it. 00:27:29.477 [2024-12-08 02:29:56.927101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.927291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.927316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.477 qpair failed and we were unable to recover it. 00:27:29.477 [2024-12-08 02:29:56.927424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.927552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.927577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.477 qpair failed and we were unable to recover it. 00:27:29.477 [2024-12-08 02:29:56.927663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.927741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.927765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.477 qpair failed and we were unable to recover it. 00:27:29.477 [2024-12-08 02:29:56.927877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.927963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.927988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.477 qpair failed and we were unable to recover it. 00:27:29.477 [2024-12-08 02:29:56.928099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.928185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.928210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.477 qpair failed and we were unable to recover it. 00:27:29.477 [2024-12-08 02:29:56.928288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.928434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.928459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.477 qpair failed and we were unable to recover it. 00:27:29.477 [2024-12-08 02:29:56.928547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.928627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.928652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.477 qpair failed and we were unable to recover it. 00:27:29.477 [2024-12-08 02:29:56.928772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.928858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.928883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.477 qpair failed and we were unable to recover it. 00:27:29.477 [2024-12-08 02:29:56.928960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.929070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.929095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.477 qpair failed and we were unable to recover it. 00:27:29.477 [2024-12-08 02:29:56.929172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.929264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.929289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.477 qpair failed and we were unable to recover it. 00:27:29.477 [2024-12-08 02:29:56.929379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.929494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.929520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.477 qpair failed and we were unable to recover it. 00:27:29.477 [2024-12-08 02:29:56.929611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.929801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.929826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.477 qpair failed and we were unable to recover it. 00:27:29.477 [2024-12-08 02:29:56.929934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.930011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.930036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.477 qpair failed and we were unable to recover it. 00:27:29.477 [2024-12-08 02:29:56.930123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.930210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.930235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.477 qpair failed and we were unable to recover it. 00:27:29.477 [2024-12-08 02:29:56.930314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.930425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.930450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.477 qpair failed and we were unable to recover it. 00:27:29.477 [2024-12-08 02:29:56.930642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.930752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.930777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.477 qpair failed and we were unable to recover it. 00:27:29.477 [2024-12-08 02:29:56.930891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.931002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.931031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.477 qpair failed and we were unable to recover it. 00:27:29.477 [2024-12-08 02:29:56.931120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.931230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.931255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.477 qpair failed and we were unable to recover it. 00:27:29.477 [2024-12-08 02:29:56.931366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.931441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.931465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.477 qpair failed and we were unable to recover it. 00:27:29.477 [2024-12-08 02:29:56.931555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.931637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.931662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.477 qpair failed and we were unable to recover it. 00:27:29.477 [2024-12-08 02:29:56.931773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.931881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.931906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.477 qpair failed and we were unable to recover it. 00:27:29.477 [2024-12-08 02:29:56.932019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.932092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.932117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.477 qpair failed and we were unable to recover it. 00:27:29.477 [2024-12-08 02:29:56.932199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.932284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.932309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.477 qpair failed and we were unable to recover it. 00:27:29.477 [2024-12-08 02:29:56.932417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.477 [2024-12-08 02:29:56.932506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.932531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.478 qpair failed and we were unable to recover it. 00:27:29.478 [2024-12-08 02:29:56.932617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.932734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.932759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.478 qpair failed and we were unable to recover it. 00:27:29.478 [2024-12-08 02:29:56.932850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.932930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.932954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.478 qpair failed and we were unable to recover it. 00:27:29.478 [2024-12-08 02:29:56.933048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.933152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.933181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.478 qpair failed and we were unable to recover it. 00:27:29.478 [2024-12-08 02:29:56.933289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.933480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.933505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.478 qpair failed and we were unable to recover it. 00:27:29.478 [2024-12-08 02:29:56.933593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.933697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.933723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.478 qpair failed and we were unable to recover it. 00:27:29.478 [2024-12-08 02:29:56.933836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.933947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.933971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.478 qpair failed and we were unable to recover it. 00:27:29.478 [2024-12-08 02:29:56.934050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.934136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.934161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.478 qpair failed and we were unable to recover it. 00:27:29.478 [2024-12-08 02:29:56.934240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.934348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.934373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.478 qpair failed and we were unable to recover it. 00:27:29.478 [2024-12-08 02:29:56.934450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.934557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.934582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.478 qpair failed and we were unable to recover it. 00:27:29.478 [2024-12-08 02:29:56.934672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.934782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.934806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.478 qpair failed and we were unable to recover it. 00:27:29.478 [2024-12-08 02:29:56.934889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.935003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.935028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.478 qpair failed and we were unable to recover it. 00:27:29.478 [2024-12-08 02:29:56.935137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.935249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.935274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.478 qpair failed and we were unable to recover it. 00:27:29.478 [2024-12-08 02:29:56.935393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.935500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.935525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.478 qpair failed and we were unable to recover it. 00:27:29.478 [2024-12-08 02:29:56.935637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.935775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.935800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.478 qpair failed and we were unable to recover it. 00:27:29.478 [2024-12-08 02:29:56.935916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.935999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.936024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.478 qpair failed and we were unable to recover it. 00:27:29.478 [2024-12-08 02:29:56.936101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.936231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.936256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.478 qpair failed and we were unable to recover it. 00:27:29.478 [2024-12-08 02:29:56.936364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.936442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.936467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.478 qpair failed and we were unable to recover it. 00:27:29.478 [2024-12-08 02:29:56.936558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.936635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.936660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.478 qpair failed and we were unable to recover it. 00:27:29.478 [2024-12-08 02:29:56.936742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.936857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.936882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.478 qpair failed and we were unable to recover it. 00:27:29.478 [2024-12-08 02:29:56.936966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.937075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.937100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.478 qpair failed and we were unable to recover it. 00:27:29.478 [2024-12-08 02:29:56.937207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.937316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.937341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.478 qpair failed and we were unable to recover it. 00:27:29.478 [2024-12-08 02:29:56.937421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.937528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.937558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.478 qpair failed and we were unable to recover it. 00:27:29.478 [2024-12-08 02:29:56.937644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.937734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.937760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.478 qpair failed and we were unable to recover it. 00:27:29.478 [2024-12-08 02:29:56.937877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.937952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.937977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.478 qpair failed and we were unable to recover it. 00:27:29.478 [2024-12-08 02:29:56.938092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.938172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.938197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.478 qpair failed and we were unable to recover it. 00:27:29.478 [2024-12-08 02:29:56.938290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.938400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.938425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.478 qpair failed and we were unable to recover it. 00:27:29.478 [2024-12-08 02:29:56.938513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.938628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.938653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.478 qpair failed and we were unable to recover it. 00:27:29.478 [2024-12-08 02:29:56.938736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.938841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.938866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.478 qpair failed and we were unable to recover it. 00:27:29.478 [2024-12-08 02:29:56.938947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.478 [2024-12-08 02:29:56.939072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.939096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.479 qpair failed and we were unable to recover it. 00:27:29.479 [2024-12-08 02:29:56.939207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.939345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.939370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.479 qpair failed and we were unable to recover it. 00:27:29.479 [2024-12-08 02:29:56.939450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.939528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.939560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.479 qpair failed and we were unable to recover it. 00:27:29.479 [2024-12-08 02:29:56.939679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.939753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.939778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.479 qpair failed and we were unable to recover it. 00:27:29.479 [2024-12-08 02:29:56.939905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.940010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.940035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.479 qpair failed and we were unable to recover it. 00:27:29.479 [2024-12-08 02:29:56.940162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.940269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.940294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.479 qpair failed and we were unable to recover it. 00:27:29.479 [2024-12-08 02:29:56.940378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.940461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.940487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.479 qpair failed and we were unable to recover it. 00:27:29.479 [2024-12-08 02:29:56.940579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.940692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.940717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.479 qpair failed and we were unable to recover it. 00:27:29.479 [2024-12-08 02:29:56.940790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.940864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.940889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.479 qpair failed and we were unable to recover it. 00:27:29.479 [2024-12-08 02:29:56.940997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.941073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.941097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.479 qpair failed and we were unable to recover it. 00:27:29.479 [2024-12-08 02:29:56.941234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.941338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.941363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.479 qpair failed and we were unable to recover it. 00:27:29.479 [2024-12-08 02:29:56.941449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.941529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.941566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.479 qpair failed and we were unable to recover it. 00:27:29.479 [2024-12-08 02:29:56.941655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.941763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.941789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.479 qpair failed and we were unable to recover it. 00:27:29.479 [2024-12-08 02:29:56.941926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.942004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.942029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.479 qpair failed and we were unable to recover it. 00:27:29.479 [2024-12-08 02:29:56.942108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.942216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.942241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.479 qpair failed and we were unable to recover it. 00:27:29.479 [2024-12-08 02:29:56.942325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.942404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.942429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.479 qpair failed and we were unable to recover it. 00:27:29.479 [2024-12-08 02:29:56.942513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.942626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.942651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.479 qpair failed and we were unable to recover it. 00:27:29.479 [2024-12-08 02:29:56.942744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.942823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.942848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.479 qpair failed and we were unable to recover it. 00:27:29.479 [2024-12-08 02:29:56.942928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.943006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.943030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.479 qpair failed and we were unable to recover it. 00:27:29.479 [2024-12-08 02:29:56.943145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.943221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.943246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.479 qpair failed and we were unable to recover it. 00:27:29.479 [2024-12-08 02:29:56.943351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.943475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.943499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.479 qpair failed and we were unable to recover it. 00:27:29.479 [2024-12-08 02:29:56.943617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.943692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.943718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.479 qpair failed and we were unable to recover it. 00:27:29.479 [2024-12-08 02:29:56.943790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.943903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.943928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.479 qpair failed and we were unable to recover it. 00:27:29.479 [2024-12-08 02:29:56.944010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.944086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.944111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.479 qpair failed and we were unable to recover it. 00:27:29.479 [2024-12-08 02:29:56.944192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.944301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.944326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.479 qpair failed and we were unable to recover it. 00:27:29.479 [2024-12-08 02:29:56.944410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.944517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.479 [2024-12-08 02:29:56.944551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.480 qpair failed and we were unable to recover it. 00:27:29.480 [2024-12-08 02:29:56.944633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.944715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.944740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.480 qpair failed and we were unable to recover it. 00:27:29.480 [2024-12-08 02:29:56.944820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.944896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.944921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.480 qpair failed and we were unable to recover it. 00:27:29.480 [2024-12-08 02:29:56.945009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.945115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.945140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.480 qpair failed and we were unable to recover it. 00:27:29.480 [2024-12-08 02:29:56.945216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.945321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.945345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.480 qpair failed and we were unable to recover it. 00:27:29.480 [2024-12-08 02:29:56.945435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.945549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.945575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.480 qpair failed and we were unable to recover it. 00:27:29.480 [2024-12-08 02:29:56.945655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.945743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.945768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.480 qpair failed and we were unable to recover it. 00:27:29.480 [2024-12-08 02:29:56.945844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.945928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.945955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.480 qpair failed and we were unable to recover it. 00:27:29.480 [2024-12-08 02:29:56.946039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.946122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.946147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.480 qpair failed and we were unable to recover it. 00:27:29.480 [2024-12-08 02:29:56.946225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.946302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.946327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.480 qpair failed and we were unable to recover it. 00:27:29.480 [2024-12-08 02:29:56.946434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.946551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.946576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.480 qpair failed and we were unable to recover it. 00:27:29.480 [2024-12-08 02:29:56.946662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.946735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.946760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.480 qpair failed and we were unable to recover it. 00:27:29.480 [2024-12-08 02:29:56.946899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.946977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.947002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.480 qpair failed and we were unable to recover it. 00:27:29.480 [2024-12-08 02:29:56.947086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.947194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.947219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.480 qpair failed and we were unable to recover it. 00:27:29.480 [2024-12-08 02:29:56.947335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.947411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.947436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.480 qpair failed and we were unable to recover it. 00:27:29.480 [2024-12-08 02:29:56.947563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.947674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.947701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.480 qpair failed and we were unable to recover it. 00:27:29.480 [2024-12-08 02:29:56.947815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.947887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.947912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.480 qpair failed and we were unable to recover it. 00:27:29.480 [2024-12-08 02:29:56.947997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.948102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.948127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.480 qpair failed and we were unable to recover it. 00:27:29.480 [2024-12-08 02:29:56.948209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.948283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.948308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.480 qpair failed and we were unable to recover it. 00:27:29.480 [2024-12-08 02:29:56.948411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.948517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.948549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.480 qpair failed and we were unable to recover it. 00:27:29.480 [2024-12-08 02:29:56.948627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.948743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.948768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.480 qpair failed and we were unable to recover it. 00:27:29.480 [2024-12-08 02:29:56.948855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.948963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.948987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.480 qpair failed and we were unable to recover it. 00:27:29.480 [2024-12-08 02:29:56.949096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.949211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.949236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.480 qpair failed and we were unable to recover it. 00:27:29.480 [2024-12-08 02:29:56.949351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.949436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.949461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.480 qpair failed and we were unable to recover it. 00:27:29.480 [2024-12-08 02:29:56.949560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.949667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.949692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.480 qpair failed and we were unable to recover it. 00:27:29.480 [2024-12-08 02:29:56.949781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.949861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.949886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.480 qpair failed and we were unable to recover it. 00:27:29.480 [2024-12-08 02:29:56.949995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.950107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.950133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.480 qpair failed and we were unable to recover it. 00:27:29.480 [2024-12-08 02:29:56.950212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.950321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.950346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.480 qpair failed and we were unable to recover it. 00:27:29.480 [2024-12-08 02:29:56.950431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.950511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.950545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.480 qpair failed and we were unable to recover it. 00:27:29.480 [2024-12-08 02:29:56.950638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.480 [2024-12-08 02:29:56.950749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.950773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.481 qpair failed and we were unable to recover it. 00:27:29.481 [2024-12-08 02:29:56.950850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.950925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.950949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.481 qpair failed and we were unable to recover it. 00:27:29.481 [2024-12-08 02:29:56.951030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.951144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.951170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.481 qpair failed and we were unable to recover it. 00:27:29.481 [2024-12-08 02:29:56.951251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.951321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.951346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.481 qpair failed and we were unable to recover it. 00:27:29.481 [2024-12-08 02:29:56.951485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.951568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.951594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.481 qpair failed and we were unable to recover it. 00:27:29.481 [2024-12-08 02:29:56.951685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.951798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.951823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.481 qpair failed and we were unable to recover it. 00:27:29.481 [2024-12-08 02:29:56.951966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.952049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.952074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.481 qpair failed and we were unable to recover it. 00:27:29.481 [2024-12-08 02:29:56.952162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.952268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.952293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.481 qpair failed and we were unable to recover it. 00:27:29.481 [2024-12-08 02:29:56.952370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.952446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.952471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.481 qpair failed and we were unable to recover it. 00:27:29.481 [2024-12-08 02:29:56.952577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.952654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.952678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.481 qpair failed and we were unable to recover it. 00:27:29.481 [2024-12-08 02:29:56.952776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.952848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.952873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.481 qpair failed and we were unable to recover it. 00:27:29.481 [2024-12-08 02:29:56.952952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.953042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.953067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.481 qpair failed and we were unable to recover it. 00:27:29.481 [2024-12-08 02:29:56.953180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.953269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.953294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.481 qpair failed and we were unable to recover it. 00:27:29.481 [2024-12-08 02:29:56.953380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.953465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.953490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.481 qpair failed and we were unable to recover it. 00:27:29.481 [2024-12-08 02:29:56.953571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.953652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.953677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.481 qpair failed and we were unable to recover it. 00:27:29.481 [2024-12-08 02:29:56.953788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.953942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.953967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.481 qpair failed and we were unable to recover it. 00:27:29.481 [2024-12-08 02:29:56.954042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.954145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.954170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.481 qpair failed and we were unable to recover it. 00:27:29.481 [2024-12-08 02:29:56.954279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.954368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.954392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.481 qpair failed and we were unable to recover it. 00:27:29.481 [2024-12-08 02:29:56.954506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.954592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.954617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.481 qpair failed and we were unable to recover it. 00:27:29.481 [2024-12-08 02:29:56.954730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.954834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.954859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.481 qpair failed and we were unable to recover it. 00:27:29.481 [2024-12-08 02:29:56.954940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.955016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.955042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.481 qpair failed and we were unable to recover it. 00:27:29.481 [2024-12-08 02:29:56.955182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.955260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.955285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.481 qpair failed and we were unable to recover it. 00:27:29.481 [2024-12-08 02:29:56.955371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.955449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.955477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.481 qpair failed and we were unable to recover it. 00:27:29.481 [2024-12-08 02:29:56.955560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.955639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.955664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.481 qpair failed and we were unable to recover it. 00:27:29.481 [2024-12-08 02:29:56.955754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.955892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.955917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.481 qpair failed and we were unable to recover it. 00:27:29.481 [2024-12-08 02:29:56.955994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.956101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.956126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.481 qpair failed and we were unable to recover it. 00:27:29.481 [2024-12-08 02:29:56.956213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.956293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.956318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.481 qpair failed and we were unable to recover it. 00:27:29.481 [2024-12-08 02:29:56.956426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.956500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.956525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.481 qpair failed and we were unable to recover it. 00:27:29.481 [2024-12-08 02:29:56.956641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.481 [2024-12-08 02:29:56.956719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.956744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.482 qpair failed and we were unable to recover it. 00:27:29.482 [2024-12-08 02:29:56.956822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.956930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.956955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.482 qpair failed and we were unable to recover it. 00:27:29.482 [2024-12-08 02:29:56.957043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.957152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.957178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.482 qpair failed and we were unable to recover it. 00:27:29.482 [2024-12-08 02:29:56.957264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.957406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.957431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.482 qpair failed and we were unable to recover it. 00:27:29.482 [2024-12-08 02:29:56.957511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.957595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.957620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.482 qpair failed and we were unable to recover it. 00:27:29.482 [2024-12-08 02:29:56.957701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.957778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.957802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.482 qpair failed and we were unable to recover it. 00:27:29.482 [2024-12-08 02:29:56.957913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.958023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.958048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.482 qpair failed and we were unable to recover it. 00:27:29.482 [2024-12-08 02:29:56.958159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.958236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.958261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.482 qpair failed and we were unable to recover it. 00:27:29.482 [2024-12-08 02:29:56.958337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.958478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.958504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.482 qpair failed and we were unable to recover it. 00:27:29.482 [2024-12-08 02:29:56.958626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.958746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.958771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.482 qpair failed and we were unable to recover it. 00:27:29.482 [2024-12-08 02:29:56.958853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.958942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.958968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.482 qpair failed and we were unable to recover it. 00:27:29.482 [2024-12-08 02:29:56.959050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.959155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.959180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.482 qpair failed and we were unable to recover it. 00:27:29.482 [2024-12-08 02:29:56.959255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.959343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.959368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.482 qpair failed and we were unable to recover it. 00:27:29.482 [2024-12-08 02:29:56.959508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.959609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.959634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.482 qpair failed and we were unable to recover it. 00:27:29.482 [2024-12-08 02:29:56.959717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.959793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.959818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.482 qpair failed and we were unable to recover it. 00:27:29.482 [2024-12-08 02:29:56.959933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.960039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.960064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.482 qpair failed and we were unable to recover it. 00:27:29.482 [2024-12-08 02:29:56.960171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.960246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.960271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.482 qpair failed and we were unable to recover it. 00:27:29.482 [2024-12-08 02:29:56.960359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.960441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.960466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.482 qpair failed and we were unable to recover it. 00:27:29.482 [2024-12-08 02:29:56.960576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.960666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.960691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.482 qpair failed and we were unable to recover it. 00:27:29.482 [2024-12-08 02:29:56.960769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.960846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.960871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.482 qpair failed and we were unable to recover it. 00:27:29.482 [2024-12-08 02:29:56.960981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.961060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.961085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.482 qpair failed and we were unable to recover it. 00:27:29.482 [2024-12-08 02:29:56.961204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.961288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.961312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.482 qpair failed and we were unable to recover it. 00:27:29.482 [2024-12-08 02:29:56.961422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.961500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.961524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.482 qpair failed and we were unable to recover it. 00:27:29.482 [2024-12-08 02:29:56.961637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.961755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.961779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.482 qpair failed and we were unable to recover it. 00:27:29.482 [2024-12-08 02:29:56.961920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.962026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.962051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.482 qpair failed and we were unable to recover it. 00:27:29.482 [2024-12-08 02:29:56.962170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.962254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.962279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.482 qpair failed and we were unable to recover it. 00:27:29.482 [2024-12-08 02:29:56.962358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.962436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.962461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.482 qpair failed and we were unable to recover it. 00:27:29.482 [2024-12-08 02:29:56.962551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.962661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.962685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.482 qpair failed and we were unable to recover it. 00:27:29.482 [2024-12-08 02:29:56.962763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.962836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.482 [2024-12-08 02:29:56.962861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.482 qpair failed and we were unable to recover it. 00:27:29.483 [2024-12-08 02:29:56.962966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.963177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.963202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.483 qpair failed and we were unable to recover it. 00:27:29.483 [2024-12-08 02:29:56.963303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.963410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.963434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.483 qpair failed and we were unable to recover it. 00:27:29.483 [2024-12-08 02:29:56.963510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.963595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.963621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.483 qpair failed and we were unable to recover it. 00:27:29.483 [2024-12-08 02:29:56.963710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.963816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.963841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.483 qpair failed and we were unable to recover it. 00:27:29.483 [2024-12-08 02:29:56.963922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.964058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.964083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.483 qpair failed and we were unable to recover it. 00:27:29.483 [2024-12-08 02:29:56.964163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.964242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.964267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.483 qpair failed and we were unable to recover it. 00:27:29.483 [2024-12-08 02:29:56.964376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.964485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.964510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.483 qpair failed and we were unable to recover it. 00:27:29.483 [2024-12-08 02:29:56.964603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.964708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.964733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.483 qpair failed and we were unable to recover it. 00:27:29.483 [2024-12-08 02:29:56.964815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.964894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.964919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.483 qpair failed and we were unable to recover it. 00:27:29.483 [2024-12-08 02:29:56.964997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.965079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.965104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.483 qpair failed and we were unable to recover it. 00:27:29.483 [2024-12-08 02:29:56.965191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.965264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.965289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.483 qpair failed and we were unable to recover it. 00:27:29.483 [2024-12-08 02:29:56.965401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.965490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.965515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.483 qpair failed and we were unable to recover it. 00:27:29.483 [2024-12-08 02:29:56.965621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.965723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.965752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.483 qpair failed and we were unable to recover it. 00:27:29.483 [2024-12-08 02:29:56.965832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.965908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.965935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.483 qpair failed and we were unable to recover it. 00:27:29.483 [2024-12-08 02:29:56.966029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.966140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.966167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.483 qpair failed and we were unable to recover it. 00:27:29.483 [2024-12-08 02:29:56.966282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.966392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.966418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.483 qpair failed and we were unable to recover it. 00:27:29.483 [2024-12-08 02:29:56.966503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.966625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.966658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.483 qpair failed and we were unable to recover it. 00:27:29.483 [2024-12-08 02:29:56.966736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.966857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.966883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.483 qpair failed and we were unable to recover it. 00:27:29.483 [2024-12-08 02:29:56.966964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.967054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.967079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.483 qpair failed and we were unable to recover it. 00:27:29.483 [2024-12-08 02:29:56.967194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.967272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.967297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.483 qpair failed and we were unable to recover it. 00:27:29.483 [2024-12-08 02:29:56.967378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.967457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.967483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.483 qpair failed and we were unable to recover it. 00:27:29.483 [2024-12-08 02:29:56.967601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.967683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.967708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.483 qpair failed and we were unable to recover it. 00:27:29.483 [2024-12-08 02:29:56.967825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.967915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.967941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.483 qpair failed and we were unable to recover it. 00:27:29.483 [2024-12-08 02:29:56.968023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.968102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.968127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.483 qpair failed and we were unable to recover it. 00:27:29.483 [2024-12-08 02:29:56.968211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.968337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.968363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.483 qpair failed and we were unable to recover it. 00:27:29.483 [2024-12-08 02:29:56.968447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.968527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.968560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.483 qpair failed and we were unable to recover it. 00:27:29.483 [2024-12-08 02:29:56.968671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.968750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.968780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.483 qpair failed and we were unable to recover it. 00:27:29.483 [2024-12-08 02:29:56.968861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.968972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.483 [2024-12-08 02:29:56.968997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.483 qpair failed and we were unable to recover it. 00:27:29.483 [2024-12-08 02:29:56.969081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.969167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.969192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.484 qpair failed and we were unable to recover it. 00:27:29.484 [2024-12-08 02:29:56.969273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.969394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.969419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.484 qpair failed and we were unable to recover it. 00:27:29.484 [2024-12-08 02:29:56.969499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.969640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.969667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.484 qpair failed and we were unable to recover it. 00:27:29.484 [2024-12-08 02:29:56.969779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.969857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.969882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.484 qpair failed and we were unable to recover it. 00:27:29.484 [2024-12-08 02:29:56.969960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.970034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.970059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.484 qpair failed and we were unable to recover it. 00:27:29.484 [2024-12-08 02:29:56.970141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.970217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.970244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.484 qpair failed and we were unable to recover it. 00:27:29.484 [2024-12-08 02:29:56.970324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.970403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.970429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.484 qpair failed and we were unable to recover it. 00:27:29.484 [2024-12-08 02:29:56.970506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.970599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.970627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.484 qpair failed and we were unable to recover it. 00:27:29.484 [2024-12-08 02:29:56.970718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.970828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.970855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.484 qpair failed and we were unable to recover it. 00:27:29.484 [2024-12-08 02:29:56.970942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.971025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.971051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.484 qpair failed and we were unable to recover it. 00:27:29.484 [2024-12-08 02:29:56.971165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.971248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.971273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.484 qpair failed and we were unable to recover it. 00:27:29.484 [2024-12-08 02:29:56.971358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.971472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.971497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.484 qpair failed and we were unable to recover it. 00:27:29.484 [2024-12-08 02:29:56.971585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.971672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.971697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.484 qpair failed and we were unable to recover it. 00:27:29.484 [2024-12-08 02:29:56.971777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.971898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.971924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.484 qpair failed and we were unable to recover it. 00:27:29.484 [2024-12-08 02:29:56.972036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.972120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.972146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.484 qpair failed and we were unable to recover it. 00:27:29.484 [2024-12-08 02:29:56.972231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.972305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.972330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.484 qpair failed and we were unable to recover it. 00:27:29.484 [2024-12-08 02:29:56.972416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.972528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.972562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.484 qpair failed and we were unable to recover it. 00:27:29.484 [2024-12-08 02:29:56.972680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.972764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.972789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.484 qpair failed and we were unable to recover it. 00:27:29.484 [2024-12-08 02:29:56.972874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.972961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.972986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.484 qpair failed and we were unable to recover it. 00:27:29.484 [2024-12-08 02:29:56.973079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.973185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.973210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.484 qpair failed and we were unable to recover it. 00:27:29.484 [2024-12-08 02:29:56.973287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.973363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.973388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.484 qpair failed and we were unable to recover it. 00:27:29.484 [2024-12-08 02:29:56.973461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.973574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.973599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.484 qpair failed and we were unable to recover it. 00:27:29.484 [2024-12-08 02:29:56.973682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.973764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.973789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.484 qpair failed and we were unable to recover it. 00:27:29.484 [2024-12-08 02:29:56.973899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.974011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.974036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.484 qpair failed and we were unable to recover it. 00:27:29.484 [2024-12-08 02:29:56.974113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.974228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.484 [2024-12-08 02:29:56.974252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.485 qpair failed and we were unable to recover it. 00:27:29.485 [2024-12-08 02:29:56.974331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.974408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.974433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.485 qpair failed and we were unable to recover it. 00:27:29.485 [2024-12-08 02:29:56.974513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.974596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.974621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.485 qpair failed and we were unable to recover it. 00:27:29.485 [2024-12-08 02:29:56.974731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.974806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.974831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.485 qpair failed and we were unable to recover it. 00:27:29.485 [2024-12-08 02:29:56.974906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.975008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.975033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.485 qpair failed and we were unable to recover it. 00:27:29.485 [2024-12-08 02:29:56.975150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.975262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.975287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.485 qpair failed and we were unable to recover it. 00:27:29.485 [2024-12-08 02:29:56.975398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.975475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.975499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.485 qpair failed and we were unable to recover it. 00:27:29.485 [2024-12-08 02:29:56.975583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.975667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.975692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.485 qpair failed and we were unable to recover it. 00:27:29.485 [2024-12-08 02:29:56.975887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.975965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.975990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.485 qpair failed and we were unable to recover it. 00:27:29.485 [2024-12-08 02:29:56.976093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.976243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.976268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.485 qpair failed and we were unable to recover it. 00:27:29.485 [2024-12-08 02:29:56.976355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.976459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.976484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.485 qpair failed and we were unable to recover it. 00:27:29.485 [2024-12-08 02:29:56.976608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.976696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.976722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.485 qpair failed and we were unable to recover it. 00:27:29.485 [2024-12-08 02:29:56.976833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.976945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.976971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.485 qpair failed and we were unable to recover it. 00:27:29.485 [2024-12-08 02:29:56.977063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.977134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.977160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.485 qpair failed and we were unable to recover it. 00:27:29.485 [2024-12-08 02:29:56.977245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.977349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.977375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.485 qpair failed and we were unable to recover it. 00:27:29.485 [2024-12-08 02:29:56.977462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.977574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.977601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.485 qpair failed and we were unable to recover it. 00:27:29.485 [2024-12-08 02:29:56.977719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.977803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.977830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.485 qpair failed and we were unable to recover it. 00:27:29.485 [2024-12-08 02:29:56.977940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.978020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.978046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.485 qpair failed and we were unable to recover it. 00:27:29.485 [2024-12-08 02:29:56.978133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.978208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.978234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.485 qpair failed and we were unable to recover it. 00:27:29.485 [2024-12-08 02:29:56.978351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.978441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.978467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.485 qpair failed and we were unable to recover it. 00:27:29.485 [2024-12-08 02:29:56.978560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.978639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.978664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.485 qpair failed and we were unable to recover it. 00:27:29.485 [2024-12-08 02:29:56.978752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.978864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.978889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.485 qpair failed and we were unable to recover it. 00:27:29.485 [2024-12-08 02:29:56.978977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.979050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.979075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.485 qpair failed and we were unable to recover it. 00:27:29.485 [2024-12-08 02:29:56.979162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.979248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.979272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.485 qpair failed and we were unable to recover it. 00:27:29.485 [2024-12-08 02:29:56.979346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.979419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.979444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.485 qpair failed and we were unable to recover it. 00:27:29.485 [2024-12-08 02:29:56.979553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.979648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.979674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.485 qpair failed and we were unable to recover it. 00:27:29.485 [2024-12-08 02:29:56.979759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.979867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.979893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.485 qpair failed and we were unable to recover it. 00:27:29.485 [2024-12-08 02:29:56.980010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.980095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.980121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.485 qpair failed and we were unable to recover it. 00:27:29.485 [2024-12-08 02:29:56.980199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.980290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.485 [2024-12-08 02:29:56.980317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.485 qpair failed and we were unable to recover it. 00:27:29.485 [2024-12-08 02:29:56.980393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.980474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.980500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.486 qpair failed and we were unable to recover it. 00:27:29.486 [2024-12-08 02:29:56.980613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.980691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.980716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.486 qpair failed and we were unable to recover it. 00:27:29.486 [2024-12-08 02:29:56.980801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.980919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.980945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.486 qpair failed and we were unable to recover it. 00:27:29.486 [2024-12-08 02:29:56.981027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.981108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.981135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.486 qpair failed and we were unable to recover it. 00:27:29.486 [2024-12-08 02:29:56.981279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.981358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.981384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.486 qpair failed and we were unable to recover it. 00:27:29.486 [2024-12-08 02:29:56.981462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.981575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.981602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.486 qpair failed and we were unable to recover it. 00:27:29.486 [2024-12-08 02:29:56.981741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.981823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.981849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.486 qpair failed and we were unable to recover it. 00:27:29.486 [2024-12-08 02:29:56.981938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.982029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.982054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.486 qpair failed and we were unable to recover it. 00:27:29.486 [2024-12-08 02:29:56.982139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.982217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.982242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.486 qpair failed and we were unable to recover it. 00:27:29.486 [2024-12-08 02:29:56.982329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.982409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.982435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.486 qpair failed and we were unable to recover it. 00:27:29.486 [2024-12-08 02:29:56.982511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.982602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.982628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.486 qpair failed and we were unable to recover it. 00:27:29.486 [2024-12-08 02:29:56.982706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.982786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.982811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.486 qpair failed and we were unable to recover it. 00:27:29.486 [2024-12-08 02:29:56.982920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.982997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.983022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.486 qpair failed and we were unable to recover it. 00:27:29.486 [2024-12-08 02:29:56.983160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.983277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.983302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.486 qpair failed and we were unable to recover it. 00:27:29.486 [2024-12-08 02:29:56.983377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.983455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.983480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.486 qpair failed and we were unable to recover it. 00:27:29.486 [2024-12-08 02:29:56.983590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.983668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.983694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.486 qpair failed and we were unable to recover it. 00:27:29.486 [2024-12-08 02:29:56.983785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.983889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.983918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.486 qpair failed and we were unable to recover it. 00:27:29.486 [2024-12-08 02:29:56.984009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.984113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.984138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.486 qpair failed and we were unable to recover it. 00:27:29.486 [2024-12-08 02:29:56.984217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.984321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.984347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.486 qpair failed and we were unable to recover it. 00:27:29.486 [2024-12-08 02:29:56.984435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.984515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.984546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.486 qpair failed and we were unable to recover it. 00:27:29.486 [2024-12-08 02:29:56.984624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.984710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.984734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.486 qpair failed and we were unable to recover it. 00:27:29.486 [2024-12-08 02:29:56.984817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.984893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.984919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.486 qpair failed and we were unable to recover it. 00:27:29.486 [2024-12-08 02:29:56.984993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.985070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.985094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.486 qpair failed and we were unable to recover it. 00:27:29.486 [2024-12-08 02:29:56.985183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.985261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.985286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.486 qpair failed and we were unable to recover it. 00:27:29.486 [2024-12-08 02:29:56.985424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.985531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.985570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.486 qpair failed and we were unable to recover it. 00:27:29.486 [2024-12-08 02:29:56.985686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.985760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.985785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.486 qpair failed and we were unable to recover it. 00:27:29.486 [2024-12-08 02:29:56.985892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.985970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.985995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.486 qpair failed and we were unable to recover it. 00:27:29.486 [2024-12-08 02:29:56.986114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.986228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.986254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.486 qpair failed and we were unable to recover it. 00:27:29.486 [2024-12-08 02:29:56.986342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.486 [2024-12-08 02:29:56.986457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.986482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.487 qpair failed and we were unable to recover it. 00:27:29.487 [2024-12-08 02:29:56.986569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.986679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.986704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.487 qpair failed and we were unable to recover it. 00:27:29.487 [2024-12-08 02:29:56.986791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.986869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.986894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.487 qpair failed and we were unable to recover it. 00:27:29.487 [2024-12-08 02:29:56.987009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.987099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.987125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.487 qpair failed and we were unable to recover it. 00:27:29.487 [2024-12-08 02:29:56.987204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.987316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.987341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.487 qpair failed and we were unable to recover it. 00:27:29.487 [2024-12-08 02:29:56.987432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.987545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.987571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.487 qpair failed and we were unable to recover it. 00:27:29.487 [2024-12-08 02:29:56.987653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.987732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.987757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.487 qpair failed and we were unable to recover it. 00:27:29.487 [2024-12-08 02:29:56.987847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.987958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.987983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.487 qpair failed and we were unable to recover it. 00:27:29.487 [2024-12-08 02:29:56.988097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.988171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.988196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.487 qpair failed and we were unable to recover it. 00:27:29.487 [2024-12-08 02:29:56.988316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.988430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.988456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.487 qpair failed and we were unable to recover it. 00:27:29.487 [2024-12-08 02:29:56.988573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.988718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.988743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.487 qpair failed and we were unable to recover it. 00:27:29.487 [2024-12-08 02:29:56.988853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.988962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.988987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.487 qpair failed and we were unable to recover it. 00:27:29.487 [2024-12-08 02:29:56.989125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.989234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.989259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.487 qpair failed and we were unable to recover it. 00:27:29.487 [2024-12-08 02:29:56.989337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.989410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.989434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.487 qpair failed and we were unable to recover it. 00:27:29.487 [2024-12-08 02:29:56.989519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.989605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.989632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.487 qpair failed and we were unable to recover it. 00:27:29.487 [2024-12-08 02:29:56.989713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.989799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.989825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.487 qpair failed and we were unable to recover it. 00:27:29.487 [2024-12-08 02:29:56.989933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.990016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.990043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.487 qpair failed and we were unable to recover it. 00:27:29.487 [2024-12-08 02:29:56.990147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.990258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.990283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.487 qpair failed and we were unable to recover it. 00:27:29.487 [2024-12-08 02:29:56.990397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.990471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.990496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.487 qpair failed and we were unable to recover it. 00:27:29.487 [2024-12-08 02:29:56.990627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.990738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.990764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.487 qpair failed and we were unable to recover it. 00:27:29.487 [2024-12-08 02:29:56.990877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.990954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.990980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.487 qpair failed and we were unable to recover it. 00:27:29.487 [2024-12-08 02:29:56.991094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.991209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.991234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.487 qpair failed and we were unable to recover it. 00:27:29.487 [2024-12-08 02:29:56.991313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.991393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.991420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.487 qpair failed and we were unable to recover it. 00:27:29.487 [2024-12-08 02:29:56.991508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.991652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.991678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.487 qpair failed and we were unable to recover it. 00:27:29.487 [2024-12-08 02:29:56.991790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.991876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.991901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.487 qpair failed and we were unable to recover it. 00:27:29.487 [2024-12-08 02:29:56.992005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.992080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.992105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.487 qpair failed and we were unable to recover it. 00:27:29.487 [2024-12-08 02:29:56.992213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.992291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.992317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.487 qpair failed and we were unable to recover it. 00:27:29.487 [2024-12-08 02:29:56.992394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.992507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.992532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.487 qpair failed and we were unable to recover it. 00:27:29.487 [2024-12-08 02:29:56.992625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.992703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.992728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.487 qpair failed and we were unable to recover it. 00:27:29.487 [2024-12-08 02:29:56.992815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.487 [2024-12-08 02:29:56.992931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.992957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.488 qpair failed and we were unable to recover it. 00:27:29.488 [2024-12-08 02:29:56.993069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.993148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.993173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.488 qpair failed and we were unable to recover it. 00:27:29.488 [2024-12-08 02:29:56.993256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.993346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.993372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.488 qpair failed and we were unable to recover it. 00:27:29.488 [2024-12-08 02:29:56.993489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.993604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.993630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.488 qpair failed and we were unable to recover it. 00:27:29.488 [2024-12-08 02:29:56.993749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.993853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.993878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.488 qpair failed and we were unable to recover it. 00:27:29.488 [2024-12-08 02:29:56.993956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.994040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.994066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.488 qpair failed and we were unable to recover it. 00:27:29.488 [2024-12-08 02:29:56.994175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.994262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.994289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.488 qpair failed and we were unable to recover it. 00:27:29.488 [2024-12-08 02:29:56.994400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.994490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.994517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.488 qpair failed and we were unable to recover it. 00:27:29.488 [2024-12-08 02:29:56.994669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.994756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.994781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.488 qpair failed and we were unable to recover it. 00:27:29.488 [2024-12-08 02:29:56.994865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.994976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.995002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.488 qpair failed and we were unable to recover it. 00:27:29.488 [2024-12-08 02:29:56.995086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.995228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.995254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.488 qpair failed and we were unable to recover it. 00:27:29.488 [2024-12-08 02:29:56.995335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.995447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.995473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.488 qpair failed and we were unable to recover it. 00:27:29.488 [2024-12-08 02:29:56.995566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.995680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.995706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.488 qpair failed and we were unable to recover it. 00:27:29.488 [2024-12-08 02:29:56.995797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.995883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.995910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.488 qpair failed and we were unable to recover it. 00:27:29.488 [2024-12-08 02:29:56.996004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.996089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.996114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.488 qpair failed and we were unable to recover it. 00:27:29.488 [2024-12-08 02:29:56.996195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.996272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.996298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.488 qpair failed and we were unable to recover it. 00:27:29.488 [2024-12-08 02:29:56.996380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.996519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.996550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.488 qpair failed and we were unable to recover it. 00:27:29.488 [2024-12-08 02:29:56.996643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.996718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.996743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.488 qpair failed and we were unable to recover it. 00:27:29.488 [2024-12-08 02:29:56.996828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.996905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.996930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.488 qpair failed and we were unable to recover it. 00:27:29.488 [2024-12-08 02:29:56.997043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.997129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.997155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.488 qpair failed and we were unable to recover it. 00:27:29.488 [2024-12-08 02:29:56.997232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.997343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.997369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.488 qpair failed and we were unable to recover it. 00:27:29.488 [2024-12-08 02:29:56.997450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.997528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.997562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.488 qpair failed and we were unable to recover it. 00:27:29.488 [2024-12-08 02:29:56.997643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.997756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.997782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.488 qpair failed and we were unable to recover it. 00:27:29.488 [2024-12-08 02:29:56.997870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.997947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.997972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.488 qpair failed and we were unable to recover it. 00:27:29.488 [2024-12-08 02:29:56.998056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.998163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.998188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.488 qpair failed and we were unable to recover it. 00:27:29.488 [2024-12-08 02:29:56.998276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.998363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.488 [2024-12-08 02:29:56.998388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.488 qpair failed and we were unable to recover it. 00:27:29.489 [2024-12-08 02:29:56.998468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:56.998549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:56.998576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.489 qpair failed and we were unable to recover it. 00:27:29.489 [2024-12-08 02:29:56.998655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:56.998765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:56.998791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.489 qpair failed and we were unable to recover it. 00:27:29.489 [2024-12-08 02:29:56.998902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:56.998983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:56.999008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.489 qpair failed and we were unable to recover it. 00:27:29.489 [2024-12-08 02:29:56.999117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:56.999198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:56.999224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.489 qpair failed and we were unable to recover it. 00:27:29.489 [2024-12-08 02:29:56.999335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:56.999425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:56.999451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.489 qpair failed and we were unable to recover it. 00:27:29.489 [2024-12-08 02:29:56.999573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:56.999685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:56.999712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.489 qpair failed and we were unable to recover it. 00:27:29.489 [2024-12-08 02:29:56.999789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:56.999875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:56.999900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.489 qpair failed and we were unable to recover it. 00:27:29.489 [2024-12-08 02:29:57.000013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.000086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.000112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.489 qpair failed and we were unable to recover it. 00:27:29.489 [2024-12-08 02:29:57.000254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.000367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.000392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.489 qpair failed and we were unable to recover it. 00:27:29.489 [2024-12-08 02:29:57.000504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.000599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.000624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.489 qpair failed and we were unable to recover it. 00:27:29.489 [2024-12-08 02:29:57.000715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.000789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.000814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.489 qpair failed and we were unable to recover it. 00:27:29.489 [2024-12-08 02:29:57.000926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.001002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.001026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.489 qpair failed and we were unable to recover it. 00:27:29.489 [2024-12-08 02:29:57.001107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.001183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.001208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.489 qpair failed and we were unable to recover it. 00:27:29.489 [2024-12-08 02:29:57.001317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.001402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.001427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.489 qpair failed and we were unable to recover it. 00:27:29.489 [2024-12-08 02:29:57.001540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.001617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.001647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.489 qpair failed and we were unable to recover it. 00:27:29.489 [2024-12-08 02:29:57.001758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.001850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.001875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.489 qpair failed and we were unable to recover it. 00:27:29.489 [2024-12-08 02:29:57.001970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.002073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.002098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.489 qpair failed and we were unable to recover it. 00:27:29.489 [2024-12-08 02:29:57.002179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.002289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.002314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.489 qpair failed and we were unable to recover it. 00:27:29.489 [2024-12-08 02:29:57.002431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.002513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.002552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.489 qpair failed and we were unable to recover it. 00:27:29.489 [2024-12-08 02:29:57.002636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.002747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.002772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.489 qpair failed and we were unable to recover it. 00:27:29.489 [2024-12-08 02:29:57.002848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.002921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.002946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.489 qpair failed and we were unable to recover it. 00:27:29.489 [2024-12-08 02:29:57.003025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.003139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.003164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.489 qpair failed and we were unable to recover it. 00:27:29.489 [2024-12-08 02:29:57.003241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.003368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.003393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.489 qpair failed and we were unable to recover it. 00:27:29.489 [2024-12-08 02:29:57.003500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.003615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.003641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.489 qpair failed and we were unable to recover it. 00:27:29.489 [2024-12-08 02:29:57.003721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.003844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.003873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.489 qpair failed and we were unable to recover it. 00:27:29.489 [2024-12-08 02:29:57.003954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.004058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.004084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.489 qpair failed and we were unable to recover it. 00:27:29.489 [2024-12-08 02:29:57.004160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.004268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.004293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.489 qpair failed and we were unable to recover it. 00:27:29.489 [2024-12-08 02:29:57.004377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.004460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.489 [2024-12-08 02:29:57.004485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.489 qpair failed and we were unable to recover it. 00:27:29.489 [2024-12-08 02:29:57.004629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.004713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.004738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.490 qpair failed and we were unable to recover it. 00:27:29.490 [2024-12-08 02:29:57.004824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.004897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.004922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.490 qpair failed and we were unable to recover it. 00:27:29.490 [2024-12-08 02:29:57.005002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.005140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.005164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.490 qpair failed and we were unable to recover it. 00:27:29.490 [2024-12-08 02:29:57.005275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.005351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.005376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.490 qpair failed and we were unable to recover it. 00:27:29.490 [2024-12-08 02:29:57.005482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.005565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.005590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.490 qpair failed and we were unable to recover it. 00:27:29.490 [2024-12-08 02:29:57.005673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.005747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.005772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.490 qpair failed and we were unable to recover it. 00:27:29.490 [2024-12-08 02:29:57.005880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.005959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.005985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.490 qpair failed and we were unable to recover it. 00:27:29.490 [2024-12-08 02:29:57.006096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.006174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.006199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.490 qpair failed and we were unable to recover it. 00:27:29.490 [2024-12-08 02:29:57.006278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.006384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.006409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.490 qpair failed and we were unable to recover it. 00:27:29.490 [2024-12-08 02:29:57.006496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.006583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.006609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.490 qpair failed and we were unable to recover it. 00:27:29.490 [2024-12-08 02:29:57.006716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.006799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.006823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.490 qpair failed and we were unable to recover it. 00:27:29.490 [2024-12-08 02:29:57.006908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.007026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.007051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.490 qpair failed and we were unable to recover it. 00:27:29.490 [2024-12-08 02:29:57.007161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.007275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.007300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.490 qpair failed and we were unable to recover it. 00:27:29.490 [2024-12-08 02:29:57.007373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.007448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.007473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.490 qpair failed and we were unable to recover it. 00:27:29.490 [2024-12-08 02:29:57.007567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.007648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.007673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.490 qpair failed and we were unable to recover it. 00:27:29.490 [2024-12-08 02:29:57.007781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.007858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.007883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.490 qpair failed and we were unable to recover it. 00:27:29.490 [2024-12-08 02:29:57.007958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.008061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.008086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.490 qpair failed and we were unable to recover it. 00:27:29.490 [2024-12-08 02:29:57.008176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.008293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.008318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.490 qpair failed and we were unable to recover it. 00:27:29.490 [2024-12-08 02:29:57.008394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.008471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.008496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.490 qpair failed and we were unable to recover it. 00:27:29.490 [2024-12-08 02:29:57.008646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.008729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.008753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.490 qpair failed and we were unable to recover it. 00:27:29.490 [2024-12-08 02:29:57.008836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.008913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.008937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.490 qpair failed and we were unable to recover it. 00:27:29.490 [2024-12-08 02:29:57.009020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.009128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.009154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.490 qpair failed and we were unable to recover it. 00:27:29.490 [2024-12-08 02:29:57.009258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.009341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.009370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.490 qpair failed and we were unable to recover it. 00:27:29.490 [2024-12-08 02:29:57.009456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.009564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.009590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.490 qpair failed and we were unable to recover it. 00:27:29.490 [2024-12-08 02:29:57.009711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.009794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.009819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.490 qpair failed and we were unable to recover it. 00:27:29.490 [2024-12-08 02:29:57.009904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.009984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.010009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.490 qpair failed and we were unable to recover it. 00:27:29.490 [2024-12-08 02:29:57.010091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.010197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.010222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.490 qpair failed and we were unable to recover it. 00:27:29.490 [2024-12-08 02:29:57.010297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.010438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.010463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.490 qpair failed and we were unable to recover it. 00:27:29.490 [2024-12-08 02:29:57.010550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.010639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.490 [2024-12-08 02:29:57.010664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.491 qpair failed and we were unable to recover it. 00:27:29.491 [2024-12-08 02:29:57.010741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.010845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.010870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.491 qpair failed and we were unable to recover it. 00:27:29.491 [2024-12-08 02:29:57.010952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.011030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.011055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.491 qpair failed and we were unable to recover it. 00:27:29.491 [2024-12-08 02:29:57.011142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.011217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.011242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.491 qpair failed and we were unable to recover it. 00:27:29.491 [2024-12-08 02:29:57.011331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.011434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.011459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.491 qpair failed and we were unable to recover it. 00:27:29.491 [2024-12-08 02:29:57.011569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.011705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.011735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.491 qpair failed and we were unable to recover it. 00:27:29.491 [2024-12-08 02:29:57.011849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.011932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.011958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.491 qpair failed and we were unable to recover it. 00:27:29.491 [2024-12-08 02:29:57.012046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.012129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.012156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.491 qpair failed and we were unable to recover it. 00:27:29.491 [2024-12-08 02:29:57.012233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.012313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.012339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.491 qpair failed and we were unable to recover it. 00:27:29.491 [2024-12-08 02:29:57.012450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.012533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.012565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.491 qpair failed and we were unable to recover it. 00:27:29.491 [2024-12-08 02:29:57.012662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.012744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.012769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.491 qpair failed and we were unable to recover it. 00:27:29.491 [2024-12-08 02:29:57.012886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.012995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.013020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.491 qpair failed and we were unable to recover it. 00:27:29.491 [2024-12-08 02:29:57.013134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.013250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.013276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.491 qpair failed and we were unable to recover it. 00:27:29.491 [2024-12-08 02:29:57.013367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.013446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.013472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.491 qpair failed and we were unable to recover it. 00:27:29.491 [2024-12-08 02:29:57.013555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.013636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.013662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.491 qpair failed and we were unable to recover it. 00:27:29.491 [2024-12-08 02:29:57.013804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.013887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.013912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.491 qpair failed and we were unable to recover it. 00:27:29.491 [2024-12-08 02:29:57.014002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.014085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.014112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.491 qpair failed and we were unable to recover it. 00:27:29.491 [2024-12-08 02:29:57.014190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.014307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.014334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.491 qpair failed and we were unable to recover it. 00:27:29.491 [2024-12-08 02:29:57.014419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.014531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.014566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.491 qpair failed and we were unable to recover it. 00:27:29.491 [2024-12-08 02:29:57.014650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.014740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.014765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.491 qpair failed and we were unable to recover it. 00:27:29.491 [2024-12-08 02:29:57.014850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.014963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.014988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.491 qpair failed and we were unable to recover it. 00:27:29.491 [2024-12-08 02:29:57.015074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.015182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.015207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.491 qpair failed and we were unable to recover it. 00:27:29.491 [2024-12-08 02:29:57.015311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.015387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.015411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.491 qpair failed and we were unable to recover it. 00:27:29.491 [2024-12-08 02:29:57.015529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.015611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.015636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.491 qpair failed and we were unable to recover it. 00:27:29.491 [2024-12-08 02:29:57.015717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.015790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.015815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.491 qpair failed and we were unable to recover it. 00:27:29.491 [2024-12-08 02:29:57.015926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.016004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.016030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.491 qpair failed and we were unable to recover it. 00:27:29.491 [2024-12-08 02:29:57.016116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.016191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.016217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.491 qpair failed and we were unable to recover it. 00:27:29.491 [2024-12-08 02:29:57.016293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.016398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.016423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.491 qpair failed and we were unable to recover it. 00:27:29.491 [2024-12-08 02:29:57.016533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.016625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.016650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.491 qpair failed and we were unable to recover it. 00:27:29.491 [2024-12-08 02:29:57.016731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.491 [2024-12-08 02:29:57.016858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.016888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.492 qpair failed and we were unable to recover it. 00:27:29.492 [2024-12-08 02:29:57.017006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.017113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.017138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.492 qpair failed and we were unable to recover it. 00:27:29.492 [2024-12-08 02:29:57.017214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.017322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.017347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.492 qpair failed and we were unable to recover it. 00:27:29.492 [2024-12-08 02:29:57.017430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.017515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.017548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.492 qpair failed and we were unable to recover it. 00:27:29.492 [2024-12-08 02:29:57.017633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.017716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.017743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.492 qpair failed and we were unable to recover it. 00:27:29.492 [2024-12-08 02:29:57.017854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.017961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.017987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.492 qpair failed and we were unable to recover it. 00:27:29.492 [2024-12-08 02:29:57.018070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.018150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.018176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.492 qpair failed and we were unable to recover it. 00:27:29.492 [2024-12-08 02:29:57.018281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.018369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.018395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.492 qpair failed and we were unable to recover it. 00:27:29.492 [2024-12-08 02:29:57.018482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.018622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.018648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.492 qpair failed and we were unable to recover it. 00:27:29.492 [2024-12-08 02:29:57.018729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.018841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.018867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.492 qpair failed and we were unable to recover it. 00:27:29.492 [2024-12-08 02:29:57.018984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.019099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.019124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.492 qpair failed and we were unable to recover it. 00:27:29.492 [2024-12-08 02:29:57.019209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.019286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.019312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.492 qpair failed and we were unable to recover it. 00:27:29.492 [2024-12-08 02:29:57.019427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.019505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.019531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.492 qpair failed and we were unable to recover it. 00:27:29.492 [2024-12-08 02:29:57.019625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.019739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.019764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.492 qpair failed and we were unable to recover it. 00:27:29.492 [2024-12-08 02:29:57.019845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.019925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.019949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.492 qpair failed and we were unable to recover it. 00:27:29.492 [2024-12-08 02:29:57.020090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.020175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.020200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.492 qpair failed and we were unable to recover it. 00:27:29.492 [2024-12-08 02:29:57.020311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.020389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.020414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.492 qpair failed and we were unable to recover it. 00:27:29.492 [2024-12-08 02:29:57.020498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.020613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.020638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.492 qpair failed and we were unable to recover it. 00:27:29.492 [2024-12-08 02:29:57.020720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.020828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.020853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.492 qpair failed and we were unable to recover it. 00:27:29.492 [2024-12-08 02:29:57.020929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.021015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.021039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.492 qpair failed and we were unable to recover it. 00:27:29.492 [2024-12-08 02:29:57.021155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.021231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.021257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.492 qpair failed and we were unable to recover it. 00:27:29.492 [2024-12-08 02:29:57.021348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.021455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.021481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.492 qpair failed and we were unable to recover it. 00:27:29.492 [2024-12-08 02:29:57.021594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.021671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.021697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.492 qpair failed and we were unable to recover it. 00:27:29.492 [2024-12-08 02:29:57.021811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.021903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.021929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.492 qpair failed and we were unable to recover it. 00:27:29.492 [2024-12-08 02:29:57.022019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.022131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.022159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.492 qpair failed and we were unable to recover it. 00:27:29.492 [2024-12-08 02:29:57.022266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.022344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.022369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.492 qpair failed and we were unable to recover it. 00:27:29.492 [2024-12-08 02:29:57.022449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.022563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.022590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.492 qpair failed and we were unable to recover it. 00:27:29.492 [2024-12-08 02:29:57.022682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.022805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.022830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.492 qpair failed and we were unable to recover it. 00:27:29.492 [2024-12-08 02:29:57.022915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.492 [2024-12-08 02:29:57.023026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.023052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.493 qpair failed and we were unable to recover it. 00:27:29.493 [2024-12-08 02:29:57.023137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.023267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.023293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.493 qpair failed and we were unable to recover it. 00:27:29.493 [2024-12-08 02:29:57.023374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.023454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.023481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.493 qpair failed and we were unable to recover it. 00:27:29.493 [2024-12-08 02:29:57.023615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.023722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.023748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.493 qpair failed and we were unable to recover it. 00:27:29.493 [2024-12-08 02:29:57.023857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.023935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.023960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.493 qpair failed and we were unable to recover it. 00:27:29.493 [2024-12-08 02:29:57.024075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.024186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.024212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.493 qpair failed and we were unable to recover it. 00:27:29.493 [2024-12-08 02:29:57.024294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.024407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.024434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.493 qpair failed and we were unable to recover it. 00:27:29.493 [2024-12-08 02:29:57.024547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.024635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.024661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.493 qpair failed and we were unable to recover it. 00:27:29.493 [2024-12-08 02:29:57.024743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.024856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.024881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.493 qpair failed and we were unable to recover it. 00:27:29.493 [2024-12-08 02:29:57.024991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.025081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.025106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.493 qpair failed and we were unable to recover it. 00:27:29.493 [2024-12-08 02:29:57.025186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.025269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.025295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.493 qpair failed and we were unable to recover it. 00:27:29.493 [2024-12-08 02:29:57.025410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.025525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.025556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.493 qpair failed and we were unable to recover it. 00:27:29.493 [2024-12-08 02:29:57.025642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.025718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.025743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.493 qpair failed and we were unable to recover it. 00:27:29.493 [2024-12-08 02:29:57.025827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.025906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.025930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.493 qpair failed and we were unable to recover it. 00:27:29.493 [2024-12-08 02:29:57.026034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.026145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.026170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.493 qpair failed and we were unable to recover it. 00:27:29.493 [2024-12-08 02:29:57.026251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.026337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.026362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.493 qpair failed and we were unable to recover it. 00:27:29.493 [2024-12-08 02:29:57.026471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.026560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.026586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.493 qpair failed and we were unable to recover it. 00:27:29.493 [2024-12-08 02:29:57.026680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.026797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.026822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.493 qpair failed and we were unable to recover it. 00:27:29.493 [2024-12-08 02:29:57.026904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.027017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.027042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.493 qpair failed and we were unable to recover it. 00:27:29.493 [2024-12-08 02:29:57.027124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.027208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.027233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.493 qpair failed and we were unable to recover it. 00:27:29.493 [2024-12-08 02:29:57.027313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.027396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.027420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.493 qpair failed and we were unable to recover it. 00:27:29.493 [2024-12-08 02:29:57.027530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.027645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.027669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.493 qpair failed and we were unable to recover it. 00:27:29.493 [2024-12-08 02:29:57.027747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.027856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.027881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.493 qpair failed and we were unable to recover it. 00:27:29.493 [2024-12-08 02:29:57.028001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.028084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.028109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.493 qpair failed and we were unable to recover it. 00:27:29.493 [2024-12-08 02:29:57.028217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.028294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.028319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.493 qpair failed and we were unable to recover it. 00:27:29.493 [2024-12-08 02:29:57.028405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.028492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.028517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.493 qpair failed and we were unable to recover it. 00:27:29.493 [2024-12-08 02:29:57.028605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.493 [2024-12-08 02:29:57.028682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.028707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.494 qpair failed and we were unable to recover it. 00:27:29.494 [2024-12-08 02:29:57.028786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.028864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.028889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.494 qpair failed and we were unable to recover it. 00:27:29.494 [2024-12-08 02:29:57.028994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.029069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.029094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.494 qpair failed and we were unable to recover it. 00:27:29.494 [2024-12-08 02:29:57.029208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.029317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.029342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.494 qpair failed and we were unable to recover it. 00:27:29.494 [2024-12-08 02:29:57.029422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.029501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.029525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.494 qpair failed and we were unable to recover it. 00:27:29.494 [2024-12-08 02:29:57.029647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.029753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.029778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.494 qpair failed and we were unable to recover it. 00:27:29.494 [2024-12-08 02:29:57.029893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.029967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.029993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.494 qpair failed and we were unable to recover it. 00:27:29.494 [2024-12-08 02:29:57.030102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.030191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.030217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.494 qpair failed and we were unable to recover it. 00:27:29.494 [2024-12-08 02:29:57.030295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.030434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.030459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.494 qpair failed and we were unable to recover it. 00:27:29.494 [2024-12-08 02:29:57.030544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.030626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.030652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.494 qpair failed and we were unable to recover it. 00:27:29.494 [2024-12-08 02:29:57.030770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.030851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.030877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.494 qpair failed and we were unable to recover it. 00:27:29.494 [2024-12-08 02:29:57.030959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.031036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.031062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.494 qpair failed and we were unable to recover it. 00:27:29.494 [2024-12-08 02:29:57.031205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.031288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.031314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.494 qpair failed and we were unable to recover it. 00:27:29.494 [2024-12-08 02:29:57.031395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.031481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.031506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.494 qpair failed and we were unable to recover it. 00:27:29.494 [2024-12-08 02:29:57.031602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.031678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.031703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.494 qpair failed and we were unable to recover it. 00:27:29.494 [2024-12-08 02:29:57.031792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.031932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.031958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.494 qpair failed and we were unable to recover it. 00:27:29.494 [2024-12-08 02:29:57.032037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.032147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.032172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.494 qpair failed and we were unable to recover it. 00:27:29.494 [2024-12-08 02:29:57.032250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.032358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.032388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.494 qpair failed and we were unable to recover it. 00:27:29.494 [2024-12-08 02:29:57.032476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.032611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.032636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.494 qpair failed and we were unable to recover it. 00:27:29.494 [2024-12-08 02:29:57.032742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.032831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.032856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.494 qpair failed and we were unable to recover it. 00:27:29.494 [2024-12-08 02:29:57.032934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.033016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.033041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.494 qpair failed and we were unable to recover it. 00:27:29.494 [2024-12-08 02:29:57.033129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.033236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.033262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.494 qpair failed and we were unable to recover it. 00:27:29.494 [2024-12-08 02:29:57.033345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.033419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.033444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.494 qpair failed and we were unable to recover it. 00:27:29.494 [2024-12-08 02:29:57.033555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.033633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.033657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.494 qpair failed and we were unable to recover it. 00:27:29.494 [2024-12-08 02:29:57.033738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.033851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.033876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.494 qpair failed and we were unable to recover it. 00:27:29.494 [2024-12-08 02:29:57.033993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.034066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.034091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.494 qpair failed and we were unable to recover it. 00:27:29.494 [2024-12-08 02:29:57.034180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.034291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.034316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.494 qpair failed and we were unable to recover it. 00:27:29.494 [2024-12-08 02:29:57.034393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.034481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.034506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.494 qpair failed and we were unable to recover it. 00:27:29.494 [2024-12-08 02:29:57.034598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.034671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.494 [2024-12-08 02:29:57.034696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.494 qpair failed and we were unable to recover it. 00:27:29.494 [2024-12-08 02:29:57.034772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.034876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.034901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.495 qpair failed and we were unable to recover it. 00:27:29.495 [2024-12-08 02:29:57.034981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.035085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.035110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.495 qpair failed and we were unable to recover it. 00:27:29.495 [2024-12-08 02:29:57.035201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.035311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.035336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.495 qpair failed and we were unable to recover it. 00:27:29.495 [2024-12-08 02:29:57.035419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.035525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.035556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.495 qpair failed and we were unable to recover it. 00:27:29.495 [2024-12-08 02:29:57.035636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.035725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.035750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.495 qpair failed and we were unable to recover it. 00:27:29.495 [2024-12-08 02:29:57.035836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.035913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.035938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.495 qpair failed and we were unable to recover it. 00:27:29.495 [2024-12-08 02:29:57.036018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.036128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.036153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.495 qpair failed and we were unable to recover it. 00:27:29.495 [2024-12-08 02:29:57.036263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.036371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.036395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.495 qpair failed and we were unable to recover it. 00:27:29.495 [2024-12-08 02:29:57.036508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.036593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.036618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.495 qpair failed and we were unable to recover it. 00:27:29.495 [2024-12-08 02:29:57.036695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.036807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.036832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.495 qpair failed and we were unable to recover it. 00:27:29.495 [2024-12-08 02:29:57.036919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.036998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.037023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.495 qpair failed and we were unable to recover it. 00:27:29.495 [2024-12-08 02:29:57.037099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.037171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.037197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.495 qpair failed and we were unable to recover it. 00:27:29.495 [2024-12-08 02:29:57.037288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.037367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.037392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.495 qpair failed and we were unable to recover it. 00:27:29.495 [2024-12-08 02:29:57.037484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.037617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.037647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.495 qpair failed and we were unable to recover it. 00:27:29.495 [2024-12-08 02:29:57.037731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.037843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.037869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.495 qpair failed and we were unable to recover it. 00:27:29.495 [2024-12-08 02:29:57.037948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.038060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.038085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.495 qpair failed and we were unable to recover it. 00:27:29.495 [2024-12-08 02:29:57.038197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.038306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.038332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.495 qpair failed and we were unable to recover it. 00:27:29.495 [2024-12-08 02:29:57.038413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.038486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.038512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.495 qpair failed and we were unable to recover it. 00:27:29.495 [2024-12-08 02:29:57.038600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.038695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.038722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.495 qpair failed and we were unable to recover it. 00:27:29.495 [2024-12-08 02:29:57.038839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.038950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.038976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.495 qpair failed and we were unable to recover it. 00:27:29.495 [2024-12-08 02:29:57.039084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.039196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.039221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.495 qpair failed and we were unable to recover it. 00:27:29.495 [2024-12-08 02:29:57.039300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.039408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.039434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.495 qpair failed and we were unable to recover it. 00:27:29.495 [2024-12-08 02:29:57.039552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.039632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.039657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.495 qpair failed and we were unable to recover it. 00:27:29.495 [2024-12-08 02:29:57.039774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.039855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.039880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.495 qpair failed and we were unable to recover it. 00:27:29.495 [2024-12-08 02:29:57.040010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.040088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.040113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.495 qpair failed and we were unable to recover it. 00:27:29.495 [2024-12-08 02:29:57.040190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.040304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.040330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.495 qpair failed and we were unable to recover it. 00:27:29.495 [2024-12-08 02:29:57.040471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.040553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.040580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.495 qpair failed and we were unable to recover it. 00:27:29.495 [2024-12-08 02:29:57.040669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.040746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.040771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.495 qpair failed and we were unable to recover it. 00:27:29.495 [2024-12-08 02:29:57.040856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.040935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.495 [2024-12-08 02:29:57.040961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.495 qpair failed and we were unable to recover it. 00:27:29.496 [2024-12-08 02:29:57.041041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.041150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.041176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.496 qpair failed and we were unable to recover it. 00:27:29.496 [2024-12-08 02:29:57.041258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.041366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.041391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.496 qpair failed and we were unable to recover it. 00:27:29.496 [2024-12-08 02:29:57.041477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.041591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.041618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.496 qpair failed and we were unable to recover it. 00:27:29.496 [2024-12-08 02:29:57.041699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.041805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.041831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.496 qpair failed and we were unable to recover it. 00:27:29.496 [2024-12-08 02:29:57.041944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.042050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.042075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.496 qpair failed and we were unable to recover it. 00:27:29.496 [2024-12-08 02:29:57.042154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.042237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.042262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.496 qpair failed and we were unable to recover it. 00:27:29.496 [2024-12-08 02:29:57.042343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.042456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.042482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.496 qpair failed and we were unable to recover it. 00:27:29.496 [2024-12-08 02:29:57.042564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.042667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.042693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.496 qpair failed and we were unable to recover it. 00:27:29.496 [2024-12-08 02:29:57.042802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.042875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.042901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.496 qpair failed and we were unable to recover it. 00:27:29.496 [2024-12-08 02:29:57.043010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.043090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.043114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.496 qpair failed and we were unable to recover it. 00:27:29.496 [2024-12-08 02:29:57.043195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.043308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.043333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.496 qpair failed and we were unable to recover it. 00:27:29.496 [2024-12-08 02:29:57.043410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.043518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.043554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.496 qpair failed and we were unable to recover it. 00:27:29.496 [2024-12-08 02:29:57.043739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.043844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.043869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.496 qpair failed and we were unable to recover it. 00:27:29.496 [2024-12-08 02:29:57.043978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.044059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.044083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.496 qpair failed and we were unable to recover it. 00:27:29.496 [2024-12-08 02:29:57.044191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.044298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.044323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.496 qpair failed and we were unable to recover it. 00:27:29.496 [2024-12-08 02:29:57.044430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.044534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.044574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.496 qpair failed and we were unable to recover it. 00:27:29.496 [2024-12-08 02:29:57.044664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.044747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.044772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.496 qpair failed and we were unable to recover it. 00:27:29.496 [2024-12-08 02:29:57.044861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.044969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.044994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.496 qpair failed and we were unable to recover it. 00:27:29.496 [2024-12-08 02:29:57.045112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.045195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.045221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.496 qpair failed and we were unable to recover it. 00:27:29.496 [2024-12-08 02:29:57.045300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.045379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.045404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.496 qpair failed and we were unable to recover it. 00:27:29.496 [2024-12-08 02:29:57.045517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.045637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.045663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.496 qpair failed and we were unable to recover it. 00:27:29.496 [2024-12-08 02:29:57.045745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.045856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.045882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.496 qpair failed and we were unable to recover it. 00:27:29.496 [2024-12-08 02:29:57.045972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.046056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.046081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.496 qpair failed and we were unable to recover it. 00:27:29.496 [2024-12-08 02:29:57.046168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.046284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.046309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.496 qpair failed and we were unable to recover it. 00:27:29.496 [2024-12-08 02:29:57.046447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.046524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.046557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.496 qpair failed and we were unable to recover it. 00:27:29.496 [2024-12-08 02:29:57.046647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.046762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.046787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.496 qpair failed and we were unable to recover it. 00:27:29.496 [2024-12-08 02:29:57.046861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.046977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.047002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.496 qpair failed and we were unable to recover it. 00:27:29.496 [2024-12-08 02:29:57.047109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.047186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.047211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.496 qpair failed and we were unable to recover it. 00:27:29.496 [2024-12-08 02:29:57.047293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.496 [2024-12-08 02:29:57.047368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.047393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.497 qpair failed and we were unable to recover it. 00:27:29.497 [2024-12-08 02:29:57.047469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.047571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.047598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.497 qpair failed and we were unable to recover it. 00:27:29.497 [2024-12-08 02:29:57.047683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.047768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.047797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.497 qpair failed and we were unable to recover it. 00:27:29.497 [2024-12-08 02:29:57.047876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.047955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.047981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.497 qpair failed and we were unable to recover it. 00:27:29.497 [2024-12-08 02:29:57.048064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.048170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.048196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.497 qpair failed and we were unable to recover it. 00:27:29.497 [2024-12-08 02:29:57.048283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.048356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.048381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.497 qpair failed and we were unable to recover it. 00:27:29.497 [2024-12-08 02:29:57.048478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.048561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.048587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.497 qpair failed and we were unable to recover it. 00:27:29.497 [2024-12-08 02:29:57.048671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.048778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.048803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.497 qpair failed and we were unable to recover it. 00:27:29.497 [2024-12-08 02:29:57.048893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.048971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.048996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.497 qpair failed and we were unable to recover it. 00:27:29.497 [2024-12-08 02:29:57.049086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.049161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.049186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.497 qpair failed and we were unable to recover it. 00:27:29.497 [2024-12-08 02:29:57.049267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.049381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.049406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.497 qpair failed and we were unable to recover it. 00:27:29.497 [2024-12-08 02:29:57.049487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.049601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.049626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.497 qpair failed and we were unable to recover it. 00:27:29.497 [2024-12-08 02:29:57.049710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.049788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.049813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.497 qpair failed and we were unable to recover it. 00:27:29.497 [2024-12-08 02:29:57.049930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.050009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.050034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.497 qpair failed and we were unable to recover it. 00:27:29.497 [2024-12-08 02:29:57.050133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.050241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.050266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.497 qpair failed and we were unable to recover it. 00:27:29.497 [2024-12-08 02:29:57.050344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.050423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.050447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.497 qpair failed and we were unable to recover it. 00:27:29.497 [2024-12-08 02:29:57.050532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.050643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.050668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.497 qpair failed and we were unable to recover it. 00:27:29.497 [2024-12-08 02:29:57.050756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.050833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.050858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.497 qpair failed and we were unable to recover it. 00:27:29.497 [2024-12-08 02:29:57.050949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.051032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.051058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.497 qpair failed and we were unable to recover it. 00:27:29.497 [2024-12-08 02:29:57.051135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.051243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.051268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.497 qpair failed and we were unable to recover it. 00:27:29.497 [2024-12-08 02:29:57.051358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.051464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.051489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.497 qpair failed and we were unable to recover it. 00:27:29.497 [2024-12-08 02:29:57.051601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.051686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.051711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.497 qpair failed and we were unable to recover it. 00:27:29.497 [2024-12-08 02:29:57.051785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.051866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.051891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.497 qpair failed and we were unable to recover it. 00:27:29.497 [2024-12-08 02:29:57.051974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.052091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.052116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.497 qpair failed and we were unable to recover it. 00:27:29.497 [2024-12-08 02:29:57.052194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.052278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.052302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.497 qpair failed and we were unable to recover it. 00:27:29.497 [2024-12-08 02:29:57.052377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.052489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.052514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.497 qpair failed and we were unable to recover it. 00:27:29.497 [2024-12-08 02:29:57.052617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.052704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.052732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.497 qpair failed and we were unable to recover it. 00:27:29.497 [2024-12-08 02:29:57.052850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.052926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.052951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.497 qpair failed and we were unable to recover it. 00:27:29.497 [2024-12-08 02:29:57.053038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.053182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.497 [2024-12-08 02:29:57.053207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.497 qpair failed and we were unable to recover it. 00:27:29.497 [2024-12-08 02:29:57.053288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.053362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.053386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.498 qpair failed and we were unable to recover it. 00:27:29.498 [2024-12-08 02:29:57.053475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.053563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.053591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.498 qpair failed and we were unable to recover it. 00:27:29.498 [2024-12-08 02:29:57.053692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.053785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.053815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.498 qpair failed and we were unable to recover it. 00:27:29.498 [2024-12-08 02:29:57.053932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.054042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.054067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.498 qpair failed and we were unable to recover it. 00:27:29.498 [2024-12-08 02:29:57.054151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.054258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.054283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.498 qpair failed and we were unable to recover it. 00:27:29.498 [2024-12-08 02:29:57.054359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.054437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.054463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.498 qpair failed and we were unable to recover it. 00:27:29.498 [2024-12-08 02:29:57.054580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.054662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.054687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.498 qpair failed and we were unable to recover it. 00:27:29.498 [2024-12-08 02:29:57.054776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.054851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.054876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.498 qpair failed and we were unable to recover it. 00:27:29.498 [2024-12-08 02:29:57.054956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.055035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.055060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.498 qpair failed and we were unable to recover it. 00:27:29.498 [2024-12-08 02:29:57.055142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.055235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.055260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.498 qpair failed and we were unable to recover it. 00:27:29.498 [2024-12-08 02:29:57.055348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.055460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.055485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.498 qpair failed and we were unable to recover it. 00:27:29.498 [2024-12-08 02:29:57.055597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.055678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.055703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.498 qpair failed and we were unable to recover it. 00:27:29.498 [2024-12-08 02:29:57.055786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.055894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.055919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.498 qpair failed and we were unable to recover it. 00:27:29.498 [2024-12-08 02:29:57.055993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.056103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.056128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.498 qpair failed and we were unable to recover it. 00:27:29.498 [2024-12-08 02:29:57.056207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.056318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.056343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.498 qpair failed and we were unable to recover it. 00:27:29.498 [2024-12-08 02:29:57.056419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.056499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.056524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.498 qpair failed and we were unable to recover it. 00:27:29.498 [2024-12-08 02:29:57.056628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.056737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.056762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.498 qpair failed and we were unable to recover it. 00:27:29.498 [2024-12-08 02:29:57.056852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.056933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.056958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.498 qpair failed and we were unable to recover it. 00:27:29.498 [2024-12-08 02:29:57.057036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.057121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.057146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.498 qpair failed and we were unable to recover it. 00:27:29.498 [2024-12-08 02:29:57.057238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.057377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.057402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.498 qpair failed and we were unable to recover it. 00:27:29.498 [2024-12-08 02:29:57.057489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.057574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.057600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.498 qpair failed and we were unable to recover it. 00:27:29.498 [2024-12-08 02:29:57.057687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.057763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.057788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.498 qpair failed and we were unable to recover it. 00:27:29.498 [2024-12-08 02:29:57.057897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.057981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.058007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.498 qpair failed and we were unable to recover it. 00:27:29.498 [2024-12-08 02:29:57.058089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.058165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.058191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.498 qpair failed and we were unable to recover it. 00:27:29.498 [2024-12-08 02:29:57.058274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.058361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.058390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.498 qpair failed and we were unable to recover it. 00:27:29.498 [2024-12-08 02:29:57.058472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.058584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.498 [2024-12-08 02:29:57.058610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.498 qpair failed and we were unable to recover it. 00:27:29.499 [2024-12-08 02:29:57.058722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.058801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.058826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.499 qpair failed and we were unable to recover it. 00:27:29.499 [2024-12-08 02:29:57.058910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.058984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.059009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.499 qpair failed and we were unable to recover it. 00:27:29.499 [2024-12-08 02:29:57.059100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.059175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.059199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.499 qpair failed and we were unable to recover it. 00:27:29.499 [2024-12-08 02:29:57.059278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.059365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.059390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.499 qpair failed and we were unable to recover it. 00:27:29.499 [2024-12-08 02:29:57.059496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.059588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.059613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.499 qpair failed and we were unable to recover it. 00:27:29.499 [2024-12-08 02:29:57.059707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.059783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.059808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.499 qpair failed and we were unable to recover it. 00:27:29.499 [2024-12-08 02:29:57.059885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.059970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.059995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.499 qpair failed and we were unable to recover it. 00:27:29.499 [2024-12-08 02:29:57.060138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.060214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.060239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.499 qpair failed and we were unable to recover it. 00:27:29.499 [2024-12-08 02:29:57.060350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.060458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.060487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.499 qpair failed and we were unable to recover it. 00:27:29.499 [2024-12-08 02:29:57.060630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.060711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.060736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.499 qpair failed and we were unable to recover it. 00:27:29.499 [2024-12-08 02:29:57.060852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.060928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.060953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.499 qpair failed and we were unable to recover it. 00:27:29.499 [2024-12-08 02:29:57.061091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.061200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.061225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.499 qpair failed and we were unable to recover it. 00:27:29.499 [2024-12-08 02:29:57.061333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.061438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.061463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.499 qpair failed and we were unable to recover it. 00:27:29.499 [2024-12-08 02:29:57.061555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.061639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.061665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.499 qpair failed and we were unable to recover it. 00:27:29.499 [2024-12-08 02:29:57.061742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.061819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.061845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.499 qpair failed and we were unable to recover it. 00:27:29.499 [2024-12-08 02:29:57.061929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.062035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.062061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.499 qpair failed and we were unable to recover it. 00:27:29.499 [2024-12-08 02:29:57.062147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.062225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.062250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.499 qpair failed and we were unable to recover it. 00:27:29.499 [2024-12-08 02:29:57.062371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.062482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.062507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.499 qpair failed and we were unable to recover it. 00:27:29.499 [2024-12-08 02:29:57.062591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.062704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.062733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.499 qpair failed and we were unable to recover it. 00:27:29.499 [2024-12-08 02:29:57.062829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.062906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.062931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.499 qpair failed and we were unable to recover it. 00:27:29.499 [2024-12-08 02:29:57.063042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.063184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.063208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.499 qpair failed and we were unable to recover it. 00:27:29.499 [2024-12-08 02:29:57.063294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.063376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.063401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.499 qpair failed and we were unable to recover it. 00:27:29.499 [2024-12-08 02:29:57.063484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.063564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.063589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.499 qpair failed and we were unable to recover it. 00:27:29.499 [2024-12-08 02:29:57.063673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.063758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.063784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.499 qpair failed and we were unable to recover it. 00:27:29.499 [2024-12-08 02:29:57.063891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.063971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.063996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.499 qpair failed and we were unable to recover it. 00:27:29.499 [2024-12-08 02:29:57.064107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.064214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.064239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.499 qpair failed and we were unable to recover it. 00:27:29.499 [2024-12-08 02:29:57.064349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.064429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.064454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.499 qpair failed and we were unable to recover it. 00:27:29.499 [2024-12-08 02:29:57.064529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.064642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.064667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.499 qpair failed and we were unable to recover it. 00:27:29.499 [2024-12-08 02:29:57.064779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.499 [2024-12-08 02:29:57.064886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.064911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.500 qpair failed and we were unable to recover it. 00:27:29.500 [2024-12-08 02:29:57.064992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.065130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.065155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.500 qpair failed and we were unable to recover it. 00:27:29.500 [2024-12-08 02:29:57.065237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.065348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.065373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.500 qpair failed and we were unable to recover it. 00:27:29.500 [2024-12-08 02:29:57.065482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.065591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.065617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.500 qpair failed and we were unable to recover it. 00:27:29.500 [2024-12-08 02:29:57.065707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.065782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.065807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.500 qpair failed and we were unable to recover it. 00:27:29.500 [2024-12-08 02:29:57.065892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.065969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.065994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.500 qpair failed and we were unable to recover it. 00:27:29.500 [2024-12-08 02:29:57.066105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.066191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.066216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.500 qpair failed and we were unable to recover it. 00:27:29.500 [2024-12-08 02:29:57.066303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.066413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.066438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.500 qpair failed and we were unable to recover it. 00:27:29.500 [2024-12-08 02:29:57.066516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.066600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.066625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.500 qpair failed and we were unable to recover it. 00:27:29.500 [2024-12-08 02:29:57.066703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.066776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.066801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.500 qpair failed and we were unable to recover it. 00:27:29.500 [2024-12-08 02:29:57.066884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.066964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.066989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.500 qpair failed and we were unable to recover it. 00:27:29.500 [2024-12-08 02:29:57.067068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.067148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.067173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.500 qpair failed and we were unable to recover it. 00:27:29.500 [2024-12-08 02:29:57.067279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.067352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.067377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.500 qpair failed and we were unable to recover it. 00:27:29.500 [2024-12-08 02:29:57.067454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.067591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.067616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.500 qpair failed and we were unable to recover it. 00:27:29.500 [2024-12-08 02:29:57.067729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.067804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.067829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.500 qpair failed and we were unable to recover it. 00:27:29.500 [2024-12-08 02:29:57.067914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.067991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.068016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.500 qpair failed and we were unable to recover it. 00:27:29.500 [2024-12-08 02:29:57.068104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.068193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.068218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.500 qpair failed and we were unable to recover it. 00:27:29.500 [2024-12-08 02:29:57.068330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.068416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.068441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.500 qpair failed and we were unable to recover it. 00:27:29.500 [2024-12-08 02:29:57.068520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.068612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.068637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.500 qpair failed and we were unable to recover it. 00:27:29.500 [2024-12-08 02:29:57.068728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.068835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.068860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.500 qpair failed and we were unable to recover it. 00:27:29.500 [2024-12-08 02:29:57.068976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.069089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.069115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.500 qpair failed and we were unable to recover it. 00:27:29.500 [2024-12-08 02:29:57.069226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.069337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.069363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.500 qpair failed and we were unable to recover it. 00:27:29.500 [2024-12-08 02:29:57.069445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.069556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.069582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.500 qpair failed and we were unable to recover it. 00:27:29.500 [2024-12-08 02:29:57.069673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.069781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.069807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.500 qpair failed and we were unable to recover it. 00:27:29.500 [2024-12-08 02:29:57.069881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.069987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.070012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.500 qpair failed and we were unable to recover it. 00:27:29.500 [2024-12-08 02:29:57.070095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.070169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.070194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.500 qpair failed and we were unable to recover it. 00:27:29.500 [2024-12-08 02:29:57.070335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.070446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.070471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.500 qpair failed and we were unable to recover it. 00:27:29.500 [2024-12-08 02:29:57.070562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.070702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.070727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.500 qpair failed and we were unable to recover it. 00:27:29.500 [2024-12-08 02:29:57.070839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.070916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.070941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.500 qpair failed and we were unable to recover it. 00:27:29.500 [2024-12-08 02:29:57.071019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.500 [2024-12-08 02:29:57.071096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.071121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.501 qpair failed and we were unable to recover it. 00:27:29.501 [2024-12-08 02:29:57.071228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.071308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.071333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.501 qpair failed and we were unable to recover it. 00:27:29.501 [2024-12-08 02:29:57.071421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.071509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.071544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.501 qpair failed and we were unable to recover it. 00:27:29.501 [2024-12-08 02:29:57.071629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.071704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.071729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.501 qpair failed and we were unable to recover it. 00:27:29.501 [2024-12-08 02:29:57.071812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.071891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.071916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.501 qpair failed and we were unable to recover it. 00:27:29.501 [2024-12-08 02:29:57.072003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.072081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.072106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.501 qpair failed and we were unable to recover it. 00:27:29.501 [2024-12-08 02:29:57.072201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.072277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.072302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.501 qpair failed and we were unable to recover it. 00:27:29.501 [2024-12-08 02:29:57.072417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.072523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.072567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.501 qpair failed and we were unable to recover it. 00:27:29.501 [2024-12-08 02:29:57.072649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.072731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.072756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.501 qpair failed and we were unable to recover it. 00:27:29.501 [2024-12-08 02:29:57.072837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.072916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.072943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.501 qpair failed and we were unable to recover it. 00:27:29.501 [2024-12-08 02:29:57.073052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.073167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.073192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.501 qpair failed and we were unable to recover it. 00:27:29.501 [2024-12-08 02:29:57.073280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.073358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.073382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.501 qpair failed and we were unable to recover it. 00:27:29.501 [2024-12-08 02:29:57.073467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.073550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.073576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.501 qpair failed and we were unable to recover it. 00:27:29.501 [2024-12-08 02:29:57.073691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.073777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.073802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.501 qpair failed and we were unable to recover it. 00:27:29.501 [2024-12-08 02:29:57.073877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.073952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.073977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.501 qpair failed and we were unable to recover it. 00:27:29.501 [2024-12-08 02:29:57.074056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.074163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.074188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.501 qpair failed and we were unable to recover it. 00:27:29.501 [2024-12-08 02:29:57.074282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.074390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.074415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.501 qpair failed and we were unable to recover it. 00:27:29.501 [2024-12-08 02:29:57.074562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.074637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.074663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.501 qpair failed and we were unable to recover it. 00:27:29.501 [2024-12-08 02:29:57.074746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.074851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.074876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.501 qpair failed and we were unable to recover it. 00:27:29.501 [2024-12-08 02:29:57.074952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.075027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.075052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.501 qpair failed and we were unable to recover it. 00:27:29.501 [2024-12-08 02:29:57.075140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.075249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.075274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.501 qpair failed and we were unable to recover it. 00:27:29.501 [2024-12-08 02:29:57.075362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.075445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.075470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.501 qpair failed and we were unable to recover it. 00:27:29.501 [2024-12-08 02:29:57.075581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.075660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.075685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.501 qpair failed and we were unable to recover it. 00:27:29.501 [2024-12-08 02:29:57.075779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.075893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.075919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.501 qpair failed and we were unable to recover it. 00:27:29.501 [2024-12-08 02:29:57.076003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.076090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.076115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.501 qpair failed and we were unable to recover it. 00:27:29.501 [2024-12-08 02:29:57.076191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.076276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.076301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.501 qpair failed and we were unable to recover it. 00:27:29.501 [2024-12-08 02:29:57.076383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.076499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.076524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.501 qpair failed and we were unable to recover it. 00:27:29.501 [2024-12-08 02:29:57.076611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.076717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.076742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.501 qpair failed and we were unable to recover it. 00:27:29.501 [2024-12-08 02:29:57.076855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.076964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.501 [2024-12-08 02:29:57.076989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.501 qpair failed and we were unable to recover it. 00:27:29.501 [2024-12-08 02:29:57.077070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.077148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.077173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.502 qpair failed and we were unable to recover it. 00:27:29.502 [2024-12-08 02:29:57.077256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.077346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.077371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.502 qpair failed and we were unable to recover it. 00:27:29.502 [2024-12-08 02:29:57.077480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.077590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.077615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.502 qpair failed and we were unable to recover it. 00:27:29.502 [2024-12-08 02:29:57.077694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.077798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.077823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.502 qpair failed and we were unable to recover it. 00:27:29.502 [2024-12-08 02:29:57.077946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.078028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.078053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.502 qpair failed and we were unable to recover it. 00:27:29.502 [2024-12-08 02:29:57.078144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.078218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.078243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.502 qpair failed and we were unable to recover it. 00:27:29.502 [2024-12-08 02:29:57.078322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.078438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.078463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.502 qpair failed and we were unable to recover it. 00:27:29.502 [2024-12-08 02:29:57.078547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.078624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.078649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.502 qpair failed and we were unable to recover it. 00:27:29.502 [2024-12-08 02:29:57.078729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.078839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.078864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.502 qpair failed and we were unable to recover it. 00:27:29.502 [2024-12-08 02:29:57.078973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.079058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.079083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.502 qpair failed and we were unable to recover it. 00:27:29.502 [2024-12-08 02:29:57.079195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.079305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.079330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.502 qpair failed and we were unable to recover it. 00:27:29.502 [2024-12-08 02:29:57.079438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.079512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.079542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.502 qpair failed and we were unable to recover it. 00:27:29.502 [2024-12-08 02:29:57.079633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.079771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.079796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.502 qpair failed and we were unable to recover it. 00:27:29.502 [2024-12-08 02:29:57.079877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.080016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.080041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.502 qpair failed and we were unable to recover it. 00:27:29.502 [2024-12-08 02:29:57.080135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.080215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.080241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.502 qpair failed and we were unable to recover it. 00:27:29.502 [2024-12-08 02:29:57.080324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.080429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.080454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.502 qpair failed and we were unable to recover it. 00:27:29.502 [2024-12-08 02:29:57.080570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.080651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.080677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.502 qpair failed and we were unable to recover it. 00:27:29.502 [2024-12-08 02:29:57.080786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.080868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.080893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.502 qpair failed and we were unable to recover it. 00:27:29.502 [2024-12-08 02:29:57.080971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.081084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.081109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.502 qpair failed and we were unable to recover it. 00:27:29.502 [2024-12-08 02:29:57.081190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.081298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.081323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.502 qpair failed and we were unable to recover it. 00:27:29.502 [2024-12-08 02:29:57.081412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.081495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.081520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.502 qpair failed and we were unable to recover it. 00:27:29.502 [2024-12-08 02:29:57.081643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.081727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.081752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.502 qpair failed and we were unable to recover it. 00:27:29.502 [2024-12-08 02:29:57.081839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.081912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.081937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.502 qpair failed and we were unable to recover it. 00:27:29.502 [2024-12-08 02:29:57.082046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.082153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.082178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.502 qpair failed and we were unable to recover it. 00:27:29.502 [2024-12-08 02:29:57.082268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.082405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.082435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.502 qpair failed and we were unable to recover it. 00:27:29.502 [2024-12-08 02:29:57.082549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.082631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.502 [2024-12-08 02:29:57.082656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.502 qpair failed and we were unable to recover it. 00:27:29.503 [2024-12-08 02:29:57.082761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.082837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.082862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.503 qpair failed and we were unable to recover it. 00:27:29.503 [2024-12-08 02:29:57.082940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.083013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.083038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.503 qpair failed and we were unable to recover it. 00:27:29.503 [2024-12-08 02:29:57.083126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.083240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.083265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.503 qpair failed and we were unable to recover it. 00:27:29.503 [2024-12-08 02:29:57.083351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.083434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.083459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.503 qpair failed and we were unable to recover it. 00:27:29.503 [2024-12-08 02:29:57.083540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.083627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.083653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.503 qpair failed and we were unable to recover it. 00:27:29.503 [2024-12-08 02:29:57.083730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.083838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.083863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.503 qpair failed and we were unable to recover it. 00:27:29.503 [2024-12-08 02:29:57.083936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.084014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.084039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.503 qpair failed and we were unable to recover it. 00:27:29.503 [2024-12-08 02:29:57.084120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.084201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.084226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.503 qpair failed and we were unable to recover it. 00:27:29.503 [2024-12-08 02:29:57.084344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.084433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.084458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.503 qpair failed and we were unable to recover it. 00:27:29.503 [2024-12-08 02:29:57.084547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.084629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.084654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.503 qpair failed and we were unable to recover it. 00:27:29.503 [2024-12-08 02:29:57.084745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.084820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.084845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.503 qpair failed and we were unable to recover it. 00:27:29.503 [2024-12-08 02:29:57.084925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.085065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.085090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.503 qpair failed and we were unable to recover it. 00:27:29.503 [2024-12-08 02:29:57.085203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.085276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.085302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.503 qpair failed and we were unable to recover it. 00:27:29.503 [2024-12-08 02:29:57.085379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.085496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.085521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.503 qpair failed and we were unable to recover it. 00:27:29.503 [2024-12-08 02:29:57.085607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.085716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.085742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.503 qpair failed and we were unable to recover it. 00:27:29.503 [2024-12-08 02:29:57.085848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.085960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.085985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.503 qpair failed and we were unable to recover it. 00:27:29.503 [2024-12-08 02:29:57.086066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.086174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.086199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.503 qpair failed and we were unable to recover it. 00:27:29.503 [2024-12-08 02:29:57.086300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.086412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.086438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.503 qpair failed and we were unable to recover it. 00:27:29.503 [2024-12-08 02:29:57.086534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.086616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.086641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.503 qpair failed and we were unable to recover it. 00:27:29.503 [2024-12-08 02:29:57.086727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.086807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.086832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.503 qpair failed and we were unable to recover it. 00:27:29.503 [2024-12-08 02:29:57.086943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.087022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.087047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.503 qpair failed and we were unable to recover it. 00:27:29.503 [2024-12-08 02:29:57.087133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.087216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.087241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.503 qpair failed and we were unable to recover it. 00:27:29.503 [2024-12-08 02:29:57.087357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.087439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.087465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.503 qpair failed and we were unable to recover it. 00:27:29.503 [2024-12-08 02:29:57.087584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.087664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.087689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.503 qpair failed and we were unable to recover it. 00:27:29.503 [2024-12-08 02:29:57.087804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.087919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.087944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.503 qpair failed and we were unable to recover it. 00:27:29.503 [2024-12-08 02:29:57.088053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.088131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.088156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.503 qpair failed and we were unable to recover it. 00:27:29.503 [2024-12-08 02:29:57.088266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.088373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.088398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.503 qpair failed and we were unable to recover it. 00:27:29.503 [2024-12-08 02:29:57.088507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.088597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.088623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.503 qpair failed and we were unable to recover it. 00:27:29.503 [2024-12-08 02:29:57.088713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.088825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.503 [2024-12-08 02:29:57.088850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.504 qpair failed and we were unable to recover it. 00:27:29.504 [2024-12-08 02:29:57.088963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.089067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.089092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.504 qpair failed and we were unable to recover it. 00:27:29.504 [2024-12-08 02:29:57.089177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.089254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.089279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.504 qpair failed and we were unable to recover it. 00:27:29.504 [2024-12-08 02:29:57.089367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.089450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.089475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.504 qpair failed and we were unable to recover it. 00:27:29.504 [2024-12-08 02:29:57.089606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.089716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.089741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.504 qpair failed and we were unable to recover it. 00:27:29.504 [2024-12-08 02:29:57.089847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.089961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.089987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.504 qpair failed and we were unable to recover it. 00:27:29.504 [2024-12-08 02:29:57.090078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.090160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.090185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.504 qpair failed and we were unable to recover it. 00:27:29.504 [2024-12-08 02:29:57.090260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.090373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.090398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.504 qpair failed and we were unable to recover it. 00:27:29.504 [2024-12-08 02:29:57.090472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.090589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.090614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.504 qpair failed and we were unable to recover it. 00:27:29.504 [2024-12-08 02:29:57.090693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.090764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.090790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.504 qpair failed and we were unable to recover it. 00:27:29.504 [2024-12-08 02:29:57.090887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.090964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.090990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.504 qpair failed and we were unable to recover it. 00:27:29.504 [2024-12-08 02:29:57.091110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.091196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.091221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.504 qpair failed and we were unable to recover it. 00:27:29.504 [2024-12-08 02:29:57.091332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.091441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.091466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.504 qpair failed and we were unable to recover it. 00:27:29.504 [2024-12-08 02:29:57.091553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.091634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.091659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.504 qpair failed and we were unable to recover it. 00:27:29.504 [2024-12-08 02:29:57.091744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.091856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.091881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.504 qpair failed and we were unable to recover it. 00:27:29.504 [2024-12-08 02:29:57.091964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.092044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.092069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.504 qpair failed and we were unable to recover it. 00:27:29.504 [2024-12-08 02:29:57.092177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.092264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.092289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.504 qpair failed and we were unable to recover it. 00:27:29.504 [2024-12-08 02:29:57.092386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.092505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.092530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.504 qpair failed and we were unable to recover it. 00:27:29.504 [2024-12-08 02:29:57.092648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.092736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.092761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.504 qpair failed and we were unable to recover it. 00:27:29.504 [2024-12-08 02:29:57.092898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.092983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.093008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.504 qpair failed and we were unable to recover it. 00:27:29.504 [2024-12-08 02:29:57.093118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.093196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.093221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.504 qpair failed and we were unable to recover it. 00:27:29.504 [2024-12-08 02:29:57.093321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.093391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.093420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.504 qpair failed and we were unable to recover it. 00:27:29.504 [2024-12-08 02:29:57.093532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.093649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.093674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.504 qpair failed and we were unable to recover it. 00:27:29.504 [2024-12-08 02:29:57.093754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.093897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.093922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.504 qpair failed and we were unable to recover it. 00:27:29.504 [2024-12-08 02:29:57.094044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.094130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.094155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.504 qpair failed and we were unable to recover it. 00:27:29.504 [2024-12-08 02:29:57.094268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.094346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.094370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.504 qpair failed and we were unable to recover it. 00:27:29.504 [2024-12-08 02:29:57.094481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.094556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.094581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.504 qpair failed and we were unable to recover it. 00:27:29.504 [2024-12-08 02:29:57.094698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.094782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.094807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.504 qpair failed and we were unable to recover it. 00:27:29.504 [2024-12-08 02:29:57.094887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.095023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.095049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.504 qpair failed and we were unable to recover it. 00:27:29.504 [2024-12-08 02:29:57.095131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.504 [2024-12-08 02:29:57.095238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.095263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.505 qpair failed and we were unable to recover it. 00:27:29.505 [2024-12-08 02:29:57.095379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.095487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.095512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.505 qpair failed and we were unable to recover it. 00:27:29.505 [2024-12-08 02:29:57.095630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.095706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.095732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.505 qpair failed and we were unable to recover it. 00:27:29.505 [2024-12-08 02:29:57.095846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.095982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.096007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.505 qpair failed and we were unable to recover it. 00:27:29.505 [2024-12-08 02:29:57.096088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.096161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.096186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.505 qpair failed and we were unable to recover it. 00:27:29.505 [2024-12-08 02:29:57.096267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.096385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.096410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.505 qpair failed and we were unable to recover it. 00:27:29.505 [2024-12-08 02:29:57.096535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.096618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.096643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.505 qpair failed and we were unable to recover it. 00:27:29.505 [2024-12-08 02:29:57.096753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.096830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.096856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.505 qpair failed and we were unable to recover it. 00:27:29.505 [2024-12-08 02:29:57.096938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.097047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.097072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.505 qpair failed and we were unable to recover it. 00:27:29.505 [2024-12-08 02:29:57.097153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.097259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.097285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.505 qpair failed and we were unable to recover it. 00:27:29.505 [2024-12-08 02:29:57.097366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.097441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.097466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.505 qpair failed and we were unable to recover it. 00:27:29.505 [2024-12-08 02:29:57.097567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.097679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.097704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.505 qpair failed and we were unable to recover it. 00:27:29.505 [2024-12-08 02:29:57.097793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.097898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.097923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.505 qpair failed and we were unable to recover it. 00:27:29.505 [2024-12-08 02:29:57.098039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.098144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.098169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.505 qpair failed and we were unable to recover it. 00:27:29.505 [2024-12-08 02:29:57.098252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.098361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.098387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.505 qpair failed and we were unable to recover it. 00:27:29.505 [2024-12-08 02:29:57.098496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.098576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.098602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.505 qpair failed and we were unable to recover it. 00:27:29.505 [2024-12-08 02:29:57.098685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.098763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.098788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.505 qpair failed and we were unable to recover it. 00:27:29.505 [2024-12-08 02:29:57.098867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.098940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.098965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.505 qpair failed and we were unable to recover it. 00:27:29.505 [2024-12-08 02:29:57.099039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.099124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.099149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.505 qpair failed and we were unable to recover it. 00:27:29.505 [2024-12-08 02:29:57.099224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.099333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.099358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.505 qpair failed and we were unable to recover it. 00:27:29.505 [2024-12-08 02:29:57.099437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.099552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.099578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.505 qpair failed and we were unable to recover it. 00:27:29.505 [2024-12-08 02:29:57.099652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.099735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.099760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.505 qpair failed and we were unable to recover it. 00:27:29.505 [2024-12-08 02:29:57.099845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.099954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.099979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.505 qpair failed and we were unable to recover it. 00:27:29.505 [2024-12-08 02:29:57.100090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.100201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.100226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.505 qpair failed and we were unable to recover it. 00:27:29.505 [2024-12-08 02:29:57.100305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.100440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.100465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.505 qpair failed and we were unable to recover it. 00:27:29.505 [2024-12-08 02:29:57.100572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.100682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.100707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.505 qpair failed and we were unable to recover it. 00:27:29.505 [2024-12-08 02:29:57.100818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.100897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.100922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.505 qpair failed and we were unable to recover it. 00:27:29.505 [2024-12-08 02:29:57.101006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.101112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.101137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.505 qpair failed and we were unable to recover it. 00:27:29.505 [2024-12-08 02:29:57.101243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.101317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.505 [2024-12-08 02:29:57.101342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.505 qpair failed and we were unable to recover it. 00:27:29.506 [2024-12-08 02:29:57.101426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.101505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.101531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.506 qpair failed and we were unable to recover it. 00:27:29.506 [2024-12-08 02:29:57.101627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.101729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.101754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.506 qpair failed and we were unable to recover it. 00:27:29.506 [2024-12-08 02:29:57.101844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.101923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.101948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.506 qpair failed and we were unable to recover it. 00:27:29.506 [2024-12-08 02:29:57.102031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.102135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.102160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.506 qpair failed and we were unable to recover it. 00:27:29.506 [2024-12-08 02:29:57.102268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.102349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.102374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.506 qpair failed and we were unable to recover it. 00:27:29.506 [2024-12-08 02:29:57.102460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.102549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.102574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.506 qpair failed and we were unable to recover it. 00:27:29.506 [2024-12-08 02:29:57.102653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.102758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.102783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.506 qpair failed and we were unable to recover it. 00:27:29.506 [2024-12-08 02:29:57.102864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.102971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.102996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.506 qpair failed and we were unable to recover it. 00:27:29.506 [2024-12-08 02:29:57.103079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.103188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.103213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.506 qpair failed and we were unable to recover it. 00:27:29.506 [2024-12-08 02:29:57.103295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.103374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.103399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.506 qpair failed and we were unable to recover it. 00:27:29.506 [2024-12-08 02:29:57.103476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.103597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.103624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.506 qpair failed and we were unable to recover it. 00:27:29.506 [2024-12-08 02:29:57.103699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.103772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.103798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.506 qpair failed and we were unable to recover it. 00:27:29.506 [2024-12-08 02:29:57.103909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.103991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.104016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.506 qpair failed and we were unable to recover it. 00:27:29.506 [2024-12-08 02:29:57.104099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.104212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.104236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.506 qpair failed and we were unable to recover it. 00:27:29.506 [2024-12-08 02:29:57.104331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.104420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.104449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.506 qpair failed and we were unable to recover it. 00:27:29.506 [2024-12-08 02:29:57.104529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.104656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.104682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.506 qpair failed and we were unable to recover it. 00:27:29.506 [2024-12-08 02:29:57.104791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.104897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.104922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.506 qpair failed and we were unable to recover it. 00:27:29.506 [2024-12-08 02:29:57.105061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.105168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.105193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.506 qpair failed and we were unable to recover it. 00:27:29.506 [2024-12-08 02:29:57.105274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.105355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.105381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.506 qpair failed and we were unable to recover it. 00:27:29.506 [2024-12-08 02:29:57.105477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.105575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.105600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.506 qpair failed and we were unable to recover it. 00:27:29.506 [2024-12-08 02:29:57.105709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.105790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.105815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.506 qpair failed and we were unable to recover it. 00:27:29.506 [2024-12-08 02:29:57.105928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.106007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.106032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.506 qpair failed and we were unable to recover it. 00:27:29.506 [2024-12-08 02:29:57.106112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.106195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.106219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.506 qpair failed and we were unable to recover it. 00:27:29.506 [2024-12-08 02:29:57.106298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.106378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.106402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.506 qpair failed and we were unable to recover it. 00:27:29.506 [2024-12-08 02:29:57.106511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.106593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.106623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.506 qpair failed and we were unable to recover it. 00:27:29.506 [2024-12-08 02:29:57.106709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.106818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.106843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.506 qpair failed and we were unable to recover it. 00:27:29.506 [2024-12-08 02:29:57.106917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.106997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.107022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.506 qpair failed and we were unable to recover it. 00:27:29.506 [2024-12-08 02:29:57.107098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.107207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.107232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.506 qpair failed and we were unable to recover it. 00:27:29.506 [2024-12-08 02:29:57.107317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.506 [2024-12-08 02:29:57.107437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.107462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.507 qpair failed and we were unable to recover it. 00:27:29.507 [2024-12-08 02:29:57.107549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.107629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.107653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.507 qpair failed and we were unable to recover it. 00:27:29.507 [2024-12-08 02:29:57.107730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.107851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.107876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.507 qpair failed and we were unable to recover it. 00:27:29.507 [2024-12-08 02:29:57.107984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.108063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.108088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.507 qpair failed and we were unable to recover it. 00:27:29.507 [2024-12-08 02:29:57.108162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.108268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.108294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.507 qpair failed and we were unable to recover it. 00:27:29.507 [2024-12-08 02:29:57.108435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.108509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.108534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.507 qpair failed and we were unable to recover it. 00:27:29.507 [2024-12-08 02:29:57.108627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.108713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.108738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.507 qpair failed and we were unable to recover it. 00:27:29.507 [2024-12-08 02:29:57.108828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.108906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.108931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.507 qpair failed and we were unable to recover it. 00:27:29.507 [2024-12-08 02:29:57.109038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.109112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.109137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.507 qpair failed and we were unable to recover it. 00:27:29.507 [2024-12-08 02:29:57.109218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.109291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.109316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.507 qpair failed and we were unable to recover it. 00:27:29.507 [2024-12-08 02:29:57.109391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.109501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.109526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.507 qpair failed and we were unable to recover it. 00:27:29.507 [2024-12-08 02:29:57.109608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.109692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.109717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.507 qpair failed and we were unable to recover it. 00:27:29.507 [2024-12-08 02:29:57.109796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.109933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.109959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.507 qpair failed and we were unable to recover it. 00:27:29.507 [2024-12-08 02:29:57.110036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.110116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.110142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.507 qpair failed and we were unable to recover it. 00:27:29.507 [2024-12-08 02:29:57.110249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.110354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.110379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.507 qpair failed and we were unable to recover it. 00:27:29.507 [2024-12-08 02:29:57.110456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.110561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.110586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.507 qpair failed and we were unable to recover it. 00:27:29.507 [2024-12-08 02:29:57.110695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.110800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.110825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.507 qpair failed and we were unable to recover it. 00:27:29.507 [2024-12-08 02:29:57.110944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.111055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.111080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.507 qpair failed and we were unable to recover it. 00:27:29.507 [2024-12-08 02:29:57.111157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.111232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.111257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.507 qpair failed and we were unable to recover it. 00:27:29.507 [2024-12-08 02:29:57.111337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.111437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.111462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.507 qpair failed and we were unable to recover it. 00:27:29.507 [2024-12-08 02:29:57.111575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.111686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.111711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.507 qpair failed and we were unable to recover it. 00:27:29.507 [2024-12-08 02:29:57.111788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.111902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.111927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.507 qpair failed and we were unable to recover it. 00:27:29.507 [2024-12-08 02:29:57.112070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.112149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.112174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.507 qpair failed and we were unable to recover it. 00:27:29.507 [2024-12-08 02:29:57.112255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.112340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.112365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.507 qpair failed and we were unable to recover it. 00:27:29.507 [2024-12-08 02:29:57.112473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.112593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.112619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.507 qpair failed and we were unable to recover it. 00:27:29.507 [2024-12-08 02:29:57.112710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.112790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.112815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.507 qpair failed and we were unable to recover it. 00:27:29.507 [2024-12-08 02:29:57.112896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.507 [2024-12-08 02:29:57.113004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.113029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.508 qpair failed and we were unable to recover it. 00:27:29.508 [2024-12-08 02:29:57.113139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.113251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.113276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.508 qpair failed and we were unable to recover it. 00:27:29.508 [2024-12-08 02:29:57.113383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.113460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.113486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.508 qpair failed and we were unable to recover it. 00:27:29.508 [2024-12-08 02:29:57.113579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.113668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.113693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.508 qpair failed and we were unable to recover it. 00:27:29.508 [2024-12-08 02:29:57.113774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.113887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.113912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.508 qpair failed and we were unable to recover it. 00:27:29.508 [2024-12-08 02:29:57.113991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.114073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.114098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.508 qpair failed and we were unable to recover it. 00:27:29.508 [2024-12-08 02:29:57.114205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.114316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.114341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.508 qpair failed and we were unable to recover it. 00:27:29.508 [2024-12-08 02:29:57.114418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.114494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.114518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.508 qpair failed and we were unable to recover it. 00:27:29.508 [2024-12-08 02:29:57.114607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.114694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.114718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.508 qpair failed and we were unable to recover it. 00:27:29.508 [2024-12-08 02:29:57.114861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.114932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.114957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.508 qpair failed and we were unable to recover it. 00:27:29.508 [2024-12-08 02:29:57.115039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.115116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.115141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.508 qpair failed and we were unable to recover it. 00:27:29.508 [2024-12-08 02:29:57.115259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.115382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.115407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.508 qpair failed and we were unable to recover it. 00:27:29.508 [2024-12-08 02:29:57.115487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.115593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.115618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.508 qpair failed and we were unable to recover it. 00:27:29.508 [2024-12-08 02:29:57.115699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.115776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.115801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.508 qpair failed and we were unable to recover it. 00:27:29.508 [2024-12-08 02:29:57.115881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.115988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.116013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.508 qpair failed and we were unable to recover it. 00:27:29.508 [2024-12-08 02:29:57.116104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.116178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.116203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.508 qpair failed and we were unable to recover it. 00:27:29.508 [2024-12-08 02:29:57.116312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.116426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.116451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.508 qpair failed and we were unable to recover it. 00:27:29.508 [2024-12-08 02:29:57.116543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.116648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.116673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.508 qpair failed and we were unable to recover it. 00:27:29.508 [2024-12-08 02:29:57.116779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.116884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.116909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.508 qpair failed and we were unable to recover it. 00:27:29.508 [2024-12-08 02:29:57.117019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.117101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.117126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.508 qpair failed and we were unable to recover it. 00:27:29.508 [2024-12-08 02:29:57.117238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.117324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.117349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.508 qpair failed and we were unable to recover it. 00:27:29.508 [2024-12-08 02:29:57.117460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.117546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.117575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.508 qpair failed and we were unable to recover it. 00:27:29.508 [2024-12-08 02:29:57.117663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.117740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.117765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.508 qpair failed and we were unable to recover it. 00:27:29.508 [2024-12-08 02:29:57.117880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.117954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.117979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.508 qpair failed and we were unable to recover it. 00:27:29.508 [2024-12-08 02:29:57.118066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.118147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.118171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.508 qpair failed and we were unable to recover it. 00:27:29.508 [2024-12-08 02:29:57.118251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.118364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.118389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.508 qpair failed and we were unable to recover it. 00:27:29.508 [2024-12-08 02:29:57.118463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.118596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.118621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.508 qpair failed and we were unable to recover it. 00:27:29.508 [2024-12-08 02:29:57.118772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.118856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.118881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.508 qpair failed and we were unable to recover it. 00:27:29.508 [2024-12-08 02:29:57.118988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.119091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.508 [2024-12-08 02:29:57.119116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.508 qpair failed and we were unable to recover it. 00:27:29.508 [2024-12-08 02:29:57.119228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.119331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.119356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.509 qpair failed and we were unable to recover it. 00:27:29.509 [2024-12-08 02:29:57.119439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.119567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.119593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.509 qpair failed and we were unable to recover it. 00:27:29.509 [2024-12-08 02:29:57.119734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.119813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.119848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.509 qpair failed and we were unable to recover it. 00:27:29.509 [2024-12-08 02:29:57.119930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.120040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.120066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.509 qpair failed and we were unable to recover it. 00:27:29.509 [2024-12-08 02:29:57.120147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.120258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.120282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.509 qpair failed and we were unable to recover it. 00:27:29.509 [2024-12-08 02:29:57.120392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.120471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.120495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.509 qpair failed and we were unable to recover it. 00:27:29.509 [2024-12-08 02:29:57.120592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.120674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.120699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.509 qpair failed and we were unable to recover it. 00:27:29.509 [2024-12-08 02:29:57.120783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.120888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.120912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.509 qpair failed and we were unable to recover it. 00:27:29.509 [2024-12-08 02:29:57.120993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.121099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.121124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.509 qpair failed and we were unable to recover it. 00:27:29.509 [2024-12-08 02:29:57.121229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.121313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.121338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.509 qpair failed and we were unable to recover it. 00:27:29.509 [2024-12-08 02:29:57.121451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.121526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.121556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.509 qpair failed and we were unable to recover it. 00:27:29.509 [2024-12-08 02:29:57.121654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.121769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.121794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.509 qpair failed and we were unable to recover it. 00:27:29.509 [2024-12-08 02:29:57.121882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.121960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.121985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.509 qpair failed and we were unable to recover it. 00:27:29.509 [2024-12-08 02:29:57.122099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.122180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.122204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.509 qpair failed and we were unable to recover it. 00:27:29.509 [2024-12-08 02:29:57.122285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.122394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.122418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.509 qpair failed and we were unable to recover it. 00:27:29.509 [2024-12-08 02:29:57.122529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.122613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.122638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.509 qpair failed and we were unable to recover it. 00:27:29.509 [2024-12-08 02:29:57.122746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.122827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.122852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.509 qpair failed and we were unable to recover it. 00:27:29.509 [2024-12-08 02:29:57.122966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.123075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.123100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.509 qpair failed and we were unable to recover it. 00:27:29.509 [2024-12-08 02:29:57.123221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.123310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.123334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.509 qpair failed and we were unable to recover it. 00:27:29.509 [2024-12-08 02:29:57.123441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.123520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.123551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.509 qpair failed and we were unable to recover it. 00:27:29.509 [2024-12-08 02:29:57.123647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.123725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.123750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.509 qpair failed and we were unable to recover it. 00:27:29.509 [2024-12-08 02:29:57.123834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.123949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.123974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.509 qpair failed and we were unable to recover it. 00:27:29.509 [2024-12-08 02:29:57.124064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.124140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.124165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.509 qpair failed and we were unable to recover it. 00:27:29.509 [2024-12-08 02:29:57.124242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.124319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.124344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.509 qpair failed and we were unable to recover it. 00:27:29.509 [2024-12-08 02:29:57.124424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.124501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.124526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.509 qpair failed and we were unable to recover it. 00:27:29.509 [2024-12-08 02:29:57.124671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.124783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.124808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.509 qpair failed and we were unable to recover it. 00:27:29.509 [2024-12-08 02:29:57.124891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.124969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.124993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.509 qpair failed and we were unable to recover it. 00:27:29.509 [2024-12-08 02:29:57.125102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.125189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.125214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.509 qpair failed and we were unable to recover it. 00:27:29.509 [2024-12-08 02:29:57.125296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.125376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.509 [2024-12-08 02:29:57.125402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.509 qpair failed and we were unable to recover it. 00:27:29.510 [2024-12-08 02:29:57.125508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.125629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.125655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.510 qpair failed and we were unable to recover it. 00:27:29.510 [2024-12-08 02:29:57.125735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.125814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.125839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.510 qpair failed and we were unable to recover it. 00:27:29.510 [2024-12-08 02:29:57.125949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.126060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.126086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.510 qpair failed and we were unable to recover it. 00:27:29.510 [2024-12-08 02:29:57.126194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.126302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.126327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.510 qpair failed and we were unable to recover it. 00:27:29.510 [2024-12-08 02:29:57.126401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.126512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.126544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.510 qpair failed and we were unable to recover it. 00:27:29.510 [2024-12-08 02:29:57.126658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.126739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.126765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.510 qpair failed and we were unable to recover it. 00:27:29.510 [2024-12-08 02:29:57.126859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.126974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.126999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.510 qpair failed and we were unable to recover it. 00:27:29.510 [2024-12-08 02:29:57.127075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.127184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.127208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.510 qpair failed and we were unable to recover it. 00:27:29.510 [2024-12-08 02:29:57.127310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.127400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.127425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.510 qpair failed and we were unable to recover it. 00:27:29.510 [2024-12-08 02:29:57.127516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.127653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.127679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.510 qpair failed and we were unable to recover it. 00:27:29.510 [2024-12-08 02:29:57.127757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.127830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.127854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.510 qpair failed and we were unable to recover it. 00:27:29.510 [2024-12-08 02:29:57.127963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.128034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.128059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.510 qpair failed and we were unable to recover it. 00:27:29.510 [2024-12-08 02:29:57.128175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.128311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.128336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.510 qpair failed and we were unable to recover it. 00:27:29.510 [2024-12-08 02:29:57.128408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.128489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.128514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.510 qpair failed and we were unable to recover it. 00:27:29.510 [2024-12-08 02:29:57.128630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.128711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.128740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.510 qpair failed and we were unable to recover it. 00:27:29.510 [2024-12-08 02:29:57.128819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.128892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.128917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.510 qpair failed and we were unable to recover it. 00:27:29.510 [2024-12-08 02:29:57.129032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.129140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.129165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.510 qpair failed and we were unable to recover it. 00:27:29.510 [2024-12-08 02:29:57.129240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.129322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.129347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.510 qpair failed and we were unable to recover it. 00:27:29.510 [2024-12-08 02:29:57.129458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.129548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.129573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.510 qpair failed and we were unable to recover it. 00:27:29.510 [2024-12-08 02:29:57.129658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.129736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.129761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.510 qpair failed and we were unable to recover it. 00:27:29.510 [2024-12-08 02:29:57.129844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.129919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.129944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.510 qpair failed and we were unable to recover it. 00:27:29.510 [2024-12-08 02:29:57.130025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.130103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.130128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.510 qpair failed and we were unable to recover it. 00:27:29.510 [2024-12-08 02:29:57.130268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.130377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.130401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.510 qpair failed and we were unable to recover it. 00:27:29.510 [2024-12-08 02:29:57.130513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.130606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.130631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.510 qpair failed and we were unable to recover it. 00:27:29.510 [2024-12-08 02:29:57.130709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.130789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.130814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.510 qpair failed and we were unable to recover it. 00:27:29.510 [2024-12-08 02:29:57.130929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.131004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.131029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.510 qpair failed and we were unable to recover it. 00:27:29.510 [2024-12-08 02:29:57.131109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.131215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.131240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.510 qpair failed and we were unable to recover it. 00:27:29.510 [2024-12-08 02:29:57.131349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.131436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.131462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.510 qpair failed and we were unable to recover it. 00:27:29.510 [2024-12-08 02:29:57.131560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.510 [2024-12-08 02:29:57.131673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.131699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.511 qpair failed and we were unable to recover it. 00:27:29.511 [2024-12-08 02:29:57.131781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.131865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.131890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.511 qpair failed and we were unable to recover it. 00:27:29.511 [2024-12-08 02:29:57.131982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.132057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.132082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.511 qpair failed and we were unable to recover it. 00:27:29.511 [2024-12-08 02:29:57.132192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.132267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.132292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.511 qpair failed and we were unable to recover it. 00:27:29.511 [2024-12-08 02:29:57.132410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.132482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.132507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.511 qpair failed and we were unable to recover it. 00:27:29.511 [2024-12-08 02:29:57.132632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.132712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.132737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.511 qpair failed and we were unable to recover it. 00:27:29.511 [2024-12-08 02:29:57.132822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.132901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.132926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.511 qpair failed and we were unable to recover it. 00:27:29.511 [2024-12-08 02:29:57.133012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.133096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.133120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.511 qpair failed and we were unable to recover it. 00:27:29.511 [2024-12-08 02:29:57.133238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.133376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.133400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.511 qpair failed and we were unable to recover it. 00:27:29.511 [2024-12-08 02:29:57.133484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.133569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.133594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.511 qpair failed and we were unable to recover it. 00:27:29.511 [2024-12-08 02:29:57.133670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.133748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.133773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.511 qpair failed and we were unable to recover it. 00:27:29.511 [2024-12-08 02:29:57.133883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.133991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.134016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.511 qpair failed and we were unable to recover it. 00:27:29.511 [2024-12-08 02:29:57.134095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.134198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.134223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.511 qpair failed and we were unable to recover it. 00:27:29.511 [2024-12-08 02:29:57.134331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.134406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.134431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.511 qpair failed and we were unable to recover it. 00:27:29.511 [2024-12-08 02:29:57.134515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.134629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.134654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.511 qpair failed and we were unable to recover it. 00:27:29.511 [2024-12-08 02:29:57.134765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.134843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.134867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.511 qpair failed and we were unable to recover it. 00:27:29.511 [2024-12-08 02:29:57.135009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.135120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.135144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.511 qpair failed and we were unable to recover it. 00:27:29.511 [2024-12-08 02:29:57.135236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.135345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.135370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.511 qpair failed and we were unable to recover it. 00:27:29.511 [2024-12-08 02:29:57.135459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.135531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.135561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.511 qpair failed and we were unable to recover it. 00:27:29.511 [2024-12-08 02:29:57.135645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.135752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.135777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.511 qpair failed and we were unable to recover it. 00:27:29.511 [2024-12-08 02:29:57.135887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.136027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.136052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.511 qpair failed and we were unable to recover it. 00:27:29.511 [2024-12-08 02:29:57.136138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.136243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.136268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.511 qpair failed and we were unable to recover it. 00:27:29.511 [2024-12-08 02:29:57.136353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.136490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.136515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.511 qpair failed and we were unable to recover it. 00:27:29.511 [2024-12-08 02:29:57.136610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.136687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.136712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.511 qpair failed and we were unable to recover it. 00:27:29.511 [2024-12-08 02:29:57.136821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.136895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.136920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.511 qpair failed and we were unable to recover it. 00:27:29.511 [2024-12-08 02:29:57.137032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.137137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.137162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.511 qpair failed and we were unable to recover it. 00:27:29.511 [2024-12-08 02:29:57.137247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.511 [2024-12-08 02:29:57.137324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.137349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.512 qpair failed and we were unable to recover it. 00:27:29.512 [2024-12-08 02:29:57.137457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.137544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.137570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.512 qpair failed and we were unable to recover it. 00:27:29.512 [2024-12-08 02:29:57.137655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.137765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.137790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.512 qpair failed and we were unable to recover it. 00:27:29.512 [2024-12-08 02:29:57.137871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.137954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.137979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.512 qpair failed and we were unable to recover it. 00:27:29.512 [2024-12-08 02:29:57.138068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.138173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.138198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.512 qpair failed and we were unable to recover it. 00:27:29.512 [2024-12-08 02:29:57.138285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.138402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.138427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.512 qpair failed and we were unable to recover it. 00:27:29.512 [2024-12-08 02:29:57.138507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.138595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.138620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.512 qpair failed and we were unable to recover it. 00:27:29.512 [2024-12-08 02:29:57.138705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.138778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.138803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.512 qpair failed and we were unable to recover it. 00:27:29.512 [2024-12-08 02:29:57.138886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.138995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.139020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.512 qpair failed and we were unable to recover it. 00:27:29.512 [2024-12-08 02:29:57.139164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.139247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.139272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.512 qpair failed and we were unable to recover it. 00:27:29.512 [2024-12-08 02:29:57.139347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.139421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.139446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.512 qpair failed and we were unable to recover it. 00:27:29.512 [2024-12-08 02:29:57.139534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.139653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.139683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.512 qpair failed and we were unable to recover it. 00:27:29.512 [2024-12-08 02:29:57.139758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.139898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.139923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.512 qpair failed and we were unable to recover it. 00:27:29.512 [2024-12-08 02:29:57.139997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.140072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.140097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.512 qpair failed and we were unable to recover it. 00:27:29.512 [2024-12-08 02:29:57.140175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.140284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.140309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.512 qpair failed and we were unable to recover it. 00:27:29.512 [2024-12-08 02:29:57.140386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.140492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.140517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.512 qpair failed and we were unable to recover it. 00:27:29.512 [2024-12-08 02:29:57.140602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.140684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.140708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.512 qpair failed and we were unable to recover it. 00:27:29.512 [2024-12-08 02:29:57.140844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.140921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.140946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.512 qpair failed and we were unable to recover it. 00:27:29.512 [2024-12-08 02:29:57.141025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.141102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.141127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.512 qpair failed and we were unable to recover it. 00:27:29.512 [2024-12-08 02:29:57.141237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.141345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.141370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.512 qpair failed and we were unable to recover it. 00:27:29.512 [2024-12-08 02:29:57.141451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.141532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.141563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.512 qpair failed and we were unable to recover it. 00:27:29.512 [2024-12-08 02:29:57.141644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.141755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.141785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.512 qpair failed and we were unable to recover it. 00:27:29.512 [2024-12-08 02:29:57.141877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.141961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.141986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.512 qpair failed and we were unable to recover it. 00:27:29.512 [2024-12-08 02:29:57.142071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.142151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.142176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.512 qpair failed and we were unable to recover it. 00:27:29.512 [2024-12-08 02:29:57.142253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.142324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.142349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.512 qpair failed and we were unable to recover it. 00:27:29.512 [2024-12-08 02:29:57.142486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.142580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.142605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.512 qpair failed and we were unable to recover it. 00:27:29.512 [2024-12-08 02:29:57.142681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.142789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.142814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.512 qpair failed and we were unable to recover it. 00:27:29.512 [2024-12-08 02:29:57.142927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.143033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.143058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.512 qpair failed and we were unable to recover it. 00:27:29.512 [2024-12-08 02:29:57.143172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.143282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.512 [2024-12-08 02:29:57.143307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.512 qpair failed and we were unable to recover it. 00:27:29.513 [2024-12-08 02:29:57.143393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.143498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.143523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.513 qpair failed and we were unable to recover it. 00:27:29.513 [2024-12-08 02:29:57.143644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.143756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.143780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.513 qpair failed and we were unable to recover it. 00:27:29.513 [2024-12-08 02:29:57.143899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.144009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.144034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.513 qpair failed and we were unable to recover it. 00:27:29.513 [2024-12-08 02:29:57.144151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.144258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.144283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.513 qpair failed and we were unable to recover it. 00:27:29.513 [2024-12-08 02:29:57.144393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.144477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.144502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.513 qpair failed and we were unable to recover it. 00:27:29.513 [2024-12-08 02:29:57.144620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.144698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.144723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.513 qpair failed and we were unable to recover it. 00:27:29.513 [2024-12-08 02:29:57.144798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.144904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.144929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.513 qpair failed and we were unable to recover it. 00:27:29.513 [2024-12-08 02:29:57.145009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.145114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.145139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.513 qpair failed and we were unable to recover it. 00:27:29.513 [2024-12-08 02:29:57.145222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.145298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.145323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.513 qpair failed and we were unable to recover it. 00:27:29.513 [2024-12-08 02:29:57.145462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.145574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.145599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.513 qpair failed and we were unable to recover it. 00:27:29.513 [2024-12-08 02:29:57.145690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.145767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.145792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.513 qpair failed and we were unable to recover it. 00:27:29.513 [2024-12-08 02:29:57.145903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.146041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.146066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.513 qpair failed and we were unable to recover it. 00:27:29.513 [2024-12-08 02:29:57.146177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.146255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.146280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.513 qpair failed and we were unable to recover it. 00:27:29.513 [2024-12-08 02:29:57.146364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.146452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.146476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.513 qpair failed and we were unable to recover it. 00:27:29.513 [2024-12-08 02:29:57.146568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.146641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.146666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.513 qpair failed and we were unable to recover it. 00:27:29.513 [2024-12-08 02:29:57.146762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.146901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.146927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.513 qpair failed and we were unable to recover it. 00:27:29.513 [2024-12-08 02:29:57.147011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.147101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.147126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.513 qpair failed and we were unable to recover it. 00:27:29.513 [2024-12-08 02:29:57.147243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.147318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.147343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.513 qpair failed and we were unable to recover it. 00:27:29.513 [2024-12-08 02:29:57.147455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.147557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.147583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.513 qpair failed and we were unable to recover it. 00:27:29.513 [2024-12-08 02:29:57.147663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.147752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.147776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.513 qpair failed and we were unable to recover it. 00:27:29.513 [2024-12-08 02:29:57.147864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.147973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.147998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.513 qpair failed and we were unable to recover it. 00:27:29.513 [2024-12-08 02:29:57.148078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.148156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.148180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.513 qpair failed and we were unable to recover it. 00:27:29.513 [2024-12-08 02:29:57.148276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.148392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.148417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.513 qpair failed and we were unable to recover it. 00:27:29.513 [2024-12-08 02:29:57.148507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.148630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.148656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.513 qpair failed and we were unable to recover it. 00:27:29.513 [2024-12-08 02:29:57.148768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.148851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.148877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.513 qpair failed and we were unable to recover it. 00:27:29.513 [2024-12-08 02:29:57.148959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.149067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.149092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.513 qpair failed and we were unable to recover it. 00:27:29.513 [2024-12-08 02:29:57.149206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.149278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.149303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.513 qpair failed and we were unable to recover it. 00:27:29.513 [2024-12-08 02:29:57.149384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.149487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.149512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.513 qpair failed and we were unable to recover it. 00:27:29.513 [2024-12-08 02:29:57.149659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.513 [2024-12-08 02:29:57.149742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.149767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.514 qpair failed and we were unable to recover it. 00:27:29.514 [2024-12-08 02:29:57.149882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.149958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.149983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.514 qpair failed and we were unable to recover it. 00:27:29.514 [2024-12-08 02:29:57.150064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.150173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.150199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.514 qpair failed and we were unable to recover it. 00:27:29.514 [2024-12-08 02:29:57.150314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.150394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.150419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.514 qpair failed and we were unable to recover it. 00:27:29.514 [2024-12-08 02:29:57.150553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.150632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.150657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.514 qpair failed and we were unable to recover it. 00:27:29.514 [2024-12-08 02:29:57.150777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.150870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.150895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.514 qpair failed and we were unable to recover it. 00:27:29.514 [2024-12-08 02:29:57.150972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.151050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.151075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.514 qpair failed and we were unable to recover it. 00:27:29.514 [2024-12-08 02:29:57.151155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.151234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.151259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.514 qpair failed and we were unable to recover it. 00:27:29.514 [2024-12-08 02:29:57.151368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.151471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.151496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.514 qpair failed and we were unable to recover it. 00:27:29.514 [2024-12-08 02:29:57.151661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.151739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.151764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.514 qpair failed and we were unable to recover it. 00:27:29.514 [2024-12-08 02:29:57.151880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.151955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.151979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.514 qpair failed and we were unable to recover it. 00:27:29.514 [2024-12-08 02:29:57.152058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.152131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.152156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.514 qpair failed and we were unable to recover it. 00:27:29.514 [2024-12-08 02:29:57.152241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.152313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.152338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.514 qpair failed and we were unable to recover it. 00:27:29.514 [2024-12-08 02:29:57.152426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.152510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.152541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.514 qpair failed and we were unable to recover it. 00:27:29.514 [2024-12-08 02:29:57.152622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.152701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.152726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.514 qpair failed and we were unable to recover it. 00:27:29.514 [2024-12-08 02:29:57.152864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.152983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.153012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.514 qpair failed and we were unable to recover it. 00:27:29.514 [2024-12-08 02:29:57.153086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.153195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.153220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.514 qpair failed and we were unable to recover it. 00:27:29.514 [2024-12-08 02:29:57.153298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.153376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.153401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.514 qpair failed and we were unable to recover it. 00:27:29.514 [2024-12-08 02:29:57.153478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.153593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.153618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.514 qpair failed and we were unable to recover it. 00:27:29.514 [2024-12-08 02:29:57.153725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.153804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.153829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.514 qpair failed and we were unable to recover it. 00:27:29.514 [2024-12-08 02:29:57.153943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.154049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.154074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.514 qpair failed and we were unable to recover it. 00:27:29.514 [2024-12-08 02:29:57.154164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.154237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.154263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.514 qpair failed and we were unable to recover it. 00:27:29.514 [2024-12-08 02:29:57.154413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.154487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.154512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.514 qpair failed and we were unable to recover it. 00:27:29.514 [2024-12-08 02:29:57.154615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.154689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.154715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.514 qpair failed and we were unable to recover it. 00:27:29.514 [2024-12-08 02:29:57.154802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.154941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.154966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.514 qpair failed and we were unable to recover it. 00:27:29.514 [2024-12-08 02:29:57.155045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.155156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.155181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.514 qpair failed and we were unable to recover it. 00:27:29.514 [2024-12-08 02:29:57.155262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.155338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.155363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.514 qpair failed and we were unable to recover it. 00:27:29.514 [2024-12-08 02:29:57.155477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.155564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.155590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.514 qpair failed and we were unable to recover it. 00:27:29.514 [2024-12-08 02:29:57.155706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.155791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.155816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.514 qpair failed and we were unable to recover it. 00:27:29.514 [2024-12-08 02:29:57.155899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.155974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.156000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.514 qpair failed and we were unable to recover it. 00:27:29.514 [2024-12-08 02:29:57.156086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.156193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.514 [2024-12-08 02:29:57.156218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.514 qpair failed and we were unable to recover it. 00:27:29.515 [2024-12-08 02:29:57.156307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.156386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.156411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.515 qpair failed and we were unable to recover it. 00:27:29.515 [2024-12-08 02:29:57.156488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.156570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.156595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.515 qpair failed and we were unable to recover it. 00:27:29.515 [2024-12-08 02:29:57.156709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.156811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.156836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.515 qpair failed and we were unable to recover it. 00:27:29.515 [2024-12-08 02:29:57.156920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.156997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.157022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.515 qpair failed and we were unable to recover it. 00:27:29.515 [2024-12-08 02:29:57.157132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.157209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.157234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.515 qpair failed and we were unable to recover it. 00:27:29.515 [2024-12-08 02:29:57.157314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.157418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.157443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.515 qpair failed and we were unable to recover it. 00:27:29.515 [2024-12-08 02:29:57.157519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.157606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.157632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.515 qpair failed and we were unable to recover it. 00:27:29.515 [2024-12-08 02:29:57.157750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.157824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.157849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.515 qpair failed and we were unable to recover it. 00:27:29.515 [2024-12-08 02:29:57.157931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.158039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.158064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.515 qpair failed and we were unable to recover it. 00:27:29.515 [2024-12-08 02:29:57.158175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.158259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.158284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.515 qpair failed and we were unable to recover it. 00:27:29.515 [2024-12-08 02:29:57.158360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.158467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.158492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.515 qpair failed and we were unable to recover it. 00:27:29.515 [2024-12-08 02:29:57.158614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.158703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.158729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.515 qpair failed and we were unable to recover it. 00:27:29.515 [2024-12-08 02:29:57.158806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.158907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.158932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.515 qpair failed and we were unable to recover it. 00:27:29.515 [2024-12-08 02:29:57.159045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.159123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.159147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.515 qpair failed and we were unable to recover it. 00:27:29.515 [2024-12-08 02:29:57.159266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.159344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.159369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.515 qpair failed and we were unable to recover it. 00:27:29.515 [2024-12-08 02:29:57.159449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.159563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.159588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.515 qpair failed and we were unable to recover it. 00:27:29.515 [2024-12-08 02:29:57.159698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.159802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.159827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.515 qpair failed and we were unable to recover it. 00:27:29.515 [2024-12-08 02:29:57.159963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.160042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.160066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.515 qpair failed and we were unable to recover it. 00:27:29.515 [2024-12-08 02:29:57.160159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.160235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.160260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.515 qpair failed and we were unable to recover it. 00:27:29.515 [2024-12-08 02:29:57.160339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.160452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.160477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.515 qpair failed and we were unable to recover it. 00:27:29.515 [2024-12-08 02:29:57.160573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.160651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.160676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.515 qpair failed and we were unable to recover it. 00:27:29.515 [2024-12-08 02:29:57.160763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.160898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.160923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.515 qpair failed and we were unable to recover it. 00:27:29.515 [2024-12-08 02:29:57.161037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.161148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.161173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.515 qpair failed and we were unable to recover it. 00:27:29.515 [2024-12-08 02:29:57.161280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.161360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.161386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.515 qpair failed and we were unable to recover it. 00:27:29.515 [2024-12-08 02:29:57.161469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.161586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.161612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.515 qpair failed and we were unable to recover it. 00:27:29.515 [2024-12-08 02:29:57.161690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.161772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.161797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.515 qpair failed and we were unable to recover it. 00:27:29.515 [2024-12-08 02:29:57.161907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.161992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.162017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.515 qpair failed and we were unable to recover it. 00:27:29.515 [2024-12-08 02:29:57.162122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.162202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.162226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.515 qpair failed and we were unable to recover it. 00:27:29.515 [2024-12-08 02:29:57.162366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.162449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.162474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.515 qpair failed and we were unable to recover it. 00:27:29.515 [2024-12-08 02:29:57.162553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.162632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.162657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.515 qpair failed and we were unable to recover it. 00:27:29.515 [2024-12-08 02:29:57.162754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.162872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.515 [2024-12-08 02:29:57.162897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.515 qpair failed and we were unable to recover it. 00:27:29.516 [2024-12-08 02:29:57.162975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.163082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.163107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.516 qpair failed and we were unable to recover it. 00:27:29.516 [2024-12-08 02:29:57.163249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.163333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.163358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.516 qpair failed and we were unable to recover it. 00:27:29.516 [2024-12-08 02:29:57.163436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.163514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.163556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.516 qpair failed and we were unable to recover it. 00:27:29.516 [2024-12-08 02:29:57.163644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.163722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.163746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.516 qpair failed and we were unable to recover it. 00:27:29.516 [2024-12-08 02:29:57.163884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.163969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.163998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.516 qpair failed and we were unable to recover it. 00:27:29.516 [2024-12-08 02:29:57.164089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.164163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.164187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.516 qpair failed and we were unable to recover it. 00:27:29.516 [2024-12-08 02:29:57.164306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.164385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.164410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.516 qpair failed and we were unable to recover it. 00:27:29.516 [2024-12-08 02:29:57.164500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.164590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.164617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.516 qpair failed and we were unable to recover it. 00:27:29.516 [2024-12-08 02:29:57.164699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.164780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.164805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.516 qpair failed and we were unable to recover it. 00:27:29.516 [2024-12-08 02:29:57.164883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.164969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.164995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.516 qpair failed and we were unable to recover it. 00:27:29.516 [2024-12-08 02:29:57.165077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.165151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.165176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.516 qpair failed and we were unable to recover it. 00:27:29.516 [2024-12-08 02:29:57.165258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.165331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.165356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.516 qpair failed and we were unable to recover it. 00:27:29.516 [2024-12-08 02:29:57.165474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.165612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.165637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.516 qpair failed and we were unable to recover it. 00:27:29.516 [2024-12-08 02:29:57.165722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.165801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.165826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.516 qpair failed and we were unable to recover it. 00:27:29.516 [2024-12-08 02:29:57.165935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.166011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.166036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.516 qpair failed and we were unable to recover it. 00:27:29.516 [2024-12-08 02:29:57.166130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.166248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.166273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.516 qpair failed and we were unable to recover it. 00:27:29.516 [2024-12-08 02:29:57.166357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.166437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.166462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.516 qpair failed and we were unable to recover it. 00:27:29.516 [2024-12-08 02:29:57.166549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.166637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.166661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.516 qpair failed and we were unable to recover it. 00:27:29.516 [2024-12-08 02:29:57.166738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.166850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.166875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.516 qpair failed and we were unable to recover it. 00:27:29.516 [2024-12-08 02:29:57.166951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.167061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.167086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.516 qpair failed and we were unable to recover it. 00:27:29.516 [2024-12-08 02:29:57.167194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.167297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.167322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.516 qpair failed and we were unable to recover it. 00:27:29.516 [2024-12-08 02:29:57.167401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.167481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.167505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.516 qpair failed and we were unable to recover it. 00:27:29.516 [2024-12-08 02:29:57.167622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.167730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.167755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.516 qpair failed and we were unable to recover it. 00:27:29.516 [2024-12-08 02:29:57.167899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.168011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.168037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.516 qpair failed and we were unable to recover it. 00:27:29.516 [2024-12-08 02:29:57.168121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.168199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.168224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.516 qpair failed and we were unable to recover it. 00:27:29.516 [2024-12-08 02:29:57.168308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.168423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.516 [2024-12-08 02:29:57.168454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.516 qpair failed and we were unable to recover it. 00:27:29.517 [2024-12-08 02:29:57.168568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.168683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.168707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.517 qpair failed and we were unable to recover it. 00:27:29.517 [2024-12-08 02:29:57.168784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.168902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.168926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.517 qpair failed and we were unable to recover it. 00:27:29.517 [2024-12-08 02:29:57.169004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.169091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.169116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.517 qpair failed and we were unable to recover it. 00:27:29.517 [2024-12-08 02:29:57.169222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.169311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.169336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.517 qpair failed and we were unable to recover it. 00:27:29.517 [2024-12-08 02:29:57.169444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.169522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.169553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.517 qpair failed and we were unable to recover it. 00:27:29.517 [2024-12-08 02:29:57.169638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.169749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.169774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.517 qpair failed and we were unable to recover it. 00:27:29.517 [2024-12-08 02:29:57.169870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.169958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.169983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.517 qpair failed and we were unable to recover it. 00:27:29.517 [2024-12-08 02:29:57.170072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.170183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.170208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.517 qpair failed and we were unable to recover it. 00:27:29.517 [2024-12-08 02:29:57.170329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.170445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.170470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.517 qpair failed and we were unable to recover it. 00:27:29.517 [2024-12-08 02:29:57.170610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.170698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.170723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.517 qpair failed and we were unable to recover it. 00:27:29.517 [2024-12-08 02:29:57.170813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.170959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.170985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.517 qpair failed and we were unable to recover it. 00:27:29.517 [2024-12-08 02:29:57.171063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.171149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.171175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.517 qpair failed and we were unable to recover it. 00:27:29.517 [2024-12-08 02:29:57.171261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.171333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.171359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.517 qpair failed and we were unable to recover it. 00:27:29.517 [2024-12-08 02:29:57.171451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.171595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.171621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.517 qpair failed and we were unable to recover it. 00:27:29.517 [2024-12-08 02:29:57.171730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.171841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.171866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.517 qpair failed and we were unable to recover it. 00:27:29.517 [2024-12-08 02:29:57.171958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.172038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.172063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.517 qpair failed and we were unable to recover it. 00:27:29.517 [2024-12-08 02:29:57.172140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.172246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.172271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.517 qpair failed and we were unable to recover it. 00:27:29.517 [2024-12-08 02:29:57.172375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.172479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.172504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.517 qpair failed and we were unable to recover it. 00:27:29.517 [2024-12-08 02:29:57.172680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.172800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.172825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.517 qpair failed and we were unable to recover it. 00:27:29.517 [2024-12-08 02:29:57.172906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.173019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.173044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.517 qpair failed and we were unable to recover it. 00:27:29.517 [2024-12-08 02:29:57.173134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.173210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.173235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.517 qpair failed and we were unable to recover it. 00:27:29.517 [2024-12-08 02:29:57.173344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.173416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.173441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.517 qpair failed and we were unable to recover it. 00:27:29.517 [2024-12-08 02:29:57.173519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.173619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.173644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.517 qpair failed and we were unable to recover it. 00:27:29.517 [2024-12-08 02:29:57.173734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.173814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.517 [2024-12-08 02:29:57.173839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.518 qpair failed and we were unable to recover it. 00:27:29.518 [2024-12-08 02:29:57.173917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.174023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.174047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.518 qpair failed and we were unable to recover it. 00:27:29.518 [2024-12-08 02:29:57.174136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.174221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.174246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.518 qpair failed and we were unable to recover it. 00:27:29.518 [2024-12-08 02:29:57.174354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.174467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.174492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.518 qpair failed and we were unable to recover it. 00:27:29.518 [2024-12-08 02:29:57.174615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.174695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.174721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.518 qpair failed and we were unable to recover it. 00:27:29.518 [2024-12-08 02:29:57.174803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.174882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.174906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.518 qpair failed and we were unable to recover it. 00:27:29.518 [2024-12-08 02:29:57.174989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.175074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.175104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.518 qpair failed and we were unable to recover it. 00:27:29.518 [2024-12-08 02:29:57.175210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.175287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.175312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.518 qpair failed and we were unable to recover it. 00:27:29.518 [2024-12-08 02:29:57.175421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.175498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.175523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.518 qpair failed and we were unable to recover it. 00:27:29.518 [2024-12-08 02:29:57.175640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.175718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.175743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.518 qpair failed and we were unable to recover it. 00:27:29.518 [2024-12-08 02:29:57.175821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.175919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.175944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.518 qpair failed and we were unable to recover it. 00:27:29.518 [2024-12-08 02:29:57.176018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.176100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.176125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.518 qpair failed and we were unable to recover it. 00:27:29.518 [2024-12-08 02:29:57.176203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.176281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.176306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.518 qpair failed and we were unable to recover it. 00:27:29.518 [2024-12-08 02:29:57.176422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.176501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.176526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.518 qpair failed and we were unable to recover it. 00:27:29.518 [2024-12-08 02:29:57.176628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.176707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.176732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.518 qpair failed and we were unable to recover it. 00:27:29.518 [2024-12-08 02:29:57.176812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.176915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.176940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.518 qpair failed and we were unable to recover it. 00:27:29.518 [2024-12-08 02:29:57.177019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.177104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.177135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.518 qpair failed and we were unable to recover it. 00:27:29.518 [2024-12-08 02:29:57.177225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.177312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.177337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.518 qpair failed and we were unable to recover it. 00:27:29.518 [2024-12-08 02:29:57.177444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.177520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.177553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.518 qpair failed and we were unable to recover it. 00:27:29.518 [2024-12-08 02:29:57.177638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.177746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.177772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.518 qpair failed and we were unable to recover it. 00:27:29.518 [2024-12-08 02:29:57.177866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.177944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.177969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.518 qpair failed and we were unable to recover it. 00:27:29.518 [2024-12-08 02:29:57.178049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.178137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.178171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.518 qpair failed and we were unable to recover it. 00:27:29.518 [2024-12-08 02:29:57.178251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.178397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.178423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.518 qpair failed and we were unable to recover it. 00:27:29.518 [2024-12-08 02:29:57.178514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.178628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.178654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.518 qpair failed and we were unable to recover it. 00:27:29.518 [2024-12-08 02:29:57.178744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.178852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.178877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.518 qpair failed and we were unable to recover it. 00:27:29.518 [2024-12-08 02:29:57.178955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.179031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.179056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.518 qpair failed and we were unable to recover it. 00:27:29.518 [2024-12-08 02:29:57.179146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.179253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.179285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.518 qpair failed and we were unable to recover it. 00:27:29.518 [2024-12-08 02:29:57.179380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.179453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.179479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.518 qpair failed and we were unable to recover it. 00:27:29.518 [2024-12-08 02:29:57.179596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.179685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.179711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.518 qpair failed and we were unable to recover it. 00:27:29.518 [2024-12-08 02:29:57.179791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.518 [2024-12-08 02:29:57.179912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.179938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.519 qpair failed and we were unable to recover it. 00:27:29.519 [2024-12-08 02:29:57.180032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.180108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.180132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.519 qpair failed and we were unable to recover it. 00:27:29.519 [2024-12-08 02:29:57.180218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.180366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.180391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.519 qpair failed and we were unable to recover it. 00:27:29.519 [2024-12-08 02:29:57.180483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.180576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.180601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.519 qpair failed and we were unable to recover it. 00:27:29.519 [2024-12-08 02:29:57.180681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.180794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.180820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.519 qpair failed and we were unable to recover it. 00:27:29.519 [2024-12-08 02:29:57.180916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.180999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.181025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.519 qpair failed and we were unable to recover it. 00:27:29.519 [2024-12-08 02:29:57.181110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.181248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.181274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.519 qpair failed and we were unable to recover it. 00:27:29.519 [2024-12-08 02:29:57.181384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.181499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.181524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.519 qpair failed and we were unable to recover it. 00:27:29.519 [2024-12-08 02:29:57.181622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.181727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.181752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.519 qpair failed and we were unable to recover it. 00:27:29.519 [2024-12-08 02:29:57.181848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.181929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.181954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.519 qpair failed and we were unable to recover it. 00:27:29.519 [2024-12-08 02:29:57.182041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.182138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.182163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.519 qpair failed and we were unable to recover it. 00:27:29.519 [2024-12-08 02:29:57.182240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.182325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.182350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.519 qpair failed and we were unable to recover it. 00:27:29.519 [2024-12-08 02:29:57.182437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.182515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.182544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.519 qpair failed and we were unable to recover it. 00:27:29.519 [2024-12-08 02:29:57.182628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.182743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.182768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.519 qpair failed and we were unable to recover it. 00:27:29.519 [2024-12-08 02:29:57.182867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.182973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.182998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.519 qpair failed and we were unable to recover it. 00:27:29.519 [2024-12-08 02:29:57.183117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.183225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.183251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.519 qpair failed and we were unable to recover it. 00:27:29.519 [2024-12-08 02:29:57.183331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.183435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.183460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.519 qpair failed and we were unable to recover it. 00:27:29.519 [2024-12-08 02:29:57.183553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.183632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.183657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.519 qpair failed and we were unable to recover it. 00:27:29.519 [2024-12-08 02:29:57.183747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.183866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.183891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.519 qpair failed and we were unable to recover it. 00:27:29.519 [2024-12-08 02:29:57.183970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.184080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.184105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.519 qpair failed and we were unable to recover it. 00:27:29.519 [2024-12-08 02:29:57.184188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.184315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.184341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.519 qpair failed and we were unable to recover it. 00:27:29.519 [2024-12-08 02:29:57.184419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.184560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.184587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.519 qpair failed and we were unable to recover it. 00:27:29.519 [2024-12-08 02:29:57.184693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.184776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.184801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.519 qpair failed and we were unable to recover it. 00:27:29.519 [2024-12-08 02:29:57.184907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.185014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.185039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.519 qpair failed and we were unable to recover it. 00:27:29.519 [2024-12-08 02:29:57.185151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.185229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.185254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.519 qpair failed and we were unable to recover it. 00:27:29.519 [2024-12-08 02:29:57.185337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.185443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.185469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.519 qpair failed and we were unable to recover it. 00:27:29.519 [2024-12-08 02:29:57.185563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.185657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.185683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.519 qpair failed and we were unable to recover it. 00:27:29.519 [2024-12-08 02:29:57.185791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.185881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.185906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.519 qpair failed and we were unable to recover it. 00:27:29.519 [2024-12-08 02:29:57.186026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.186144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.186173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.519 qpair failed and we were unable to recover it. 00:27:29.519 [2024-12-08 02:29:57.186254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.519 [2024-12-08 02:29:57.186359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.186384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.520 qpair failed and we were unable to recover it. 00:27:29.520 [2024-12-08 02:29:57.186469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.186568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.186600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.520 qpair failed and we were unable to recover it. 00:27:29.520 [2024-12-08 02:29:57.186694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.186771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.186796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.520 qpair failed and we were unable to recover it. 00:27:29.520 [2024-12-08 02:29:57.186884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.186987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.187012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.520 qpair failed and we were unable to recover it. 00:27:29.520 [2024-12-08 02:29:57.187094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.187173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.187198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.520 qpair failed and we were unable to recover it. 00:27:29.520 [2024-12-08 02:29:57.187278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.187387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.187413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.520 qpair failed and we were unable to recover it. 00:27:29.520 [2024-12-08 02:29:57.187494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.187648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.187674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.520 qpair failed and we were unable to recover it. 00:27:29.520 [2024-12-08 02:29:57.187788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.187861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.187886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.520 qpair failed and we were unable to recover it. 00:27:29.520 [2024-12-08 02:29:57.187967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.188055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.188080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.520 qpair failed and we were unable to recover it. 00:27:29.520 [2024-12-08 02:29:57.188189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.188274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.188303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.520 qpair failed and we were unable to recover it. 00:27:29.520 [2024-12-08 02:29:57.188387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.188465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.188490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.520 qpair failed and we were unable to recover it. 00:27:29.520 [2024-12-08 02:29:57.188626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.188733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.188758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.520 qpair failed and we were unable to recover it. 00:27:29.520 [2024-12-08 02:29:57.188832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.188949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.188974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.520 qpair failed and we were unable to recover it. 00:27:29.520 [2024-12-08 02:29:57.189084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.189168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.189193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.520 qpair failed and we were unable to recover it. 00:27:29.520 [2024-12-08 02:29:57.189304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.189378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.189403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.520 qpair failed and we were unable to recover it. 00:27:29.520 [2024-12-08 02:29:57.189512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.189640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.189666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.520 qpair failed and we were unable to recover it. 00:27:29.520 [2024-12-08 02:29:57.189748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.189833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.189858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.520 qpair failed and we were unable to recover it. 00:27:29.520 [2024-12-08 02:29:57.189939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.190045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.190071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.520 qpair failed and we were unable to recover it. 00:27:29.520 [2024-12-08 02:29:57.190147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.190251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.190277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.520 qpair failed and we were unable to recover it. 00:27:29.520 [2024-12-08 02:29:57.190354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.190433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.190457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.520 qpair failed and we were unable to recover it. 00:27:29.520 [2024-12-08 02:29:57.190558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.190674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.190699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.520 qpair failed and we were unable to recover it. 00:27:29.520 [2024-12-08 02:29:57.190854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.190933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.190958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.520 qpair failed and we were unable to recover it. 00:27:29.520 [2024-12-08 02:29:57.191067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.191177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.191202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.520 qpair failed and we were unable to recover it. 00:27:29.520 [2024-12-08 02:29:57.191315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.191391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.191416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.520 qpair failed and we were unable to recover it. 00:27:29.520 [2024-12-08 02:29:57.191500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.191612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.191638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.520 qpair failed and we were unable to recover it. 00:27:29.520 [2024-12-08 02:29:57.191755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.191843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.191868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.520 qpair failed and we were unable to recover it. 00:27:29.520 [2024-12-08 02:29:57.191963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.192073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.192105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.520 qpair failed and we were unable to recover it. 00:27:29.520 [2024-12-08 02:29:57.192190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.192268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.520 [2024-12-08 02:29:57.192293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.521 qpair failed and we were unable to recover it. 00:27:29.521 [2024-12-08 02:29:57.192408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.192513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.192544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.521 qpair failed and we were unable to recover it. 00:27:29.521 [2024-12-08 02:29:57.192695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.192776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.192801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.521 qpair failed and we were unable to recover it. 00:27:29.521 [2024-12-08 02:29:57.192952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.193080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.193106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.521 qpair failed and we were unable to recover it. 00:27:29.521 [2024-12-08 02:29:57.193221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.193331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.193356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.521 qpair failed and we were unable to recover it. 00:27:29.521 [2024-12-08 02:29:57.193448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.193556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.193581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.521 qpair failed and we were unable to recover it. 00:27:29.521 [2024-12-08 02:29:57.193661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.193741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.193766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.521 qpair failed and we were unable to recover it. 00:27:29.521 [2024-12-08 02:29:57.193848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.193955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.193980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.521 qpair failed and we were unable to recover it. 00:27:29.521 [2024-12-08 02:29:57.194088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.194196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.194221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.521 qpair failed and we were unable to recover it. 00:27:29.521 [2024-12-08 02:29:57.194296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.194370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.194395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.521 qpair failed and we were unable to recover it. 00:27:29.521 [2024-12-08 02:29:57.194503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.194587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.194612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.521 qpair failed and we were unable to recover it. 00:27:29.521 [2024-12-08 02:29:57.194722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.194840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.194871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.521 qpair failed and we were unable to recover it. 00:27:29.521 [2024-12-08 02:29:57.194962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.195040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.195065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.521 qpair failed and we were unable to recover it. 00:27:29.521 [2024-12-08 02:29:57.195176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.195286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.195311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.521 qpair failed and we were unable to recover it. 00:27:29.521 [2024-12-08 02:29:57.195391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.195472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.195498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.521 qpair failed and we were unable to recover it. 00:27:29.521 [2024-12-08 02:29:57.195599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.195705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.195730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.521 qpair failed and we were unable to recover it. 00:27:29.521 [2024-12-08 02:29:57.195812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.195893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.195924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.521 qpair failed and we were unable to recover it. 00:27:29.521 [2024-12-08 02:29:57.196037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.196117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.196144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.521 qpair failed and we were unable to recover it. 00:27:29.521 [2024-12-08 02:29:57.196233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.196312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.196337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.521 qpair failed and we were unable to recover it. 00:27:29.521 [2024-12-08 02:29:57.196423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.196563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.196591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.521 qpair failed and we were unable to recover it. 00:27:29.521 [2024-12-08 02:29:57.196667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.196747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.196772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.521 qpair failed and we were unable to recover it. 00:27:29.521 [2024-12-08 02:29:57.196883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.196961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.196986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.521 qpair failed and we were unable to recover it. 00:27:29.521 [2024-12-08 02:29:57.197095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.197199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.197224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.521 qpair failed and we were unable to recover it. 00:27:29.521 [2024-12-08 02:29:57.197316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.197393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.197418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.521 qpair failed and we were unable to recover it. 00:27:29.521 [2024-12-08 02:29:57.197525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.197616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.197641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.521 qpair failed and we were unable to recover it. 00:27:29.521 [2024-12-08 02:29:57.197720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.197801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.197826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.521 qpair failed and we were unable to recover it. 00:27:29.521 [2024-12-08 02:29:57.197945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.198028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.521 [2024-12-08 02:29:57.198052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.522 qpair failed and we were unable to recover it. 00:27:29.522 [2024-12-08 02:29:57.198131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.198243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.198269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.522 qpair failed and we were unable to recover it. 00:27:29.522 [2024-12-08 02:29:57.198360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.198466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.198491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.522 qpair failed and we were unable to recover it. 00:27:29.522 [2024-12-08 02:29:57.198576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.198660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.198685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.522 qpair failed and we were unable to recover it. 00:27:29.522 [2024-12-08 02:29:57.198798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.198904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.198929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.522 qpair failed and we were unable to recover it. 00:27:29.522 [2024-12-08 02:29:57.199079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.199168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.199194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.522 qpair failed and we were unable to recover it. 00:27:29.522 [2024-12-08 02:29:57.199273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.199353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.199379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.522 qpair failed and we were unable to recover it. 00:27:29.522 [2024-12-08 02:29:57.199468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.199589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.199620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.522 qpair failed and we were unable to recover it. 00:27:29.522 [2024-12-08 02:29:57.199700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.199785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.199810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.522 qpair failed and we were unable to recover it. 00:27:29.522 [2024-12-08 02:29:57.199943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.200017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.200042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.522 qpair failed and we were unable to recover it. 00:27:29.522 [2024-12-08 02:29:57.200159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.200237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.200263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.522 qpair failed and we were unable to recover it. 00:27:29.522 [2024-12-08 02:29:57.200344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.200450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.200474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.522 qpair failed and we were unable to recover it. 00:27:29.522 [2024-12-08 02:29:57.200579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.200661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.200686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.522 qpair failed and we were unable to recover it. 00:27:29.522 [2024-12-08 02:29:57.200766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.200848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.200873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.522 qpair failed and we were unable to recover it. 00:27:29.522 [2024-12-08 02:29:57.200954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.201079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.201104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.522 qpair failed and we were unable to recover it. 00:27:29.522 [2024-12-08 02:29:57.201183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.201295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.201320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.522 qpair failed and we were unable to recover it. 00:27:29.522 [2024-12-08 02:29:57.201429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.201510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.201550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.522 qpair failed and we were unable to recover it. 00:27:29.522 [2024-12-08 02:29:57.201635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.201738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.201763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.522 qpair failed and we were unable to recover it. 00:27:29.522 [2024-12-08 02:29:57.201845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.201916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.201940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.522 qpair failed and we were unable to recover it. 00:27:29.522 [2024-12-08 02:29:57.202039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.202151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.202176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.522 qpair failed and we were unable to recover it. 00:27:29.522 [2024-12-08 02:29:57.202250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.202360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.202385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.522 qpair failed and we were unable to recover it. 00:27:29.522 [2024-12-08 02:29:57.202496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.202580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.202606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.522 qpair failed and we were unable to recover it. 00:27:29.522 [2024-12-08 02:29:57.202711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.202789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.202814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.522 qpair failed and we were unable to recover it. 00:27:29.522 [2024-12-08 02:29:57.202936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.203038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.203063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.522 qpair failed and we were unable to recover it. 00:27:29.522 [2024-12-08 02:29:57.203142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.203224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.203249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.522 qpair failed and we were unable to recover it. 00:27:29.522 [2024-12-08 02:29:57.203360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.203442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.203467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.522 qpair failed and we were unable to recover it. 00:27:29.522 [2024-12-08 02:29:57.203586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.203696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.203722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.522 qpair failed and we were unable to recover it. 00:27:29.522 [2024-12-08 02:29:57.203839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.203947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.522 [2024-12-08 02:29:57.203972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.522 qpair failed and we were unable to recover it. 00:27:29.522 [2024-12-08 02:29:57.204079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.204190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.204215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.523 qpair failed and we were unable to recover it. 00:27:29.523 [2024-12-08 02:29:57.204302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.204381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.204406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.523 qpair failed and we were unable to recover it. 00:27:29.523 [2024-12-08 02:29:57.204480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.204570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.204596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.523 qpair failed and we were unable to recover it. 00:27:29.523 [2024-12-08 02:29:57.204693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.204805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.204831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.523 qpair failed and we were unable to recover it. 00:27:29.523 [2024-12-08 02:29:57.204954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.205038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.205063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.523 qpair failed and we were unable to recover it. 00:27:29.523 [2024-12-08 02:29:57.205190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.205309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.205334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.523 qpair failed and we were unable to recover it. 00:27:29.523 [2024-12-08 02:29:57.205422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.205511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.205552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.523 qpair failed and we were unable to recover it. 00:27:29.523 [2024-12-08 02:29:57.205635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.205712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.205737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.523 qpair failed and we were unable to recover it. 00:27:29.523 [2024-12-08 02:29:57.205810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.205896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.205931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.523 qpair failed and we were unable to recover it. 00:27:29.523 [2024-12-08 02:29:57.206019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.206110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.206135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.523 qpair failed and we were unable to recover it. 00:27:29.523 [2024-12-08 02:29:57.206289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.206396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.206422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.523 qpair failed and we were unable to recover it. 00:27:29.523 [2024-12-08 02:29:57.206502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.206588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.206613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.523 qpair failed and we were unable to recover it. 00:27:29.523 [2024-12-08 02:29:57.206691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.206768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.206793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.523 qpair failed and we were unable to recover it. 00:27:29.523 [2024-12-08 02:29:57.206913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.207020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.207045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.523 qpair failed and we were unable to recover it. 00:27:29.523 [2024-12-08 02:29:57.207134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.207208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.207233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.523 qpair failed and we were unable to recover it. 00:27:29.523 [2024-12-08 02:29:57.207307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.207388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.207414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.523 qpair failed and we were unable to recover it. 00:27:29.523 [2024-12-08 02:29:57.207522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.207649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.207673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.523 qpair failed and we were unable to recover it. 00:27:29.523 [2024-12-08 02:29:57.207753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.207861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.207886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.523 qpair failed and we were unable to recover it. 00:27:29.523 [2024-12-08 02:29:57.207962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.208088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.208113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.523 qpair failed and we were unable to recover it. 00:27:29.523 [2024-12-08 02:29:57.208236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.208320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.208345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.523 qpair failed and we were unable to recover it. 00:27:29.523 [2024-12-08 02:29:57.208425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.208572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.208599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.523 qpair failed and we were unable to recover it. 00:27:29.523 [2024-12-08 02:29:57.208683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.208769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.208794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.523 qpair failed and we were unable to recover it. 00:27:29.523 [2024-12-08 02:29:57.208886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.208964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.208989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.523 qpair failed and we were unable to recover it. 00:27:29.523 [2024-12-08 02:29:57.209074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.209148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.209173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.523 qpair failed and we were unable to recover it. 00:27:29.523 [2024-12-08 02:29:57.209284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.209372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.209397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.523 qpair failed and we were unable to recover it. 00:27:29.523 [2024-12-08 02:29:57.209474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.209563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.209589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.523 qpair failed and we were unable to recover it. 00:27:29.523 [2024-12-08 02:29:57.209711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.209820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.209856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.523 qpair failed and we were unable to recover it. 00:27:29.523 [2024-12-08 02:29:57.209936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.210040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.210065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.523 qpair failed and we were unable to recover it. 00:27:29.523 [2024-12-08 02:29:57.210150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.523 [2024-12-08 02:29:57.210291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.210316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.524 qpair failed and we were unable to recover it. 00:27:29.524 [2024-12-08 02:29:57.210398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.210505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.210530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.524 qpair failed and we were unable to recover it. 00:27:29.524 [2024-12-08 02:29:57.210650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.210724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.210755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.524 qpair failed and we were unable to recover it. 00:27:29.524 [2024-12-08 02:29:57.210833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.210945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.210970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.524 qpair failed and we were unable to recover it. 00:27:29.524 [2024-12-08 02:29:57.211078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.211152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.211177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.524 qpair failed and we were unable to recover it. 00:27:29.524 [2024-12-08 02:29:57.211260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.211349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.211381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.524 qpair failed and we were unable to recover it. 00:27:29.524 [2024-12-08 02:29:57.211491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.211592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.211619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.524 qpair failed and we were unable to recover it. 00:27:29.524 [2024-12-08 02:29:57.211705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.211810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.211843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.524 qpair failed and we were unable to recover it. 00:27:29.524 [2024-12-08 02:29:57.211959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.212035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.212067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.524 qpair failed and we were unable to recover it. 00:27:29.524 [2024-12-08 02:29:57.212150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.212227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.212252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.524 qpair failed and we were unable to recover it. 00:27:29.524 [2024-12-08 02:29:57.212359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.212435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.212460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.524 qpair failed and we were unable to recover it. 00:27:29.524 [2024-12-08 02:29:57.212551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.212630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.212655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.524 qpair failed and we were unable to recover it. 00:27:29.524 [2024-12-08 02:29:57.212763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.212879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.212904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.524 qpair failed and we were unable to recover it. 00:27:29.524 [2024-12-08 02:29:57.212993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.213071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.213096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.524 qpair failed and we were unable to recover it. 00:27:29.524 [2024-12-08 02:29:57.213204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.213284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.213308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.524 qpair failed and we were unable to recover it. 00:27:29.524 [2024-12-08 02:29:57.213419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.213494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.213519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.524 qpair failed and we were unable to recover it. 00:27:29.524 [2024-12-08 02:29:57.213639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.213719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.213745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.524 qpair failed and we were unable to recover it. 00:27:29.524 [2024-12-08 02:29:57.213829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.213940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.213965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.524 qpair failed and we were unable to recover it. 00:27:29.524 [2024-12-08 02:29:57.214055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.214161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.214186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.524 qpair failed and we were unable to recover it. 00:27:29.524 [2024-12-08 02:29:57.214269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.214346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.214371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.524 qpair failed and we were unable to recover it. 00:27:29.524 [2024-12-08 02:29:57.214475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.214568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.214594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.524 qpair failed and we were unable to recover it. 00:27:29.524 [2024-12-08 02:29:57.214670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.214756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.214781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.524 qpair failed and we were unable to recover it. 00:27:29.524 [2024-12-08 02:29:57.214876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.214983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.215008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.524 qpair failed and we were unable to recover it. 00:27:29.524 [2024-12-08 02:29:57.215098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.215184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.215210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.524 qpair failed and we were unable to recover it. 00:27:29.524 [2024-12-08 02:29:57.215297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.215399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.215424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.524 qpair failed and we were unable to recover it. 00:27:29.524 [2024-12-08 02:29:57.215535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.215634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.215660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.524 qpair failed and we were unable to recover it. 00:27:29.524 [2024-12-08 02:29:57.215750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.215860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.215895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.524 qpair failed and we were unable to recover it. 00:27:29.524 [2024-12-08 02:29:57.215978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.216083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.216108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.524 qpair failed and we were unable to recover it. 00:27:29.524 [2024-12-08 02:29:57.216220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.216296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.216321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.524 qpair failed and we were unable to recover it. 00:27:29.524 [2024-12-08 02:29:57.216399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.524 [2024-12-08 02:29:57.216510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.216541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.525 qpair failed and we were unable to recover it. 00:27:29.525 [2024-12-08 02:29:57.216624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.216701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.216726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.525 qpair failed and we were unable to recover it. 00:27:29.525 [2024-12-08 02:29:57.216810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.216891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.216917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.525 qpair failed and we were unable to recover it. 00:27:29.525 [2024-12-08 02:29:57.217027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.217126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.217151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.525 qpair failed and we were unable to recover it. 00:27:29.525 [2024-12-08 02:29:57.217309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.217389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.217414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.525 qpair failed and we were unable to recover it. 00:27:29.525 [2024-12-08 02:29:57.217532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.217658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.217684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.525 qpair failed and we were unable to recover it. 00:27:29.525 [2024-12-08 02:29:57.217764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.217880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.217905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.525 qpair failed and we were unable to recover it. 00:27:29.525 [2024-12-08 02:29:57.218024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.218103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.218128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.525 qpair failed and we were unable to recover it. 00:27:29.525 [2024-12-08 02:29:57.218240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.218317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.218342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.525 qpair failed and we were unable to recover it. 00:27:29.525 [2024-12-08 02:29:57.218478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.218599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.218625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.525 qpair failed and we were unable to recover it. 00:27:29.525 [2024-12-08 02:29:57.218702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.218783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.218809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.525 qpair failed and we were unable to recover it. 00:27:29.525 [2024-12-08 02:29:57.218936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.219052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.219077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.525 qpair failed and we were unable to recover it. 00:27:29.525 [2024-12-08 02:29:57.219169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.219249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.219274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.525 qpair failed and we were unable to recover it. 00:27:29.525 [2024-12-08 02:29:57.219355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.219482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.219508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.525 qpair failed and we were unable to recover it. 00:27:29.525 [2024-12-08 02:29:57.219662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.219745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.219771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.525 qpair failed and we were unable to recover it. 00:27:29.525 [2024-12-08 02:29:57.219860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.219975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.220000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.525 qpair failed and we were unable to recover it. 00:27:29.525 [2024-12-08 02:29:57.220080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.220185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.220210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.525 qpair failed and we were unable to recover it. 00:27:29.525 [2024-12-08 02:29:57.220329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.220445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.220470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.525 qpair failed and we were unable to recover it. 00:27:29.525 [2024-12-08 02:29:57.220580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.220659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.220684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.525 qpair failed and we were unable to recover it. 00:27:29.525 [2024-12-08 02:29:57.220775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.220888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.220914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.525 qpair failed and we were unable to recover it. 00:27:29.525 [2024-12-08 02:29:57.221026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.221105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.221130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.525 qpair failed and we were unable to recover it. 00:27:29.525 [2024-12-08 02:29:57.221241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.221318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.221344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.525 qpair failed and we were unable to recover it. 00:27:29.525 [2024-12-08 02:29:57.221430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.221505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.221530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.525 qpair failed and we were unable to recover it. 00:27:29.525 [2024-12-08 02:29:57.221616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.525 [2024-12-08 02:29:57.221692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.526 [2024-12-08 02:29:57.221717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.526 qpair failed and we were unable to recover it. 00:27:29.526 [2024-12-08 02:29:57.221805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.526 [2024-12-08 02:29:57.221909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.526 [2024-12-08 02:29:57.221939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.526 qpair failed and we were unable to recover it. 00:27:29.526 [2024-12-08 02:29:57.222026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.526 [2024-12-08 02:29:57.222108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.526 [2024-12-08 02:29:57.222133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.526 qpair failed and we were unable to recover it. 00:27:29.526 [2024-12-08 02:29:57.222251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.526 [2024-12-08 02:29:57.222359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.526 [2024-12-08 02:29:57.222383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.526 qpair failed and we were unable to recover it. 00:27:29.526 [2024-12-08 02:29:57.222493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.526 [2024-12-08 02:29:57.222601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.526 [2024-12-08 02:29:57.222627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.526 qpair failed and we were unable to recover it. 00:27:29.526 [2024-12-08 02:29:57.222706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.526 [2024-12-08 02:29:57.222787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.526 [2024-12-08 02:29:57.222813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.526 qpair failed and we were unable to recover it. 00:27:29.526 [2024-12-08 02:29:57.222895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.526 [2024-12-08 02:29:57.222970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.526 [2024-12-08 02:29:57.222998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.526 qpair failed and we were unable to recover it. 00:27:29.526 [2024-12-08 02:29:57.223114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.526 [2024-12-08 02:29:57.223192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.526 [2024-12-08 02:29:57.223218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.526 qpair failed and we were unable to recover it. 00:27:29.526 [2024-12-08 02:29:57.223306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.526 [2024-12-08 02:29:57.223396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.526 [2024-12-08 02:29:57.223422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.526 qpair failed and we were unable to recover it. 00:27:29.526 [2024-12-08 02:29:57.223505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.526 [2024-12-08 02:29:57.223597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.526 [2024-12-08 02:29:57.223622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.526 qpair failed and we were unable to recover it. 00:27:29.526 [2024-12-08 02:29:57.223741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.526 [2024-12-08 02:29:57.223818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.526 [2024-12-08 02:29:57.223851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.526 qpair failed and we were unable to recover it. 00:27:29.526 [2024-12-08 02:29:57.223936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.526 [2024-12-08 02:29:57.224009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.526 [2024-12-08 02:29:57.224038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.526 qpair failed and we were unable to recover it. 00:27:29.526 [2024-12-08 02:29:57.224159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.526 [2024-12-08 02:29:57.224262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.526 [2024-12-08 02:29:57.224287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.526 qpair failed and we were unable to recover it. 00:27:29.526 [2024-12-08 02:29:57.224398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.526 [2024-12-08 02:29:57.224547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.526 [2024-12-08 02:29:57.224575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.526 qpair failed and we were unable to recover it. 00:27:29.526 [2024-12-08 02:29:57.224656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.526 [2024-12-08 02:29:57.224795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.526 [2024-12-08 02:29:57.224821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.526 qpair failed and we were unable to recover it. 00:27:29.526 [2024-12-08 02:29:57.224901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.801 [2024-12-08 02:29:57.225017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.801 [2024-12-08 02:29:57.225043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.801 qpair failed and we were unable to recover it. 00:27:29.801 [2024-12-08 02:29:57.225127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.801 [2024-12-08 02:29:57.225207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.801 [2024-12-08 02:29:57.225232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.801 qpair failed and we were unable to recover it. 00:27:29.801 [2024-12-08 02:29:57.225315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.801 [2024-12-08 02:29:57.225424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.801 [2024-12-08 02:29:57.225450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.801 qpair failed and we were unable to recover it. 00:27:29.801 [2024-12-08 02:29:57.225535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.801 [2024-12-08 02:29:57.225621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.801 [2024-12-08 02:29:57.225650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.801 qpair failed and we were unable to recover it. 00:27:29.801 [2024-12-08 02:29:57.225740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.801 [2024-12-08 02:29:57.225857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.801 [2024-12-08 02:29:57.225882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.801 qpair failed and we were unable to recover it. 00:27:29.801 [2024-12-08 02:29:57.226004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.801 [2024-12-08 02:29:57.226080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.801 [2024-12-08 02:29:57.226105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.801 qpair failed and we were unable to recover it. 00:27:29.801 [2024-12-08 02:29:57.226181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.801 [2024-12-08 02:29:57.226317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.801 [2024-12-08 02:29:57.226342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.801 qpair failed and we were unable to recover it. 00:27:29.801 [2024-12-08 02:29:57.226428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.801 [2024-12-08 02:29:57.226534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.801 [2024-12-08 02:29:57.226567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.801 qpair failed and we were unable to recover it. 00:27:29.801 [2024-12-08 02:29:57.226650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.801 [2024-12-08 02:29:57.226760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.801 [2024-12-08 02:29:57.226785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.801 qpair failed and we were unable to recover it. 00:27:29.801 [2024-12-08 02:29:57.226926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.801 [2024-12-08 02:29:57.227003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.801 [2024-12-08 02:29:57.227028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.801 qpair failed and we were unable to recover it. 00:27:29.801 [2024-12-08 02:29:57.227109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.801 [2024-12-08 02:29:57.227191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.801 [2024-12-08 02:29:57.227216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.801 qpair failed and we were unable to recover it. 00:27:29.801 [2024-12-08 02:29:57.227297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.801 [2024-12-08 02:29:57.227371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.801 [2024-12-08 02:29:57.227396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.801 qpair failed and we were unable to recover it. 00:27:29.801 [2024-12-08 02:29:57.227504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.801 [2024-12-08 02:29:57.227592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.801 [2024-12-08 02:29:57.227618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.801 qpair failed and we were unable to recover it. 00:27:29.801 [2024-12-08 02:29:57.227723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.801 [2024-12-08 02:29:57.227801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.801 [2024-12-08 02:29:57.227825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.801 qpair failed and we were unable to recover it. 00:27:29.801 [2024-12-08 02:29:57.227905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.801 [2024-12-08 02:29:57.227981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.801 [2024-12-08 02:29:57.228006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.801 qpair failed and we were unable to recover it. 00:27:29.801 [2024-12-08 02:29:57.228117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.801 [2024-12-08 02:29:57.228206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.801 [2024-12-08 02:29:57.228232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.801 qpair failed and we were unable to recover it. 00:27:29.801 [2024-12-08 02:29:57.228318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.801 [2024-12-08 02:29:57.228398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.801 [2024-12-08 02:29:57.228423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.801 qpair failed and we were unable to recover it. 00:27:29.801 [2024-12-08 02:29:57.228535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.801 [2024-12-08 02:29:57.228638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.228663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.802 qpair failed and we were unable to recover it. 00:27:29.802 [2024-12-08 02:29:57.228802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.228895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.228920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.802 qpair failed and we were unable to recover it. 00:27:29.802 [2024-12-08 02:29:57.229000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.229078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.229104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.802 qpair failed and we were unable to recover it. 00:27:29.802 [2024-12-08 02:29:57.229186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.229275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.229300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.802 qpair failed and we were unable to recover it. 00:27:29.802 [2024-12-08 02:29:57.229381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.229456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.229482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.802 qpair failed and we were unable to recover it. 00:27:29.802 [2024-12-08 02:29:57.229605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.229715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.229740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.802 qpair failed and we were unable to recover it. 00:27:29.802 [2024-12-08 02:29:57.229818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.229927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.229952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.802 qpair failed and we were unable to recover it. 00:27:29.802 [2024-12-08 02:29:57.230043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.230121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.230146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.802 qpair failed and we were unable to recover it. 00:27:29.802 [2024-12-08 02:29:57.230286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.230369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.230394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.802 qpair failed and we were unable to recover it. 00:27:29.802 [2024-12-08 02:29:57.230509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.230599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.230624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.802 qpair failed and we were unable to recover it. 00:27:29.802 [2024-12-08 02:29:57.230713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.230804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.230830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.802 qpair failed and we were unable to recover it. 00:27:29.802 [2024-12-08 02:29:57.230942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.231021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.231046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.802 qpair failed and we were unable to recover it. 00:27:29.802 [2024-12-08 02:29:57.231159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.231245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.231270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.802 qpair failed and we were unable to recover it. 00:27:29.802 [2024-12-08 02:29:57.231350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.231438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.231463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.802 qpair failed and we were unable to recover it. 00:27:29.802 [2024-12-08 02:29:57.231547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.231621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.231646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.802 qpair failed and we were unable to recover it. 00:27:29.802 [2024-12-08 02:29:57.231725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.231819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.231854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.802 qpair failed and we were unable to recover it. 00:27:29.802 [2024-12-08 02:29:57.231932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.232009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.232034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.802 qpair failed and we were unable to recover it. 00:27:29.802 [2024-12-08 02:29:57.232122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.232239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.232264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.802 qpair failed and we were unable to recover it. 00:27:29.802 [2024-12-08 02:29:57.232352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.232458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.232484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.802 qpair failed and we were unable to recover it. 00:27:29.802 [2024-12-08 02:29:57.232612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.232721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.232746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.802 qpair failed and we were unable to recover it. 00:27:29.802 [2024-12-08 02:29:57.232835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.232950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.232975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.802 qpair failed and we were unable to recover it. 00:27:29.802 [2024-12-08 02:29:57.233069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.233151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.233176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.802 qpair failed and we were unable to recover it. 00:27:29.802 [2024-12-08 02:29:57.233263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.233402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.233428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.802 qpair failed and we were unable to recover it. 00:27:29.802 [2024-12-08 02:29:57.233518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.233630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.233656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.802 qpair failed and we were unable to recover it. 00:27:29.802 [2024-12-08 02:29:57.233764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.233884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.233909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.802 qpair failed and we were unable to recover it. 00:27:29.802 [2024-12-08 02:29:57.234021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.234102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.234127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.802 qpair failed and we were unable to recover it. 00:27:29.802 [2024-12-08 02:29:57.234216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.234294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.234319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.802 qpair failed and we were unable to recover it. 00:27:29.802 [2024-12-08 02:29:57.234410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.802 [2024-12-08 02:29:57.234488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.234513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.803 qpair failed and we were unable to recover it. 00:27:29.803 [2024-12-08 02:29:57.234659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.234752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.234781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.803 qpair failed and we were unable to recover it. 00:27:29.803 [2024-12-08 02:29:57.234897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.234990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.235017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.803 qpair failed and we were unable to recover it. 00:27:29.803 [2024-12-08 02:29:57.235096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.235207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.235246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.803 qpair failed and we were unable to recover it. 00:27:29.803 [2024-12-08 02:29:57.235328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.235441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.235466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.803 qpair failed and we were unable to recover it. 00:27:29.803 [2024-12-08 02:29:57.235562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.235640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.235666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.803 qpair failed and we were unable to recover it. 00:27:29.803 [2024-12-08 02:29:57.235781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.235872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.235898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.803 qpair failed and we were unable to recover it. 00:27:29.803 [2024-12-08 02:29:57.235982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.236091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.236116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.803 qpair failed and we were unable to recover it. 00:27:29.803 [2024-12-08 02:29:57.236198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.236271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.236297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.803 qpair failed and we were unable to recover it. 00:27:29.803 [2024-12-08 02:29:57.236370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.236461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.236486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.803 qpair failed and we were unable to recover it. 00:27:29.803 [2024-12-08 02:29:57.236626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.236705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.236731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.803 qpair failed and we were unable to recover it. 00:27:29.803 [2024-12-08 02:29:57.236815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.236888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.236913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.803 qpair failed and we were unable to recover it. 00:27:29.803 [2024-12-08 02:29:57.236997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.237086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.237112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.803 qpair failed and we were unable to recover it. 00:27:29.803 [2024-12-08 02:29:57.237192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.237302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.237333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.803 qpair failed and we were unable to recover it. 00:27:29.803 [2024-12-08 02:29:57.237421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.237559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.237586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.803 qpair failed and we were unable to recover it. 00:27:29.803 [2024-12-08 02:29:57.237699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.237787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.237813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.803 qpair failed and we were unable to recover it. 00:27:29.803 [2024-12-08 02:29:57.237896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.238037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.238063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.803 qpair failed and we were unable to recover it. 00:27:29.803 [2024-12-08 02:29:57.238145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.238230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.238257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.803 qpair failed and we were unable to recover it. 00:27:29.803 [2024-12-08 02:29:57.238340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.238462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.238489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.803 qpair failed and we were unable to recover it. 00:27:29.803 [2024-12-08 02:29:57.238599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.238679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.238704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.803 qpair failed and we were unable to recover it. 00:27:29.803 [2024-12-08 02:29:57.238782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.238864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.238892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.803 qpair failed and we were unable to recover it. 00:27:29.803 [2024-12-08 02:29:57.238977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.239069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.239094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.803 qpair failed and we were unable to recover it. 00:27:29.803 [2024-12-08 02:29:57.239235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.239326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.239352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.803 qpair failed and we were unable to recover it. 00:27:29.803 [2024-12-08 02:29:57.239471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.239563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.239589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.803 qpair failed and we were unable to recover it. 00:27:29.803 [2024-12-08 02:29:57.239736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.239818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.239851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.803 qpair failed and we were unable to recover it. 00:27:29.803 [2024-12-08 02:29:57.239941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.240017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.240046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.803 qpair failed and we were unable to recover it. 00:27:29.803 [2024-12-08 02:29:57.240156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.240265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.240290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.803 qpair failed and we were unable to recover it. 00:27:29.803 [2024-12-08 02:29:57.240403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.240479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.240504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.803 qpair failed and we were unable to recover it. 00:27:29.803 [2024-12-08 02:29:57.240593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.240671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.803 [2024-12-08 02:29:57.240697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.804 qpair failed and we were unable to recover it. 00:27:29.804 [2024-12-08 02:29:57.240776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.240862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.240887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.804 qpair failed and we were unable to recover it. 00:27:29.804 [2024-12-08 02:29:57.240964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.241074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.241099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.804 qpair failed and we were unable to recover it. 00:27:29.804 [2024-12-08 02:29:57.241214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.241303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.241330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.804 qpair failed and we were unable to recover it. 00:27:29.804 [2024-12-08 02:29:57.241414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.241497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.241522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.804 qpair failed and we were unable to recover it. 00:27:29.804 [2024-12-08 02:29:57.241610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.241697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.241724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.804 qpair failed and we were unable to recover it. 00:27:29.804 [2024-12-08 02:29:57.241858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.241940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.241967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.804 qpair failed and we were unable to recover it. 00:27:29.804 [2024-12-08 02:29:57.242050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.242132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.242163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.804 qpair failed and we were unable to recover it. 00:27:29.804 [2024-12-08 02:29:57.242241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.242353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.242379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.804 qpair failed and we were unable to recover it. 00:27:29.804 [2024-12-08 02:29:57.242498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.242601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.242627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.804 qpair failed and we were unable to recover it. 00:27:29.804 [2024-12-08 02:29:57.242740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.242827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.242852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.804 qpair failed and we were unable to recover it. 00:27:29.804 [2024-12-08 02:29:57.242936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.243021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.243046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.804 qpair failed and we were unable to recover it. 00:27:29.804 [2024-12-08 02:29:57.243155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.243266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.243293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.804 qpair failed and we were unable to recover it. 00:27:29.804 [2024-12-08 02:29:57.243375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.243487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.243522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.804 qpair failed and we were unable to recover it. 00:27:29.804 [2024-12-08 02:29:57.243649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.243739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.243765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.804 qpair failed and we were unable to recover it. 00:27:29.804 [2024-12-08 02:29:57.243852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.243954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.243979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.804 qpair failed and we were unable to recover it. 00:27:29.804 [2024-12-08 02:29:57.244065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.244148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.244173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.804 qpair failed and we were unable to recover it. 00:27:29.804 [2024-12-08 02:29:57.244262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.244342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.244369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.804 qpair failed and we were unable to recover it. 00:27:29.804 [2024-12-08 02:29:57.244482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.244586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.244612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.804 qpair failed and we were unable to recover it. 00:27:29.804 [2024-12-08 02:29:57.244729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.244817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.244852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.804 qpair failed and we were unable to recover it. 00:27:29.804 [2024-12-08 02:29:57.244936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.245046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.245072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.804 qpair failed and we were unable to recover it. 00:27:29.804 [2024-12-08 02:29:57.245166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.245250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.245276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.804 qpair failed and we were unable to recover it. 00:27:29.804 [2024-12-08 02:29:57.245384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.245491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.245517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.804 qpair failed and we were unable to recover it. 00:27:29.804 [2024-12-08 02:29:57.245614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.245719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.245743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.804 qpair failed and we were unable to recover it. 00:27:29.804 [2024-12-08 02:29:57.245822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.245909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.245935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.804 qpair failed and we were unable to recover it. 00:27:29.804 [2024-12-08 02:29:57.246044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.246128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.246154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.804 qpair failed and we were unable to recover it. 00:27:29.804 [2024-12-08 02:29:57.246303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.246380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.246406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.804 qpair failed and we were unable to recover it. 00:27:29.804 [2024-12-08 02:29:57.246527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.246643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.246668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.804 qpair failed and we were unable to recover it. 00:27:29.804 [2024-12-08 02:29:57.246751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.804 [2024-12-08 02:29:57.246860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.246886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.805 qpair failed and we were unable to recover it. 00:27:29.805 [2024-12-08 02:29:57.246971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.247062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.247088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.805 qpair failed and we were unable to recover it. 00:27:29.805 [2024-12-08 02:29:57.247200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.247278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.247304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.805 qpair failed and we were unable to recover it. 00:27:29.805 [2024-12-08 02:29:57.247409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.247528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.247558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.805 qpair failed and we were unable to recover it. 00:27:29.805 [2024-12-08 02:29:57.247672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.247749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.247774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.805 qpair failed and we were unable to recover it. 00:27:29.805 [2024-12-08 02:29:57.247903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.248014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.248039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.805 qpair failed and we were unable to recover it. 00:27:29.805 [2024-12-08 02:29:57.248120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.248216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.248241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.805 qpair failed and we were unable to recover it. 00:27:29.805 [2024-12-08 02:29:57.248320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.248430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.248455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.805 qpair failed and we were unable to recover it. 00:27:29.805 [2024-12-08 02:29:57.248552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.248637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.248663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.805 qpair failed and we were unable to recover it. 00:27:29.805 [2024-12-08 02:29:57.248758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.248841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.248871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.805 qpair failed and we were unable to recover it. 00:27:29.805 [2024-12-08 02:29:57.248980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.249056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.249080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.805 qpair failed and we were unable to recover it. 00:27:29.805 [2024-12-08 02:29:57.249159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.249267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.249293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.805 qpair failed and we were unable to recover it. 00:27:29.805 [2024-12-08 02:29:57.249371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.249446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.249470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.805 qpair failed and we were unable to recover it. 00:27:29.805 [2024-12-08 02:29:57.249572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.249713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.249738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.805 qpair failed and we were unable to recover it. 00:27:29.805 [2024-12-08 02:29:57.249856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.249962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.249987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.805 qpair failed and we were unable to recover it. 00:27:29.805 [2024-12-08 02:29:57.250067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.250146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.250172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.805 qpair failed and we were unable to recover it. 00:27:29.805 [2024-12-08 02:29:57.250250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.250387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.250412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.805 qpair failed and we were unable to recover it. 00:27:29.805 [2024-12-08 02:29:57.250497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.250589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.250614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.805 qpair failed and we were unable to recover it. 00:27:29.805 [2024-12-08 02:29:57.250699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.250781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.250806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.805 qpair failed and we were unable to recover it. 00:27:29.805 [2024-12-08 02:29:57.250921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.251028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.251053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.805 qpair failed and we were unable to recover it. 00:27:29.805 [2024-12-08 02:29:57.251132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.251259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.251292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.805 qpair failed and we were unable to recover it. 00:27:29.805 [2024-12-08 02:29:57.251413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.251498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.251524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.805 qpair failed and we were unable to recover it. 00:27:29.805 [2024-12-08 02:29:57.251614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.251721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.251746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.805 qpair failed and we were unable to recover it. 00:27:29.805 [2024-12-08 02:29:57.251831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.251963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.251988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.805 qpair failed and we were unable to recover it. 00:27:29.805 [2024-12-08 02:29:57.252071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.252157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.252182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.805 qpair failed and we were unable to recover it. 00:27:29.805 [2024-12-08 02:29:57.252270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.252361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.252387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.805 qpair failed and we were unable to recover it. 00:27:29.805 [2024-12-08 02:29:57.252535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.252620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.805 [2024-12-08 02:29:57.252645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.805 qpair failed and we were unable to recover it. 00:27:29.805 [2024-12-08 02:29:57.252719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.252796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.252821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.806 qpair failed and we were unable to recover it. 00:27:29.806 [2024-12-08 02:29:57.252978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.253055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.253080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.806 qpair failed and we were unable to recover it. 00:27:29.806 [2024-12-08 02:29:57.253170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.253253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.253281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.806 qpair failed and we were unable to recover it. 00:27:29.806 [2024-12-08 02:29:57.253392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.253470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.253495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.806 qpair failed and we were unable to recover it. 00:27:29.806 [2024-12-08 02:29:57.253612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.253717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.253742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.806 qpair failed and we were unable to recover it. 00:27:29.806 [2024-12-08 02:29:57.253819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.253908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.253934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.806 qpair failed and we were unable to recover it. 00:27:29.806 [2024-12-08 02:29:57.254078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.254160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.254187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.806 qpair failed and we were unable to recover it. 00:27:29.806 [2024-12-08 02:29:57.254298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.254379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.254405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.806 qpair failed and we were unable to recover it. 00:27:29.806 [2024-12-08 02:29:57.254560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.254646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.254672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.806 qpair failed and we were unable to recover it. 00:27:29.806 [2024-12-08 02:29:57.254758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.254869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.254894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.806 qpair failed and we were unable to recover it. 00:27:29.806 [2024-12-08 02:29:57.255012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.255093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.255119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.806 qpair failed and we were unable to recover it. 00:27:29.806 [2024-12-08 02:29:57.255218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.255330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.255355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.806 qpair failed and we were unable to recover it. 00:27:29.806 [2024-12-08 02:29:57.255455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.255529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.255572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.806 qpair failed and we were unable to recover it. 00:27:29.806 [2024-12-08 02:29:57.255683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.255795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.255820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.806 qpair failed and we were unable to recover it. 00:27:29.806 [2024-12-08 02:29:57.255909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.256006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.256031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.806 qpair failed and we were unable to recover it. 00:27:29.806 [2024-12-08 02:29:57.256145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.256252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.256278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.806 qpair failed and we were unable to recover it. 00:27:29.806 [2024-12-08 02:29:57.256359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.256480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.256505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.806 qpair failed and we were unable to recover it. 00:27:29.806 [2024-12-08 02:29:57.256628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.256709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.256734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.806 qpair failed and we were unable to recover it. 00:27:29.806 [2024-12-08 02:29:57.256814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.256890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.256915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.806 qpair failed and we were unable to recover it. 00:27:29.806 [2024-12-08 02:29:57.257007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.257087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.257113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.806 qpair failed and we were unable to recover it. 00:27:29.806 [2024-12-08 02:29:57.257201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.257326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.257351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.806 qpair failed and we were unable to recover it. 00:27:29.806 [2024-12-08 02:29:57.257431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.257551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.257578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.806 qpair failed and we were unable to recover it. 00:27:29.806 [2024-12-08 02:29:57.257662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.257770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.257795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.806 qpair failed and we were unable to recover it. 00:27:29.806 [2024-12-08 02:29:57.257880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.258026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.258052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.806 qpair failed and we were unable to recover it. 00:27:29.806 [2024-12-08 02:29:57.258164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.258243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.806 [2024-12-08 02:29:57.258268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.807 qpair failed and we were unable to recover it. 00:27:29.807 [2024-12-08 02:29:57.258355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.258474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.258499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.807 qpair failed and we were unable to recover it. 00:27:29.807 [2024-12-08 02:29:57.258601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.258708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.258734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.807 qpair failed and we were unable to recover it. 00:27:29.807 [2024-12-08 02:29:57.258822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.258921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.258947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.807 qpair failed and we were unable to recover it. 00:27:29.807 [2024-12-08 02:29:57.259059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.259140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.259166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.807 qpair failed and we were unable to recover it. 00:27:29.807 [2024-12-08 02:29:57.259286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.259396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.259422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.807 qpair failed and we were unable to recover it. 00:27:29.807 [2024-12-08 02:29:57.259555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.259637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.259663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.807 qpair failed and we were unable to recover it. 00:27:29.807 [2024-12-08 02:29:57.259775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.259881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.259907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.807 qpair failed and we were unable to recover it. 00:27:29.807 [2024-12-08 02:29:57.260000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.260081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.260106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.807 qpair failed and we were unable to recover it. 00:27:29.807 [2024-12-08 02:29:57.260217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.260294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.260319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.807 qpair failed and we were unable to recover it. 00:27:29.807 [2024-12-08 02:29:57.260430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.260544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.260570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.807 qpair failed and we were unable to recover it. 00:27:29.807 [2024-12-08 02:29:57.260684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.260791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.260816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.807 qpair failed and we were unable to recover it. 00:27:29.807 [2024-12-08 02:29:57.260935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.261014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.261039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.807 qpair failed and we were unable to recover it. 00:27:29.807 [2024-12-08 02:29:57.261134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.261242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.261267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.807 qpair failed and we were unable to recover it. 00:27:29.807 [2024-12-08 02:29:57.261389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.261525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.261556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.807 qpair failed and we were unable to recover it. 00:27:29.807 [2024-12-08 02:29:57.261641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.261724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.261750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.807 qpair failed and we were unable to recover it. 00:27:29.807 [2024-12-08 02:29:57.261835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.261917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.261943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.807 qpair failed and we were unable to recover it. 00:27:29.807 [2024-12-08 02:29:57.262027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.262111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.262136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.807 qpair failed and we were unable to recover it. 00:27:29.807 [2024-12-08 02:29:57.262245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.262324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.262350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.807 qpair failed and we were unable to recover it. 00:27:29.807 [2024-12-08 02:29:57.262440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.262532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.262563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.807 qpair failed and we were unable to recover it. 00:27:29.807 [2024-12-08 02:29:57.262675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.262752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.262777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.807 qpair failed and we were unable to recover it. 00:27:29.807 [2024-12-08 02:29:57.262866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.262947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.262971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.807 qpair failed and we were unable to recover it. 00:27:29.807 [2024-12-08 02:29:57.263058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.263165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.263190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.807 qpair failed and we were unable to recover it. 00:27:29.807 [2024-12-08 02:29:57.263273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.263381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.263405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.807 qpair failed and we were unable to recover it. 00:27:29.807 [2024-12-08 02:29:57.263499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.263585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.263611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.807 qpair failed and we were unable to recover it. 00:27:29.807 [2024-12-08 02:29:57.263702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.263808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.263833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.807 qpair failed and we were unable to recover it. 00:27:29.807 [2024-12-08 02:29:57.263956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.264072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.264102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.807 qpair failed and we were unable to recover it. 00:27:29.807 [2024-12-08 02:29:57.264193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.264284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.264315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.807 qpair failed and we were unable to recover it. 00:27:29.807 [2024-12-08 02:29:57.264430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.807 [2024-12-08 02:29:57.264519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.264587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.808 qpair failed and we were unable to recover it. 00:27:29.808 [2024-12-08 02:29:57.264668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.264750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.264776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.808 qpair failed and we were unable to recover it. 00:27:29.808 [2024-12-08 02:29:57.264896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.265016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.265041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.808 qpair failed and we were unable to recover it. 00:27:29.808 [2024-12-08 02:29:57.265159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.265243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.265269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.808 qpair failed and we were unable to recover it. 00:27:29.808 [2024-12-08 02:29:57.265349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.265464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.265489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.808 qpair failed and we were unable to recover it. 00:27:29.808 [2024-12-08 02:29:57.265579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.265657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.265683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.808 qpair failed and we were unable to recover it. 00:27:29.808 [2024-12-08 02:29:57.265763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.265883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.265919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.808 qpair failed and we were unable to recover it. 00:27:29.808 [2024-12-08 02:29:57.266007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.266129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.266154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.808 qpair failed and we were unable to recover it. 00:27:29.808 [2024-12-08 02:29:57.266234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.266342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.266368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.808 qpair failed and we were unable to recover it. 00:27:29.808 [2024-12-08 02:29:57.266446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.266566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.266597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.808 qpair failed and we were unable to recover it. 00:27:29.808 [2024-12-08 02:29:57.266681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.266786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.266811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.808 qpair failed and we were unable to recover it. 00:27:29.808 [2024-12-08 02:29:57.266894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.266973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.266999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.808 qpair failed and we were unable to recover it. 00:27:29.808 [2024-12-08 02:29:57.267091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.267177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.267202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.808 qpair failed and we were unable to recover it. 00:27:29.808 [2024-12-08 02:29:57.267317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.267428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.267453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.808 qpair failed and we were unable to recover it. 00:27:29.808 [2024-12-08 02:29:57.267574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.267654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.267679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.808 qpair failed and we were unable to recover it. 00:27:29.808 [2024-12-08 02:29:57.267760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.267906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.267932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.808 qpair failed and we were unable to recover it. 00:27:29.808 [2024-12-08 02:29:57.268018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.268116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.268143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.808 qpair failed and we were unable to recover it. 00:27:29.808 [2024-12-08 02:29:57.268235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.268324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.268349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.808 qpair failed and we were unable to recover it. 00:27:29.808 [2024-12-08 02:29:57.268435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.268522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.268560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.808 qpair failed and we were unable to recover it. 00:27:29.808 [2024-12-08 02:29:57.268641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.268750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.268780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.808 qpair failed and we were unable to recover it. 00:27:29.808 [2024-12-08 02:29:57.268915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.268993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.269018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.808 qpair failed and we were unable to recover it. 00:27:29.808 [2024-12-08 02:29:57.269102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.269209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.269235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.808 qpair failed and we were unable to recover it. 00:27:29.808 [2024-12-08 02:29:57.269342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.269425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.269451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.808 qpair failed and we were unable to recover it. 00:27:29.808 [2024-12-08 02:29:57.269532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.269617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.269643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.808 qpair failed and we were unable to recover it. 00:27:29.808 [2024-12-08 02:29:57.269722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.269825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.269862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.808 qpair failed and we were unable to recover it. 00:27:29.808 [2024-12-08 02:29:57.269976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.270063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.270088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.808 qpair failed and we were unable to recover it. 00:27:29.808 [2024-12-08 02:29:57.270200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.270280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.270306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.808 qpair failed and we were unable to recover it. 00:27:29.808 [2024-12-08 02:29:57.270397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.270510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.270553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.808 qpair failed and we were unable to recover it. 00:27:29.808 [2024-12-08 02:29:57.270641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.808 [2024-12-08 02:29:57.270778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.270804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.809 qpair failed and we were unable to recover it. 00:27:29.809 [2024-12-08 02:29:57.270893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.270971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.271001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.809 qpair failed and we were unable to recover it. 00:27:29.809 [2024-12-08 02:29:57.271085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.271201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.271228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.809 qpair failed and we were unable to recover it. 00:27:29.809 [2024-12-08 02:29:57.271346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.271423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.271448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.809 qpair failed and we were unable to recover it. 00:27:29.809 [2024-12-08 02:29:57.271569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.271651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.271677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.809 qpair failed and we were unable to recover it. 00:27:29.809 [2024-12-08 02:29:57.271756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.271827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.271852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.809 qpair failed and we were unable to recover it. 00:27:29.809 [2024-12-08 02:29:57.271968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.272061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.272087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.809 qpair failed and we were unable to recover it. 00:27:29.809 [2024-12-08 02:29:57.272198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.272337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.272363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.809 qpair failed and we were unable to recover it. 00:27:29.809 [2024-12-08 02:29:57.272458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.272542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.272568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.809 qpair failed and we were unable to recover it. 00:27:29.809 [2024-12-08 02:29:57.272648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.272757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.272783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.809 qpair failed and we were unable to recover it. 00:27:29.809 [2024-12-08 02:29:57.272871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.272950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.272975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.809 qpair failed and we were unable to recover it. 00:27:29.809 [2024-12-08 02:29:57.273056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.273146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.273184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.809 qpair failed and we were unable to recover it. 00:27:29.809 [2024-12-08 02:29:57.273272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.273381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.273407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.809 qpair failed and we were unable to recover it. 00:27:29.809 [2024-12-08 02:29:57.273483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.273590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.273616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.809 qpair failed and we were unable to recover it. 00:27:29.809 [2024-12-08 02:29:57.273699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.273779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.273804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.809 qpair failed and we were unable to recover it. 00:27:29.809 [2024-12-08 02:29:57.273918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.274010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.274036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.809 qpair failed and we were unable to recover it. 00:27:29.809 [2024-12-08 02:29:57.274152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.274237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.274262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.809 qpair failed and we were unable to recover it. 00:27:29.809 [2024-12-08 02:29:57.274405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.274507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.274532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.809 qpair failed and we were unable to recover it. 00:27:29.809 [2024-12-08 02:29:57.274619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.274699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.274725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.809 qpair failed and we were unable to recover it. 00:27:29.809 [2024-12-08 02:29:57.274800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.274923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.274948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.809 qpair failed and we were unable to recover it. 00:27:29.809 [2024-12-08 02:29:57.275036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.275158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.275183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.809 qpair failed and we were unable to recover it. 00:27:29.809 [2024-12-08 02:29:57.275268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.275350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.275375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.809 qpair failed and we were unable to recover it. 00:27:29.809 [2024-12-08 02:29:57.275460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.275579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.275606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.809 qpair failed and we were unable to recover it. 00:27:29.809 [2024-12-08 02:29:57.275692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.275772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.275799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.809 qpair failed and we were unable to recover it. 00:27:29.809 [2024-12-08 02:29:57.275892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.276002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.276028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.809 qpair failed and we were unable to recover it. 00:27:29.809 [2024-12-08 02:29:57.276110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.276191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.276217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.809 qpair failed and we were unable to recover it. 00:27:29.809 [2024-12-08 02:29:57.276346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.276455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.276481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.809 qpair failed and we were unable to recover it. 00:27:29.809 [2024-12-08 02:29:57.276571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.276679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.809 [2024-12-08 02:29:57.276706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.810 qpair failed and we were unable to recover it. 00:27:29.810 [2024-12-08 02:29:57.276785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.276881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.276919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.810 qpair failed and we were unable to recover it. 00:27:29.810 [2024-12-08 02:29:57.277034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.277125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.277150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.810 qpair failed and we were unable to recover it. 00:27:29.810 [2024-12-08 02:29:57.277237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.277344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.277370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.810 qpair failed and we were unable to recover it. 00:27:29.810 [2024-12-08 02:29:57.277460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.277548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.277573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.810 qpair failed and we were unable to recover it. 00:27:29.810 [2024-12-08 02:29:57.277661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.277742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.277768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.810 qpair failed and we were unable to recover it. 00:27:29.810 [2024-12-08 02:29:57.277841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.277926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.277952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.810 qpair failed and we were unable to recover it. 00:27:29.810 [2024-12-08 02:29:57.278044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.278122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.278147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.810 qpair failed and we were unable to recover it. 00:27:29.810 [2024-12-08 02:29:57.278225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.278335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.278361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.810 qpair failed and we were unable to recover it. 00:27:29.810 [2024-12-08 02:29:57.278454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.278546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.278573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.810 qpair failed and we were unable to recover it. 00:27:29.810 [2024-12-08 02:29:57.278656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.278737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.278762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.810 qpair failed and we were unable to recover it. 00:27:29.810 [2024-12-08 02:29:57.278870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.278948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.278974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.810 qpair failed and we were unable to recover it. 00:27:29.810 [2024-12-08 02:29:57.279053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.279170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.279195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.810 qpair failed and we were unable to recover it. 00:27:29.810 [2024-12-08 02:29:57.279305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.279394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.279419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.810 qpair failed and we were unable to recover it. 00:27:29.810 [2024-12-08 02:29:57.279495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.279611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.279638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.810 qpair failed and we were unable to recover it. 00:27:29.810 [2024-12-08 02:29:57.279738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.279826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.279853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.810 qpair failed and we were unable to recover it. 00:27:29.810 [2024-12-08 02:29:57.279974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.280055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.280080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.810 qpair failed and we were unable to recover it. 00:27:29.810 [2024-12-08 02:29:57.280166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.280244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.280269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.810 qpair failed and we were unable to recover it. 00:27:29.810 [2024-12-08 02:29:57.280380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.280462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.280487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.810 qpair failed and we were unable to recover it. 00:27:29.810 [2024-12-08 02:29:57.280579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.280688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.280713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.810 qpair failed and we were unable to recover it. 00:27:29.810 [2024-12-08 02:29:57.280795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.280942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.280968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.810 qpair failed and we were unable to recover it. 00:27:29.810 [2024-12-08 02:29:57.281086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.281165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.281191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.810 qpair failed and we were unable to recover it. 00:27:29.810 [2024-12-08 02:29:57.281313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.281428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.281456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.810 qpair failed and we were unable to recover it. 00:27:29.810 [2024-12-08 02:29:57.281542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.281653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.281679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.810 qpair failed and we were unable to recover it. 00:27:29.810 [2024-12-08 02:29:57.281766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.281847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.281872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.810 qpair failed and we were unable to recover it. 00:27:29.810 [2024-12-08 02:29:57.281993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.282076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.282102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.810 qpair failed and we were unable to recover it. 00:27:29.810 [2024-12-08 02:29:57.282202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.810 [2024-12-08 02:29:57.282275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.282300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.811 qpair failed and we were unable to recover it. 00:27:29.811 [2024-12-08 02:29:57.282380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.282463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.282490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.811 qpair failed and we were unable to recover it. 00:27:29.811 [2024-12-08 02:29:57.282595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.282680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.282708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.811 qpair failed and we were unable to recover it. 00:27:29.811 [2024-12-08 02:29:57.282789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.282895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.282925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.811 qpair failed and we were unable to recover it. 00:27:29.811 [2024-12-08 02:29:57.283005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.283116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.283142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.811 qpair failed and we were unable to recover it. 00:27:29.811 [2024-12-08 02:29:57.283224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.283340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.283366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.811 qpair failed and we were unable to recover it. 00:27:29.811 [2024-12-08 02:29:57.283447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.283527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.283569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.811 qpair failed and we were unable to recover it. 00:27:29.811 [2024-12-08 02:29:57.283682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.283790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.283815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.811 qpair failed and we were unable to recover it. 00:27:29.811 [2024-12-08 02:29:57.283926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.284042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.284068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.811 qpair failed and we were unable to recover it. 00:27:29.811 [2024-12-08 02:29:57.284152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.284237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.284263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.811 qpair failed and we were unable to recover it. 00:27:29.811 [2024-12-08 02:29:57.284367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.284451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.284478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.811 qpair failed and we were unable to recover it. 00:27:29.811 [2024-12-08 02:29:57.284597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.284679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.284706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.811 qpair failed and we were unable to recover it. 00:27:29.811 [2024-12-08 02:29:57.284788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.284874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.284899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.811 qpair failed and we were unable to recover it. 00:27:29.811 [2024-12-08 02:29:57.284984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.285063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.285090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.811 qpair failed and we were unable to recover it. 00:27:29.811 [2024-12-08 02:29:57.285180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.285290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.285317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.811 qpair failed and we were unable to recover it. 00:27:29.811 [2024-12-08 02:29:57.285403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.285514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.285556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.811 qpair failed and we were unable to recover it. 00:27:29.811 [2024-12-08 02:29:57.285644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.285720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.285746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.811 qpair failed and we were unable to recover it. 00:27:29.811 [2024-12-08 02:29:57.285833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.285949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.285975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.811 qpair failed and we were unable to recover it. 00:27:29.811 [2024-12-08 02:29:57.286054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.286164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.286190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.811 qpair failed and we were unable to recover it. 00:27:29.811 [2024-12-08 02:29:57.286316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.286411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.286440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.811 qpair failed and we were unable to recover it. 00:27:29.811 [2024-12-08 02:29:57.286564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.286652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.286678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.811 qpair failed and we were unable to recover it. 00:27:29.811 [2024-12-08 02:29:57.286763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.286841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.286867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.811 qpair failed and we were unable to recover it. 00:27:29.811 [2024-12-08 02:29:57.286980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.287089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.287115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.811 qpair failed and we were unable to recover it. 00:27:29.811 [2024-12-08 02:29:57.287201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.287309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.287334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.811 qpair failed and we were unable to recover it. 00:27:29.811 [2024-12-08 02:29:57.287414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.287492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.287517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.811 qpair failed and we were unable to recover it. 00:27:29.811 [2024-12-08 02:29:57.287611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.287689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.287716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.811 qpair failed and we were unable to recover it. 00:27:29.811 [2024-12-08 02:29:57.287834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.287948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.287975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.811 qpair failed and we were unable to recover it. 00:27:29.811 [2024-12-08 02:29:57.288050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.288132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.288157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.811 qpair failed and we were unable to recover it. 00:27:29.811 [2024-12-08 02:29:57.288243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.811 [2024-12-08 02:29:57.288322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.288348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.812 qpair failed and we were unable to recover it. 00:27:29.812 [2024-12-08 02:29:57.288424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.288567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.288595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.812 qpair failed and we were unable to recover it. 00:27:29.812 [2024-12-08 02:29:57.288706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.288815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.288841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.812 qpair failed and we were unable to recover it. 00:27:29.812 [2024-12-08 02:29:57.288953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.289033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.289060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.812 qpair failed and we were unable to recover it. 00:27:29.812 [2024-12-08 02:29:57.289144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.289225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.289252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.812 qpair failed and we were unable to recover it. 00:27:29.812 [2024-12-08 02:29:57.289333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.289417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.289443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.812 qpair failed and we were unable to recover it. 00:27:29.812 [2024-12-08 02:29:57.289532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.289619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.289645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.812 qpair failed and we were unable to recover it. 00:27:29.812 [2024-12-08 02:29:57.289726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.289810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.289835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.812 qpair failed and we were unable to recover it. 00:27:29.812 [2024-12-08 02:29:57.289949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.290033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.290059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.812 qpair failed and we were unable to recover it. 00:27:29.812 [2024-12-08 02:29:57.290141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.290251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.290278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.812 qpair failed and we were unable to recover it. 00:27:29.812 [2024-12-08 02:29:57.290392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.290470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.290496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.812 qpair failed and we were unable to recover it. 00:27:29.812 [2024-12-08 02:29:57.290616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.290732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.290758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.812 qpair failed and we were unable to recover it. 00:27:29.812 [2024-12-08 02:29:57.290845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.290957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.290983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.812 qpair failed and we were unable to recover it. 00:27:29.812 [2024-12-08 02:29:57.291098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.291190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.291216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.812 qpair failed and we were unable to recover it. 00:27:29.812 [2024-12-08 02:29:57.291299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.291381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.291407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.812 qpair failed and we were unable to recover it. 00:27:29.812 [2024-12-08 02:29:57.291522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.291668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.291695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.812 qpair failed and we were unable to recover it. 00:27:29.812 [2024-12-08 02:29:57.291814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.291892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.291918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.812 qpair failed and we were unable to recover it. 00:27:29.812 [2024-12-08 02:29:57.292011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.292086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.292111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.812 qpair failed and we were unable to recover it. 00:27:29.812 [2024-12-08 02:29:57.292196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.292272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.292297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.812 qpair failed and we were unable to recover it. 00:27:29.812 [2024-12-08 02:29:57.292382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.292467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.292491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.812 qpair failed and we were unable to recover it. 00:27:29.812 [2024-12-08 02:29:57.292619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.292711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.292738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.812 qpair failed and we were unable to recover it. 00:27:29.812 [2024-12-08 02:29:57.292824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.292901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.292936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.812 qpair failed and we were unable to recover it. 00:27:29.812 [2024-12-08 02:29:57.293047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.293128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.293154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.812 qpair failed and we were unable to recover it. 00:27:29.812 [2024-12-08 02:29:57.293243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.293324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.293349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.812 qpair failed and we were unable to recover it. 00:27:29.812 [2024-12-08 02:29:57.293491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.293592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.293620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.812 qpair failed and we were unable to recover it. 00:27:29.812 [2024-12-08 02:29:57.293714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.293823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.293849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.812 qpair failed and we were unable to recover it. 00:27:29.812 [2024-12-08 02:29:57.293930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.294008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.294033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.812 qpair failed and we were unable to recover it. 00:27:29.812 [2024-12-08 02:29:57.294120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.294228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.294253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.812 qpair failed and we were unable to recover it. 00:27:29.812 [2024-12-08 02:29:57.294335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.294446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.812 [2024-12-08 02:29:57.294471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.812 qpair failed and we were unable to recover it. 00:27:29.813 [2024-12-08 02:29:57.294563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.294650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.294675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.813 qpair failed and we were unable to recover it. 00:27:29.813 [2024-12-08 02:29:57.294755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.294834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.294867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.813 qpair failed and we were unable to recover it. 00:27:29.813 [2024-12-08 02:29:57.294950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.295060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.295091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.813 qpair failed and we were unable to recover it. 00:27:29.813 [2024-12-08 02:29:57.295186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.295272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.295297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.813 qpair failed and we were unable to recover it. 00:27:29.813 [2024-12-08 02:29:57.295377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.295460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.295486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.813 qpair failed and we were unable to recover it. 00:27:29.813 [2024-12-08 02:29:57.295563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.295672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.295697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.813 qpair failed and we were unable to recover it. 00:27:29.813 [2024-12-08 02:29:57.295779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.295859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.295884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.813 qpair failed and we were unable to recover it. 00:27:29.813 [2024-12-08 02:29:57.295998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.296074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.296100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.813 qpair failed and we were unable to recover it. 00:27:29.813 [2024-12-08 02:29:57.296188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.296292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.296317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.813 qpair failed and we were unable to recover it. 00:27:29.813 [2024-12-08 02:29:57.296425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.296499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.296525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.813 qpair failed and we were unable to recover it. 00:27:29.813 [2024-12-08 02:29:57.296616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.296704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.296729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.813 qpair failed and we were unable to recover it. 00:27:29.813 [2024-12-08 02:29:57.296806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.296927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.296952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.813 qpair failed and we were unable to recover it. 00:27:29.813 [2024-12-08 02:29:57.297033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.297143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.297173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.813 qpair failed and we were unable to recover it. 00:27:29.813 [2024-12-08 02:29:57.297253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.297391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.297416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.813 qpair failed and we were unable to recover it. 00:27:29.813 [2024-12-08 02:29:57.297526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.297614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.297639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.813 qpair failed and we were unable to recover it. 00:27:29.813 [2024-12-08 02:29:57.297724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.297807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.297833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.813 qpair failed and we were unable to recover it. 00:27:29.813 [2024-12-08 02:29:57.297928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.298008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.298034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.813 qpair failed and we were unable to recover it. 00:27:29.813 [2024-12-08 02:29:57.298124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.298240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.298265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.813 qpair failed and we were unable to recover it. 00:27:29.813 [2024-12-08 02:29:57.298353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.298430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.298455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.813 qpair failed and we were unable to recover it. 00:27:29.813 [2024-12-08 02:29:57.298573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.298680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.298706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.813 qpair failed and we were unable to recover it. 00:27:29.813 [2024-12-08 02:29:57.298792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.298868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.298894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.813 qpair failed and we were unable to recover it. 00:27:29.813 [2024-12-08 02:29:57.299001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.299077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.299102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.813 qpair failed and we were unable to recover it. 00:27:29.813 [2024-12-08 02:29:57.299186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.299272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.299297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.813 qpair failed and we were unable to recover it. 00:27:29.813 [2024-12-08 02:29:57.299381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.299460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.299486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.813 qpair failed and we were unable to recover it. 00:27:29.813 [2024-12-08 02:29:57.299595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.299673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.299699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.813 qpair failed and we were unable to recover it. 00:27:29.813 [2024-12-08 02:29:57.299816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.299900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.299926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.813 qpair failed and we were unable to recover it. 00:27:29.813 [2024-12-08 02:29:57.300014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.300093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.813 [2024-12-08 02:29:57.300119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.813 qpair failed and we were unable to recover it. 00:27:29.813 [2024-12-08 02:29:57.300232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.300342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.300367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.814 qpair failed and we were unable to recover it. 00:27:29.814 [2024-12-08 02:29:57.300450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.300550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.300579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.814 qpair failed and we were unable to recover it. 00:27:29.814 [2024-12-08 02:29:57.300664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.300747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.300772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.814 qpair failed and we were unable to recover it. 00:27:29.814 [2024-12-08 02:29:57.300882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.300957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.300983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.814 qpair failed and we were unable to recover it. 00:27:29.814 [2024-12-08 02:29:57.301062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.301170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.301195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.814 qpair failed and we were unable to recover it. 00:27:29.814 [2024-12-08 02:29:57.301279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.301366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.301392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.814 qpair failed and we were unable to recover it. 00:27:29.814 [2024-12-08 02:29:57.301505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.301591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.301618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.814 qpair failed and we were unable to recover it. 00:27:29.814 [2024-12-08 02:29:57.301701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.301782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.301808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.814 qpair failed and we were unable to recover it. 00:27:29.814 [2024-12-08 02:29:57.301896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.302011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.302038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.814 qpair failed and we were unable to recover it. 00:27:29.814 [2024-12-08 02:29:57.302126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.302239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.302264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.814 qpair failed and we were unable to recover it. 00:27:29.814 [2024-12-08 02:29:57.302345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.302457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.302483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.814 qpair failed and we were unable to recover it. 00:27:29.814 [2024-12-08 02:29:57.302572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.302686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.302713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.814 qpair failed and we were unable to recover it. 00:27:29.814 [2024-12-08 02:29:57.302803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.302916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.302942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.814 qpair failed and we were unable to recover it. 00:27:29.814 [2024-12-08 02:29:57.303028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.303137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.303166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.814 qpair failed and we were unable to recover it. 00:27:29.814 [2024-12-08 02:29:57.303247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.303360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.303385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.814 qpair failed and we were unable to recover it. 00:27:29.814 [2024-12-08 02:29:57.303494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.303579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.303605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.814 qpair failed and we were unable to recover it. 00:27:29.814 [2024-12-08 02:29:57.303721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.303797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.303823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.814 qpair failed and we were unable to recover it. 00:27:29.814 [2024-12-08 02:29:57.303917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.304010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.304037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.814 qpair failed and we were unable to recover it. 00:27:29.814 [2024-12-08 02:29:57.304114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.304191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.304216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.814 qpair failed and we were unable to recover it. 00:27:29.814 [2024-12-08 02:29:57.304298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.304375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.304400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.814 qpair failed and we were unable to recover it. 00:27:29.814 [2024-12-08 02:29:57.304508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.304622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.304647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.814 qpair failed and we were unable to recover it. 00:27:29.814 [2024-12-08 02:29:57.304731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.304817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.304854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.814 qpair failed and we were unable to recover it. 00:27:29.814 [2024-12-08 02:29:57.304945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.305067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.305106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.814 qpair failed and we were unable to recover it. 00:27:29.814 [2024-12-08 02:29:57.305184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.305260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.305285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.814 qpair failed and we were unable to recover it. 00:27:29.814 [2024-12-08 02:29:57.305373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.305450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.305476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.814 qpair failed and we were unable to recover it. 00:27:29.814 [2024-12-08 02:29:57.305591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.305672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.305699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.814 qpair failed and we were unable to recover it. 00:27:29.814 [2024-12-08 02:29:57.305814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.305925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.305952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.814 qpair failed and we were unable to recover it. 00:27:29.814 [2024-12-08 02:29:57.306039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.306112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.306139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.814 qpair failed and we were unable to recover it. 00:27:29.814 [2024-12-08 02:29:57.306217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.814 [2024-12-08 02:29:57.306334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.306361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.815 qpair failed and we were unable to recover it. 00:27:29.815 [2024-12-08 02:29:57.306470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.306592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.306619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.815 qpair failed and we were unable to recover it. 00:27:29.815 [2024-12-08 02:29:57.306730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.306815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.306841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.815 qpair failed and we were unable to recover it. 00:27:29.815 [2024-12-08 02:29:57.306955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.307036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.307062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.815 qpair failed and we were unable to recover it. 00:27:29.815 [2024-12-08 02:29:57.307155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.307234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.307259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.815 qpair failed and we were unable to recover it. 00:27:29.815 [2024-12-08 02:29:57.307379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.307458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.307494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.815 qpair failed and we were unable to recover it. 00:27:29.815 [2024-12-08 02:29:57.307589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.307672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.307698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.815 qpair failed and we were unable to recover it. 00:27:29.815 [2024-12-08 02:29:57.307812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.307891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.307927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.815 qpair failed and we were unable to recover it. 00:27:29.815 [2024-12-08 02:29:57.308012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.308117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.308143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.815 qpair failed and we were unable to recover it. 00:27:29.815 [2024-12-08 02:29:57.308228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.308339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.308365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.815 qpair failed and we were unable to recover it. 00:27:29.815 [2024-12-08 02:29:57.308444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.308559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.308585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.815 qpair failed and we were unable to recover it. 00:27:29.815 [2024-12-08 02:29:57.308668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.308752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.308777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.815 qpair failed and we were unable to recover it. 00:27:29.815 [2024-12-08 02:29:57.308859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.308945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.308971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.815 qpair failed and we were unable to recover it. 00:27:29.815 [2024-12-08 02:29:57.309082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.309165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.309191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.815 qpair failed and we were unable to recover it. 00:27:29.815 [2024-12-08 02:29:57.309269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.309393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.309418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.815 qpair failed and we were unable to recover it. 00:27:29.815 [2024-12-08 02:29:57.309534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.309626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.309651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.815 qpair failed and we were unable to recover it. 00:27:29.815 [2024-12-08 02:29:57.309731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.309810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.309848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.815 qpair failed and we were unable to recover it. 00:27:29.815 [2024-12-08 02:29:57.309957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.310065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.310091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.815 qpair failed and we were unable to recover it. 00:27:29.815 [2024-12-08 02:29:57.310168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.310253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.310279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.815 qpair failed and we were unable to recover it. 00:27:29.815 [2024-12-08 02:29:57.310389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.310516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.310559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.815 qpair failed and we were unable to recover it. 00:27:29.815 [2024-12-08 02:29:57.310673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.310756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.310781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.815 qpair failed and we were unable to recover it. 00:27:29.815 [2024-12-08 02:29:57.310862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.310971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.310997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.815 qpair failed and we were unable to recover it. 00:27:29.815 [2024-12-08 02:29:57.311083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.311156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.311182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.815 qpair failed and we were unable to recover it. 00:27:29.815 [2024-12-08 02:29:57.311273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.311357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.311384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.815 qpair failed and we were unable to recover it. 00:27:29.815 [2024-12-08 02:29:57.311466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.311555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.815 [2024-12-08 02:29:57.311581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.815 qpair failed and we were unable to recover it. 00:27:29.815 [2024-12-08 02:29:57.311668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.311753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.311778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.816 qpair failed and we were unable to recover it. 00:27:29.816 [2024-12-08 02:29:57.311861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.311973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.312000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.816 qpair failed and we were unable to recover it. 00:27:29.816 [2024-12-08 02:29:57.312115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.312194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.312219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.816 qpair failed and we were unable to recover it. 00:27:29.816 [2024-12-08 02:29:57.312334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.312414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.312443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.816 qpair failed and we were unable to recover it. 00:27:29.816 [2024-12-08 02:29:57.312523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.312647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.312672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.816 qpair failed and we were unable to recover it. 00:27:29.816 [2024-12-08 02:29:57.312756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.312865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.312890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.816 qpair failed and we were unable to recover it. 00:27:29.816 [2024-12-08 02:29:57.312966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.313038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.313064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.816 qpair failed and we were unable to recover it. 00:27:29.816 [2024-12-08 02:29:57.313172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.313252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.313277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.816 qpair failed and we were unable to recover it. 00:27:29.816 [2024-12-08 02:29:57.313391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.313476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.313501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.816 qpair failed and we were unable to recover it. 00:27:29.816 [2024-12-08 02:29:57.313615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.313689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.313715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.816 qpair failed and we were unable to recover it. 00:27:29.816 [2024-12-08 02:29:57.313799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.313876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.313902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.816 qpair failed and we were unable to recover it. 00:27:29.816 [2024-12-08 02:29:57.314014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.314126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.314153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.816 qpair failed and we were unable to recover it. 00:27:29.816 [2024-12-08 02:29:57.314233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.314341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.314366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.816 qpair failed and we were unable to recover it. 00:27:29.816 [2024-12-08 02:29:57.314448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.314529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.314560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.816 qpair failed and we were unable to recover it. 00:27:29.816 [2024-12-08 02:29:57.314707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.314785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.314811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.816 qpair failed and we were unable to recover it. 00:27:29.816 [2024-12-08 02:29:57.314919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.314991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.315016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.816 qpair failed and we were unable to recover it. 00:27:29.816 [2024-12-08 02:29:57.315099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.315214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.315239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.816 qpair failed and we were unable to recover it. 00:27:29.816 [2024-12-08 02:29:57.315354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.315468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.315494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.816 qpair failed and we were unable to recover it. 00:27:29.816 [2024-12-08 02:29:57.315622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.315702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.315727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.816 qpair failed and we were unable to recover it. 00:27:29.816 [2024-12-08 02:29:57.315812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.315893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.315922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.816 qpair failed and we were unable to recover it. 00:27:29.816 [2024-12-08 02:29:57.316009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.316118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.316145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.816 qpair failed and we were unable to recover it. 00:27:29.816 [2024-12-08 02:29:57.316256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.316376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.316402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.816 qpair failed and we were unable to recover it. 00:27:29.816 [2024-12-08 02:29:57.316479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.316559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.316585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.816 qpair failed and we were unable to recover it. 00:27:29.816 [2024-12-08 02:29:57.316727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.316805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.316831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.816 qpair failed and we were unable to recover it. 00:27:29.816 [2024-12-08 02:29:57.316941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.317023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.317050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.816 qpair failed and we were unable to recover it. 00:27:29.816 [2024-12-08 02:29:57.317160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.317243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.317269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.816 qpair failed and we were unable to recover it. 00:27:29.816 [2024-12-08 02:29:57.317358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.317438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.317464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.816 qpair failed and we were unable to recover it. 00:27:29.816 [2024-12-08 02:29:57.317579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.317688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.317714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.816 qpair failed and we were unable to recover it. 00:27:29.816 [2024-12-08 02:29:57.317795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.317918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.816 [2024-12-08 02:29:57.317943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.816 qpair failed and we were unable to recover it. 00:27:29.817 [2024-12-08 02:29:57.318052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.318123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.318148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.817 qpair failed and we were unable to recover it. 00:27:29.817 [2024-12-08 02:29:57.318235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.318312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.318337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.817 qpair failed and we were unable to recover it. 00:27:29.817 [2024-12-08 02:29:57.318478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.318618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.318644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.817 qpair failed and we were unable to recover it. 00:27:29.817 [2024-12-08 02:29:57.318735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.318814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.318839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.817 qpair failed and we were unable to recover it. 00:27:29.817 [2024-12-08 02:29:57.318980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.319061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.319086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.817 qpair failed and we were unable to recover it. 00:27:29.817 [2024-12-08 02:29:57.319179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.319257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.319282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.817 qpair failed and we were unable to recover it. 00:27:29.817 [2024-12-08 02:29:57.319395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.319475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.319501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.817 qpair failed and we were unable to recover it. 00:27:29.817 [2024-12-08 02:29:57.319589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.319697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.319723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.817 qpair failed and we were unable to recover it. 00:27:29.817 [2024-12-08 02:29:57.319804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.319915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.319941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.817 qpair failed and we were unable to recover it. 00:27:29.817 [2024-12-08 02:29:57.320055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.320163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.320189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.817 qpair failed and we were unable to recover it. 00:27:29.817 [2024-12-08 02:29:57.320302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.320414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.320440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.817 qpair failed and we were unable to recover it. 00:27:29.817 [2024-12-08 02:29:57.320529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.320613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.320643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.817 qpair failed and we were unable to recover it. 00:27:29.817 [2024-12-08 02:29:57.320762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.320884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.320921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.817 qpair failed and we were unable to recover it. 00:27:29.817 [2024-12-08 02:29:57.321036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.321117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.321143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.817 qpair failed and we were unable to recover it. 00:27:29.817 [2024-12-08 02:29:57.321223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.321303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.321329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.817 qpair failed and we were unable to recover it. 00:27:29.817 [2024-12-08 02:29:57.321429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.321553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.321579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.817 qpair failed and we were unable to recover it. 00:27:29.817 [2024-12-08 02:29:57.321666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.321742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.321767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.817 qpair failed and we were unable to recover it. 00:27:29.817 [2024-12-08 02:29:57.321852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.321926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.321951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.817 qpair failed and we were unable to recover it. 00:27:29.817 [2024-12-08 02:29:57.322060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.322141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.322166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.817 qpair failed and we were unable to recover it. 00:27:29.817 [2024-12-08 02:29:57.322247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.322334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.322360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.817 qpair failed and we were unable to recover it. 00:27:29.817 [2024-12-08 02:29:57.322470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.322564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.322590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.817 qpair failed and we were unable to recover it. 00:27:29.817 [2024-12-08 02:29:57.322672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.322745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.322770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.817 qpair failed and we were unable to recover it. 00:27:29.817 [2024-12-08 02:29:57.322859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.322972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.322997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.817 qpair failed and we were unable to recover it. 00:27:29.817 [2024-12-08 02:29:57.323085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.323197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.323223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.817 qpair failed and we were unable to recover it. 00:27:29.817 [2024-12-08 02:29:57.323308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.323385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.323410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.817 qpair failed and we were unable to recover it. 00:27:29.817 [2024-12-08 02:29:57.323494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.323594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.323620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.817 qpair failed and we were unable to recover it. 00:27:29.817 [2024-12-08 02:29:57.323705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.323791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.817 [2024-12-08 02:29:57.323816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.817 qpair failed and we were unable to recover it. 00:27:29.817 [2024-12-08 02:29:57.323908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.324042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.324067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.818 qpair failed and we were unable to recover it. 00:27:29.818 [2024-12-08 02:29:57.324156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.324232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.324257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.818 qpair failed and we were unable to recover it. 00:27:29.818 [2024-12-08 02:29:57.324340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.324448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.324474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.818 qpair failed and we were unable to recover it. 00:27:29.818 [2024-12-08 02:29:57.324590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.324681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.324707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.818 qpair failed and we were unable to recover it. 00:27:29.818 [2024-12-08 02:29:57.324819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.324917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.324943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.818 qpair failed and we were unable to recover it. 00:27:29.818 [2024-12-08 02:29:57.325028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.325143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.325169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.818 qpair failed and we were unable to recover it. 00:27:29.818 [2024-12-08 02:29:57.325262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.325403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.325427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.818 qpair failed and we were unable to recover it. 00:27:29.818 [2024-12-08 02:29:57.325575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.325662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.325687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.818 qpair failed and we were unable to recover it. 00:27:29.818 [2024-12-08 02:29:57.325799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.325908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.325934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.818 qpair failed and we were unable to recover it. 00:27:29.818 [2024-12-08 02:29:57.326016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.326094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.326120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.818 qpair failed and we were unable to recover it. 00:27:29.818 [2024-12-08 02:29:57.326203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.326313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.326338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.818 qpair failed and we were unable to recover it. 00:27:29.818 [2024-12-08 02:29:57.326430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.326502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.326527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.818 qpair failed and we were unable to recover it. 00:27:29.818 [2024-12-08 02:29:57.326644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.326724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.326749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.818 qpair failed and we were unable to recover it. 00:27:29.818 [2024-12-08 02:29:57.326836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.326913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.326939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.818 qpair failed and we were unable to recover it. 00:27:29.818 [2024-12-08 02:29:57.327055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.327128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.327153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.818 qpair failed and we were unable to recover it. 00:27:29.818 [2024-12-08 02:29:57.327258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.327329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.327354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.818 qpair failed and we were unable to recover it. 00:27:29.818 [2024-12-08 02:29:57.327441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.327522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.327555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.818 qpair failed and we were unable to recover it. 00:27:29.818 [2024-12-08 02:29:57.327632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.327738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.327763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.818 qpair failed and we were unable to recover it. 00:27:29.818 [2024-12-08 02:29:57.327893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.327973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.328002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.818 qpair failed and we were unable to recover it. 00:27:29.818 [2024-12-08 02:29:57.328080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.328152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.328177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.818 qpair failed and we were unable to recover it. 00:27:29.818 [2024-12-08 02:29:57.328317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.328394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.328419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.818 qpair failed and we were unable to recover it. 00:27:29.818 [2024-12-08 02:29:57.328500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.328583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.328609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.818 qpair failed and we were unable to recover it. 00:27:29.818 [2024-12-08 02:29:57.328688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.328835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.328860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.818 qpair failed and we were unable to recover it. 00:27:29.818 [2024-12-08 02:29:57.328940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.329059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.329084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.818 qpair failed and we were unable to recover it. 00:27:29.818 [2024-12-08 02:29:57.329174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.329251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.329276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.818 qpair failed and we were unable to recover it. 00:27:29.818 [2024-12-08 02:29:57.329386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.329495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.329520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.818 qpair failed and we were unable to recover it. 00:27:29.818 [2024-12-08 02:29:57.329623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.329733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.329759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.818 qpair failed and we were unable to recover it. 00:27:29.818 [2024-12-08 02:29:57.329877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.329985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.330010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.818 qpair failed and we were unable to recover it. 00:27:29.818 [2024-12-08 02:29:57.330091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.330171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.818 [2024-12-08 02:29:57.330196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.818 qpair failed and we were unable to recover it. 00:27:29.819 [2024-12-08 02:29:57.330306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.330414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.330439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.819 qpair failed and we were unable to recover it. 00:27:29.819 [2024-12-08 02:29:57.330519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.330616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.330643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.819 qpair failed and we were unable to recover it. 00:27:29.819 [2024-12-08 02:29:57.330720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.330806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.330831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.819 qpair failed and we were unable to recover it. 00:27:29.819 [2024-12-08 02:29:57.330940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.331048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.331074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.819 qpair failed and we were unable to recover it. 00:27:29.819 [2024-12-08 02:29:57.331160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.331242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.331267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.819 qpair failed and we were unable to recover it. 00:27:29.819 [2024-12-08 02:29:57.331378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.331496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.331521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.819 qpair failed and we were unable to recover it. 00:27:29.819 [2024-12-08 02:29:57.331640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.331719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.331744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.819 qpair failed and we were unable to recover it. 00:27:29.819 [2024-12-08 02:29:57.331825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.331903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.331928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.819 qpair failed and we were unable to recover it. 00:27:29.819 [2024-12-08 02:29:57.332043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.332146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.332171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.819 qpair failed and we were unable to recover it. 00:27:29.819 [2024-12-08 02:29:57.332261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.332338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.332363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.819 qpair failed and we were unable to recover it. 00:27:29.819 [2024-12-08 02:29:57.332477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.332573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.332598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.819 qpair failed and we were unable to recover it. 00:27:29.819 [2024-12-08 02:29:57.332683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.332770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.332795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.819 qpair failed and we were unable to recover it. 00:27:29.819 [2024-12-08 02:29:57.332882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.332990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.333015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.819 qpair failed and we were unable to recover it. 00:27:29.819 [2024-12-08 02:29:57.333124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.333205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.333230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.819 qpair failed and we were unable to recover it. 00:27:29.819 [2024-12-08 02:29:57.333322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.333406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.333431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.819 qpair failed and we were unable to recover it. 00:27:29.819 [2024-12-08 02:29:57.333522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.333613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.333639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.819 qpair failed and we were unable to recover it. 00:27:29.819 [2024-12-08 02:29:57.333715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.333821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.333847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.819 qpair failed and we were unable to recover it. 00:27:29.819 [2024-12-08 02:29:57.333931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.334041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.334066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.819 qpair failed and we were unable to recover it. 00:27:29.819 [2024-12-08 02:29:57.334153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.334233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.334258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.819 qpair failed and we were unable to recover it. 00:27:29.819 [2024-12-08 02:29:57.334337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.334416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.334441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.819 qpair failed and we were unable to recover it. 00:27:29.819 [2024-12-08 02:29:57.334553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.334666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.334691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.819 qpair failed and we were unable to recover it. 00:27:29.819 [2024-12-08 02:29:57.334774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.334857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.334882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.819 qpair failed and we were unable to recover it. 00:27:29.819 [2024-12-08 02:29:57.334968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.335042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.335067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.819 qpair failed and we were unable to recover it. 00:27:29.819 [2024-12-08 02:29:57.335188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.335262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.335287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.819 qpair failed and we were unable to recover it. 00:27:29.819 [2024-12-08 02:29:57.335371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.335446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.335470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.819 qpair failed and we were unable to recover it. 00:27:29.819 [2024-12-08 02:29:57.335570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.335647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.335671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.819 qpair failed and we were unable to recover it. 00:27:29.819 [2024-12-08 02:29:57.335759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.335872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.335896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.819 qpair failed and we were unable to recover it. 00:27:29.819 [2024-12-08 02:29:57.335978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.336099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.819 [2024-12-08 02:29:57.336125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.819 qpair failed and we were unable to recover it. 00:27:29.820 [2024-12-08 02:29:57.336204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.336290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.336316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.820 qpair failed and we were unable to recover it. 00:27:29.820 [2024-12-08 02:29:57.336403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.336511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.336541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.820 qpair failed and we were unable to recover it. 00:27:29.820 [2024-12-08 02:29:57.336630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.336711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.336736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.820 qpair failed and we were unable to recover it. 00:27:29.820 [2024-12-08 02:29:57.336825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.336911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.336937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.820 qpair failed and we were unable to recover it. 00:27:29.820 [2024-12-08 02:29:57.337021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.337097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.337122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.820 qpair failed and we were unable to recover it. 00:27:29.820 [2024-12-08 02:29:57.337210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.337317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.337342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.820 qpair failed and we were unable to recover it. 00:27:29.820 [2024-12-08 02:29:57.337428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.337509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.337534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.820 qpair failed and we were unable to recover it. 00:27:29.820 [2024-12-08 02:29:57.337635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.337711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.337736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.820 qpair failed and we were unable to recover it. 00:27:29.820 [2024-12-08 02:29:57.337823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.337928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.337953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.820 qpair failed and we were unable to recover it. 00:27:29.820 [2024-12-08 02:29:57.338042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.338190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.338215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.820 qpair failed and we were unable to recover it. 00:27:29.820 [2024-12-08 02:29:57.338302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.338381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.338406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.820 qpair failed and we were unable to recover it. 00:27:29.820 [2024-12-08 02:29:57.338503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.338598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.338624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.820 qpair failed and we were unable to recover it. 00:27:29.820 [2024-12-08 02:29:57.338705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.338784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.338814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.820 qpair failed and we were unable to recover it. 00:27:29.820 [2024-12-08 02:29:57.338902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.339010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.339035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.820 qpair failed and we were unable to recover it. 00:27:29.820 [2024-12-08 02:29:57.339116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.339221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.339246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.820 qpair failed and we were unable to recover it. 00:27:29.820 [2024-12-08 02:29:57.339322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.339401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.339426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.820 qpair failed and we were unable to recover it. 00:27:29.820 [2024-12-08 02:29:57.339517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.339620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.339645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.820 qpair failed and we were unable to recover it. 00:27:29.820 [2024-12-08 02:29:57.339735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.339815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.339839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.820 qpair failed and we were unable to recover it. 00:27:29.820 [2024-12-08 02:29:57.339921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.340046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.340072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.820 qpair failed and we were unable to recover it. 00:27:29.820 [2024-12-08 02:29:57.340150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.340259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.340284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.820 qpair failed and we were unable to recover it. 00:27:29.820 [2024-12-08 02:29:57.340374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.340447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.340472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.820 qpair failed and we were unable to recover it. 00:27:29.820 [2024-12-08 02:29:57.340578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.340713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.340741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.820 qpair failed and we were unable to recover it. 00:27:29.820 [2024-12-08 02:29:57.340856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.340953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.340988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.820 qpair failed and we were unable to recover it. 00:27:29.820 [2024-12-08 02:29:57.341070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.341182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.341208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.820 qpair failed and we were unable to recover it. 00:27:29.820 [2024-12-08 02:29:57.341290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.341376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.341405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.820 qpair failed and we were unable to recover it. 00:27:29.820 [2024-12-08 02:29:57.341517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.341617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.820 [2024-12-08 02:29:57.341643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.821 qpair failed and we were unable to recover it. 00:27:29.821 [2024-12-08 02:29:57.341732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.341810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.341835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.821 qpair failed and we were unable to recover it. 00:27:29.821 [2024-12-08 02:29:57.341948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.342051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.342077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.821 qpair failed and we were unable to recover it. 00:27:29.821 [2024-12-08 02:29:57.342163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.342256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.342282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.821 qpair failed and we were unable to recover it. 00:27:29.821 [2024-12-08 02:29:57.342396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.342472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.342497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.821 qpair failed and we were unable to recover it. 00:27:29.821 [2024-12-08 02:29:57.342587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.342672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.342698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.821 qpair failed and we were unable to recover it. 00:27:29.821 [2024-12-08 02:29:57.342779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.342865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.342890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.821 qpair failed and we were unable to recover it. 00:27:29.821 [2024-12-08 02:29:57.342969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.343081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.343106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.821 qpair failed and we were unable to recover it. 00:27:29.821 [2024-12-08 02:29:57.343193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.343271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.343296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.821 qpair failed and we were unable to recover it. 00:27:29.821 [2024-12-08 02:29:57.343408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.343518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.343549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.821 qpair failed and we were unable to recover it. 00:27:29.821 [2024-12-08 02:29:57.343636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.343716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.343741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.821 qpair failed and we were unable to recover it. 00:27:29.821 [2024-12-08 02:29:57.343822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.343899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.343924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.821 qpair failed and we were unable to recover it. 00:27:29.821 [2024-12-08 02:29:57.344005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.344094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.344119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.821 qpair failed and we were unable to recover it. 00:27:29.821 [2024-12-08 02:29:57.344200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.344314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.344338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.821 qpair failed and we were unable to recover it. 00:27:29.821 [2024-12-08 02:29:57.344423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.344510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.344545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.821 qpair failed and we were unable to recover it. 00:27:29.821 [2024-12-08 02:29:57.344665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.344739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.344764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.821 qpair failed and we were unable to recover it. 00:27:29.821 [2024-12-08 02:29:57.344890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.344999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.345024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.821 qpair failed and we were unable to recover it. 00:27:29.821 [2024-12-08 02:29:57.345110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.345191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.345217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.821 qpair failed and we were unable to recover it. 00:27:29.821 [2024-12-08 02:29:57.345345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.345425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.345452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.821 qpair failed and we were unable to recover it. 00:27:29.821 [2024-12-08 02:29:57.345529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.345642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.345667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.821 qpair failed and we were unable to recover it. 00:27:29.821 [2024-12-08 02:29:57.345781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.345903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.345927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.821 qpair failed and we were unable to recover it. 00:27:29.821 [2024-12-08 02:29:57.346017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.346092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.346118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.821 qpair failed and we were unable to recover it. 00:27:29.821 [2024-12-08 02:29:57.346204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.346292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.346319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.821 qpair failed and we were unable to recover it. 00:27:29.821 [2024-12-08 02:29:57.346412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.346499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.346524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.821 qpair failed and we were unable to recover it. 00:27:29.821 [2024-12-08 02:29:57.346644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.346720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.346746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.821 qpair failed and we were unable to recover it. 00:27:29.821 [2024-12-08 02:29:57.346821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.346908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.346933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.821 qpair failed and we were unable to recover it. 00:27:29.821 [2024-12-08 02:29:57.347010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.347117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.347142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.821 qpair failed and we were unable to recover it. 00:27:29.821 [2024-12-08 02:29:57.347221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.347391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.347416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.821 qpair failed and we were unable to recover it. 00:27:29.821 [2024-12-08 02:29:57.347498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.347617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.347642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.821 qpair failed and we were unable to recover it. 00:27:29.821 [2024-12-08 02:29:57.347724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.821 [2024-12-08 02:29:57.347805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.347830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.822 qpair failed and we were unable to recover it. 00:27:29.822 [2024-12-08 02:29:57.347936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.348054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.348079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.822 qpair failed and we were unable to recover it. 00:27:29.822 [2024-12-08 02:29:57.348158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.348242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.348267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.822 qpair failed and we were unable to recover it. 00:27:29.822 [2024-12-08 02:29:57.348345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.348418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.348443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.822 qpair failed and we were unable to recover it. 00:27:29.822 [2024-12-08 02:29:57.348527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.348615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.348640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.822 qpair failed and we were unable to recover it. 00:27:29.822 [2024-12-08 02:29:57.348727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.348869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.348895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.822 qpair failed and we were unable to recover it. 00:27:29.822 02:29:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:29.822 [2024-12-08 02:29:57.348978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 02:29:57 -- common/autotest_common.sh@862 -- # return 0 00:27:29.822 [2024-12-08 02:29:57.349058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.349084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.822 qpair failed and we were unable to recover it. 00:27:29.822 [2024-12-08 02:29:57.349161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 02:29:57 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:29.822 [2024-12-08 02:29:57.349272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 02:29:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:29.822 [2024-12-08 02:29:57.349297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.822 qpair failed and we were unable to recover it. 00:27:29.822 [2024-12-08 02:29:57.349375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 02:29:57 -- common/autotest_common.sh@10 -- # set +x 00:27:29.822 [2024-12-08 02:29:57.349479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.349509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.822 qpair failed and we were unable to recover it. 00:27:29.822 [2024-12-08 02:29:57.349611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.349690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.349715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.822 qpair failed and we were unable to recover it. 00:27:29.822 [2024-12-08 02:29:57.349797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.349910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.349944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.822 qpair failed and we were unable to recover it. 00:27:29.822 [2024-12-08 02:29:57.350067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.350172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.350197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.822 qpair failed and we were unable to recover it. 00:27:29.822 [2024-12-08 02:29:57.350278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.350360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.350385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.822 qpair failed and we were unable to recover it. 00:27:29.822 [2024-12-08 02:29:57.350492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.350591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.350617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.822 qpair failed and we were unable to recover it. 00:27:29.822 [2024-12-08 02:29:57.350702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.350789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.350816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.822 qpair failed and we were unable to recover it. 00:27:29.822 [2024-12-08 02:29:57.350928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.351005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.351030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.822 qpair failed and we were unable to recover it. 00:27:29.822 [2024-12-08 02:29:57.351118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.351192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.351218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.822 qpair failed and we were unable to recover it. 00:27:29.822 [2024-12-08 02:29:57.351332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.351444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.351477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.822 qpair failed and we were unable to recover it. 00:27:29.822 [2024-12-08 02:29:57.351581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.351689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.351725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.822 qpair failed and we were unable to recover it. 00:27:29.822 [2024-12-08 02:29:57.351822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.351915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.351941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.822 qpair failed and we were unable to recover it. 00:27:29.822 [2024-12-08 02:29:57.352092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.352172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.352198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.822 qpair failed and we were unable to recover it. 00:27:29.822 [2024-12-08 02:29:57.352290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.352370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.352396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.822 qpair failed and we were unable to recover it. 00:27:29.822 [2024-12-08 02:29:57.352479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.352567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.352594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.822 qpair failed and we were unable to recover it. 00:27:29.822 [2024-12-08 02:29:57.352676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.352762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.352788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.822 qpair failed and we were unable to recover it. 00:27:29.822 [2024-12-08 02:29:57.352873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.352954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.352980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.822 qpair failed and we were unable to recover it. 00:27:29.822 [2024-12-08 02:29:57.353063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.353139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.353163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.822 qpair failed and we were unable to recover it. 00:27:29.822 [2024-12-08 02:29:57.353248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.353365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.822 [2024-12-08 02:29:57.353390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.822 qpair failed and we were unable to recover it. 00:27:29.823 [2024-12-08 02:29:57.353464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.353542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.353568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.823 qpair failed and we were unable to recover it. 00:27:29.823 [2024-12-08 02:29:57.353655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.353728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.353753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.823 qpair failed and we were unable to recover it. 00:27:29.823 [2024-12-08 02:29:57.353844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.353960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.353986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.823 qpair failed and we were unable to recover it. 00:27:29.823 [2024-12-08 02:29:57.354097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.354202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.354228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.823 qpair failed and we were unable to recover it. 00:27:29.823 [2024-12-08 02:29:57.354316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.354398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.354423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.823 qpair failed and we were unable to recover it. 00:27:29.823 [2024-12-08 02:29:57.354506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.354592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.354618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.823 qpair failed and we were unable to recover it. 00:27:29.823 [2024-12-08 02:29:57.354728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.354837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.354863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.823 qpair failed and we were unable to recover it. 00:27:29.823 [2024-12-08 02:29:57.354941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.355063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.355088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.823 qpair failed and we were unable to recover it. 00:27:29.823 [2024-12-08 02:29:57.355169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.355251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.355276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.823 qpair failed and we were unable to recover it. 00:27:29.823 [2024-12-08 02:29:57.355357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.355463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.355488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.823 qpair failed and we were unable to recover it. 00:27:29.823 [2024-12-08 02:29:57.355607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.355681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.355706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.823 qpair failed and we were unable to recover it. 00:27:29.823 [2024-12-08 02:29:57.355782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.355893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.355918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.823 qpair failed and we were unable to recover it. 00:27:29.823 [2024-12-08 02:29:57.356016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.356093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.356118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.823 qpair failed and we were unable to recover it. 00:27:29.823 [2024-12-08 02:29:57.356196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.356273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.356297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.823 qpair failed and we were unable to recover it. 00:27:29.823 [2024-12-08 02:29:57.356376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.356452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.356478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.823 qpair failed and we were unable to recover it. 00:27:29.823 [2024-12-08 02:29:57.356633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.356717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.356743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.823 qpair failed and we were unable to recover it. 00:27:29.823 [2024-12-08 02:29:57.356858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.356942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.356968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.823 qpair failed and we were unable to recover it. 00:27:29.823 [2024-12-08 02:29:57.357123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.357208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.357233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.823 qpair failed and we were unable to recover it. 00:27:29.823 [2024-12-08 02:29:57.357352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.357469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.357495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.823 qpair failed and we were unable to recover it. 00:27:29.823 [2024-12-08 02:29:57.357589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.357669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.357694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.823 qpair failed and we were unable to recover it. 00:27:29.823 [2024-12-08 02:29:57.357781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.357866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.357891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.823 qpair failed and we were unable to recover it. 00:27:29.823 [2024-12-08 02:29:57.358008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.358127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.358153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.823 qpair failed and we were unable to recover it. 00:27:29.823 [2024-12-08 02:29:57.358272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.358353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.358379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.823 qpair failed and we were unable to recover it. 00:27:29.823 [2024-12-08 02:29:57.358494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.358602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.358629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.823 qpair failed and we were unable to recover it. 00:27:29.823 [2024-12-08 02:29:57.358711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.358793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.358818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.823 qpair failed and we were unable to recover it. 00:27:29.823 [2024-12-08 02:29:57.358900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.359006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.359032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.823 qpair failed and we were unable to recover it. 00:27:29.823 [2024-12-08 02:29:57.359111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.359217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.359243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.823 qpair failed and we were unable to recover it. 00:27:29.823 [2024-12-08 02:29:57.359358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.359470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.823 [2024-12-08 02:29:57.359496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.823 qpair failed and we were unable to recover it. 00:27:29.824 [2024-12-08 02:29:57.359595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.359710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.359736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.824 qpair failed and we were unable to recover it. 00:27:29.824 [2024-12-08 02:29:57.359853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.359931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.359957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.824 qpair failed and we were unable to recover it. 00:27:29.824 [2024-12-08 02:29:57.360071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.360184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.360211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.824 qpair failed and we were unable to recover it. 00:27:29.824 [2024-12-08 02:29:57.360320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.360434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.360461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.824 qpair failed and we were unable to recover it. 00:27:29.824 [2024-12-08 02:29:57.360565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.360705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.360730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.824 qpair failed and we were unable to recover it. 00:27:29.824 [2024-12-08 02:29:57.360820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.360905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.360931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.824 qpair failed and we were unable to recover it. 00:27:29.824 [2024-12-08 02:29:57.361007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.361122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.361148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.824 qpair failed and we were unable to recover it. 00:27:29.824 [2024-12-08 02:29:57.361230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.361344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.361371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.824 qpair failed and we were unable to recover it. 00:27:29.824 [2024-12-08 02:29:57.361454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.361543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.361570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.824 qpair failed and we were unable to recover it. 00:27:29.824 [2024-12-08 02:29:57.361665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.361745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.361771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.824 qpair failed and we were unable to recover it. 00:27:29.824 [2024-12-08 02:29:57.361893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.361973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.362000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.824 qpair failed and we were unable to recover it. 00:27:29.824 [2024-12-08 02:29:57.362116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.362222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.362248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.824 qpair failed and we were unable to recover it. 00:27:29.824 [2024-12-08 02:29:57.362325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.362439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.362466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.824 qpair failed and we were unable to recover it. 00:27:29.824 [2024-12-08 02:29:57.362561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.362645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.362672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.824 qpair failed and we were unable to recover it. 00:27:29.824 [2024-12-08 02:29:57.362754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.362845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.362872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.824 qpair failed and we were unable to recover it. 00:27:29.824 [2024-12-08 02:29:57.362995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.363080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.363108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.824 qpair failed and we were unable to recover it. 00:27:29.824 [2024-12-08 02:29:57.363217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.363294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.363319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.824 qpair failed and we were unable to recover it. 00:27:29.824 [2024-12-08 02:29:57.363434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.363515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.363560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.824 qpair failed and we were unable to recover it. 00:27:29.824 [2024-12-08 02:29:57.363675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.363768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.363795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.824 qpair failed and we were unable to recover it. 00:27:29.824 [2024-12-08 02:29:57.363873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.363985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.364010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.824 qpair failed and we were unable to recover it. 00:27:29.824 [2024-12-08 02:29:57.364120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.364212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.364244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.824 qpair failed and we were unable to recover it. 00:27:29.824 [2024-12-08 02:29:57.364318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.364397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.364423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.824 qpair failed and we were unable to recover it. 00:27:29.824 [2024-12-08 02:29:57.364547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.364629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.364656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.824 qpair failed and we were unable to recover it. 00:27:29.824 [2024-12-08 02:29:57.364738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.364815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.364840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.824 qpair failed and we were unable to recover it. 00:27:29.824 [2024-12-08 02:29:57.364951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.365038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.824 [2024-12-08 02:29:57.365063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.824 qpair failed and we were unable to recover it. 00:27:29.824 [2024-12-08 02:29:57.365143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.365223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.365249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.825 qpair failed and we were unable to recover it. 00:27:29.825 [2024-12-08 02:29:57.365354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.365460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.365485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.825 qpair failed and we were unable to recover it. 00:27:29.825 [2024-12-08 02:29:57.365575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.365660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.365686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.825 qpair failed and we were unable to recover it. 00:27:29.825 [2024-12-08 02:29:57.365764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.365844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.365871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.825 qpair failed and we were unable to recover it. 00:27:29.825 [2024-12-08 02:29:57.365980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.366055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.366080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.825 qpair failed and we were unable to recover it. 00:27:29.825 [2024-12-08 02:29:57.366169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.366263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.366288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.825 qpair failed and we were unable to recover it. 00:27:29.825 [2024-12-08 02:29:57.366370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.366514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.366552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.825 qpair failed and we were unable to recover it. 00:27:29.825 [2024-12-08 02:29:57.366642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.366815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.366841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.825 qpair failed and we were unable to recover it. 00:27:29.825 02:29:57 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:29.825 [2024-12-08 02:29:57.366926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.367006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.367032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.825 02:29:57 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:29.825 qpair failed and we were unable to recover it. 00:27:29.825 [2024-12-08 02:29:57.367129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 02:29:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:29.825 [2024-12-08 02:29:57.367203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.367229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.825 qpair failed and we were unable to recover it. 00:27:29.825 02:29:57 -- common/autotest_common.sh@10 -- # set +x 00:27:29.825 [2024-12-08 02:29:57.367308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.367397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.367422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.825 qpair failed and we were unable to recover it. 00:27:29.825 [2024-12-08 02:29:57.367528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.367616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.367641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.825 qpair failed and we were unable to recover it. 00:27:29.825 [2024-12-08 02:29:57.367738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.367817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.367845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.825 qpair failed and we were unable to recover it. 00:27:29.825 [2024-12-08 02:29:57.367927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.368064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.368089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.825 qpair failed and we were unable to recover it. 00:27:29.825 [2024-12-08 02:29:57.368170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.368248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.368273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.825 qpair failed and we were unable to recover it. 00:27:29.825 [2024-12-08 02:29:57.368352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.368427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.368452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.825 qpair failed and we were unable to recover it. 00:27:29.825 [2024-12-08 02:29:57.368558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.368666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.368694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.825 qpair failed and we were unable to recover it. 00:27:29.825 [2024-12-08 02:29:57.368813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.368895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.368921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.825 qpair failed and we were unable to recover it. 00:27:29.825 [2024-12-08 02:29:57.369066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.369144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.369171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.825 qpair failed and we were unable to recover it. 00:27:29.825 [2024-12-08 02:29:57.369263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.369348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.369379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.825 qpair failed and we were unable to recover it. 00:27:29.825 [2024-12-08 02:29:57.369498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.369617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.369644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.825 qpair failed and we were unable to recover it. 00:27:29.825 [2024-12-08 02:29:57.369732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.369825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.369851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.825 qpair failed and we were unable to recover it. 00:27:29.825 [2024-12-08 02:29:57.369964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.370076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.370101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.825 qpair failed and we were unable to recover it. 00:27:29.825 [2024-12-08 02:29:57.370185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.370272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.370298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.825 qpair failed and we were unable to recover it. 00:27:29.825 [2024-12-08 02:29:57.370377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.370457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.370482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.825 qpair failed and we were unable to recover it. 00:27:29.825 [2024-12-08 02:29:57.370568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.370645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.370670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.825 qpair failed and we were unable to recover it. 00:27:29.825 [2024-12-08 02:29:57.370749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.370862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.370887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.825 qpair failed and we were unable to recover it. 00:27:29.825 [2024-12-08 02:29:57.370984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.825 [2024-12-08 02:29:57.371092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.371117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.826 qpair failed and we were unable to recover it. 00:27:29.826 [2024-12-08 02:29:57.371197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.371273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.371298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.826 qpair failed and we were unable to recover it. 00:27:29.826 [2024-12-08 02:29:57.371414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.371529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.371559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.826 qpair failed and we were unable to recover it. 00:27:29.826 [2024-12-08 02:29:57.371638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.371723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.371748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.826 qpair failed and we were unable to recover it. 00:27:29.826 [2024-12-08 02:29:57.371826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.371934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.371959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.826 qpair failed and we were unable to recover it. 00:27:29.826 [2024-12-08 02:29:57.372053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.372167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.372192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.826 qpair failed and we were unable to recover it. 00:27:29.826 [2024-12-08 02:29:57.372299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.372374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.372398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.826 qpair failed and we were unable to recover it. 00:27:29.826 [2024-12-08 02:29:57.372525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.372674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.372700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.826 qpair failed and we were unable to recover it. 00:27:29.826 [2024-12-08 02:29:57.372784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.372868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.372894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.826 qpair failed and we were unable to recover it. 00:27:29.826 [2024-12-08 02:29:57.372987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.373081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.373106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.826 qpair failed and we were unable to recover it. 00:27:29.826 [2024-12-08 02:29:57.373186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.373292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.373317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.826 qpair failed and we were unable to recover it. 00:27:29.826 [2024-12-08 02:29:57.373425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.373501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.373527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.826 qpair failed and we were unable to recover it. 00:27:29.826 [2024-12-08 02:29:57.373622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.373784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.373809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.826 qpair failed and we were unable to recover it. 00:27:29.826 [2024-12-08 02:29:57.373926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.374004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.374030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.826 qpair failed and we were unable to recover it. 00:27:29.826 [2024-12-08 02:29:57.374118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.374228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.374254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.826 qpair failed and we were unable to recover it. 00:27:29.826 [2024-12-08 02:29:57.374340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.374456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.374482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.826 qpair failed and we were unable to recover it. 00:27:29.826 [2024-12-08 02:29:57.374591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.374703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.374729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.826 qpair failed and we were unable to recover it. 00:27:29.826 [2024-12-08 02:29:57.374838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.374921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.374946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.826 qpair failed and we were unable to recover it. 00:27:29.826 [2024-12-08 02:29:57.375037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.375173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.375197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.826 qpair failed and we were unable to recover it. 00:27:29.826 [2024-12-08 02:29:57.375276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.375381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.375406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.826 qpair failed and we were unable to recover it. 00:27:29.826 [2024-12-08 02:29:57.375482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.375572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.375599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.826 qpair failed and we were unable to recover it. 00:27:29.826 [2024-12-08 02:29:57.375716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.375825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.375851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.826 qpair failed and we were unable to recover it. 00:27:29.826 [2024-12-08 02:29:57.375959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.376038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.376063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.826 qpair failed and we were unable to recover it. 00:27:29.826 [2024-12-08 02:29:57.376176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.376249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.376274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.826 qpair failed and we were unable to recover it. 00:27:29.826 [2024-12-08 02:29:57.376356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.376466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.376492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.826 qpair failed and we were unable to recover it. 00:27:29.826 [2024-12-08 02:29:57.376611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.376693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.376719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.826 qpair failed and we were unable to recover it. 00:27:29.826 [2024-12-08 02:29:57.376795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.376876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.376901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.826 qpair failed and we were unable to recover it. 00:27:29.826 [2024-12-08 02:29:57.376984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.826 [2024-12-08 02:29:57.377059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.377084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.827 qpair failed and we were unable to recover it. 00:27:29.827 [2024-12-08 02:29:57.377200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.377310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.377335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.827 qpair failed and we were unable to recover it. 00:27:29.827 [2024-12-08 02:29:57.377425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.377505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.377531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.827 qpair failed and we were unable to recover it. 00:27:29.827 [2024-12-08 02:29:57.377624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.377707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.377732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.827 qpair failed and we were unable to recover it. 00:27:29.827 [2024-12-08 02:29:57.377858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.377943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.377969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.827 qpair failed and we were unable to recover it. 00:27:29.827 [2024-12-08 02:29:57.378085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.378191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.378221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.827 qpair failed and we were unable to recover it. 00:27:29.827 [2024-12-08 02:29:57.378331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.378410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.378435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.827 qpair failed and we were unable to recover it. 00:27:29.827 [2024-12-08 02:29:57.378521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.378632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.378658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.827 qpair failed and we were unable to recover it. 00:27:29.827 [2024-12-08 02:29:57.378749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.378871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.378897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.827 qpair failed and we were unable to recover it. 00:27:29.827 [2024-12-08 02:29:57.379009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.379088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.379113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.827 qpair failed and we were unable to recover it. 00:27:29.827 [2024-12-08 02:29:57.379225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.379335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.379360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.827 qpair failed and we were unable to recover it. 00:27:29.827 [2024-12-08 02:29:57.379445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.379558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.379584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.827 qpair failed and we were unable to recover it. 00:27:29.827 [2024-12-08 02:29:57.379702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.379785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.379810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.827 qpair failed and we were unable to recover it. 00:27:29.827 [2024-12-08 02:29:57.379925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.380035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.380060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.827 qpair failed and we were unable to recover it. 00:27:29.827 [2024-12-08 02:29:57.380201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.380279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.380304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.827 qpair failed and we were unable to recover it. 00:27:29.827 [2024-12-08 02:29:57.380378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.380457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.380487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.827 qpair failed and we were unable to recover it. 00:27:29.827 [2024-12-08 02:29:57.380602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.380710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.380736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.827 qpair failed and we were unable to recover it. 00:27:29.827 [2024-12-08 02:29:57.380847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.380930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.380955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.827 qpair failed and we were unable to recover it. 00:27:29.827 [2024-12-08 02:29:57.381047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.381123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.381148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.827 qpair failed and we were unable to recover it. 00:27:29.827 [2024-12-08 02:29:57.381223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.381301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.381327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.827 qpair failed and we were unable to recover it. 00:27:29.827 [2024-12-08 02:29:57.381416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.381527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.381559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.827 qpair failed and we were unable to recover it. 00:27:29.827 [2024-12-08 02:29:57.381649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.381756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.381781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.827 qpair failed and we were unable to recover it. 00:27:29.827 [2024-12-08 02:29:57.381872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.381985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.382011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.827 qpair failed and we were unable to recover it. 00:27:29.827 [2024-12-08 02:29:57.382092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.382202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.382227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.827 qpair failed and we were unable to recover it. 00:27:29.827 [2024-12-08 02:29:57.382339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.382449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.382475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.827 qpair failed and we were unable to recover it. 00:27:29.827 [2024-12-08 02:29:57.382642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.382740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.382769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.827 qpair failed and we were unable to recover it. 00:27:29.827 [2024-12-08 02:29:57.382903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.382996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.383023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.827 qpair failed and we were unable to recover it. 00:27:29.827 [2024-12-08 02:29:57.383112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.383228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.383255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.827 qpair failed and we were unable to recover it. 00:27:29.827 [2024-12-08 02:29:57.383368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.383450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.827 [2024-12-08 02:29:57.383476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.827 qpair failed and we were unable to recover it. 00:27:29.827 [2024-12-08 02:29:57.383571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.383658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.383684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.828 qpair failed and we were unable to recover it. 00:27:29.828 [2024-12-08 02:29:57.383776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.383864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.383898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.828 qpair failed and we were unable to recover it. 00:27:29.828 [2024-12-08 02:29:57.383980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.384088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.384115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.828 qpair failed and we were unable to recover it. 00:27:29.828 [2024-12-08 02:29:57.384205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.384315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.384341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.828 qpair failed and we were unable to recover it. 00:27:29.828 [2024-12-08 02:29:57.384458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.384555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.384581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.828 qpair failed and we were unable to recover it. 00:27:29.828 [2024-12-08 02:29:57.384663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.384783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.384811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.828 qpair failed and we were unable to recover it. 00:27:29.828 [2024-12-08 02:29:57.384934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.385015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.385041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.828 qpair failed and we were unable to recover it. 00:27:29.828 [2024-12-08 02:29:57.385136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.385268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.385294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.828 qpair failed and we were unable to recover it. 00:27:29.828 [2024-12-08 02:29:57.385374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.385514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.385556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.828 qpair failed and we were unable to recover it. 00:27:29.828 [2024-12-08 02:29:57.385645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.385726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.385752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.828 qpair failed and we were unable to recover it. 00:27:29.828 [2024-12-08 02:29:57.385840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.385933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.385957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.828 qpair failed and we were unable to recover it. 00:27:29.828 [2024-12-08 02:29:57.386046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.386150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.386175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.828 qpair failed and we were unable to recover it. 00:27:29.828 [2024-12-08 02:29:57.386283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.386389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.386413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.828 qpair failed and we were unable to recover it. 00:27:29.828 [2024-12-08 02:29:57.386492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.386607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.386632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.828 qpair failed and we were unable to recover it. 00:27:29.828 [2024-12-08 02:29:57.386749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.386867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.386893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.828 qpair failed and we were unable to recover it. 00:27:29.828 [2024-12-08 02:29:57.386982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.387072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.387098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.828 qpair failed and we were unable to recover it. 00:27:29.828 [2024-12-08 02:29:57.387177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.387257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.387283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.828 qpair failed and we were unable to recover it. 00:27:29.828 [2024-12-08 02:29:57.387374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.387479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.387505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.828 qpair failed and we were unable to recover it. 00:27:29.828 [2024-12-08 02:29:57.387607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.387688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.387714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.828 qpair failed and we were unable to recover it. 00:27:29.828 [2024-12-08 02:29:57.387798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.387935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.387961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.828 qpair failed and we were unable to recover it. 00:27:29.828 [2024-12-08 02:29:57.388041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.388119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.388145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.828 qpair failed and we were unable to recover it. 00:27:29.828 [2024-12-08 02:29:57.388230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.388304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.388329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.828 qpair failed and we were unable to recover it. 00:27:29.828 [2024-12-08 02:29:57.388440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.388562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.388588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.828 qpair failed and we were unable to recover it. 00:27:29.828 [2024-12-08 02:29:57.388670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.388750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.388776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.828 qpair failed and we were unable to recover it. 00:27:29.828 [2024-12-08 02:29:57.388902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.389013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.389039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.828 qpair failed and we were unable to recover it. 00:27:29.828 [2024-12-08 02:29:57.389131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.389249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.389275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.828 qpair failed and we were unable to recover it. 00:27:29.828 [2024-12-08 02:29:57.389354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.389499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.389525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.828 qpair failed and we were unable to recover it. 00:27:29.828 [2024-12-08 02:29:57.389649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.389729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.828 [2024-12-08 02:29:57.389756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.828 qpair failed and we were unable to recover it. 00:27:29.829 [2024-12-08 02:29:57.389861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.390008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.390034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.829 qpair failed and we were unable to recover it. 00:27:29.829 [2024-12-08 02:29:57.390121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.390229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.390255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.829 qpair failed and we were unable to recover it. 00:27:29.829 [2024-12-08 02:29:57.390348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.390427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.390453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.829 qpair failed and we were unable to recover it. 00:27:29.829 [2024-12-08 02:29:57.390531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.390649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.390674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.829 qpair failed and we were unable to recover it. 00:27:29.829 [2024-12-08 02:29:57.390790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.390881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.390908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.829 qpair failed and we were unable to recover it. 00:27:29.829 [2024-12-08 02:29:57.391019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.391103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.391131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.829 qpair failed and we were unable to recover it. 00:27:29.829 [2024-12-08 02:29:57.391227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.391334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.391360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.829 qpair failed and we were unable to recover it. 00:27:29.829 [2024-12-08 02:29:57.391446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.391566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.391592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.829 qpair failed and we were unable to recover it. 00:27:29.829 [2024-12-08 02:29:57.391685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.391796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.391821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.829 qpair failed and we were unable to recover it. 00:27:29.829 [2024-12-08 02:29:57.391908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.392022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.392047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.829 qpair failed and we were unable to recover it. 00:27:29.829 Malloc0 00:27:29.829 [2024-12-08 02:29:57.392161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.392244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.392268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.829 qpair failed and we were unable to recover it. 00:27:29.829 [2024-12-08 02:29:57.392352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.392468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 02:29:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:29.829 [2024-12-08 02:29:57.392493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.829 qpair failed and we were unable to recover it. 00:27:29.829 [2024-12-08 02:29:57.392611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 02:29:57 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:29.829 [2024-12-08 02:29:57.392695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.392720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.829 qpair failed and we were unable to recover it. 00:27:29.829 [2024-12-08 02:29:57.392801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 02:29:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:29.829 [2024-12-08 02:29:57.392895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.392920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.829 qpair failed and we were unable to recover it. 00:27:29.829 02:29:57 -- common/autotest_common.sh@10 -- # set +x 00:27:29.829 [2024-12-08 02:29:57.393005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.393084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.393109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.829 qpair failed and we were unable to recover it. 00:27:29.829 [2024-12-08 02:29:57.393207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.393321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.393346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.829 qpair failed and we were unable to recover it. 00:27:29.829 [2024-12-08 02:29:57.393434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.393514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.393545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.829 qpair failed and we were unable to recover it. 00:27:29.829 [2024-12-08 02:29:57.393626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.393716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.393740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.829 qpair failed and we were unable to recover it. 00:27:29.829 [2024-12-08 02:29:57.393819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.393892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.393917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.829 qpair failed and we were unable to recover it. 00:27:29.829 [2024-12-08 02:29:57.394001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.394072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.394098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.829 qpair failed and we were unable to recover it. 00:27:29.829 [2024-12-08 02:29:57.394215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.394323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.394348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.829 qpair failed and we were unable to recover it. 00:27:29.829 [2024-12-08 02:29:57.394434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.394554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.394578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.829 qpair failed and we were unable to recover it. 00:27:29.829 [2024-12-08 02:29:57.394661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.394769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.394795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.829 qpair failed and we were unable to recover it. 00:27:29.829 [2024-12-08 02:29:57.394894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.395002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.395027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.829 qpair failed and we were unable to recover it. 00:27:29.829 [2024-12-08 02:29:57.395111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.829 [2024-12-08 02:29:57.395188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.395213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.830 qpair failed and we were unable to recover it. 00:27:29.830 [2024-12-08 02:29:57.395298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.395406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.395432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.830 qpair failed and we were unable to recover it. 00:27:29.830 [2024-12-08 02:29:57.395553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.395687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.395714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.830 qpair failed and we were unable to recover it. 00:27:29.830 [2024-12-08 02:29:57.395805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.395842] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:29.830 [2024-12-08 02:29:57.395931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.395957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.830 qpair failed and we were unable to recover it. 00:27:29.830 [2024-12-08 02:29:57.396038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.396129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.396159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.830 qpair failed and we were unable to recover it. 00:27:29.830 [2024-12-08 02:29:57.396240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.396378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.396413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.830 qpair failed and we were unable to recover it. 00:27:29.830 [2024-12-08 02:29:57.396501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.396593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.396620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.830 qpair failed and we were unable to recover it. 00:27:29.830 [2024-12-08 02:29:57.396706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.396815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.396841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.830 qpair failed and we were unable to recover it. 00:27:29.830 [2024-12-08 02:29:57.396985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.397065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.397091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.830 qpair failed and we were unable to recover it. 00:27:29.830 [2024-12-08 02:29:57.397205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.397281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.397307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.830 qpair failed and we were unable to recover it. 00:27:29.830 [2024-12-08 02:29:57.397394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.397533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.397563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.830 qpair failed and we were unable to recover it. 00:27:29.830 [2024-12-08 02:29:57.397656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.397739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.397763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.830 qpair failed and we were unable to recover it. 00:27:29.830 [2024-12-08 02:29:57.397849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.397965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.397990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.830 qpair failed and we were unable to recover it. 00:27:29.830 [2024-12-08 02:29:57.398070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.398180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.398205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.830 qpair failed and we were unable to recover it. 00:27:29.830 [2024-12-08 02:29:57.398326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.398399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.398425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.830 qpair failed and we were unable to recover it. 00:27:29.830 [2024-12-08 02:29:57.398552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.398629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.398654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.830 qpair failed and we were unable to recover it. 00:27:29.830 [2024-12-08 02:29:57.398737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.398846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.398871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.830 qpair failed and we were unable to recover it. 00:27:29.830 [2024-12-08 02:29:57.398972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.399083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.399108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.830 qpair failed and we were unable to recover it. 00:27:29.830 [2024-12-08 02:29:57.399188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.399265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.399290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.830 qpair failed and we were unable to recover it. 00:27:29.830 [2024-12-08 02:29:57.399373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.399447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.399472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.830 qpair failed and we were unable to recover it. 00:27:29.830 [2024-12-08 02:29:57.399599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.399683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.399708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.830 qpair failed and we were unable to recover it. 00:27:29.830 [2024-12-08 02:29:57.399791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.399916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.399942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.830 qpair failed and we were unable to recover it. 00:27:29.830 [2024-12-08 02:29:57.400023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.400102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.400127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.830 qpair failed and we were unable to recover it. 00:27:29.830 [2024-12-08 02:29:57.400204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.400278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.400303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.830 qpair failed and we were unable to recover it. 00:27:29.830 [2024-12-08 02:29:57.400393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.400502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.400527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.830 qpair failed and we were unable to recover it. 00:27:29.830 [2024-12-08 02:29:57.400622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.400698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.400723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.830 qpair failed and we were unable to recover it. 00:27:29.830 [2024-12-08 02:29:57.400826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.400932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.400957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.830 qpair failed and we were unable to recover it. 00:27:29.830 [2024-12-08 02:29:57.401077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.401187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.401212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.830 qpair failed and we were unable to recover it. 00:27:29.830 [2024-12-08 02:29:57.401333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.401445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.830 [2024-12-08 02:29:57.401470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.830 qpair failed and we were unable to recover it. 00:27:29.831 [2024-12-08 02:29:57.401563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.401640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.401665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.831 qpair failed and we were unable to recover it. 00:27:29.831 [2024-12-08 02:29:57.401786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.401873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.401898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.831 qpair failed and we were unable to recover it. 00:27:29.831 [2024-12-08 02:29:57.402012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.402124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.402149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.831 qpair failed and we were unable to recover it. 00:27:29.831 [2024-12-08 02:29:57.402229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.402309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.402334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.831 qpair failed and we were unable to recover it. 00:27:29.831 [2024-12-08 02:29:57.402462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.402552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.402578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.831 qpair failed and we were unable to recover it. 00:27:29.831 [2024-12-08 02:29:57.402702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.402787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.402812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.831 qpair failed and we were unable to recover it. 00:27:29.831 [2024-12-08 02:29:57.402911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.403023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.403048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.831 qpair failed and we were unable to recover it. 00:27:29.831 [2024-12-08 02:29:57.403142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.403226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.403252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.831 qpair failed and we were unable to recover it. 00:27:29.831 [2024-12-08 02:29:57.403373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.403452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.403476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.831 qpair failed and we were unable to recover it. 00:27:29.831 [2024-12-08 02:29:57.403581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.403668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.403693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.831 qpair failed and we were unable to recover it. 00:27:29.831 [2024-12-08 02:29:57.403773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.403872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.403898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.831 qpair failed and we were unable to recover it. 00:27:29.831 [2024-12-08 02:29:57.403977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.404054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 02:29:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:29.831 [2024-12-08 02:29:57.404079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.831 qpair failed and we were unable to recover it. 00:27:29.831 [2024-12-08 02:29:57.404187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 02:29:57 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:29.831 [2024-12-08 02:29:57.404272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.404297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.831 qpair failed and we were unable to recover it. 00:27:29.831 02:29:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:29.831 [2024-12-08 02:29:57.404396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 02:29:57 -- common/autotest_common.sh@10 -- # set +x 00:27:29.831 [2024-12-08 02:29:57.404502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.404527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.831 qpair failed and we were unable to recover it. 00:27:29.831 [2024-12-08 02:29:57.404624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.404718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.404743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.831 qpair failed and we were unable to recover it. 00:27:29.831 [2024-12-08 02:29:57.404861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.404979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.405008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.831 qpair failed and we were unable to recover it. 00:27:29.831 [2024-12-08 02:29:57.405088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.405197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.405222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.831 qpair failed and we were unable to recover it. 00:27:29.831 [2024-12-08 02:29:57.405305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.405443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.405468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.831 qpair failed and we were unable to recover it. 00:27:29.831 [2024-12-08 02:29:57.405560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.405688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.405713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.831 qpair failed and we were unable to recover it. 00:27:29.831 [2024-12-08 02:29:57.405825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.405913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.405938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.831 qpair failed and we were unable to recover it. 00:27:29.831 [2024-12-08 02:29:57.406054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.406162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.406187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.831 qpair failed and we were unable to recover it. 00:27:29.831 [2024-12-08 02:29:57.406266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.406350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.406375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.831 qpair failed and we were unable to recover it. 00:27:29.831 [2024-12-08 02:29:57.406465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.406582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.406608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.831 qpair failed and we were unable to recover it. 00:27:29.831 [2024-12-08 02:29:57.406724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.406800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.406826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.831 qpair failed and we were unable to recover it. 00:27:29.831 [2024-12-08 02:29:57.406924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.407030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.407055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.831 qpair failed and we were unable to recover it. 00:27:29.831 [2024-12-08 02:29:57.407164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.407274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.831 [2024-12-08 02:29:57.407299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.831 qpair failed and we were unable to recover it. 00:27:29.831 [2024-12-08 02:29:57.407416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.407505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.407530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.832 qpair failed and we were unable to recover it. 00:27:29.832 [2024-12-08 02:29:57.407617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.407693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.407718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.832 qpair failed and we were unable to recover it. 00:27:29.832 [2024-12-08 02:29:57.407804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.407923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.407947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.832 qpair failed and we were unable to recover it. 00:27:29.832 [2024-12-08 02:29:57.408026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.408108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.408133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.832 qpair failed and we were unable to recover it. 00:27:29.832 [2024-12-08 02:29:57.408213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.408324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.408349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.832 qpair failed and we were unable to recover it. 00:27:29.832 [2024-12-08 02:29:57.408443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.408566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.408592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.832 qpair failed and we were unable to recover it. 00:27:29.832 [2024-12-08 02:29:57.408703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.408782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.408807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.832 qpair failed and we were unable to recover it. 00:27:29.832 [2024-12-08 02:29:57.408888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.408970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.408995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.832 qpair failed and we were unable to recover it. 00:27:29.832 [2024-12-08 02:29:57.409085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.409172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.409197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.832 qpair failed and we were unable to recover it. 00:27:29.832 [2024-12-08 02:29:57.409306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.409382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.409407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.832 qpair failed and we were unable to recover it. 00:27:29.832 [2024-12-08 02:29:57.409485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.409583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.409608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.832 qpair failed and we were unable to recover it. 00:27:29.832 [2024-12-08 02:29:57.409688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.409799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.409824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.832 qpair failed and we were unable to recover it. 00:27:29.832 [2024-12-08 02:29:57.409898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.410037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.410062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.832 qpair failed and we were unable to recover it. 00:27:29.832 [2024-12-08 02:29:57.410169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.410247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.410272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.832 qpair failed and we were unable to recover it. 00:27:29.832 [2024-12-08 02:29:57.410382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.410490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.410515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.832 qpair failed and we were unable to recover it. 00:27:29.832 [2024-12-08 02:29:57.410630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.410707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.410732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.832 qpair failed and we were unable to recover it. 00:27:29.832 [2024-12-08 02:29:57.410852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.410967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.410992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.832 qpair failed and we were unable to recover it. 00:27:29.832 [2024-12-08 02:29:57.411104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.411215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.411240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.832 qpair failed and we were unable to recover it. 00:27:29.832 [2024-12-08 02:29:57.411326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.411433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.411457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.832 qpair failed and we were unable to recover it. 00:27:29.832 [2024-12-08 02:29:57.411559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.411639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.411665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.832 qpair failed and we were unable to recover it. 00:27:29.832 [2024-12-08 02:29:57.411766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.411873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.411901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.832 qpair failed and we were unable to recover it. 00:27:29.832 [2024-12-08 02:29:57.411987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.412074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.412100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b9 02:29:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:29.832 0 with addr=10.0.0.2, port=4420 00:27:29.832 qpair failed and we were unable to recover it. 00:27:29.832 [2024-12-08 02:29:57.412185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 02:29:57 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:29.832 [2024-12-08 02:29:57.412269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.412295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.832 qpair failed and we were unable to recover it. 00:27:29.832 02:29:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:29.832 [2024-12-08 02:29:57.412396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.412483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 02:29:57 -- common/autotest_common.sh@10 -- # set +x 00:27:29.832 [2024-12-08 02:29:57.412508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.832 qpair failed and we were unable to recover it. 00:27:29.832 [2024-12-08 02:29:57.412611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.412696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.412721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.832 qpair failed and we were unable to recover it. 00:27:29.832 [2024-12-08 02:29:57.412802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.412907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.412932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5764000b90 with addr=10.0.0.2, port=4420 00:27:29.832 qpair failed and we were unable to recover it. 00:27:29.832 [2024-12-08 02:29:57.413026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.413107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.832 [2024-12-08 02:29:57.413133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.832 qpair failed and we were unable to recover it. 00:27:29.832 [2024-12-08 02:29:57.413244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.413337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.413362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.833 qpair failed and we were unable to recover it. 00:27:29.833 [2024-12-08 02:29:57.413452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.413530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.413560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.833 qpair failed and we were unable to recover it. 00:27:29.833 [2024-12-08 02:29:57.413646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.413721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.413754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.833 qpair failed and we were unable to recover it. 00:27:29.833 [2024-12-08 02:29:57.413872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.413953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.413978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.833 qpair failed and we were unable to recover it. 00:27:29.833 [2024-12-08 02:29:57.414079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.414159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.414184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.833 qpair failed and we were unable to recover it. 00:27:29.833 [2024-12-08 02:29:57.414271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.414349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.414373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.833 qpair failed and we were unable to recover it. 00:27:29.833 [2024-12-08 02:29:57.414465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.414583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.414614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.833 qpair failed and we were unable to recover it. 00:27:29.833 [2024-12-08 02:29:57.414717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.414799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.414825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.833 qpair failed and we were unable to recover it. 00:27:29.833 [2024-12-08 02:29:57.414934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.415010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.415036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.833 qpair failed and we were unable to recover it. 00:27:29.833 [2024-12-08 02:29:57.415146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.415225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.415250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.833 qpair failed and we were unable to recover it. 00:27:29.833 [2024-12-08 02:29:57.415393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.415473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.415498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.833 qpair failed and we were unable to recover it. 00:27:29.833 [2024-12-08 02:29:57.415592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.415668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.415694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.833 qpair failed and we were unable to recover it. 00:27:29.833 [2024-12-08 02:29:57.415778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.415914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.415945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.833 qpair failed and we were unable to recover it. 00:27:29.833 [2024-12-08 02:29:57.416092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.416170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.416195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.833 qpair failed and we were unable to recover it. 00:27:29.833 [2024-12-08 02:29:57.416279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.416360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.416385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.833 qpair failed and we were unable to recover it. 00:27:29.833 [2024-12-08 02:29:57.416500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.416593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.416619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.833 qpair failed and we were unable to recover it. 00:27:29.833 [2024-12-08 02:29:57.416707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.416787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.416812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.833 qpair failed and we were unable to recover it. 00:27:29.833 [2024-12-08 02:29:57.416908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.416997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.417022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.833 qpair failed and we were unable to recover it. 00:27:29.833 [2024-12-08 02:29:57.417136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.417213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.417239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.833 qpair failed and we were unable to recover it. 00:27:29.833 [2024-12-08 02:29:57.417319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.417401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.417426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.833 qpair failed and we were unable to recover it. 00:27:29.833 [2024-12-08 02:29:57.417505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.417617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.417643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.833 qpair failed and we were unable to recover it. 00:27:29.833 [2024-12-08 02:29:57.417723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.417793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.417818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.833 qpair failed and we were unable to recover it. 00:27:29.833 [2024-12-08 02:29:57.417924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.418040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.418065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.833 qpair failed and we were unable to recover it. 00:27:29.833 [2024-12-08 02:29:57.418154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.418272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.418297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.833 qpair failed and we were unable to recover it. 00:27:29.833 [2024-12-08 02:29:57.418381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.418463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.418489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.833 qpair failed and we were unable to recover it. 00:27:29.833 [2024-12-08 02:29:57.418587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.418669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.418694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.833 qpair failed and we were unable to recover it. 00:27:29.833 [2024-12-08 02:29:57.418779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.418872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.418899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.833 qpair failed and we were unable to recover it. 00:27:29.833 [2024-12-08 02:29:57.418981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.419090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.833 [2024-12-08 02:29:57.419116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.833 qpair failed and we were unable to recover it. 00:27:29.833 [2024-12-08 02:29:57.419228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.419317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.419343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.834 qpair failed and we were unable to recover it. 00:27:29.834 [2024-12-08 02:29:57.419464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.419580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.419606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.834 qpair failed and we were unable to recover it. 00:27:29.834 [2024-12-08 02:29:57.419685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.419769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.419794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.834 qpair failed and we were unable to recover it. 00:27:29.834 [2024-12-08 02:29:57.419875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.419958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.419984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.834 qpair failed and we were unable to recover it. 00:27:29.834 [2024-12-08 02:29:57.420066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 02:29:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:29.834 [2024-12-08 02:29:57.420142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.420173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f575c000b90 with addr=10.0.0.2, port=4420 00:27:29.834 qpair failed and we were unable to recover it. 00:27:29.834 02:29:57 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:29.834 [2024-12-08 02:29:57.420263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.420347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.420373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.834 02:29:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:29.834 qpair failed and we were unable to recover it. 00:27:29.834 [2024-12-08 02:29:57.420465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 02:29:57 -- common/autotest_common.sh@10 -- # set +x 00:27:29.834 [2024-12-08 02:29:57.420563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.420589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.834 qpair failed and we were unable to recover it. 00:27:29.834 [2024-12-08 02:29:57.420672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.420758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.420782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.834 qpair failed and we were unable to recover it. 00:27:29.834 [2024-12-08 02:29:57.420892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.421002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.421028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.834 qpair failed and we were unable to recover it. 00:27:29.834 [2024-12-08 02:29:57.421136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.421227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.421252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.834 qpair failed and we were unable to recover it. 00:27:29.834 [2024-12-08 02:29:57.421332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.421410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.421435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.834 qpair failed and we were unable to recover it. 00:27:29.834 [2024-12-08 02:29:57.421550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.421638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.421663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.834 qpair failed and we were unable to recover it. 00:27:29.834 [2024-12-08 02:29:57.421747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.421822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.421847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.834 qpair failed and we were unable to recover it. 00:27:29.834 [2024-12-08 02:29:57.421958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.422066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.422091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.834 qpair failed and we were unable to recover it. 00:27:29.834 [2024-12-08 02:29:57.422167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.422257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.422282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.834 qpair failed and we were unable to recover it. 00:27:29.834 [2024-12-08 02:29:57.422386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.422464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.422489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.834 qpair failed and we were unable to recover it. 00:27:29.834 [2024-12-08 02:29:57.422575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.422687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.422712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.834 qpair failed and we were unable to recover it. 00:27:29.834 [2024-12-08 02:29:57.422800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.422874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.422899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.834 qpair failed and we were unable to recover it. 00:27:29.834 [2024-12-08 02:29:57.422977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.423078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.423103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.834 qpair failed and we were unable to recover it. 00:27:29.834 [2024-12-08 02:29:57.423211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.423289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.423314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.834 qpair failed and we were unable to recover it. 00:27:29.834 [2024-12-08 02:29:57.423427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.423511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.423542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.834 qpair failed and we were unable to recover it. 00:27:29.834 [2024-12-08 02:29:57.423629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.423709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.423734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.834 qpair failed and we were unable to recover it. 00:27:29.834 [2024-12-08 02:29:57.423824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.423902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.834 [2024-12-08 02:29:57.423927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f3cb0 with addr=10.0.0.2, port=4420 00:27:29.834 qpair failed and we were unable to recover it. 00:27:29.834 [2024-12-08 02:29:57.424062] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:29.834 [2024-12-08 02:29:57.426486] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.834 [2024-12-08 02:29:57.426603] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.834 [2024-12-08 02:29:57.426632] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.835 [2024-12-08 02:29:57.426653] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.835 [2024-12-08 02:29:57.426667] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:29.835 [2024-12-08 02:29:57.426701] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.835 qpair failed and we were unable to recover it. 00:27:29.835 02:29:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:29.835 02:29:57 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:29.835 02:29:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:29.835 02:29:57 -- common/autotest_common.sh@10 -- # set +x 00:27:29.835 02:29:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:29.835 02:29:57 -- host/target_disconnect.sh@58 -- # wait 2230335 00:27:29.835 [2024-12-08 02:29:57.436413] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.835 [2024-12-08 02:29:57.436545] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.835 [2024-12-08 02:29:57.436572] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.835 [2024-12-08 02:29:57.436586] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.835 [2024-12-08 02:29:57.436600] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:29.835 [2024-12-08 02:29:57.436628] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.835 qpair failed and we were unable to recover it. 00:27:29.835 [2024-12-08 02:29:57.446423] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.835 [2024-12-08 02:29:57.446512] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.835 [2024-12-08 02:29:57.446544] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.835 [2024-12-08 02:29:57.446561] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.835 [2024-12-08 02:29:57.446574] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:29.835 [2024-12-08 02:29:57.446603] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.835 qpair failed and we were unable to recover it. 00:27:29.835 [2024-12-08 02:29:57.456433] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.835 [2024-12-08 02:29:57.456524] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.835 [2024-12-08 02:29:57.456557] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.835 [2024-12-08 02:29:57.456573] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.835 [2024-12-08 02:29:57.456586] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:29.835 [2024-12-08 02:29:57.456615] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.835 qpair failed and we were unable to recover it. 00:27:29.835 [2024-12-08 02:29:57.466393] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.835 [2024-12-08 02:29:57.466488] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.835 [2024-12-08 02:29:57.466514] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.835 [2024-12-08 02:29:57.466548] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.835 [2024-12-08 02:29:57.466565] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:29.835 [2024-12-08 02:29:57.466595] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.835 qpair failed and we were unable to recover it. 00:27:29.835 [2024-12-08 02:29:57.476431] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.835 [2024-12-08 02:29:57.476525] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.835 [2024-12-08 02:29:57.476561] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.835 [2024-12-08 02:29:57.476576] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.835 [2024-12-08 02:29:57.476589] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:29.835 [2024-12-08 02:29:57.476618] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.835 qpair failed and we were unable to recover it. 00:27:29.835 [2024-12-08 02:29:57.486446] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.835 [2024-12-08 02:29:57.486534] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.835 [2024-12-08 02:29:57.486566] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.835 [2024-12-08 02:29:57.486580] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.835 [2024-12-08 02:29:57.486594] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:29.835 [2024-12-08 02:29:57.486622] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.835 qpair failed and we were unable to recover it. 00:27:29.835 [2024-12-08 02:29:57.496463] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.835 [2024-12-08 02:29:57.496562] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.835 [2024-12-08 02:29:57.496589] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.835 [2024-12-08 02:29:57.496604] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.835 [2024-12-08 02:29:57.496617] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:29.835 [2024-12-08 02:29:57.496647] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.835 qpair failed and we were unable to recover it. 00:27:29.835 [2024-12-08 02:29:57.506479] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.835 [2024-12-08 02:29:57.506568] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.835 [2024-12-08 02:29:57.506594] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.835 [2024-12-08 02:29:57.506609] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.835 [2024-12-08 02:29:57.506622] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:29.835 [2024-12-08 02:29:57.506650] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.835 qpair failed and we were unable to recover it. 00:27:29.835 [2024-12-08 02:29:57.516553] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.835 [2024-12-08 02:29:57.516645] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.835 [2024-12-08 02:29:57.516671] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.835 [2024-12-08 02:29:57.516685] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.835 [2024-12-08 02:29:57.516699] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:29.835 [2024-12-08 02:29:57.516728] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.835 qpair failed and we were unable to recover it. 00:27:29.835 [2024-12-08 02:29:57.526546] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.835 [2024-12-08 02:29:57.526633] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.835 [2024-12-08 02:29:57.526659] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.835 [2024-12-08 02:29:57.526674] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.835 [2024-12-08 02:29:57.526687] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:29.835 [2024-12-08 02:29:57.526716] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.835 qpair failed and we were unable to recover it. 00:27:29.835 [2024-12-08 02:29:57.536596] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.835 [2024-12-08 02:29:57.536695] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.835 [2024-12-08 02:29:57.536721] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.835 [2024-12-08 02:29:57.536735] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.835 [2024-12-08 02:29:57.536748] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:29.835 [2024-12-08 02:29:57.536777] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.835 qpair failed and we were unable to recover it. 00:27:29.835 [2024-12-08 02:29:57.546679] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.835 [2024-12-08 02:29:57.546768] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.835 [2024-12-08 02:29:57.546793] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.835 [2024-12-08 02:29:57.546807] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.835 [2024-12-08 02:29:57.546820] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:29.836 [2024-12-08 02:29:57.546851] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.836 qpair failed and we were unable to recover it. 00:27:29.836 [2024-12-08 02:29:57.556654] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:29.836 [2024-12-08 02:29:57.556751] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:29.836 [2024-12-08 02:29:57.556780] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:29.836 [2024-12-08 02:29:57.556803] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:29.836 [2024-12-08 02:29:57.556818] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:29.836 [2024-12-08 02:29:57.556849] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:29.836 qpair failed and we were unable to recover it. 00:27:30.095 [2024-12-08 02:29:57.566795] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.095 [2024-12-08 02:29:57.566891] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.095 [2024-12-08 02:29:57.566917] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.095 [2024-12-08 02:29:57.566932] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.095 [2024-12-08 02:29:57.566945] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.095 [2024-12-08 02:29:57.566974] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.095 qpair failed and we were unable to recover it. 00:27:30.095 [2024-12-08 02:29:57.576774] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.095 [2024-12-08 02:29:57.576898] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.095 [2024-12-08 02:29:57.576923] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.095 [2024-12-08 02:29:57.576938] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.095 [2024-12-08 02:29:57.576951] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.095 [2024-12-08 02:29:57.576980] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.095 qpair failed and we were unable to recover it. 00:27:30.095 [2024-12-08 02:29:57.586830] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.095 [2024-12-08 02:29:57.586927] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.095 [2024-12-08 02:29:57.586953] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.095 [2024-12-08 02:29:57.586967] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.095 [2024-12-08 02:29:57.586980] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.095 [2024-12-08 02:29:57.587009] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.095 qpair failed and we were unable to recover it. 00:27:30.095 [2024-12-08 02:29:57.596822] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.095 [2024-12-08 02:29:57.596935] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.095 [2024-12-08 02:29:57.596960] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.095 [2024-12-08 02:29:57.596974] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.096 [2024-12-08 02:29:57.596988] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.096 [2024-12-08 02:29:57.597016] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.096 qpair failed and we were unable to recover it. 00:27:30.096 [2024-12-08 02:29:57.606864] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.096 [2024-12-08 02:29:57.606950] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.096 [2024-12-08 02:29:57.606975] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.096 [2024-12-08 02:29:57.606990] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.096 [2024-12-08 02:29:57.607003] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.096 [2024-12-08 02:29:57.607032] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.096 qpair failed and we were unable to recover it. 00:27:30.096 [2024-12-08 02:29:57.616805] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.096 [2024-12-08 02:29:57.616895] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.096 [2024-12-08 02:29:57.616921] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.096 [2024-12-08 02:29:57.616935] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.096 [2024-12-08 02:29:57.616948] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.096 [2024-12-08 02:29:57.616976] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.096 qpair failed and we were unable to recover it. 00:27:30.096 [2024-12-08 02:29:57.626817] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.096 [2024-12-08 02:29:57.626904] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.096 [2024-12-08 02:29:57.626929] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.096 [2024-12-08 02:29:57.626944] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.096 [2024-12-08 02:29:57.626957] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.096 [2024-12-08 02:29:57.626986] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.096 qpair failed and we were unable to recover it. 00:27:30.096 [2024-12-08 02:29:57.636840] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.096 [2024-12-08 02:29:57.636947] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.096 [2024-12-08 02:29:57.636972] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.096 [2024-12-08 02:29:57.636986] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.096 [2024-12-08 02:29:57.636999] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.096 [2024-12-08 02:29:57.637027] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.096 qpair failed and we were unable to recover it. 00:27:30.096 [2024-12-08 02:29:57.646894] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.096 [2024-12-08 02:29:57.646975] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.096 [2024-12-08 02:29:57.647000] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.096 [2024-12-08 02:29:57.647021] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.096 [2024-12-08 02:29:57.647035] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.096 [2024-12-08 02:29:57.647064] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.096 qpair failed and we were unable to recover it. 00:27:30.096 [2024-12-08 02:29:57.656912] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.096 [2024-12-08 02:29:57.657005] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.096 [2024-12-08 02:29:57.657031] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.096 [2024-12-08 02:29:57.657046] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.096 [2024-12-08 02:29:57.657059] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.096 [2024-12-08 02:29:57.657087] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.096 qpair failed and we were unable to recover it. 00:27:30.096 [2024-12-08 02:29:57.666939] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.096 [2024-12-08 02:29:57.667059] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.096 [2024-12-08 02:29:57.667083] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.096 [2024-12-08 02:29:57.667098] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.096 [2024-12-08 02:29:57.667111] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.096 [2024-12-08 02:29:57.667139] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.096 qpair failed and we were unable to recover it. 00:27:30.096 [2024-12-08 02:29:57.676950] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.096 [2024-12-08 02:29:57.677042] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.096 [2024-12-08 02:29:57.677068] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.096 [2024-12-08 02:29:57.677082] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.096 [2024-12-08 02:29:57.677095] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.096 [2024-12-08 02:29:57.677123] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.096 qpair failed and we were unable to recover it. 00:27:30.096 [2024-12-08 02:29:57.687020] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.096 [2024-12-08 02:29:57.687111] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.096 [2024-12-08 02:29:57.687136] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.096 [2024-12-08 02:29:57.687151] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.096 [2024-12-08 02:29:57.687164] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.096 [2024-12-08 02:29:57.687192] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.096 qpair failed and we were unable to recover it. 00:27:30.096 [2024-12-08 02:29:57.697039] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.096 [2024-12-08 02:29:57.697130] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.096 [2024-12-08 02:29:57.697155] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.096 [2024-12-08 02:29:57.697170] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.096 [2024-12-08 02:29:57.697183] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.096 [2024-12-08 02:29:57.697213] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.096 qpair failed and we were unable to recover it. 00:27:30.096 [2024-12-08 02:29:57.707135] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.096 [2024-12-08 02:29:57.707229] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.096 [2024-12-08 02:29:57.707254] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.096 [2024-12-08 02:29:57.707268] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.096 [2024-12-08 02:29:57.707281] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.096 [2024-12-08 02:29:57.707310] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.096 qpair failed and we were unable to recover it. 00:27:30.096 [2024-12-08 02:29:57.717116] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.096 [2024-12-08 02:29:57.717201] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.096 [2024-12-08 02:29:57.717227] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.096 [2024-12-08 02:29:57.717241] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.096 [2024-12-08 02:29:57.717254] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.096 [2024-12-08 02:29:57.717285] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.096 qpair failed and we were unable to recover it. 00:27:30.096 [2024-12-08 02:29:57.727158] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.096 [2024-12-08 02:29:57.727275] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.096 [2024-12-08 02:29:57.727300] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.097 [2024-12-08 02:29:57.727315] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.097 [2024-12-08 02:29:57.727328] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.097 [2024-12-08 02:29:57.727356] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.097 qpair failed and we were unable to recover it. 00:27:30.097 [2024-12-08 02:29:57.737173] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.097 [2024-12-08 02:29:57.737261] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.097 [2024-12-08 02:29:57.737291] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.097 [2024-12-08 02:29:57.737307] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.097 [2024-12-08 02:29:57.737320] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.097 [2024-12-08 02:29:57.737348] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.097 qpair failed and we were unable to recover it. 00:27:30.097 [2024-12-08 02:29:57.747189] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.097 [2024-12-08 02:29:57.747282] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.097 [2024-12-08 02:29:57.747307] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.097 [2024-12-08 02:29:57.747322] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.097 [2024-12-08 02:29:57.747335] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.097 [2024-12-08 02:29:57.747363] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.097 qpair failed and we were unable to recover it. 00:27:30.097 [2024-12-08 02:29:57.757244] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.097 [2024-12-08 02:29:57.757332] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.097 [2024-12-08 02:29:57.757357] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.097 [2024-12-08 02:29:57.757372] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.097 [2024-12-08 02:29:57.757385] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.097 [2024-12-08 02:29:57.757415] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.097 qpair failed and we were unable to recover it. 00:27:30.097 [2024-12-08 02:29:57.767223] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.097 [2024-12-08 02:29:57.767303] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.097 [2024-12-08 02:29:57.767328] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.097 [2024-12-08 02:29:57.767342] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.097 [2024-12-08 02:29:57.767355] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.097 [2024-12-08 02:29:57.767383] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.097 qpair failed and we were unable to recover it. 00:27:30.097 [2024-12-08 02:29:57.777316] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.097 [2024-12-08 02:29:57.777422] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.097 [2024-12-08 02:29:57.777447] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.097 [2024-12-08 02:29:57.777462] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.097 [2024-12-08 02:29:57.777475] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.097 [2024-12-08 02:29:57.777503] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.097 qpair failed and we were unable to recover it. 00:27:30.097 [2024-12-08 02:29:57.787318] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.097 [2024-12-08 02:29:57.787405] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.097 [2024-12-08 02:29:57.787431] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.097 [2024-12-08 02:29:57.787445] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.097 [2024-12-08 02:29:57.787458] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.097 [2024-12-08 02:29:57.787486] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.097 qpair failed and we were unable to recover it. 00:27:30.097 [2024-12-08 02:29:57.797315] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.097 [2024-12-08 02:29:57.797409] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.097 [2024-12-08 02:29:57.797434] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.097 [2024-12-08 02:29:57.797449] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.097 [2024-12-08 02:29:57.797462] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.097 [2024-12-08 02:29:57.797491] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.097 qpair failed and we were unable to recover it. 00:27:30.097 [2024-12-08 02:29:57.807441] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.097 [2024-12-08 02:29:57.807545] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.097 [2024-12-08 02:29:57.807571] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.097 [2024-12-08 02:29:57.807586] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.097 [2024-12-08 02:29:57.807599] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.097 [2024-12-08 02:29:57.807628] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.097 qpair failed and we were unable to recover it. 00:27:30.097 [2024-12-08 02:29:57.817412] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.097 [2024-12-08 02:29:57.817532] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.097 [2024-12-08 02:29:57.817563] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.097 [2024-12-08 02:29:57.817578] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.097 [2024-12-08 02:29:57.817592] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.097 [2024-12-08 02:29:57.817621] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.097 qpair failed and we were unable to recover it. 00:27:30.097 [2024-12-08 02:29:57.827494] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.097 [2024-12-08 02:29:57.827589] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.097 [2024-12-08 02:29:57.827620] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.097 [2024-12-08 02:29:57.827635] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.097 [2024-12-08 02:29:57.827649] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.097 [2024-12-08 02:29:57.827677] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.097 qpair failed and we were unable to recover it. 00:27:30.097 [2024-12-08 02:29:57.837466] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.097 [2024-12-08 02:29:57.837560] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.097 [2024-12-08 02:29:57.837586] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.097 [2024-12-08 02:29:57.837600] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.097 [2024-12-08 02:29:57.837614] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.097 [2024-12-08 02:29:57.837642] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.097 qpair failed and we were unable to recover it. 00:27:30.097 [2024-12-08 02:29:57.847493] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.097 [2024-12-08 02:29:57.847584] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.097 [2024-12-08 02:29:57.847610] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.097 [2024-12-08 02:29:57.847625] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.097 [2024-12-08 02:29:57.847638] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.097 [2024-12-08 02:29:57.847666] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.097 qpair failed and we were unable to recover it. 00:27:30.097 [2024-12-08 02:29:57.857573] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.097 [2024-12-08 02:29:57.857715] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.097 [2024-12-08 02:29:57.857741] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.097 [2024-12-08 02:29:57.857755] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.097 [2024-12-08 02:29:57.857768] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.098 [2024-12-08 02:29:57.857796] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.098 qpair failed and we were unable to recover it. 00:27:30.098 [2024-12-08 02:29:57.867566] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.098 [2024-12-08 02:29:57.867671] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.098 [2024-12-08 02:29:57.867701] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.098 [2024-12-08 02:29:57.867717] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.098 [2024-12-08 02:29:57.867730] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.098 [2024-12-08 02:29:57.867766] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.098 qpair failed and we were unable to recover it. 00:27:30.358 [2024-12-08 02:29:57.877569] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.358 [2024-12-08 02:29:57.877669] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.358 [2024-12-08 02:29:57.877695] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.358 [2024-12-08 02:29:57.877710] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.358 [2024-12-08 02:29:57.877724] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.358 [2024-12-08 02:29:57.877753] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.358 qpair failed and we were unable to recover it. 00:27:30.358 [2024-12-08 02:29:57.887610] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.358 [2024-12-08 02:29:57.887728] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.358 [2024-12-08 02:29:57.887753] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.358 [2024-12-08 02:29:57.887768] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.358 [2024-12-08 02:29:57.887781] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.359 [2024-12-08 02:29:57.887809] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.359 qpair failed and we were unable to recover it. 00:27:30.359 [2024-12-08 02:29:57.897710] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.359 [2024-12-08 02:29:57.897813] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.359 [2024-12-08 02:29:57.897839] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.359 [2024-12-08 02:29:57.897853] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.359 [2024-12-08 02:29:57.897866] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.359 [2024-12-08 02:29:57.897894] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.359 qpair failed and we were unable to recover it. 00:27:30.359 [2024-12-08 02:29:57.907662] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.359 [2024-12-08 02:29:57.907771] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.359 [2024-12-08 02:29:57.907796] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.359 [2024-12-08 02:29:57.907810] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.359 [2024-12-08 02:29:57.907823] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.359 [2024-12-08 02:29:57.907852] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.359 qpair failed and we were unable to recover it. 00:27:30.359 [2024-12-08 02:29:57.917681] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.359 [2024-12-08 02:29:57.917766] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.359 [2024-12-08 02:29:57.917797] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.359 [2024-12-08 02:29:57.917813] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.359 [2024-12-08 02:29:57.917826] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.359 [2024-12-08 02:29:57.917854] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.359 qpair failed and we were unable to recover it. 00:27:30.359 [2024-12-08 02:29:57.927751] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.359 [2024-12-08 02:29:57.927838] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.359 [2024-12-08 02:29:57.927868] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.359 [2024-12-08 02:29:57.927886] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.359 [2024-12-08 02:29:57.927899] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.359 [2024-12-08 02:29:57.927929] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.359 qpair failed and we were unable to recover it. 00:27:30.359 [2024-12-08 02:29:57.937776] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.359 [2024-12-08 02:29:57.937866] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.359 [2024-12-08 02:29:57.937891] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.359 [2024-12-08 02:29:57.937906] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.359 [2024-12-08 02:29:57.937920] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.359 [2024-12-08 02:29:57.937948] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.359 qpair failed and we were unable to recover it. 00:27:30.359 [2024-12-08 02:29:57.947755] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.359 [2024-12-08 02:29:57.947843] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.359 [2024-12-08 02:29:57.947868] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.359 [2024-12-08 02:29:57.947883] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.359 [2024-12-08 02:29:57.947896] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.359 [2024-12-08 02:29:57.947925] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.359 qpair failed and we were unable to recover it. 00:27:30.359 [2024-12-08 02:29:57.957827] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.359 [2024-12-08 02:29:57.957939] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.359 [2024-12-08 02:29:57.957965] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.359 [2024-12-08 02:29:57.957980] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.359 [2024-12-08 02:29:57.957993] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.359 [2024-12-08 02:29:57.958031] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.359 qpair failed and we were unable to recover it. 00:27:30.359 [2024-12-08 02:29:57.967826] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.359 [2024-12-08 02:29:57.967912] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.359 [2024-12-08 02:29:57.967938] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.359 [2024-12-08 02:29:57.967953] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.359 [2024-12-08 02:29:57.967966] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.359 [2024-12-08 02:29:57.967994] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.359 qpair failed and we were unable to recover it. 00:27:30.359 [2024-12-08 02:29:57.977886] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.359 [2024-12-08 02:29:57.977974] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.359 [2024-12-08 02:29:57.978000] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.359 [2024-12-08 02:29:57.978015] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.359 [2024-12-08 02:29:57.978028] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.359 [2024-12-08 02:29:57.978056] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.359 qpair failed and we were unable to recover it. 00:27:30.359 [2024-12-08 02:29:57.987991] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.359 [2024-12-08 02:29:57.988074] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.359 [2024-12-08 02:29:57.988099] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.359 [2024-12-08 02:29:57.988113] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.359 [2024-12-08 02:29:57.988127] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.359 [2024-12-08 02:29:57.988155] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.359 qpair failed and we were unable to recover it. 00:27:30.359 [2024-12-08 02:29:57.997936] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.359 [2024-12-08 02:29:57.998022] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.359 [2024-12-08 02:29:57.998047] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.359 [2024-12-08 02:29:57.998061] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.359 [2024-12-08 02:29:57.998074] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.359 [2024-12-08 02:29:57.998102] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.359 qpair failed and we were unable to recover it. 00:27:30.359 [2024-12-08 02:29:58.007943] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.359 [2024-12-08 02:29:58.008035] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.359 [2024-12-08 02:29:58.008066] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.359 [2024-12-08 02:29:58.008081] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.359 [2024-12-08 02:29:58.008094] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.359 [2024-12-08 02:29:58.008123] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.359 qpair failed and we were unable to recover it. 00:27:30.359 [2024-12-08 02:29:58.017983] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.360 [2024-12-08 02:29:58.018073] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.360 [2024-12-08 02:29:58.018098] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.360 [2024-12-08 02:29:58.018112] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.360 [2024-12-08 02:29:58.018125] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.360 [2024-12-08 02:29:58.018153] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.360 qpair failed and we were unable to recover it. 00:27:30.360 [2024-12-08 02:29:58.028046] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.360 [2024-12-08 02:29:58.028133] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.360 [2024-12-08 02:29:58.028158] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.360 [2024-12-08 02:29:58.028172] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.360 [2024-12-08 02:29:58.028185] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.360 [2024-12-08 02:29:58.028214] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.360 qpair failed and we were unable to recover it. 00:27:30.360 [2024-12-08 02:29:58.038098] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.360 [2024-12-08 02:29:58.038213] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.360 [2024-12-08 02:29:58.038239] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.360 [2024-12-08 02:29:58.038253] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.360 [2024-12-08 02:29:58.038266] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.360 [2024-12-08 02:29:58.038294] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.360 qpair failed and we were unable to recover it. 00:27:30.360 [2024-12-08 02:29:58.048091] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.360 [2024-12-08 02:29:58.048206] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.360 [2024-12-08 02:29:58.048235] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.360 [2024-12-08 02:29:58.048252] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.360 [2024-12-08 02:29:58.048265] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.360 [2024-12-08 02:29:58.048300] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.360 qpair failed and we were unable to recover it. 00:27:30.360 [2024-12-08 02:29:58.058207] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.360 [2024-12-08 02:29:58.058299] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.360 [2024-12-08 02:29:58.058325] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.360 [2024-12-08 02:29:58.058340] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.360 [2024-12-08 02:29:58.058353] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.360 [2024-12-08 02:29:58.058381] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.360 qpair failed and we were unable to recover it. 00:27:30.360 [2024-12-08 02:29:58.068147] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.360 [2024-12-08 02:29:58.068240] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.360 [2024-12-08 02:29:58.068267] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.360 [2024-12-08 02:29:58.068283] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.360 [2024-12-08 02:29:58.068296] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.360 [2024-12-08 02:29:58.068326] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.360 qpair failed and we were unable to recover it. 00:27:30.360 [2024-12-08 02:29:58.078201] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.360 [2024-12-08 02:29:58.078287] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.360 [2024-12-08 02:29:58.078313] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.360 [2024-12-08 02:29:58.078328] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.360 [2024-12-08 02:29:58.078341] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.360 [2024-12-08 02:29:58.078369] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.360 qpair failed and we were unable to recover it. 00:27:30.360 [2024-12-08 02:29:58.088207] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.360 [2024-12-08 02:29:58.088334] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.360 [2024-12-08 02:29:58.088360] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.360 [2024-12-08 02:29:58.088374] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.360 [2024-12-08 02:29:58.088388] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.360 [2024-12-08 02:29:58.088416] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.360 qpair failed and we were unable to recover it. 00:27:30.360 [2024-12-08 02:29:58.098277] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.360 [2024-12-08 02:29:58.098388] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.360 [2024-12-08 02:29:58.098418] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.360 [2024-12-08 02:29:58.098434] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.360 [2024-12-08 02:29:58.098447] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.360 [2024-12-08 02:29:58.098476] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.360 qpair failed and we were unable to recover it. 00:27:30.360 [2024-12-08 02:29:58.108232] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.360 [2024-12-08 02:29:58.108321] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.360 [2024-12-08 02:29:58.108346] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.360 [2024-12-08 02:29:58.108361] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.360 [2024-12-08 02:29:58.108374] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.360 [2024-12-08 02:29:58.108403] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.360 qpair failed and we were unable to recover it. 00:27:30.360 [2024-12-08 02:29:58.118366] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.360 [2024-12-08 02:29:58.118452] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.360 [2024-12-08 02:29:58.118477] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.360 [2024-12-08 02:29:58.118492] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.360 [2024-12-08 02:29:58.118505] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.360 [2024-12-08 02:29:58.118533] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.360 qpair failed and we were unable to recover it. 00:27:30.360 [2024-12-08 02:29:58.128300] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.360 [2024-12-08 02:29:58.128425] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.360 [2024-12-08 02:29:58.128450] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.360 [2024-12-08 02:29:58.128464] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.360 [2024-12-08 02:29:58.128478] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.360 [2024-12-08 02:29:58.128506] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.360 qpair failed and we were unable to recover it. 00:27:30.620 [2024-12-08 02:29:58.138432] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.620 [2024-12-08 02:29:58.138568] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.620 [2024-12-08 02:29:58.138594] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.620 [2024-12-08 02:29:58.138609] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.620 [2024-12-08 02:29:58.138622] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.620 [2024-12-08 02:29:58.138657] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.620 qpair failed and we were unable to recover it. 00:27:30.620 [2024-12-08 02:29:58.148359] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.620 [2024-12-08 02:29:58.148446] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.620 [2024-12-08 02:29:58.148471] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.620 [2024-12-08 02:29:58.148486] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.620 [2024-12-08 02:29:58.148500] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.620 [2024-12-08 02:29:58.148528] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.620 qpair failed and we were unable to recover it. 00:27:30.620 [2024-12-08 02:29:58.158401] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.620 [2024-12-08 02:29:58.158492] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.620 [2024-12-08 02:29:58.158518] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.620 [2024-12-08 02:29:58.158533] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.620 [2024-12-08 02:29:58.158556] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.620 [2024-12-08 02:29:58.158585] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.620 qpair failed and we were unable to recover it. 00:27:30.620 [2024-12-08 02:29:58.168441] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.620 [2024-12-08 02:29:58.168525] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.620 [2024-12-08 02:29:58.168558] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.620 [2024-12-08 02:29:58.168573] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.620 [2024-12-08 02:29:58.168586] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.620 [2024-12-08 02:29:58.168615] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.620 qpair failed and we were unable to recover it. 00:27:30.620 [2024-12-08 02:29:58.178473] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.620 [2024-12-08 02:29:58.178570] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.620 [2024-12-08 02:29:58.178596] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.620 [2024-12-08 02:29:58.178610] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.620 [2024-12-08 02:29:58.178624] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.620 [2024-12-08 02:29:58.178653] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.620 qpair failed and we were unable to recover it. 00:27:30.620 [2024-12-08 02:29:58.188487] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.620 [2024-12-08 02:29:58.188582] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.620 [2024-12-08 02:29:58.188612] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.620 [2024-12-08 02:29:58.188627] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.620 [2024-12-08 02:29:58.188640] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.620 [2024-12-08 02:29:58.188671] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.620 qpair failed and we were unable to recover it. 00:27:30.620 [2024-12-08 02:29:58.198553] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.620 [2024-12-08 02:29:58.198663] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.620 [2024-12-08 02:29:58.198692] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.620 [2024-12-08 02:29:58.198708] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.620 [2024-12-08 02:29:58.198721] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.620 [2024-12-08 02:29:58.198751] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.620 qpair failed and we were unable to recover it. 00:27:30.620 [2024-12-08 02:29:58.208555] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.620 [2024-12-08 02:29:58.208639] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.620 [2024-12-08 02:29:58.208665] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.620 [2024-12-08 02:29:58.208680] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.620 [2024-12-08 02:29:58.208693] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.620 [2024-12-08 02:29:58.208721] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.620 qpair failed and we were unable to recover it. 00:27:30.620 [2024-12-08 02:29:58.218596] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.620 [2024-12-08 02:29:58.218688] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.620 [2024-12-08 02:29:58.218713] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.620 [2024-12-08 02:29:58.218727] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.620 [2024-12-08 02:29:58.218741] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.620 [2024-12-08 02:29:58.218771] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.620 qpair failed and we were unable to recover it. 00:27:30.620 [2024-12-08 02:29:58.228621] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.620 [2024-12-08 02:29:58.228708] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.620 [2024-12-08 02:29:58.228734] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.620 [2024-12-08 02:29:58.228748] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.620 [2024-12-08 02:29:58.228766] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.620 [2024-12-08 02:29:58.228797] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.620 qpair failed and we were unable to recover it. 00:27:30.620 [2024-12-08 02:29:58.238638] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.620 [2024-12-08 02:29:58.238719] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.620 [2024-12-08 02:29:58.238744] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.620 [2024-12-08 02:29:58.238759] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.620 [2024-12-08 02:29:58.238772] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.620 [2024-12-08 02:29:58.238800] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.620 qpair failed and we were unable to recover it. 00:27:30.620 [2024-12-08 02:29:58.248637] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.620 [2024-12-08 02:29:58.248721] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.621 [2024-12-08 02:29:58.248746] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.621 [2024-12-08 02:29:58.248761] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.621 [2024-12-08 02:29:58.248774] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.621 [2024-12-08 02:29:58.248802] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.621 qpair failed and we were unable to recover it. 00:27:30.621 [2024-12-08 02:29:58.258755] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.621 [2024-12-08 02:29:58.258852] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.621 [2024-12-08 02:29:58.258877] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.621 [2024-12-08 02:29:58.258891] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.621 [2024-12-08 02:29:58.258904] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.621 [2024-12-08 02:29:58.258932] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.621 qpair failed and we were unable to recover it. 00:27:30.621 [2024-12-08 02:29:58.268836] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.621 [2024-12-08 02:29:58.268963] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.621 [2024-12-08 02:29:58.268988] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.621 [2024-12-08 02:29:58.269003] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.621 [2024-12-08 02:29:58.269016] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.621 [2024-12-08 02:29:58.269044] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.621 qpair failed and we were unable to recover it. 00:27:30.621 [2024-12-08 02:29:58.278775] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.621 [2024-12-08 02:29:58.278862] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.621 [2024-12-08 02:29:58.278888] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.621 [2024-12-08 02:29:58.278902] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.621 [2024-12-08 02:29:58.278916] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.621 [2024-12-08 02:29:58.278944] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.621 qpair failed and we were unable to recover it. 00:27:30.621 [2024-12-08 02:29:58.288762] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.621 [2024-12-08 02:29:58.288858] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.621 [2024-12-08 02:29:58.288883] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.621 [2024-12-08 02:29:58.288898] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.621 [2024-12-08 02:29:58.288911] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.621 [2024-12-08 02:29:58.288940] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.621 qpair failed and we were unable to recover it. 00:27:30.621 [2024-12-08 02:29:58.298930] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.621 [2024-12-08 02:29:58.299053] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.621 [2024-12-08 02:29:58.299079] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.621 [2024-12-08 02:29:58.299093] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.621 [2024-12-08 02:29:58.299106] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.621 [2024-12-08 02:29:58.299134] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.621 qpair failed and we were unable to recover it. 00:27:30.621 [2024-12-08 02:29:58.308893] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.621 [2024-12-08 02:29:58.309035] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.621 [2024-12-08 02:29:58.309060] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.621 [2024-12-08 02:29:58.309074] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.621 [2024-12-08 02:29:58.309087] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.621 [2024-12-08 02:29:58.309115] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.621 qpair failed and we were unable to recover it. 00:27:30.621 [2024-12-08 02:29:58.318858] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.621 [2024-12-08 02:29:58.318947] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.621 [2024-12-08 02:29:58.318977] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.621 [2024-12-08 02:29:58.318992] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.621 [2024-12-08 02:29:58.319010] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.621 [2024-12-08 02:29:58.319038] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.621 qpair failed and we were unable to recover it. 00:27:30.621 [2024-12-08 02:29:58.328880] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.621 [2024-12-08 02:29:58.328976] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.621 [2024-12-08 02:29:58.329002] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.621 [2024-12-08 02:29:58.329017] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.621 [2024-12-08 02:29:58.329030] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.621 [2024-12-08 02:29:58.329060] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.621 qpair failed and we were unable to recover it. 00:27:30.621 [2024-12-08 02:29:58.338996] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.621 [2024-12-08 02:29:58.339114] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.621 [2024-12-08 02:29:58.339140] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.621 [2024-12-08 02:29:58.339155] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.621 [2024-12-08 02:29:58.339168] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.621 [2024-12-08 02:29:58.339195] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.621 qpair failed and we were unable to recover it. 00:27:30.621 [2024-12-08 02:29:58.349029] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.621 [2024-12-08 02:29:58.349117] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.621 [2024-12-08 02:29:58.349143] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.621 [2024-12-08 02:29:58.349158] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.621 [2024-12-08 02:29:58.349171] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.621 [2024-12-08 02:29:58.349199] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.621 qpair failed and we were unable to recover it. 00:27:30.621 [2024-12-08 02:29:58.359122] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.621 [2024-12-08 02:29:58.359262] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.621 [2024-12-08 02:29:58.359288] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.621 [2024-12-08 02:29:58.359303] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.621 [2024-12-08 02:29:58.359316] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.621 [2024-12-08 02:29:58.359343] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.621 qpair failed and we were unable to recover it. 00:27:30.621 [2024-12-08 02:29:58.369002] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.621 [2024-12-08 02:29:58.369095] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.621 [2024-12-08 02:29:58.369121] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.621 [2024-12-08 02:29:58.369135] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.621 [2024-12-08 02:29:58.369148] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.622 [2024-12-08 02:29:58.369176] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.622 qpair failed and we were unable to recover it. 00:27:30.622 [2024-12-08 02:29:58.379067] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.622 [2024-12-08 02:29:58.379163] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.622 [2024-12-08 02:29:58.379188] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.622 [2024-12-08 02:29:58.379206] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.622 [2024-12-08 02:29:58.379220] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.622 [2024-12-08 02:29:58.379248] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.622 qpair failed and we were unable to recover it. 00:27:30.622 [2024-12-08 02:29:58.389165] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.622 [2024-12-08 02:29:58.389249] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.622 [2024-12-08 02:29:58.389275] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.622 [2024-12-08 02:29:58.389299] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.622 [2024-12-08 02:29:58.389312] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.622 [2024-12-08 02:29:58.389341] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.622 qpair failed and we were unable to recover it. 00:27:30.882 [2024-12-08 02:29:58.399084] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.882 [2024-12-08 02:29:58.399169] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.882 [2024-12-08 02:29:58.399193] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.882 [2024-12-08 02:29:58.399208] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.882 [2024-12-08 02:29:58.399220] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.882 [2024-12-08 02:29:58.399248] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.882 qpair failed and we were unable to recover it. 00:27:30.882 [2024-12-08 02:29:58.409121] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.882 [2024-12-08 02:29:58.409235] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.882 [2024-12-08 02:29:58.409260] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.882 [2024-12-08 02:29:58.409275] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.882 [2024-12-08 02:29:58.409294] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.882 [2024-12-08 02:29:58.409324] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.882 qpair failed and we were unable to recover it. 00:27:30.882 [2024-12-08 02:29:58.419218] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.882 [2024-12-08 02:29:58.419339] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.882 [2024-12-08 02:29:58.419363] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.882 [2024-12-08 02:29:58.419378] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.882 [2024-12-08 02:29:58.419391] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.882 [2024-12-08 02:29:58.419419] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.882 qpair failed and we were unable to recover it. 00:27:30.882 [2024-12-08 02:29:58.429230] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.882 [2024-12-08 02:29:58.429345] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.882 [2024-12-08 02:29:58.429374] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.882 [2024-12-08 02:29:58.429391] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.882 [2024-12-08 02:29:58.429404] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.882 [2024-12-08 02:29:58.429433] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.882 qpair failed and we were unable to recover it. 00:27:30.882 [2024-12-08 02:29:58.439199] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.882 [2024-12-08 02:29:58.439289] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.882 [2024-12-08 02:29:58.439316] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.883 [2024-12-08 02:29:58.439331] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.883 [2024-12-08 02:29:58.439345] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.883 [2024-12-08 02:29:58.439374] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.883 qpair failed and we were unable to recover it. 00:27:30.883 [2024-12-08 02:29:58.449312] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.883 [2024-12-08 02:29:58.449395] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.883 [2024-12-08 02:29:58.449421] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.883 [2024-12-08 02:29:58.449435] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.883 [2024-12-08 02:29:58.449448] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.883 [2024-12-08 02:29:58.449477] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.883 qpair failed and we were unable to recover it. 00:27:30.883 [2024-12-08 02:29:58.459268] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.883 [2024-12-08 02:29:58.459361] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.883 [2024-12-08 02:29:58.459388] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.883 [2024-12-08 02:29:58.459402] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.883 [2024-12-08 02:29:58.459416] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.883 [2024-12-08 02:29:58.459444] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.883 qpair failed and we were unable to recover it. 00:27:30.883 [2024-12-08 02:29:58.469309] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.883 [2024-12-08 02:29:58.469409] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.883 [2024-12-08 02:29:58.469434] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.883 [2024-12-08 02:29:58.469448] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.883 [2024-12-08 02:29:58.469461] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.883 [2024-12-08 02:29:58.469490] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.883 qpair failed and we were unable to recover it. 00:27:30.883 [2024-12-08 02:29:58.479316] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.883 [2024-12-08 02:29:58.479399] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.883 [2024-12-08 02:29:58.479424] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.883 [2024-12-08 02:29:58.479439] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.883 [2024-12-08 02:29:58.479452] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.883 [2024-12-08 02:29:58.479481] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.883 qpair failed and we were unable to recover it. 00:27:30.883 [2024-12-08 02:29:58.489389] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.883 [2024-12-08 02:29:58.489479] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.883 [2024-12-08 02:29:58.489504] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.883 [2024-12-08 02:29:58.489519] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.883 [2024-12-08 02:29:58.489532] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.883 [2024-12-08 02:29:58.489573] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.883 qpair failed and we were unable to recover it. 00:27:30.883 [2024-12-08 02:29:58.499399] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.883 [2024-12-08 02:29:58.499490] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.883 [2024-12-08 02:29:58.499518] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.883 [2024-12-08 02:29:58.499542] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.883 [2024-12-08 02:29:58.499566] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.883 [2024-12-08 02:29:58.499598] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.883 qpair failed and we were unable to recover it. 00:27:30.883 [2024-12-08 02:29:58.509463] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.883 [2024-12-08 02:29:58.509553] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.883 [2024-12-08 02:29:58.509579] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.883 [2024-12-08 02:29:58.509594] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.883 [2024-12-08 02:29:58.509607] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.883 [2024-12-08 02:29:58.509637] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.883 qpair failed and we were unable to recover it. 00:27:30.883 [2024-12-08 02:29:58.519450] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.883 [2024-12-08 02:29:58.519573] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.883 [2024-12-08 02:29:58.519602] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.883 [2024-12-08 02:29:58.519616] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.883 [2024-12-08 02:29:58.519629] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.883 [2024-12-08 02:29:58.519664] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.883 qpair failed and we were unable to recover it. 00:27:30.883 [2024-12-08 02:29:58.529552] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.883 [2024-12-08 02:29:58.529660] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.883 [2024-12-08 02:29:58.529686] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.883 [2024-12-08 02:29:58.529700] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.883 [2024-12-08 02:29:58.529713] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.883 [2024-12-08 02:29:58.529742] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.883 qpair failed and we were unable to recover it. 00:27:30.883 [2024-12-08 02:29:58.539547] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.883 [2024-12-08 02:29:58.539641] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.883 [2024-12-08 02:29:58.539667] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.883 [2024-12-08 02:29:58.539681] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.883 [2024-12-08 02:29:58.539695] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.883 [2024-12-08 02:29:58.539723] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.883 qpair failed and we were unable to recover it. 00:27:30.883 [2024-12-08 02:29:58.549566] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.883 [2024-12-08 02:29:58.549652] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.883 [2024-12-08 02:29:58.549678] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.883 [2024-12-08 02:29:58.549692] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.883 [2024-12-08 02:29:58.549706] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.883 [2024-12-08 02:29:58.549735] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.883 qpair failed and we were unable to recover it. 00:27:30.883 [2024-12-08 02:29:58.559556] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.883 [2024-12-08 02:29:58.559647] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.883 [2024-12-08 02:29:58.559672] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.883 [2024-12-08 02:29:58.559687] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.883 [2024-12-08 02:29:58.559700] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.883 [2024-12-08 02:29:58.559731] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.883 qpair failed and we were unable to recover it. 00:27:30.883 [2024-12-08 02:29:58.569583] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.883 [2024-12-08 02:29:58.569669] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.883 [2024-12-08 02:29:58.569693] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.883 [2024-12-08 02:29:58.569708] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.883 [2024-12-08 02:29:58.569721] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.884 [2024-12-08 02:29:58.569749] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.884 qpair failed and we were unable to recover it. 00:27:30.884 [2024-12-08 02:29:58.579622] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.884 [2024-12-08 02:29:58.579715] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.884 [2024-12-08 02:29:58.579740] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.884 [2024-12-08 02:29:58.579755] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.884 [2024-12-08 02:29:58.579768] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.884 [2024-12-08 02:29:58.579796] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.884 qpair failed and we were unable to recover it. 00:27:30.884 [2024-12-08 02:29:58.589634] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.884 [2024-12-08 02:29:58.589723] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.884 [2024-12-08 02:29:58.589748] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.884 [2024-12-08 02:29:58.589768] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.884 [2024-12-08 02:29:58.589782] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.884 [2024-12-08 02:29:58.589812] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.884 qpair failed and we were unable to recover it. 00:27:30.884 [2024-12-08 02:29:58.599717] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.884 [2024-12-08 02:29:58.599805] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.884 [2024-12-08 02:29:58.599831] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.884 [2024-12-08 02:29:58.599846] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.884 [2024-12-08 02:29:58.599859] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.884 [2024-12-08 02:29:58.599887] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.884 qpair failed and we were unable to recover it. 00:27:30.884 [2024-12-08 02:29:58.609796] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.884 [2024-12-08 02:29:58.609927] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.884 [2024-12-08 02:29:58.609953] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.884 [2024-12-08 02:29:58.609967] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.884 [2024-12-08 02:29:58.609981] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.884 [2024-12-08 02:29:58.610009] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.884 qpair failed and we were unable to recover it. 00:27:30.884 [2024-12-08 02:29:58.619771] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.884 [2024-12-08 02:29:58.619884] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.884 [2024-12-08 02:29:58.619910] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.884 [2024-12-08 02:29:58.619924] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.884 [2024-12-08 02:29:58.619938] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.884 [2024-12-08 02:29:58.619966] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.884 qpair failed and we were unable to recover it. 00:27:30.884 [2024-12-08 02:29:58.629767] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.884 [2024-12-08 02:29:58.629896] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.884 [2024-12-08 02:29:58.629920] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.884 [2024-12-08 02:29:58.629935] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.884 [2024-12-08 02:29:58.629948] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.884 [2024-12-08 02:29:58.629976] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.884 qpair failed and we were unable to recover it. 00:27:30.884 [2024-12-08 02:29:58.639810] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.884 [2024-12-08 02:29:58.639893] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.884 [2024-12-08 02:29:58.639918] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.884 [2024-12-08 02:29:58.639933] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.884 [2024-12-08 02:29:58.639946] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.884 [2024-12-08 02:29:58.639975] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.884 qpair failed and we were unable to recover it. 00:27:30.884 [2024-12-08 02:29:58.649841] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.884 [2024-12-08 02:29:58.649924] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.884 [2024-12-08 02:29:58.649949] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.884 [2024-12-08 02:29:58.649966] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.884 [2024-12-08 02:29:58.649979] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.884 [2024-12-08 02:29:58.650007] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.884 qpair failed and we were unable to recover it. 00:27:30.884 [2024-12-08 02:29:58.659881] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:30.884 [2024-12-08 02:29:58.659970] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:30.884 [2024-12-08 02:29:58.659996] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:30.884 [2024-12-08 02:29:58.660011] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:30.884 [2024-12-08 02:29:58.660024] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:30.884 [2024-12-08 02:29:58.660052] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:30.884 qpair failed and we were unable to recover it. 00:27:31.143 [2024-12-08 02:29:58.669893] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.143 [2024-12-08 02:29:58.670008] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.143 [2024-12-08 02:29:58.670033] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.143 [2024-12-08 02:29:58.670048] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.143 [2024-12-08 02:29:58.670061] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.143 [2024-12-08 02:29:58.670090] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.143 qpair failed and we were unable to recover it. 00:27:31.143 [2024-12-08 02:29:58.679925] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.143 [2024-12-08 02:29:58.680006] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.143 [2024-12-08 02:29:58.680032] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.143 [2024-12-08 02:29:58.680053] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.143 [2024-12-08 02:29:58.680067] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.143 [2024-12-08 02:29:58.680096] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.143 qpair failed and we were unable to recover it. 00:27:31.143 [2024-12-08 02:29:58.689995] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.143 [2024-12-08 02:29:58.690124] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.143 [2024-12-08 02:29:58.690149] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.143 [2024-12-08 02:29:58.690164] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.143 [2024-12-08 02:29:58.690177] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.143 [2024-12-08 02:29:58.690205] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.143 qpair failed and we were unable to recover it. 00:27:31.143 [2024-12-08 02:29:58.700012] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.143 [2024-12-08 02:29:58.700106] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.143 [2024-12-08 02:29:58.700132] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.143 [2024-12-08 02:29:58.700146] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.143 [2024-12-08 02:29:58.700159] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.143 [2024-12-08 02:29:58.700187] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.143 qpair failed and we were unable to recover it. 00:27:31.143 [2024-12-08 02:29:58.709987] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.143 [2024-12-08 02:29:58.710088] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.143 [2024-12-08 02:29:58.710113] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.143 [2024-12-08 02:29:58.710127] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.143 [2024-12-08 02:29:58.710141] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.143 [2024-12-08 02:29:58.710169] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.143 qpair failed and we were unable to recover it. 00:27:31.143 [2024-12-08 02:29:58.720015] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.143 [2024-12-08 02:29:58.720105] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.143 [2024-12-08 02:29:58.720131] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.143 [2024-12-08 02:29:58.720145] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.143 [2024-12-08 02:29:58.720158] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.143 [2024-12-08 02:29:58.720188] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.143 qpair failed and we were unable to recover it. 00:27:31.143 [2024-12-08 02:29:58.730092] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.143 [2024-12-08 02:29:58.730174] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.143 [2024-12-08 02:29:58.730199] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.143 [2024-12-08 02:29:58.730214] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.143 [2024-12-08 02:29:58.730227] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.143 [2024-12-08 02:29:58.730255] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.143 qpair failed and we were unable to recover it. 00:27:31.143 [2024-12-08 02:29:58.740123] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.143 [2024-12-08 02:29:58.740218] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.143 [2024-12-08 02:29:58.740244] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.143 [2024-12-08 02:29:58.740258] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.143 [2024-12-08 02:29:58.740271] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.143 [2024-12-08 02:29:58.740300] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.143 qpair failed and we were unable to recover it. 00:27:31.143 [2024-12-08 02:29:58.750121] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.143 [2024-12-08 02:29:58.750209] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.143 [2024-12-08 02:29:58.750234] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.143 [2024-12-08 02:29:58.750248] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.143 [2024-12-08 02:29:58.750261] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.143 [2024-12-08 02:29:58.750290] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.143 qpair failed and we were unable to recover it. 00:27:31.143 [2024-12-08 02:29:58.760192] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.143 [2024-12-08 02:29:58.760302] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.143 [2024-12-08 02:29:58.760328] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.143 [2024-12-08 02:29:58.760342] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.144 [2024-12-08 02:29:58.760355] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.144 [2024-12-08 02:29:58.760383] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.144 qpair failed and we were unable to recover it. 00:27:31.144 [2024-12-08 02:29:58.770218] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.144 [2024-12-08 02:29:58.770324] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.144 [2024-12-08 02:29:58.770348] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.144 [2024-12-08 02:29:58.770372] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.144 [2024-12-08 02:29:58.770386] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.144 [2024-12-08 02:29:58.770414] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.144 qpair failed and we were unable to recover it. 00:27:31.144 [2024-12-08 02:29:58.780227] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.144 [2024-12-08 02:29:58.780317] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.144 [2024-12-08 02:29:58.780342] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.144 [2024-12-08 02:29:58.780356] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.144 [2024-12-08 02:29:58.780369] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.144 [2024-12-08 02:29:58.780398] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.144 qpair failed and we were unable to recover it. 00:27:31.144 [2024-12-08 02:29:58.790307] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.144 [2024-12-08 02:29:58.790392] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.144 [2024-12-08 02:29:58.790416] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.144 [2024-12-08 02:29:58.790430] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.144 [2024-12-08 02:29:58.790443] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.144 [2024-12-08 02:29:58.790472] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.144 qpair failed and we were unable to recover it. 00:27:31.144 [2024-12-08 02:29:58.800280] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.144 [2024-12-08 02:29:58.800365] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.144 [2024-12-08 02:29:58.800390] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.144 [2024-12-08 02:29:58.800405] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.144 [2024-12-08 02:29:58.800418] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.144 [2024-12-08 02:29:58.800446] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.144 qpair failed and we were unable to recover it. 00:27:31.144 [2024-12-08 02:29:58.810287] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.144 [2024-12-08 02:29:58.810373] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.144 [2024-12-08 02:29:58.810397] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.144 [2024-12-08 02:29:58.810412] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.144 [2024-12-08 02:29:58.810425] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.144 [2024-12-08 02:29:58.810453] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.144 qpair failed and we were unable to recover it. 00:27:31.144 [2024-12-08 02:29:58.820397] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.144 [2024-12-08 02:29:58.820496] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.144 [2024-12-08 02:29:58.820521] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.144 [2024-12-08 02:29:58.820542] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.144 [2024-12-08 02:29:58.820559] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.144 [2024-12-08 02:29:58.820590] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.144 qpair failed and we were unable to recover it. 00:27:31.144 [2024-12-08 02:29:58.830346] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.144 [2024-12-08 02:29:58.830433] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.144 [2024-12-08 02:29:58.830458] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.144 [2024-12-08 02:29:58.830473] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.144 [2024-12-08 02:29:58.830486] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.144 [2024-12-08 02:29:58.830514] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.144 qpair failed and we were unable to recover it. 00:27:31.144 [2024-12-08 02:29:58.840385] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.144 [2024-12-08 02:29:58.840476] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.144 [2024-12-08 02:29:58.840505] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.144 [2024-12-08 02:29:58.840524] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.144 [2024-12-08 02:29:58.840547] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.144 [2024-12-08 02:29:58.840580] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.144 qpair failed and we were unable to recover it. 00:27:31.144 [2024-12-08 02:29:58.850403] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.144 [2024-12-08 02:29:58.850484] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.144 [2024-12-08 02:29:58.850510] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.144 [2024-12-08 02:29:58.850524] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.144 [2024-12-08 02:29:58.850544] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.144 [2024-12-08 02:29:58.850575] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.144 qpair failed and we were unable to recover it. 00:27:31.144 [2024-12-08 02:29:58.860442] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.144 [2024-12-08 02:29:58.860534] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.144 [2024-12-08 02:29:58.860572] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.144 [2024-12-08 02:29:58.860593] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.144 [2024-12-08 02:29:58.860607] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.144 [2024-12-08 02:29:58.860636] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.144 qpair failed and we were unable to recover it. 00:27:31.144 [2024-12-08 02:29:58.870458] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.144 [2024-12-08 02:29:58.870554] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.144 [2024-12-08 02:29:58.870580] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.144 [2024-12-08 02:29:58.870594] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.144 [2024-12-08 02:29:58.870608] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.144 [2024-12-08 02:29:58.870636] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.144 qpair failed and we were unable to recover it. 00:27:31.144 [2024-12-08 02:29:58.880503] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.144 [2024-12-08 02:29:58.880607] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.144 [2024-12-08 02:29:58.880636] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.144 [2024-12-08 02:29:58.880652] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.144 [2024-12-08 02:29:58.880666] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.144 [2024-12-08 02:29:58.880695] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.144 qpair failed and we were unable to recover it. 00:27:31.144 [2024-12-08 02:29:58.890519] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.144 [2024-12-08 02:29:58.890609] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.144 [2024-12-08 02:29:58.890635] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.144 [2024-12-08 02:29:58.890649] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.144 [2024-12-08 02:29:58.890662] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.144 [2024-12-08 02:29:58.890692] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.145 qpair failed and we were unable to recover it. 00:27:31.145 [2024-12-08 02:29:58.900613] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.145 [2024-12-08 02:29:58.900744] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.145 [2024-12-08 02:29:58.900770] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.145 [2024-12-08 02:29:58.900784] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.145 [2024-12-08 02:29:58.900797] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.145 [2024-12-08 02:29:58.900826] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.145 qpair failed and we were unable to recover it. 00:27:31.145 [2024-12-08 02:29:58.910594] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.145 [2024-12-08 02:29:58.910686] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.145 [2024-12-08 02:29:58.910712] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.145 [2024-12-08 02:29:58.910726] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.145 [2024-12-08 02:29:58.910739] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.145 [2024-12-08 02:29:58.910767] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.145 qpair failed and we were unable to recover it. 00:27:31.145 [2024-12-08 02:29:58.920672] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.145 [2024-12-08 02:29:58.920761] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.145 [2024-12-08 02:29:58.920787] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.145 [2024-12-08 02:29:58.920801] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.145 [2024-12-08 02:29:58.920814] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.145 [2024-12-08 02:29:58.920842] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.145 qpair failed and we were unable to recover it. 00:27:31.403 [2024-12-08 02:29:58.930637] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.403 [2024-12-08 02:29:58.930781] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.403 [2024-12-08 02:29:58.930806] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.403 [2024-12-08 02:29:58.930821] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.403 [2024-12-08 02:29:58.930834] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.403 [2024-12-08 02:29:58.930863] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.403 qpair failed and we were unable to recover it. 00:27:31.404 [2024-12-08 02:29:58.940684] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.404 [2024-12-08 02:29:58.940806] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.404 [2024-12-08 02:29:58.940831] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.404 [2024-12-08 02:29:58.940846] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.404 [2024-12-08 02:29:58.940859] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.404 [2024-12-08 02:29:58.940887] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.404 qpair failed and we were unable to recover it. 00:27:31.404 [2024-12-08 02:29:58.950688] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.404 [2024-12-08 02:29:58.950777] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.404 [2024-12-08 02:29:58.950807] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.404 [2024-12-08 02:29:58.950823] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.404 [2024-12-08 02:29:58.950836] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.404 [2024-12-08 02:29:58.950864] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.404 qpair failed and we were unable to recover it. 00:27:31.404 [2024-12-08 02:29:58.960721] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.404 [2024-12-08 02:29:58.960810] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.404 [2024-12-08 02:29:58.960836] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.404 [2024-12-08 02:29:58.960850] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.404 [2024-12-08 02:29:58.960864] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.404 [2024-12-08 02:29:58.960893] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.404 qpair failed and we were unable to recover it. 00:27:31.404 [2024-12-08 02:29:58.970762] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.404 [2024-12-08 02:29:58.970844] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.404 [2024-12-08 02:29:58.970870] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.404 [2024-12-08 02:29:58.970884] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.404 [2024-12-08 02:29:58.970898] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.404 [2024-12-08 02:29:58.970927] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.404 qpair failed and we were unable to recover it. 00:27:31.404 [2024-12-08 02:29:58.980799] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.404 [2024-12-08 02:29:58.980890] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.404 [2024-12-08 02:29:58.980916] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.404 [2024-12-08 02:29:58.980931] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.404 [2024-12-08 02:29:58.980944] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.404 [2024-12-08 02:29:58.980972] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.404 qpair failed and we were unable to recover it. 00:27:31.404 [2024-12-08 02:29:58.990805] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.404 [2024-12-08 02:29:58.990898] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.404 [2024-12-08 02:29:58.990923] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.404 [2024-12-08 02:29:58.990937] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.404 [2024-12-08 02:29:58.990950] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.404 [2024-12-08 02:29:58.990979] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.404 qpair failed and we were unable to recover it. 00:27:31.404 [2024-12-08 02:29:59.000826] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.404 [2024-12-08 02:29:59.000912] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.404 [2024-12-08 02:29:59.000937] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.404 [2024-12-08 02:29:59.000951] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.404 [2024-12-08 02:29:59.000964] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.404 [2024-12-08 02:29:59.000992] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.404 qpair failed and we were unable to recover it. 00:27:31.404 [2024-12-08 02:29:59.010925] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.404 [2024-12-08 02:29:59.011024] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.404 [2024-12-08 02:29:59.011049] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.404 [2024-12-08 02:29:59.011063] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.404 [2024-12-08 02:29:59.011077] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.404 [2024-12-08 02:29:59.011105] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.404 qpair failed and we were unable to recover it. 00:27:31.404 [2024-12-08 02:29:59.020882] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.404 [2024-12-08 02:29:59.020968] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.404 [2024-12-08 02:29:59.020993] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.404 [2024-12-08 02:29:59.021008] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.404 [2024-12-08 02:29:59.021021] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.404 [2024-12-08 02:29:59.021050] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.404 qpair failed and we were unable to recover it. 00:27:31.404 [2024-12-08 02:29:59.030911] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.404 [2024-12-08 02:29:59.031012] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.404 [2024-12-08 02:29:59.031038] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.404 [2024-12-08 02:29:59.031053] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.404 [2024-12-08 02:29:59.031066] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.404 [2024-12-08 02:29:59.031095] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.404 qpair failed and we were unable to recover it. 00:27:31.404 [2024-12-08 02:29:59.040988] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.404 [2024-12-08 02:29:59.041086] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.404 [2024-12-08 02:29:59.041116] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.404 [2024-12-08 02:29:59.041132] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.404 [2024-12-08 02:29:59.041145] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.404 [2024-12-08 02:29:59.041173] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.404 qpair failed and we were unable to recover it. 00:27:31.404 [2024-12-08 02:29:59.051056] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.404 [2024-12-08 02:29:59.051154] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.404 [2024-12-08 02:29:59.051180] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.404 [2024-12-08 02:29:59.051194] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.404 [2024-12-08 02:29:59.051207] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.404 [2024-12-08 02:29:59.051236] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.404 qpair failed and we were unable to recover it. 00:27:31.404 [2024-12-08 02:29:59.061014] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.404 [2024-12-08 02:29:59.061103] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.404 [2024-12-08 02:29:59.061128] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.404 [2024-12-08 02:29:59.061142] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.404 [2024-12-08 02:29:59.061155] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.404 [2024-12-08 02:29:59.061183] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.404 qpair failed and we were unable to recover it. 00:27:31.405 [2024-12-08 02:29:59.071086] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.405 [2024-12-08 02:29:59.071193] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.405 [2024-12-08 02:29:59.071219] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.405 [2024-12-08 02:29:59.071234] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.405 [2024-12-08 02:29:59.071247] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.405 [2024-12-08 02:29:59.071275] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.405 qpair failed and we were unable to recover it. 00:27:31.405 [2024-12-08 02:29:59.081151] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.405 [2024-12-08 02:29:59.081243] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.405 [2024-12-08 02:29:59.081268] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.405 [2024-12-08 02:29:59.081283] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.405 [2024-12-08 02:29:59.081296] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.405 [2024-12-08 02:29:59.081331] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.405 qpair failed and we were unable to recover it. 00:27:31.405 [2024-12-08 02:29:59.091081] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.405 [2024-12-08 02:29:59.091167] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.405 [2024-12-08 02:29:59.091193] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.405 [2024-12-08 02:29:59.091207] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.405 [2024-12-08 02:29:59.091220] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.405 [2024-12-08 02:29:59.091248] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.405 qpair failed and we were unable to recover it. 00:27:31.405 [2024-12-08 02:29:59.101131] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.405 [2024-12-08 02:29:59.101227] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.405 [2024-12-08 02:29:59.101256] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.405 [2024-12-08 02:29:59.101272] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.405 [2024-12-08 02:29:59.101286] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.405 [2024-12-08 02:29:59.101315] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.405 qpair failed and we were unable to recover it. 00:27:31.405 [2024-12-08 02:29:59.111162] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.405 [2024-12-08 02:29:59.111244] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.405 [2024-12-08 02:29:59.111270] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.405 [2024-12-08 02:29:59.111284] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.405 [2024-12-08 02:29:59.111298] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.405 [2024-12-08 02:29:59.111326] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.405 qpair failed and we were unable to recover it. 00:27:31.405 [2024-12-08 02:29:59.121169] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.405 [2024-12-08 02:29:59.121254] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.405 [2024-12-08 02:29:59.121279] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.405 [2024-12-08 02:29:59.121294] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.405 [2024-12-08 02:29:59.121307] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.405 [2024-12-08 02:29:59.121335] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.405 qpair failed and we were unable to recover it. 00:27:31.405 [2024-12-08 02:29:59.131212] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.405 [2024-12-08 02:29:59.131290] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.405 [2024-12-08 02:29:59.131321] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.405 [2024-12-08 02:29:59.131336] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.405 [2024-12-08 02:29:59.131350] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.405 [2024-12-08 02:29:59.131378] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.405 qpair failed and we were unable to recover it. 00:27:31.405 [2024-12-08 02:29:59.141290] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.405 [2024-12-08 02:29:59.141381] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.405 [2024-12-08 02:29:59.141406] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.405 [2024-12-08 02:29:59.141420] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.405 [2024-12-08 02:29:59.141433] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.405 [2024-12-08 02:29:59.141461] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.405 qpair failed and we were unable to recover it. 00:27:31.405 [2024-12-08 02:29:59.151272] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.405 [2024-12-08 02:29:59.151362] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.405 [2024-12-08 02:29:59.151388] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.405 [2024-12-08 02:29:59.151403] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.405 [2024-12-08 02:29:59.151416] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.405 [2024-12-08 02:29:59.151444] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.405 qpair failed and we were unable to recover it. 00:27:31.405 [2024-12-08 02:29:59.161272] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.405 [2024-12-08 02:29:59.161359] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.405 [2024-12-08 02:29:59.161384] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.405 [2024-12-08 02:29:59.161398] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.405 [2024-12-08 02:29:59.161412] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.405 [2024-12-08 02:29:59.161441] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.405 qpair failed and we were unable to recover it. 00:27:31.405 [2024-12-08 02:29:59.171296] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.405 [2024-12-08 02:29:59.171380] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.405 [2024-12-08 02:29:59.171405] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.405 [2024-12-08 02:29:59.171419] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.405 [2024-12-08 02:29:59.171432] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.405 [2024-12-08 02:29:59.171467] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.405 qpair failed and we were unable to recover it. 00:27:31.405 [2024-12-08 02:29:59.181331] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.405 [2024-12-08 02:29:59.181422] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.405 [2024-12-08 02:29:59.181447] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.405 [2024-12-08 02:29:59.181461] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.405 [2024-12-08 02:29:59.181475] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.405 [2024-12-08 02:29:59.181503] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.405 qpair failed and we were unable to recover it. 00:27:31.664 [2024-12-08 02:29:59.191380] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.664 [2024-12-08 02:29:59.191485] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.664 [2024-12-08 02:29:59.191511] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.664 [2024-12-08 02:29:59.191525] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.664 [2024-12-08 02:29:59.191545] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.664 [2024-12-08 02:29:59.191576] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.664 qpair failed and we were unable to recover it. 00:27:31.664 [2024-12-08 02:29:59.201383] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.664 [2024-12-08 02:29:59.201469] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.664 [2024-12-08 02:29:59.201494] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.664 [2024-12-08 02:29:59.201508] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.664 [2024-12-08 02:29:59.201520] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.664 [2024-12-08 02:29:59.201558] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.664 qpair failed and we were unable to recover it. 00:27:31.664 [2024-12-08 02:29:59.211545] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.664 [2024-12-08 02:29:59.211668] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.664 [2024-12-08 02:29:59.211693] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.664 [2024-12-08 02:29:59.211707] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.664 [2024-12-08 02:29:59.211721] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.664 [2024-12-08 02:29:59.211749] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.664 qpair failed and we were unable to recover it. 00:27:31.664 [2024-12-08 02:29:59.221575] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.664 [2024-12-08 02:29:59.221666] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.664 [2024-12-08 02:29:59.221696] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.664 [2024-12-08 02:29:59.221711] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.664 [2024-12-08 02:29:59.221724] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.664 [2024-12-08 02:29:59.221753] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.664 qpair failed and we were unable to recover it. 00:27:31.664 [2024-12-08 02:29:59.231479] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.664 [2024-12-08 02:29:59.231573] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.664 [2024-12-08 02:29:59.231599] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.664 [2024-12-08 02:29:59.231614] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.664 [2024-12-08 02:29:59.231627] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.664 [2024-12-08 02:29:59.231656] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.665 qpair failed and we were unable to recover it. 00:27:31.665 [2024-12-08 02:29:59.241504] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.665 [2024-12-08 02:29:59.241595] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.665 [2024-12-08 02:29:59.241620] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.665 [2024-12-08 02:29:59.241634] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.665 [2024-12-08 02:29:59.241647] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.665 [2024-12-08 02:29:59.241676] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.665 qpair failed and we were unable to recover it. 00:27:31.665 [2024-12-08 02:29:59.251615] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.665 [2024-12-08 02:29:59.251732] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.665 [2024-12-08 02:29:59.251758] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.665 [2024-12-08 02:29:59.251773] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.665 [2024-12-08 02:29:59.251786] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.665 [2024-12-08 02:29:59.251814] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.665 qpair failed and we were unable to recover it. 00:27:31.665 [2024-12-08 02:29:59.261595] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.665 [2024-12-08 02:29:59.261690] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.665 [2024-12-08 02:29:59.261716] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.665 [2024-12-08 02:29:59.261730] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.665 [2024-12-08 02:29:59.261744] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.665 [2024-12-08 02:29:59.261778] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.665 qpair failed and we were unable to recover it. 00:27:31.665 [2024-12-08 02:29:59.271727] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.665 [2024-12-08 02:29:59.271839] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.665 [2024-12-08 02:29:59.271864] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.665 [2024-12-08 02:29:59.271878] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.665 [2024-12-08 02:29:59.271892] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.665 [2024-12-08 02:29:59.271920] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.665 qpair failed and we were unable to recover it. 00:27:31.665 [2024-12-08 02:29:59.281631] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.665 [2024-12-08 02:29:59.281717] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.665 [2024-12-08 02:29:59.281742] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.665 [2024-12-08 02:29:59.281756] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.665 [2024-12-08 02:29:59.281770] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.665 [2024-12-08 02:29:59.281799] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.665 qpair failed and we were unable to recover it. 00:27:31.665 [2024-12-08 02:29:59.291688] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.665 [2024-12-08 02:29:59.291776] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.665 [2024-12-08 02:29:59.291802] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.665 [2024-12-08 02:29:59.291816] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.665 [2024-12-08 02:29:59.291830] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.665 [2024-12-08 02:29:59.291858] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.665 qpair failed and we were unable to recover it. 00:27:31.665 [2024-12-08 02:29:59.301716] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.665 [2024-12-08 02:29:59.301840] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.665 [2024-12-08 02:29:59.301865] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.665 [2024-12-08 02:29:59.301880] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.665 [2024-12-08 02:29:59.301893] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.665 [2024-12-08 02:29:59.301922] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.665 qpair failed and we were unable to recover it. 00:27:31.665 [2024-12-08 02:29:59.311714] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.665 [2024-12-08 02:29:59.311831] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.665 [2024-12-08 02:29:59.311861] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.665 [2024-12-08 02:29:59.311876] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.665 [2024-12-08 02:29:59.311890] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.665 [2024-12-08 02:29:59.311918] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.665 qpair failed and we were unable to recover it. 00:27:31.665 [2024-12-08 02:29:59.321792] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.665 [2024-12-08 02:29:59.321901] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.665 [2024-12-08 02:29:59.321926] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.665 [2024-12-08 02:29:59.321941] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.665 [2024-12-08 02:29:59.321953] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.665 [2024-12-08 02:29:59.321981] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.665 qpair failed and we were unable to recover it. 00:27:31.665 [2024-12-08 02:29:59.331788] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.665 [2024-12-08 02:29:59.331876] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.665 [2024-12-08 02:29:59.331901] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.665 [2024-12-08 02:29:59.331916] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.665 [2024-12-08 02:29:59.331929] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.665 [2024-12-08 02:29:59.331957] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.665 qpair failed and we were unable to recover it. 00:27:31.665 [2024-12-08 02:29:59.341867] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.665 [2024-12-08 02:29:59.341960] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.665 [2024-12-08 02:29:59.341985] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.665 [2024-12-08 02:29:59.341999] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.665 [2024-12-08 02:29:59.342012] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.665 [2024-12-08 02:29:59.342041] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.665 qpair failed and we were unable to recover it. 00:27:31.665 [2024-12-08 02:29:59.351865] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.665 [2024-12-08 02:29:59.351974] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.665 [2024-12-08 02:29:59.351999] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.665 [2024-12-08 02:29:59.352013] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.665 [2024-12-08 02:29:59.352027] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.665 [2024-12-08 02:29:59.352061] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.665 qpair failed and we were unable to recover it. 00:27:31.665 [2024-12-08 02:29:59.361881] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.665 [2024-12-08 02:29:59.361981] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.665 [2024-12-08 02:29:59.362007] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.665 [2024-12-08 02:29:59.362021] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.665 [2024-12-08 02:29:59.362035] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.666 [2024-12-08 02:29:59.362063] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.666 qpair failed and we were unable to recover it. 00:27:31.666 [2024-12-08 02:29:59.371894] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.666 [2024-12-08 02:29:59.371998] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.666 [2024-12-08 02:29:59.372023] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.666 [2024-12-08 02:29:59.372038] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.666 [2024-12-08 02:29:59.372051] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.666 [2024-12-08 02:29:59.372079] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.666 qpair failed and we were unable to recover it. 00:27:31.666 [2024-12-08 02:29:59.381998] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.666 [2024-12-08 02:29:59.382088] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.666 [2024-12-08 02:29:59.382113] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.666 [2024-12-08 02:29:59.382128] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.666 [2024-12-08 02:29:59.382141] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.666 [2024-12-08 02:29:59.382169] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.666 qpair failed and we were unable to recover it. 00:27:31.666 [2024-12-08 02:29:59.391940] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.666 [2024-12-08 02:29:59.392029] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.666 [2024-12-08 02:29:59.392055] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.666 [2024-12-08 02:29:59.392069] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.666 [2024-12-08 02:29:59.392082] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.666 [2024-12-08 02:29:59.392111] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.666 qpair failed and we were unable to recover it. 00:27:31.666 [2024-12-08 02:29:59.401992] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.666 [2024-12-08 02:29:59.402074] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.666 [2024-12-08 02:29:59.402104] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.666 [2024-12-08 02:29:59.402119] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.666 [2024-12-08 02:29:59.402131] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.666 [2024-12-08 02:29:59.402159] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.666 qpair failed and we were unable to recover it. 00:27:31.666 [2024-12-08 02:29:59.411995] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.666 [2024-12-08 02:29:59.412077] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.666 [2024-12-08 02:29:59.412103] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.666 [2024-12-08 02:29:59.412118] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.666 [2024-12-08 02:29:59.412131] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.666 [2024-12-08 02:29:59.412158] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.666 qpair failed and we were unable to recover it. 00:27:31.666 [2024-12-08 02:29:59.422043] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.666 [2024-12-08 02:29:59.422134] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.666 [2024-12-08 02:29:59.422159] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.666 [2024-12-08 02:29:59.422174] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.666 [2024-12-08 02:29:59.422187] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.666 [2024-12-08 02:29:59.422216] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.666 qpair failed and we were unable to recover it. 00:27:31.666 [2024-12-08 02:29:59.432087] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.666 [2024-12-08 02:29:59.432173] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.666 [2024-12-08 02:29:59.432198] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.666 [2024-12-08 02:29:59.432212] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.666 [2024-12-08 02:29:59.432225] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.666 [2024-12-08 02:29:59.432253] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.666 qpair failed and we were unable to recover it. 00:27:31.666 [2024-12-08 02:29:59.442175] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.666 [2024-12-08 02:29:59.442263] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.666 [2024-12-08 02:29:59.442289] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.666 [2024-12-08 02:29:59.442304] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.666 [2024-12-08 02:29:59.442327] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.666 [2024-12-08 02:29:59.442359] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.666 qpair failed and we were unable to recover it. 00:27:31.925 [2024-12-08 02:29:59.452140] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.925 [2024-12-08 02:29:59.452231] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.925 [2024-12-08 02:29:59.452257] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.925 [2024-12-08 02:29:59.452273] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.925 [2024-12-08 02:29:59.452286] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.925 [2024-12-08 02:29:59.452314] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.925 qpair failed and we were unable to recover it. 00:27:31.925 [2024-12-08 02:29:59.462154] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.925 [2024-12-08 02:29:59.462242] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.925 [2024-12-08 02:29:59.462267] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.925 [2024-12-08 02:29:59.462281] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.925 [2024-12-08 02:29:59.462293] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.925 [2024-12-08 02:29:59.462322] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.925 qpair failed and we were unable to recover it. 00:27:31.925 [2024-12-08 02:29:59.472286] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.925 [2024-12-08 02:29:59.472373] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.925 [2024-12-08 02:29:59.472399] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.925 [2024-12-08 02:29:59.472413] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.925 [2024-12-08 02:29:59.472426] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.925 [2024-12-08 02:29:59.472454] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.925 qpair failed and we were unable to recover it. 00:27:31.925 [2024-12-08 02:29:59.482310] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.925 [2024-12-08 02:29:59.482394] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.925 [2024-12-08 02:29:59.482420] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.925 [2024-12-08 02:29:59.482435] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.925 [2024-12-08 02:29:59.482448] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.925 [2024-12-08 02:29:59.482476] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.925 qpair failed and we were unable to recover it. 00:27:31.925 [2024-12-08 02:29:59.492241] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.925 [2024-12-08 02:29:59.492350] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.925 [2024-12-08 02:29:59.492374] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.925 [2024-12-08 02:29:59.492389] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.925 [2024-12-08 02:29:59.492402] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.925 [2024-12-08 02:29:59.492430] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.925 qpair failed and we were unable to recover it. 00:27:31.925 [2024-12-08 02:29:59.502301] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.925 [2024-12-08 02:29:59.502394] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.925 [2024-12-08 02:29:59.502419] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.925 [2024-12-08 02:29:59.502433] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.925 [2024-12-08 02:29:59.502446] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.925 [2024-12-08 02:29:59.502474] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.925 qpair failed and we were unable to recover it. 00:27:31.925 [2024-12-08 02:29:59.512328] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.925 [2024-12-08 02:29:59.512417] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.925 [2024-12-08 02:29:59.512452] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.925 [2024-12-08 02:29:59.512467] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.925 [2024-12-08 02:29:59.512480] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.925 [2024-12-08 02:29:59.512508] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.925 qpair failed and we were unable to recover it. 00:27:31.925 [2024-12-08 02:29:59.522371] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.926 [2024-12-08 02:29:59.522465] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.926 [2024-12-08 02:29:59.522494] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.926 [2024-12-08 02:29:59.522510] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.926 [2024-12-08 02:29:59.522523] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.926 [2024-12-08 02:29:59.522562] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.926 qpair failed and we were unable to recover it. 00:27:31.926 [2024-12-08 02:29:59.532378] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.926 [2024-12-08 02:29:59.532481] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.926 [2024-12-08 02:29:59.532509] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.926 [2024-12-08 02:29:59.532524] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.926 [2024-12-08 02:29:59.532551] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.926 [2024-12-08 02:29:59.532584] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.926 qpair failed and we were unable to recover it. 00:27:31.926 [2024-12-08 02:29:59.542436] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.926 [2024-12-08 02:29:59.542545] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.926 [2024-12-08 02:29:59.542571] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.926 [2024-12-08 02:29:59.542585] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.926 [2024-12-08 02:29:59.542599] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.926 [2024-12-08 02:29:59.542627] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.926 qpair failed and we were unable to recover it. 00:27:31.926 [2024-12-08 02:29:59.552443] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.926 [2024-12-08 02:29:59.552547] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.926 [2024-12-08 02:29:59.552573] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.926 [2024-12-08 02:29:59.552587] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.926 [2024-12-08 02:29:59.552600] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.926 [2024-12-08 02:29:59.552629] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.926 qpair failed and we were unable to recover it. 00:27:31.926 [2024-12-08 02:29:59.562452] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.926 [2024-12-08 02:29:59.562547] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.926 [2024-12-08 02:29:59.562573] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.926 [2024-12-08 02:29:59.562588] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.926 [2024-12-08 02:29:59.562602] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.926 [2024-12-08 02:29:59.562630] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.926 qpair failed and we were unable to recover it. 00:27:31.926 [2024-12-08 02:29:59.572486] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.926 [2024-12-08 02:29:59.572590] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.926 [2024-12-08 02:29:59.572615] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.926 [2024-12-08 02:29:59.572630] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.926 [2024-12-08 02:29:59.572643] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.926 [2024-12-08 02:29:59.572671] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.926 qpair failed and we were unable to recover it. 00:27:31.926 [2024-12-08 02:29:59.582616] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.926 [2024-12-08 02:29:59.582714] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.926 [2024-12-08 02:29:59.582739] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.926 [2024-12-08 02:29:59.582754] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.926 [2024-12-08 02:29:59.582767] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.926 [2024-12-08 02:29:59.582795] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.926 qpair failed and we were unable to recover it. 00:27:31.926 [2024-12-08 02:29:59.592565] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.926 [2024-12-08 02:29:59.592696] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.926 [2024-12-08 02:29:59.592721] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.926 [2024-12-08 02:29:59.592736] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.926 [2024-12-08 02:29:59.592750] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.926 [2024-12-08 02:29:59.592778] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.926 qpair failed and we were unable to recover it. 00:27:31.926 [2024-12-08 02:29:59.602598] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.926 [2024-12-08 02:29:59.602712] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.926 [2024-12-08 02:29:59.602738] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.926 [2024-12-08 02:29:59.602752] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.926 [2024-12-08 02:29:59.602766] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.926 [2024-12-08 02:29:59.602794] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.926 qpair failed and we were unable to recover it. 00:27:31.926 [2024-12-08 02:29:59.612678] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.926 [2024-12-08 02:29:59.612760] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.926 [2024-12-08 02:29:59.612785] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.926 [2024-12-08 02:29:59.612801] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.926 [2024-12-08 02:29:59.612815] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.926 [2024-12-08 02:29:59.612846] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.926 qpair failed and we were unable to recover it. 00:27:31.926 [2024-12-08 02:29:59.622688] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.926 [2024-12-08 02:29:59.622777] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.926 [2024-12-08 02:29:59.622802] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.926 [2024-12-08 02:29:59.622818] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.926 [2024-12-08 02:29:59.622837] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.926 [2024-12-08 02:29:59.622867] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.926 qpair failed and we were unable to recover it. 00:27:31.926 [2024-12-08 02:29:59.632684] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.926 [2024-12-08 02:29:59.632773] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.926 [2024-12-08 02:29:59.632798] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.926 [2024-12-08 02:29:59.632813] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.926 [2024-12-08 02:29:59.632826] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.926 [2024-12-08 02:29:59.632855] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.926 qpair failed and we were unable to recover it. 00:27:31.926 [2024-12-08 02:29:59.642685] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.926 [2024-12-08 02:29:59.642782] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.926 [2024-12-08 02:29:59.642807] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.926 [2024-12-08 02:29:59.642821] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.926 [2024-12-08 02:29:59.642835] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.926 [2024-12-08 02:29:59.642864] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.926 qpair failed and we were unable to recover it. 00:27:31.926 [2024-12-08 02:29:59.652706] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.926 [2024-12-08 02:29:59.652812] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.926 [2024-12-08 02:29:59.652837] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.927 [2024-12-08 02:29:59.652852] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.927 [2024-12-08 02:29:59.652865] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.927 [2024-12-08 02:29:59.652894] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.927 qpair failed and we were unable to recover it. 00:27:31.927 [2024-12-08 02:29:59.662765] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.927 [2024-12-08 02:29:59.662857] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.927 [2024-12-08 02:29:59.662886] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.927 [2024-12-08 02:29:59.662906] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.927 [2024-12-08 02:29:59.662919] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.927 [2024-12-08 02:29:59.662949] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.927 qpair failed and we were unable to recover it. 00:27:31.927 [2024-12-08 02:29:59.672801] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.927 [2024-12-08 02:29:59.672893] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.927 [2024-12-08 02:29:59.672919] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.927 [2024-12-08 02:29:59.672934] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.927 [2024-12-08 02:29:59.672947] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.927 [2024-12-08 02:29:59.672976] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.927 qpair failed and we were unable to recover it. 00:27:31.927 [2024-12-08 02:29:59.682851] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.927 [2024-12-08 02:29:59.682966] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.927 [2024-12-08 02:29:59.682992] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.927 [2024-12-08 02:29:59.683006] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.927 [2024-12-08 02:29:59.683020] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.927 [2024-12-08 02:29:59.683049] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.927 qpair failed and we were unable to recover it. 00:27:31.927 [2024-12-08 02:29:59.692930] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.927 [2024-12-08 02:29:59.693009] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.927 [2024-12-08 02:29:59.693034] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.927 [2024-12-08 02:29:59.693049] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.927 [2024-12-08 02:29:59.693063] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.927 [2024-12-08 02:29:59.693091] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.927 qpair failed and we were unable to recover it. 00:27:31.927 [2024-12-08 02:29:59.702912] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:31.927 [2024-12-08 02:29:59.703002] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:31.927 [2024-12-08 02:29:59.703027] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:31.927 [2024-12-08 02:29:59.703042] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:31.927 [2024-12-08 02:29:59.703055] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:31.927 [2024-12-08 02:29:59.703083] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:31.927 qpair failed and we were unable to recover it. 00:27:32.188 [2024-12-08 02:29:59.712986] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.188 [2024-12-08 02:29:59.713114] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.188 [2024-12-08 02:29:59.713140] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.188 [2024-12-08 02:29:59.713155] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.188 [2024-12-08 02:29:59.713173] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.188 [2024-12-08 02:29:59.713203] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.188 qpair failed and we were unable to recover it. 00:27:32.188 [2024-12-08 02:29:59.722984] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.188 [2024-12-08 02:29:59.723074] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.188 [2024-12-08 02:29:59.723100] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.188 [2024-12-08 02:29:59.723114] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.188 [2024-12-08 02:29:59.723127] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.188 [2024-12-08 02:29:59.723156] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.188 qpair failed and we were unable to recover it. 00:27:32.188 [2024-12-08 02:29:59.732995] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.188 [2024-12-08 02:29:59.733119] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.188 [2024-12-08 02:29:59.733144] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.188 [2024-12-08 02:29:59.733159] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.188 [2024-12-08 02:29:59.733173] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.188 [2024-12-08 02:29:59.733201] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.188 qpair failed and we were unable to recover it. 00:27:32.188 [2024-12-08 02:29:59.743026] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.188 [2024-12-08 02:29:59.743124] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.188 [2024-12-08 02:29:59.743150] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.188 [2024-12-08 02:29:59.743164] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.188 [2024-12-08 02:29:59.743177] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.188 [2024-12-08 02:29:59.743206] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.188 qpair failed and we were unable to recover it. 00:27:32.188 [2024-12-08 02:29:59.753131] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.188 [2024-12-08 02:29:59.753225] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.188 [2024-12-08 02:29:59.753250] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.188 [2024-12-08 02:29:59.753264] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.188 [2024-12-08 02:29:59.753278] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.188 [2024-12-08 02:29:59.753306] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.188 qpair failed and we were unable to recover it. 00:27:32.188 [2024-12-08 02:29:59.763098] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.188 [2024-12-08 02:29:59.763191] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.188 [2024-12-08 02:29:59.763217] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.188 [2024-12-08 02:29:59.763231] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.188 [2024-12-08 02:29:59.763244] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.188 [2024-12-08 02:29:59.763273] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.188 qpair failed and we were unable to recover it. 00:27:32.188 [2024-12-08 02:29:59.773080] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.188 [2024-12-08 02:29:59.773163] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.188 [2024-12-08 02:29:59.773188] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.188 [2024-12-08 02:29:59.773202] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.188 [2024-12-08 02:29:59.773215] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.188 [2024-12-08 02:29:59.773244] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.188 qpair failed and we were unable to recover it. 00:27:32.188 [2024-12-08 02:29:59.783190] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.188 [2024-12-08 02:29:59.783278] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.188 [2024-12-08 02:29:59.783303] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.188 [2024-12-08 02:29:59.783318] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.188 [2024-12-08 02:29:59.783331] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.188 [2024-12-08 02:29:59.783359] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.188 qpair failed and we were unable to recover it. 00:27:32.188 [2024-12-08 02:29:59.793137] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.188 [2024-12-08 02:29:59.793272] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.188 [2024-12-08 02:29:59.793297] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.188 [2024-12-08 02:29:59.793311] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.188 [2024-12-08 02:29:59.793324] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.189 [2024-12-08 02:29:59.793354] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.189 qpair failed and we were unable to recover it. 00:27:32.189 [2024-12-08 02:29:59.803184] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.189 [2024-12-08 02:29:59.803280] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.189 [2024-12-08 02:29:59.803304] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.189 [2024-12-08 02:29:59.803324] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.189 [2024-12-08 02:29:59.803338] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.189 [2024-12-08 02:29:59.803367] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.189 qpair failed and we were unable to recover it. 00:27:32.189 [2024-12-08 02:29:59.813218] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.189 [2024-12-08 02:29:59.813325] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.189 [2024-12-08 02:29:59.813350] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.189 [2024-12-08 02:29:59.813364] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.189 [2024-12-08 02:29:59.813377] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.189 [2024-12-08 02:29:59.813407] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.189 qpair failed and we were unable to recover it. 00:27:32.189 [2024-12-08 02:29:59.823323] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.189 [2024-12-08 02:29:59.823411] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.189 [2024-12-08 02:29:59.823436] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.189 [2024-12-08 02:29:59.823450] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.189 [2024-12-08 02:29:59.823464] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.189 [2024-12-08 02:29:59.823492] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.189 qpair failed and we were unable to recover it. 00:27:32.189 [2024-12-08 02:29:59.833264] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.189 [2024-12-08 02:29:59.833356] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.189 [2024-12-08 02:29:59.833381] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.189 [2024-12-08 02:29:59.833395] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.189 [2024-12-08 02:29:59.833409] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.189 [2024-12-08 02:29:59.833437] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.189 qpair failed and we were unable to recover it. 00:27:32.189 [2024-12-08 02:29:59.843284] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.189 [2024-12-08 02:29:59.843370] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.189 [2024-12-08 02:29:59.843396] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.189 [2024-12-08 02:29:59.843410] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.189 [2024-12-08 02:29:59.843424] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.189 [2024-12-08 02:29:59.843452] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.189 qpair failed and we were unable to recover it. 00:27:32.189 [2024-12-08 02:29:59.853309] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.189 [2024-12-08 02:29:59.853395] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.189 [2024-12-08 02:29:59.853420] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.189 [2024-12-08 02:29:59.853434] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.189 [2024-12-08 02:29:59.853446] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.189 [2024-12-08 02:29:59.853475] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.189 qpair failed and we were unable to recover it. 00:27:32.189 [2024-12-08 02:29:59.863365] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.189 [2024-12-08 02:29:59.863458] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.189 [2024-12-08 02:29:59.863484] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.189 [2024-12-08 02:29:59.863498] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.189 [2024-12-08 02:29:59.863511] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.189 [2024-12-08 02:29:59.863546] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.189 qpair failed and we were unable to recover it. 00:27:32.189 [2024-12-08 02:29:59.873375] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.189 [2024-12-08 02:29:59.873465] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.189 [2024-12-08 02:29:59.873489] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.189 [2024-12-08 02:29:59.873504] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.189 [2024-12-08 02:29:59.873517] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.189 [2024-12-08 02:29:59.873554] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.189 qpair failed and we were unable to recover it. 00:27:32.189 [2024-12-08 02:29:59.883393] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.189 [2024-12-08 02:29:59.883491] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.189 [2024-12-08 02:29:59.883516] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.189 [2024-12-08 02:29:59.883530] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.189 [2024-12-08 02:29:59.883551] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.189 [2024-12-08 02:29:59.883582] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.189 qpair failed and we were unable to recover it. 00:27:32.189 [2024-12-08 02:29:59.893455] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.189 [2024-12-08 02:29:59.893570] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.189 [2024-12-08 02:29:59.893596] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.189 [2024-12-08 02:29:59.893617] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.189 [2024-12-08 02:29:59.893631] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.189 [2024-12-08 02:29:59.893660] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.189 qpair failed and we were unable to recover it. 00:27:32.189 [2024-12-08 02:29:59.903462] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.189 [2024-12-08 02:29:59.903576] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.189 [2024-12-08 02:29:59.903603] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.189 [2024-12-08 02:29:59.903617] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.189 [2024-12-08 02:29:59.903630] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.189 [2024-12-08 02:29:59.903659] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.189 qpair failed and we were unable to recover it. 00:27:32.189 [2024-12-08 02:29:59.913485] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.189 [2024-12-08 02:29:59.913577] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.189 [2024-12-08 02:29:59.913602] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.189 [2024-12-08 02:29:59.913616] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.189 [2024-12-08 02:29:59.913630] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.189 [2024-12-08 02:29:59.913660] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.189 qpair failed and we were unable to recover it. 00:27:32.189 [2024-12-08 02:29:59.923521] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.189 [2024-12-08 02:29:59.923618] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.189 [2024-12-08 02:29:59.923644] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.189 [2024-12-08 02:29:59.923658] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.189 [2024-12-08 02:29:59.923671] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.189 [2024-12-08 02:29:59.923700] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.190 qpair failed and we were unable to recover it. 00:27:32.190 [2024-12-08 02:29:59.933524] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.190 [2024-12-08 02:29:59.933617] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.190 [2024-12-08 02:29:59.933643] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.190 [2024-12-08 02:29:59.933657] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.190 [2024-12-08 02:29:59.933670] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.190 [2024-12-08 02:29:59.933699] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.190 qpair failed and we were unable to recover it. 00:27:32.190 [2024-12-08 02:29:59.943590] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.190 [2024-12-08 02:29:59.943682] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.190 [2024-12-08 02:29:59.943707] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.190 [2024-12-08 02:29:59.943721] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.190 [2024-12-08 02:29:59.943734] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.190 [2024-12-08 02:29:59.943762] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.190 qpair failed and we were unable to recover it. 00:27:32.190 [2024-12-08 02:29:59.953622] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.190 [2024-12-08 02:29:59.953717] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.190 [2024-12-08 02:29:59.953747] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.190 [2024-12-08 02:29:59.953763] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.190 [2024-12-08 02:29:59.953776] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.190 [2024-12-08 02:29:59.953805] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.190 qpair failed and we were unable to recover it. 00:27:32.190 [2024-12-08 02:29:59.963729] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.190 [2024-12-08 02:29:59.963826] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.190 [2024-12-08 02:29:59.963851] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.190 [2024-12-08 02:29:59.963866] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.190 [2024-12-08 02:29:59.963880] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.190 [2024-12-08 02:29:59.963908] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.190 qpair failed and we were unable to recover it. 00:27:32.451 [2024-12-08 02:29:59.973652] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.451 [2024-12-08 02:29:59.973734] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.451 [2024-12-08 02:29:59.973760] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.451 [2024-12-08 02:29:59.973775] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.451 [2024-12-08 02:29:59.973788] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.451 [2024-12-08 02:29:59.973816] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.451 qpair failed and we were unable to recover it. 00:27:32.451 [2024-12-08 02:29:59.983736] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.451 [2024-12-08 02:29:59.983824] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.451 [2024-12-08 02:29:59.983850] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.451 [2024-12-08 02:29:59.983871] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.451 [2024-12-08 02:29:59.983885] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.451 [2024-12-08 02:29:59.983916] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.451 qpair failed and we were unable to recover it. 00:27:32.451 [2024-12-08 02:29:59.993696] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.451 [2024-12-08 02:29:59.993784] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.451 [2024-12-08 02:29:59.993809] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.451 [2024-12-08 02:29:59.993824] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.451 [2024-12-08 02:29:59.993837] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.451 [2024-12-08 02:29:59.993865] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.451 qpair failed and we were unable to recover it. 00:27:32.451 [2024-12-08 02:30:00.003763] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.451 [2024-12-08 02:30:00.003874] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.451 [2024-12-08 02:30:00.003899] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.451 [2024-12-08 02:30:00.003914] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.451 [2024-12-08 02:30:00.003926] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.451 [2024-12-08 02:30:00.003955] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.451 qpair failed and we were unable to recover it. 00:27:32.451 [2024-12-08 02:30:00.013812] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.451 [2024-12-08 02:30:00.013908] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.451 [2024-12-08 02:30:00.013936] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.451 [2024-12-08 02:30:00.013952] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.451 [2024-12-08 02:30:00.013965] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.451 [2024-12-08 02:30:00.013995] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.451 qpair failed and we were unable to recover it. 00:27:32.451 [2024-12-08 02:30:00.024010] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.451 [2024-12-08 02:30:00.024133] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.451 [2024-12-08 02:30:00.024160] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.451 [2024-12-08 02:30:00.024175] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.451 [2024-12-08 02:30:00.024188] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.451 [2024-12-08 02:30:00.024218] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.451 qpair failed and we were unable to recover it. 00:27:32.451 [2024-12-08 02:30:00.033994] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.451 [2024-12-08 02:30:00.034108] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.451 [2024-12-08 02:30:00.034136] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.451 [2024-12-08 02:30:00.034151] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.451 [2024-12-08 02:30:00.034165] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.452 [2024-12-08 02:30:00.034197] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.452 qpair failed and we were unable to recover it. 00:27:32.452 [2024-12-08 02:30:00.043920] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.452 [2024-12-08 02:30:00.044018] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.452 [2024-12-08 02:30:00.044044] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.452 [2024-12-08 02:30:00.044059] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.452 [2024-12-08 02:30:00.044073] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.452 [2024-12-08 02:30:00.044101] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.452 qpair failed and we were unable to recover it. 00:27:32.452 [2024-12-08 02:30:00.053931] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.452 [2024-12-08 02:30:00.054031] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.452 [2024-12-08 02:30:00.054060] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.452 [2024-12-08 02:30:00.054078] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.452 [2024-12-08 02:30:00.054092] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.452 [2024-12-08 02:30:00.054123] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.452 qpair failed and we were unable to recover it. 00:27:32.452 [2024-12-08 02:30:00.064017] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.452 [2024-12-08 02:30:00.064127] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.452 [2024-12-08 02:30:00.064153] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.452 [2024-12-08 02:30:00.064168] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.452 [2024-12-08 02:30:00.064182] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.452 [2024-12-08 02:30:00.064211] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.452 qpair failed and we were unable to recover it. 00:27:32.452 [2024-12-08 02:30:00.074043] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.452 [2024-12-08 02:30:00.074141] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.452 [2024-12-08 02:30:00.074166] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.452 [2024-12-08 02:30:00.074189] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.452 [2024-12-08 02:30:00.074203] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.452 [2024-12-08 02:30:00.074233] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.452 qpair failed and we were unable to recover it. 00:27:32.452 [2024-12-08 02:30:00.083998] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.452 [2024-12-08 02:30:00.084099] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.452 [2024-12-08 02:30:00.084125] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.452 [2024-12-08 02:30:00.084141] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.452 [2024-12-08 02:30:00.084154] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.452 [2024-12-08 02:30:00.084183] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.452 qpair failed and we were unable to recover it. 00:27:32.452 [2024-12-08 02:30:00.094077] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.452 [2024-12-08 02:30:00.094178] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.452 [2024-12-08 02:30:00.094204] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.452 [2024-12-08 02:30:00.094219] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.452 [2024-12-08 02:30:00.094232] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.452 [2024-12-08 02:30:00.094261] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.452 qpair failed and we were unable to recover it. 00:27:32.452 [2024-12-08 02:30:00.104036] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.452 [2024-12-08 02:30:00.104157] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.452 [2024-12-08 02:30:00.104182] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.452 [2024-12-08 02:30:00.104197] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.452 [2024-12-08 02:30:00.104210] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.452 [2024-12-08 02:30:00.104240] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.452 qpair failed and we were unable to recover it. 00:27:32.452 [2024-12-08 02:30:00.114045] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.452 [2024-12-08 02:30:00.114175] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.452 [2024-12-08 02:30:00.114200] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.452 [2024-12-08 02:30:00.114215] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.452 [2024-12-08 02:30:00.114228] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.452 [2024-12-08 02:30:00.114257] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.452 qpair failed and we were unable to recover it. 00:27:32.452 [2024-12-08 02:30:00.124187] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.452 [2024-12-08 02:30:00.124282] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.452 [2024-12-08 02:30:00.124308] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.452 [2024-12-08 02:30:00.124322] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.452 [2024-12-08 02:30:00.124336] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.452 [2024-12-08 02:30:00.124364] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.452 qpair failed and we were unable to recover it. 00:27:32.452 [2024-12-08 02:30:00.134107] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.452 [2024-12-08 02:30:00.134192] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.452 [2024-12-08 02:30:00.134217] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.452 [2024-12-08 02:30:00.134232] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.452 [2024-12-08 02:30:00.134246] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.452 [2024-12-08 02:30:00.134275] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.452 qpair failed and we were unable to recover it. 00:27:32.452 [2024-12-08 02:30:00.144144] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.452 [2024-12-08 02:30:00.144233] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.452 [2024-12-08 02:30:00.144257] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.452 [2024-12-08 02:30:00.144273] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.452 [2024-12-08 02:30:00.144286] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.452 [2024-12-08 02:30:00.144315] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.452 qpair failed and we were unable to recover it. 00:27:32.452 [2024-12-08 02:30:00.154179] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.452 [2024-12-08 02:30:00.154272] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.452 [2024-12-08 02:30:00.154297] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.452 [2024-12-08 02:30:00.154312] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.452 [2024-12-08 02:30:00.154325] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.452 [2024-12-08 02:30:00.154353] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.452 qpair failed and we were unable to recover it. 00:27:32.452 [2024-12-08 02:30:00.164205] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.452 [2024-12-08 02:30:00.164294] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.452 [2024-12-08 02:30:00.164324] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.453 [2024-12-08 02:30:00.164340] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.453 [2024-12-08 02:30:00.164353] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.453 [2024-12-08 02:30:00.164384] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.453 qpair failed and we were unable to recover it. 00:27:32.453 [2024-12-08 02:30:00.174218] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.453 [2024-12-08 02:30:00.174301] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.453 [2024-12-08 02:30:00.174327] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.453 [2024-12-08 02:30:00.174341] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.453 [2024-12-08 02:30:00.174355] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.453 [2024-12-08 02:30:00.174383] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.453 qpair failed and we were unable to recover it. 00:27:32.453 [2024-12-08 02:30:00.184278] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.453 [2024-12-08 02:30:00.184370] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.453 [2024-12-08 02:30:00.184396] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.453 [2024-12-08 02:30:00.184410] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.453 [2024-12-08 02:30:00.184423] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.453 [2024-12-08 02:30:00.184452] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.453 qpair failed and we were unable to recover it. 00:27:32.453 [2024-12-08 02:30:00.194295] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.453 [2024-12-08 02:30:00.194393] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.453 [2024-12-08 02:30:00.194418] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.453 [2024-12-08 02:30:00.194432] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.453 [2024-12-08 02:30:00.194446] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.453 [2024-12-08 02:30:00.194475] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.453 qpair failed and we were unable to recover it. 00:27:32.453 [2024-12-08 02:30:00.204321] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.453 [2024-12-08 02:30:00.204410] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.453 [2024-12-08 02:30:00.204436] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.453 [2024-12-08 02:30:00.204452] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.453 [2024-12-08 02:30:00.204466] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.453 [2024-12-08 02:30:00.204495] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.453 qpair failed and we were unable to recover it. 00:27:32.453 [2024-12-08 02:30:00.214328] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.453 [2024-12-08 02:30:00.214448] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.453 [2024-12-08 02:30:00.214473] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.453 [2024-12-08 02:30:00.214488] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.453 [2024-12-08 02:30:00.214502] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.453 [2024-12-08 02:30:00.214530] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.453 qpair failed and we were unable to recover it. 00:27:32.453 [2024-12-08 02:30:00.224388] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.453 [2024-12-08 02:30:00.224477] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.453 [2024-12-08 02:30:00.224503] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.453 [2024-12-08 02:30:00.224517] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.453 [2024-12-08 02:30:00.224531] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.453 [2024-12-08 02:30:00.224566] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.453 qpair failed and we were unable to recover it. 00:27:32.714 [2024-12-08 02:30:00.234427] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.714 [2024-12-08 02:30:00.234557] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.714 [2024-12-08 02:30:00.234592] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.714 [2024-12-08 02:30:00.234606] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.714 [2024-12-08 02:30:00.234620] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.714 [2024-12-08 02:30:00.234649] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.714 qpair failed and we were unable to recover it. 00:27:32.714 [2024-12-08 02:30:00.244426] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.714 [2024-12-08 02:30:00.244513] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.714 [2024-12-08 02:30:00.244544] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.714 [2024-12-08 02:30:00.244561] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.714 [2024-12-08 02:30:00.244575] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.714 [2024-12-08 02:30:00.244606] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.714 qpair failed and we were unable to recover it. 00:27:32.714 [2024-12-08 02:30:00.254435] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.714 [2024-12-08 02:30:00.254566] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.715 [2024-12-08 02:30:00.254611] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.715 [2024-12-08 02:30:00.254627] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.715 [2024-12-08 02:30:00.254641] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.715 [2024-12-08 02:30:00.254671] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.715 qpair failed and we were unable to recover it. 00:27:32.715 [2024-12-08 02:30:00.264547] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.715 [2024-12-08 02:30:00.264646] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.715 [2024-12-08 02:30:00.264672] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.715 [2024-12-08 02:30:00.264687] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.715 [2024-12-08 02:30:00.264701] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.715 [2024-12-08 02:30:00.264730] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.715 qpair failed and we were unable to recover it. 00:27:32.715 [2024-12-08 02:30:00.274520] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.715 [2024-12-08 02:30:00.274618] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.715 [2024-12-08 02:30:00.274645] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.715 [2024-12-08 02:30:00.274664] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.715 [2024-12-08 02:30:00.274679] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.715 [2024-12-08 02:30:00.274709] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.715 qpair failed and we were unable to recover it. 00:27:32.715 [2024-12-08 02:30:00.284552] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.715 [2024-12-08 02:30:00.284656] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.715 [2024-12-08 02:30:00.284682] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.715 [2024-12-08 02:30:00.284696] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.715 [2024-12-08 02:30:00.284710] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.715 [2024-12-08 02:30:00.284739] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.715 qpair failed and we were unable to recover it. 00:27:32.715 [2024-12-08 02:30:00.294586] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.715 [2024-12-08 02:30:00.294673] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.715 [2024-12-08 02:30:00.294700] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.715 [2024-12-08 02:30:00.294714] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.715 [2024-12-08 02:30:00.294727] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.715 [2024-12-08 02:30:00.294762] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.715 qpair failed and we were unable to recover it. 00:27:32.715 [2024-12-08 02:30:00.304637] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.715 [2024-12-08 02:30:00.304736] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.715 [2024-12-08 02:30:00.304762] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.715 [2024-12-08 02:30:00.304776] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.715 [2024-12-08 02:30:00.304790] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.715 [2024-12-08 02:30:00.304818] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.715 qpair failed and we were unable to recover it. 00:27:32.715 [2024-12-08 02:30:00.314629] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.715 [2024-12-08 02:30:00.314724] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.715 [2024-12-08 02:30:00.314750] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.715 [2024-12-08 02:30:00.314765] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.715 [2024-12-08 02:30:00.314778] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.715 [2024-12-08 02:30:00.314807] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.715 qpair failed and we were unable to recover it. 00:27:32.715 [2024-12-08 02:30:00.324668] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.715 [2024-12-08 02:30:00.324751] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.715 [2024-12-08 02:30:00.324777] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.715 [2024-12-08 02:30:00.324792] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.715 [2024-12-08 02:30:00.324815] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.715 [2024-12-08 02:30:00.324843] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.715 qpair failed and we were unable to recover it. 00:27:32.715 [2024-12-08 02:30:00.334694] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.715 [2024-12-08 02:30:00.334805] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.715 [2024-12-08 02:30:00.334834] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.715 [2024-12-08 02:30:00.334850] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.715 [2024-12-08 02:30:00.334864] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.715 [2024-12-08 02:30:00.334895] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.715 qpair failed and we were unable to recover it. 00:27:32.715 [2024-12-08 02:30:00.344769] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.715 [2024-12-08 02:30:00.344883] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.715 [2024-12-08 02:30:00.344915] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.715 [2024-12-08 02:30:00.344931] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.715 [2024-12-08 02:30:00.344944] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.715 [2024-12-08 02:30:00.344973] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.715 qpair failed and we were unable to recover it. 00:27:32.715 [2024-12-08 02:30:00.354787] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.715 [2024-12-08 02:30:00.354904] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.715 [2024-12-08 02:30:00.354930] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.715 [2024-12-08 02:30:00.354945] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.715 [2024-12-08 02:30:00.354958] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.715 [2024-12-08 02:30:00.354986] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.715 qpair failed and we were unable to recover it. 00:27:32.715 [2024-12-08 02:30:00.364851] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.715 [2024-12-08 02:30:00.364941] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.715 [2024-12-08 02:30:00.364968] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.715 [2024-12-08 02:30:00.364982] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.715 [2024-12-08 02:30:00.364995] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.715 [2024-12-08 02:30:00.365024] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.715 qpair failed and we were unable to recover it. 00:27:32.715 [2024-12-08 02:30:00.374882] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.715 [2024-12-08 02:30:00.374962] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.715 [2024-12-08 02:30:00.374987] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.715 [2024-12-08 02:30:00.375002] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.715 [2024-12-08 02:30:00.375015] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.715 [2024-12-08 02:30:00.375043] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.716 qpair failed and we were unable to recover it. 00:27:32.716 [2024-12-08 02:30:00.384827] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.716 [2024-12-08 02:30:00.384953] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.716 [2024-12-08 02:30:00.384979] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.716 [2024-12-08 02:30:00.384994] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.716 [2024-12-08 02:30:00.385007] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.716 [2024-12-08 02:30:00.385041] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.716 qpair failed and we were unable to recover it. 00:27:32.716 [2024-12-08 02:30:00.394855] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.716 [2024-12-08 02:30:00.394939] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.716 [2024-12-08 02:30:00.394964] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.716 [2024-12-08 02:30:00.394979] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.716 [2024-12-08 02:30:00.394993] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.716 [2024-12-08 02:30:00.395021] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.716 qpair failed and we were unable to recover it. 00:27:32.716 [2024-12-08 02:30:00.404893] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.716 [2024-12-08 02:30:00.404979] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.716 [2024-12-08 02:30:00.405003] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.716 [2024-12-08 02:30:00.405017] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.716 [2024-12-08 02:30:00.405029] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.716 [2024-12-08 02:30:00.405057] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.716 qpair failed and we were unable to recover it. 00:27:32.716 [2024-12-08 02:30:00.414923] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.716 [2024-12-08 02:30:00.415012] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.716 [2024-12-08 02:30:00.415037] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.716 [2024-12-08 02:30:00.415052] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.716 [2024-12-08 02:30:00.415065] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.716 [2024-12-08 02:30:00.415093] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.716 qpair failed and we were unable to recover it. 00:27:32.716 [2024-12-08 02:30:00.424962] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.716 [2024-12-08 02:30:00.425074] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.716 [2024-12-08 02:30:00.425100] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.716 [2024-12-08 02:30:00.425114] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.716 [2024-12-08 02:30:00.425128] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.716 [2024-12-08 02:30:00.425156] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.716 qpair failed and we were unable to recover it. 00:27:32.716 [2024-12-08 02:30:00.434957] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.716 [2024-12-08 02:30:00.435046] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.716 [2024-12-08 02:30:00.435076] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.716 [2024-12-08 02:30:00.435092] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.716 [2024-12-08 02:30:00.435105] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.716 [2024-12-08 02:30:00.435134] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.716 qpair failed and we were unable to recover it. 00:27:32.716 [2024-12-08 02:30:00.445050] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.716 [2024-12-08 02:30:00.445167] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.716 [2024-12-08 02:30:00.445193] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.716 [2024-12-08 02:30:00.445208] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.716 [2024-12-08 02:30:00.445221] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.716 [2024-12-08 02:30:00.445249] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.716 qpair failed and we were unable to recover it. 00:27:32.716 [2024-12-08 02:30:00.455061] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.716 [2024-12-08 02:30:00.455155] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.716 [2024-12-08 02:30:00.455181] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.716 [2024-12-08 02:30:00.455196] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.716 [2024-12-08 02:30:00.455209] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.716 [2024-12-08 02:30:00.455237] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.716 qpair failed and we were unable to recover it. 00:27:32.716 [2024-12-08 02:30:00.465093] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.716 [2024-12-08 02:30:00.465183] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.716 [2024-12-08 02:30:00.465208] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.716 [2024-12-08 02:30:00.465223] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.716 [2024-12-08 02:30:00.465237] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.716 [2024-12-08 02:30:00.465265] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.716 qpair failed and we were unable to recover it. 00:27:32.716 [2024-12-08 02:30:00.475170] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.716 [2024-12-08 02:30:00.475251] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.716 [2024-12-08 02:30:00.475277] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.716 [2024-12-08 02:30:00.475292] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.716 [2024-12-08 02:30:00.475305] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.716 [2024-12-08 02:30:00.475340] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.716 qpair failed and we were unable to recover it. 00:27:32.716 [2024-12-08 02:30:00.485205] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.716 [2024-12-08 02:30:00.485308] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.716 [2024-12-08 02:30:00.485333] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.716 [2024-12-08 02:30:00.485348] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.716 [2024-12-08 02:30:00.485361] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.716 [2024-12-08 02:30:00.485389] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.716 qpair failed and we were unable to recover it. 00:27:32.976 [2024-12-08 02:30:00.495139] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.976 [2024-12-08 02:30:00.495225] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.976 [2024-12-08 02:30:00.495251] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.976 [2024-12-08 02:30:00.495266] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.976 [2024-12-08 02:30:00.495279] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.976 [2024-12-08 02:30:00.495310] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.976 qpair failed and we were unable to recover it. 00:27:32.976 [2024-12-08 02:30:00.505272] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.976 [2024-12-08 02:30:00.505368] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.976 [2024-12-08 02:30:00.505393] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.976 [2024-12-08 02:30:00.505407] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.976 [2024-12-08 02:30:00.505421] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.976 [2024-12-08 02:30:00.505449] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.976 qpair failed and we were unable to recover it. 00:27:32.976 [2024-12-08 02:30:00.515211] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.976 [2024-12-08 02:30:00.515298] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.976 [2024-12-08 02:30:00.515324] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.976 [2024-12-08 02:30:00.515338] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.976 [2024-12-08 02:30:00.515351] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.976 [2024-12-08 02:30:00.515381] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.976 qpair failed and we were unable to recover it. 00:27:32.976 [2024-12-08 02:30:00.525241] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.976 [2024-12-08 02:30:00.525326] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.976 [2024-12-08 02:30:00.525357] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.976 [2024-12-08 02:30:00.525372] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.976 [2024-12-08 02:30:00.525386] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.976 [2024-12-08 02:30:00.525414] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.976 qpair failed and we were unable to recover it. 00:27:32.976 [2024-12-08 02:30:00.535279] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.976 [2024-12-08 02:30:00.535400] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.976 [2024-12-08 02:30:00.535425] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.976 [2024-12-08 02:30:00.535440] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.976 [2024-12-08 02:30:00.535453] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.976 [2024-12-08 02:30:00.535482] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.976 qpair failed and we were unable to recover it. 00:27:32.976 [2024-12-08 02:30:00.545293] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.976 [2024-12-08 02:30:00.545381] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.976 [2024-12-08 02:30:00.545406] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.976 [2024-12-08 02:30:00.545421] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.976 [2024-12-08 02:30:00.545434] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.976 [2024-12-08 02:30:00.545463] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.976 qpair failed and we were unable to recover it. 00:27:32.976 [2024-12-08 02:30:00.555324] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.976 [2024-12-08 02:30:00.555414] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.976 [2024-12-08 02:30:00.555439] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.976 [2024-12-08 02:30:00.555453] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.976 [2024-12-08 02:30:00.555466] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.976 [2024-12-08 02:30:00.555495] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.976 qpair failed and we were unable to recover it. 00:27:32.976 [2024-12-08 02:30:00.565342] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.976 [2024-12-08 02:30:00.565442] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.976 [2024-12-08 02:30:00.565467] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.976 [2024-12-08 02:30:00.565481] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.976 [2024-12-08 02:30:00.565494] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.976 [2024-12-08 02:30:00.565529] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.976 qpair failed and we were unable to recover it. 00:27:32.976 [2024-12-08 02:30:00.575398] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.976 [2024-12-08 02:30:00.575487] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.976 [2024-12-08 02:30:00.575513] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.976 [2024-12-08 02:30:00.575527] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.976 [2024-12-08 02:30:00.575548] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.976 [2024-12-08 02:30:00.575578] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.976 qpair failed and we were unable to recover it. 00:27:32.976 [2024-12-08 02:30:00.585414] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.976 [2024-12-08 02:30:00.585503] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.976 [2024-12-08 02:30:00.585529] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.976 [2024-12-08 02:30:00.585552] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.976 [2024-12-08 02:30:00.585566] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.976 [2024-12-08 02:30:00.585594] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.976 qpair failed and we were unable to recover it. 00:27:32.976 [2024-12-08 02:30:00.595469] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.976 [2024-12-08 02:30:00.595576] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.976 [2024-12-08 02:30:00.595605] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.976 [2024-12-08 02:30:00.595619] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.976 [2024-12-08 02:30:00.595632] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.976 [2024-12-08 02:30:00.595661] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.976 qpair failed and we were unable to recover it. 00:27:32.977 [2024-12-08 02:30:00.605447] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.977 [2024-12-08 02:30:00.605566] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.977 [2024-12-08 02:30:00.605592] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.977 [2024-12-08 02:30:00.605606] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.977 [2024-12-08 02:30:00.605619] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.977 [2024-12-08 02:30:00.605649] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.977 qpair failed and we were unable to recover it. 00:27:32.977 [2024-12-08 02:30:00.615491] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.977 [2024-12-08 02:30:00.615607] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.977 [2024-12-08 02:30:00.615637] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.977 [2024-12-08 02:30:00.615653] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.977 [2024-12-08 02:30:00.615667] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.977 [2024-12-08 02:30:00.615695] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.977 qpair failed and we were unable to recover it. 00:27:32.977 [2024-12-08 02:30:00.625549] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.977 [2024-12-08 02:30:00.625641] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.977 [2024-12-08 02:30:00.625667] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.977 [2024-12-08 02:30:00.625681] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.977 [2024-12-08 02:30:00.625695] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.977 [2024-12-08 02:30:00.625724] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.977 qpair failed and we were unable to recover it. 00:27:32.977 [2024-12-08 02:30:00.635598] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.977 [2024-12-08 02:30:00.635712] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.977 [2024-12-08 02:30:00.635738] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.977 [2024-12-08 02:30:00.635752] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.977 [2024-12-08 02:30:00.635766] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.977 [2024-12-08 02:30:00.635794] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.977 qpair failed and we were unable to recover it. 00:27:32.977 [2024-12-08 02:30:00.645616] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.977 [2024-12-08 02:30:00.645705] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.977 [2024-12-08 02:30:00.645731] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.977 [2024-12-08 02:30:00.645745] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.977 [2024-12-08 02:30:00.645758] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.977 [2024-12-08 02:30:00.645787] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.977 qpair failed and we were unable to recover it. 00:27:32.977 [2024-12-08 02:30:00.655669] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.977 [2024-12-08 02:30:00.655768] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.977 [2024-12-08 02:30:00.655793] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.977 [2024-12-08 02:30:00.655807] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.977 [2024-12-08 02:30:00.655827] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.977 [2024-12-08 02:30:00.655858] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.977 qpair failed and we were unable to recover it. 00:27:32.977 [2024-12-08 02:30:00.665743] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.977 [2024-12-08 02:30:00.665882] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.977 [2024-12-08 02:30:00.665917] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.977 [2024-12-08 02:30:00.665932] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.977 [2024-12-08 02:30:00.665945] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.977 [2024-12-08 02:30:00.665973] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.977 qpair failed and we were unable to recover it. 00:27:32.977 [2024-12-08 02:30:00.675726] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.977 [2024-12-08 02:30:00.675814] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.977 [2024-12-08 02:30:00.675841] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.977 [2024-12-08 02:30:00.675855] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.977 [2024-12-08 02:30:00.675868] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.977 [2024-12-08 02:30:00.675899] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.977 qpair failed and we were unable to recover it. 00:27:32.977 [2024-12-08 02:30:00.685749] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.977 [2024-12-08 02:30:00.685879] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.977 [2024-12-08 02:30:00.685915] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.977 [2024-12-08 02:30:00.685930] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.977 [2024-12-08 02:30:00.685943] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.977 [2024-12-08 02:30:00.685972] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.977 qpair failed and we were unable to recover it. 00:27:32.977 [2024-12-08 02:30:00.695733] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.977 [2024-12-08 02:30:00.695833] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.977 [2024-12-08 02:30:00.695858] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.977 [2024-12-08 02:30:00.695872] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.977 [2024-12-08 02:30:00.695885] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.977 [2024-12-08 02:30:00.695914] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.977 qpair failed and we were unable to recover it. 00:27:32.977 [2024-12-08 02:30:00.705855] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.977 [2024-12-08 02:30:00.705960] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.977 [2024-12-08 02:30:00.705985] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.977 [2024-12-08 02:30:00.706000] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.977 [2024-12-08 02:30:00.706013] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.977 [2024-12-08 02:30:00.706041] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.977 qpair failed and we were unable to recover it. 00:27:32.977 [2024-12-08 02:30:00.715823] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.977 [2024-12-08 02:30:00.715922] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.977 [2024-12-08 02:30:00.715948] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.977 [2024-12-08 02:30:00.715963] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.977 [2024-12-08 02:30:00.715976] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.977 [2024-12-08 02:30:00.716004] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.977 qpair failed and we were unable to recover it. 00:27:32.977 [2024-12-08 02:30:00.725928] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.977 [2024-12-08 02:30:00.726014] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.977 [2024-12-08 02:30:00.726040] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.977 [2024-12-08 02:30:00.726054] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.977 [2024-12-08 02:30:00.726068] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.977 [2024-12-08 02:30:00.726096] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.977 qpair failed and we were unable to recover it. 00:27:32.977 [2024-12-08 02:30:00.735861] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.977 [2024-12-08 02:30:00.735945] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.977 [2024-12-08 02:30:00.735970] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.977 [2024-12-08 02:30:00.735985] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.978 [2024-12-08 02:30:00.735998] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.978 [2024-12-08 02:30:00.736027] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.978 qpair failed and we were unable to recover it. 00:27:32.978 [2024-12-08 02:30:00.745900] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:32.978 [2024-12-08 02:30:00.745988] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:32.978 [2024-12-08 02:30:00.746014] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:32.978 [2024-12-08 02:30:00.746028] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:32.978 [2024-12-08 02:30:00.746046] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:32.978 [2024-12-08 02:30:00.746077] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:32.978 qpair failed and we were unable to recover it. 00:27:33.236 [2024-12-08 02:30:00.755904] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.236 [2024-12-08 02:30:00.756005] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.236 [2024-12-08 02:30:00.756030] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.236 [2024-12-08 02:30:00.756045] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.236 [2024-12-08 02:30:00.756058] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.236 [2024-12-08 02:30:00.756087] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.236 qpair failed and we were unable to recover it. 00:27:33.237 [2024-12-08 02:30:00.765943] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.237 [2024-12-08 02:30:00.766024] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.237 [2024-12-08 02:30:00.766049] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.237 [2024-12-08 02:30:00.766064] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.237 [2024-12-08 02:30:00.766078] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.237 [2024-12-08 02:30:00.766106] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.237 qpair failed and we were unable to recover it. 00:27:33.237 [2024-12-08 02:30:00.775978] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.237 [2024-12-08 02:30:00.776091] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.237 [2024-12-08 02:30:00.776116] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.237 [2024-12-08 02:30:00.776131] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.237 [2024-12-08 02:30:00.776144] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.237 [2024-12-08 02:30:00.776172] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.237 qpair failed and we were unable to recover it. 00:27:33.237 [2024-12-08 02:30:00.786074] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.237 [2024-12-08 02:30:00.786186] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.237 [2024-12-08 02:30:00.786214] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.237 [2024-12-08 02:30:00.786230] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.237 [2024-12-08 02:30:00.786243] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.237 [2024-12-08 02:30:00.786272] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.237 qpair failed and we were unable to recover it. 00:27:33.237 [2024-12-08 02:30:00.796038] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.237 [2024-12-08 02:30:00.796133] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.237 [2024-12-08 02:30:00.796158] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.237 [2024-12-08 02:30:00.796172] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.237 [2024-12-08 02:30:00.796186] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.237 [2024-12-08 02:30:00.796214] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.237 qpair failed and we were unable to recover it. 00:27:33.237 [2024-12-08 02:30:00.806144] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.237 [2024-12-08 02:30:00.806273] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.237 [2024-12-08 02:30:00.806299] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.237 [2024-12-08 02:30:00.806313] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.237 [2024-12-08 02:30:00.806326] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.237 [2024-12-08 02:30:00.806355] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.237 qpair failed and we were unable to recover it. 00:27:33.237 [2024-12-08 02:30:00.816063] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.237 [2024-12-08 02:30:00.816158] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.237 [2024-12-08 02:30:00.816184] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.237 [2024-12-08 02:30:00.816198] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.237 [2024-12-08 02:30:00.816211] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.237 [2024-12-08 02:30:00.816239] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.237 qpair failed and we were unable to recover it. 00:27:33.237 [2024-12-08 02:30:00.826116] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.237 [2024-12-08 02:30:00.826206] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.237 [2024-12-08 02:30:00.826231] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.237 [2024-12-08 02:30:00.826246] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.237 [2024-12-08 02:30:00.826259] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.237 [2024-12-08 02:30:00.826287] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.237 qpair failed and we were unable to recover it. 00:27:33.237 [2024-12-08 02:30:00.836217] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.237 [2024-12-08 02:30:00.836316] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.237 [2024-12-08 02:30:00.836342] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.237 [2024-12-08 02:30:00.836357] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.237 [2024-12-08 02:30:00.836375] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.237 [2024-12-08 02:30:00.836404] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.237 qpair failed and we were unable to recover it. 00:27:33.237 [2024-12-08 02:30:00.846194] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.237 [2024-12-08 02:30:00.846302] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.237 [2024-12-08 02:30:00.846330] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.237 [2024-12-08 02:30:00.846348] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.237 [2024-12-08 02:30:00.846361] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.237 [2024-12-08 02:30:00.846391] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.237 qpair failed and we were unable to recover it. 00:27:33.237 [2024-12-08 02:30:00.856278] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.237 [2024-12-08 02:30:00.856366] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.237 [2024-12-08 02:30:00.856392] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.237 [2024-12-08 02:30:00.856416] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.237 [2024-12-08 02:30:00.856430] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.237 [2024-12-08 02:30:00.856459] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.237 qpair failed and we were unable to recover it. 00:27:33.237 [2024-12-08 02:30:00.866246] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.237 [2024-12-08 02:30:00.866339] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.237 [2024-12-08 02:30:00.866364] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.237 [2024-12-08 02:30:00.866378] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.237 [2024-12-08 02:30:00.866392] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.237 [2024-12-08 02:30:00.866420] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.237 qpair failed and we were unable to recover it. 00:27:33.237 [2024-12-08 02:30:00.876291] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.237 [2024-12-08 02:30:00.876396] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.237 [2024-12-08 02:30:00.876422] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.237 [2024-12-08 02:30:00.876437] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.237 [2024-12-08 02:30:00.876451] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.237 [2024-12-08 02:30:00.876479] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.237 qpair failed and we were unable to recover it. 00:27:33.237 [2024-12-08 02:30:00.886368] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.237 [2024-12-08 02:30:00.886470] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.237 [2024-12-08 02:30:00.886495] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.237 [2024-12-08 02:30:00.886510] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.237 [2024-12-08 02:30:00.886523] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.237 [2024-12-08 02:30:00.886559] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.237 qpair failed and we were unable to recover it. 00:27:33.237 [2024-12-08 02:30:00.896284] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.237 [2024-12-08 02:30:00.896363] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.238 [2024-12-08 02:30:00.896389] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.238 [2024-12-08 02:30:00.896403] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.238 [2024-12-08 02:30:00.896416] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.238 [2024-12-08 02:30:00.896446] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.238 qpair failed and we were unable to recover it. 00:27:33.238 [2024-12-08 02:30:00.906337] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.238 [2024-12-08 02:30:00.906431] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.238 [2024-12-08 02:30:00.906457] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.238 [2024-12-08 02:30:00.906472] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.238 [2024-12-08 02:30:00.906485] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.238 [2024-12-08 02:30:00.906513] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.238 qpair failed and we were unable to recover it. 00:27:33.238 [2024-12-08 02:30:00.916382] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.238 [2024-12-08 02:30:00.916502] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.238 [2024-12-08 02:30:00.916531] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.238 [2024-12-08 02:30:00.916554] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.238 [2024-12-08 02:30:00.916568] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.238 [2024-12-08 02:30:00.916596] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.238 qpair failed and we were unable to recover it. 00:27:33.238 [2024-12-08 02:30:00.926380] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.238 [2024-12-08 02:30:00.926463] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.238 [2024-12-08 02:30:00.926488] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.238 [2024-12-08 02:30:00.926503] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.238 [2024-12-08 02:30:00.926522] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.238 [2024-12-08 02:30:00.926559] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.238 qpair failed and we were unable to recover it. 00:27:33.238 [2024-12-08 02:30:00.936491] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.238 [2024-12-08 02:30:00.936589] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.238 [2024-12-08 02:30:00.936615] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.238 [2024-12-08 02:30:00.936630] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.238 [2024-12-08 02:30:00.936644] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.238 [2024-12-08 02:30:00.936673] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.238 qpair failed and we were unable to recover it. 00:27:33.238 [2024-12-08 02:30:00.946433] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.238 [2024-12-08 02:30:00.946522] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.238 [2024-12-08 02:30:00.946555] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.238 [2024-12-08 02:30:00.946570] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.238 [2024-12-08 02:30:00.946584] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.238 [2024-12-08 02:30:00.946615] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.238 qpair failed and we were unable to recover it. 00:27:33.238 [2024-12-08 02:30:00.956490] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.238 [2024-12-08 02:30:00.956591] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.238 [2024-12-08 02:30:00.956618] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.238 [2024-12-08 02:30:00.956639] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.238 [2024-12-08 02:30:00.956653] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.238 [2024-12-08 02:30:00.956683] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.238 qpair failed and we were unable to recover it. 00:27:33.238 [2024-12-08 02:30:00.966491] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.238 [2024-12-08 02:30:00.966585] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.238 [2024-12-08 02:30:00.966611] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.238 [2024-12-08 02:30:00.966626] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.238 [2024-12-08 02:30:00.966639] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.238 [2024-12-08 02:30:00.966669] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.238 qpair failed and we were unable to recover it. 00:27:33.238 [2024-12-08 02:30:00.976610] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.238 [2024-12-08 02:30:00.976697] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.238 [2024-12-08 02:30:00.976722] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.238 [2024-12-08 02:30:00.976737] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.238 [2024-12-08 02:30:00.976750] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.238 [2024-12-08 02:30:00.976779] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.238 qpair failed and we were unable to recover it. 00:27:33.238 [2024-12-08 02:30:00.986668] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.238 [2024-12-08 02:30:00.986794] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.238 [2024-12-08 02:30:00.986819] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.238 [2024-12-08 02:30:00.986834] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.238 [2024-12-08 02:30:00.986847] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.238 [2024-12-08 02:30:00.986875] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.238 qpair failed and we were unable to recover it. 00:27:33.238 [2024-12-08 02:30:00.996587] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.238 [2024-12-08 02:30:00.996682] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.238 [2024-12-08 02:30:00.996708] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.238 [2024-12-08 02:30:00.996723] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.238 [2024-12-08 02:30:00.996736] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.238 [2024-12-08 02:30:00.996765] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.238 qpair failed and we were unable to recover it. 00:27:33.238 [2024-12-08 02:30:01.006640] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.238 [2024-12-08 02:30:01.006729] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.238 [2024-12-08 02:30:01.006754] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.238 [2024-12-08 02:30:01.006769] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.238 [2024-12-08 02:30:01.006783] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.238 [2024-12-08 02:30:01.006813] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.238 qpair failed and we were unable to recover it. 00:27:33.497 [2024-12-08 02:30:01.016637] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.497 [2024-12-08 02:30:01.016721] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.497 [2024-12-08 02:30:01.016748] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.497 [2024-12-08 02:30:01.016769] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.497 [2024-12-08 02:30:01.016783] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.497 [2024-12-08 02:30:01.016812] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.497 qpair failed and we were unable to recover it. 00:27:33.497 [2024-12-08 02:30:01.026774] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.497 [2024-12-08 02:30:01.026868] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.497 [2024-12-08 02:30:01.026893] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.497 [2024-12-08 02:30:01.026908] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.497 [2024-12-08 02:30:01.026921] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.497 [2024-12-08 02:30:01.026950] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.497 qpair failed and we were unable to recover it. 00:27:33.497 [2024-12-08 02:30:01.036853] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.497 [2024-12-08 02:30:01.036979] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.497 [2024-12-08 02:30:01.037005] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.497 [2024-12-08 02:30:01.037019] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.497 [2024-12-08 02:30:01.037032] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.497 [2024-12-08 02:30:01.037060] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.497 qpair failed and we were unable to recover it. 00:27:33.497 [2024-12-08 02:30:01.046755] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.497 [2024-12-08 02:30:01.046843] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.497 [2024-12-08 02:30:01.046868] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.497 [2024-12-08 02:30:01.046883] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.497 [2024-12-08 02:30:01.046896] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.497 [2024-12-08 02:30:01.046924] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.497 qpair failed and we were unable to recover it. 00:27:33.497 [2024-12-08 02:30:01.056765] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.497 [2024-12-08 02:30:01.056890] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.498 [2024-12-08 02:30:01.056920] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.498 [2024-12-08 02:30:01.056938] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.498 [2024-12-08 02:30:01.056952] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.498 [2024-12-08 02:30:01.056981] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.498 qpair failed and we were unable to recover it. 00:27:33.498 [2024-12-08 02:30:01.066795] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.498 [2024-12-08 02:30:01.066891] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.498 [2024-12-08 02:30:01.066916] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.498 [2024-12-08 02:30:01.066931] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.498 [2024-12-08 02:30:01.066945] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.498 [2024-12-08 02:30:01.066973] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.498 qpair failed and we were unable to recover it. 00:27:33.498 [2024-12-08 02:30:01.076847] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.498 [2024-12-08 02:30:01.076935] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.498 [2024-12-08 02:30:01.076961] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.498 [2024-12-08 02:30:01.076975] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.498 [2024-12-08 02:30:01.076989] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.498 [2024-12-08 02:30:01.077018] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.498 qpair failed and we were unable to recover it. 00:27:33.498 [2024-12-08 02:30:01.086896] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.498 [2024-12-08 02:30:01.086990] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.498 [2024-12-08 02:30:01.087016] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.498 [2024-12-08 02:30:01.087030] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.498 [2024-12-08 02:30:01.087044] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.498 [2024-12-08 02:30:01.087072] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.498 qpair failed and we were unable to recover it. 00:27:33.498 [2024-12-08 02:30:01.096869] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.498 [2024-12-08 02:30:01.096967] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.498 [2024-12-08 02:30:01.096996] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.498 [2024-12-08 02:30:01.097013] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.498 [2024-12-08 02:30:01.097026] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.498 [2024-12-08 02:30:01.097056] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.498 qpair failed and we were unable to recover it. 00:27:33.498 [2024-12-08 02:30:01.107006] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.498 [2024-12-08 02:30:01.107103] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.498 [2024-12-08 02:30:01.107129] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.498 [2024-12-08 02:30:01.107150] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.498 [2024-12-08 02:30:01.107166] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.498 [2024-12-08 02:30:01.107196] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.498 qpair failed and we were unable to recover it. 00:27:33.498 [2024-12-08 02:30:01.116962] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.498 [2024-12-08 02:30:01.117051] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.498 [2024-12-08 02:30:01.117077] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.498 [2024-12-08 02:30:01.117092] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.498 [2024-12-08 02:30:01.117105] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.498 [2024-12-08 02:30:01.117134] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.498 qpair failed and we were unable to recover it. 00:27:33.498 [2024-12-08 02:30:01.126983] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.498 [2024-12-08 02:30:01.127063] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.498 [2024-12-08 02:30:01.127089] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.498 [2024-12-08 02:30:01.127103] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.498 [2024-12-08 02:30:01.127116] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.498 [2024-12-08 02:30:01.127145] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.498 qpair failed and we were unable to recover it. 00:27:33.498 [2024-12-08 02:30:01.137048] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.498 [2024-12-08 02:30:01.137138] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.498 [2024-12-08 02:30:01.137164] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.498 [2024-12-08 02:30:01.137179] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.498 [2024-12-08 02:30:01.137192] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.498 [2024-12-08 02:30:01.137220] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.498 qpair failed and we were unable to recover it. 00:27:33.498 [2024-12-08 02:30:01.147059] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.498 [2024-12-08 02:30:01.147182] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.498 [2024-12-08 02:30:01.147207] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.498 [2024-12-08 02:30:01.147221] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.498 [2024-12-08 02:30:01.147235] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.498 [2024-12-08 02:30:01.147263] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.498 qpair failed and we were unable to recover it. 00:27:33.499 [2024-12-08 02:30:01.157048] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.499 [2024-12-08 02:30:01.157141] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.499 [2024-12-08 02:30:01.157166] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.499 [2024-12-08 02:30:01.157181] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.499 [2024-12-08 02:30:01.157194] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.499 [2024-12-08 02:30:01.157222] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.499 qpair failed and we were unable to recover it. 00:27:33.499 [2024-12-08 02:30:01.167170] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.499 [2024-12-08 02:30:01.167254] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.499 [2024-12-08 02:30:01.167280] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.499 [2024-12-08 02:30:01.167294] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.499 [2024-12-08 02:30:01.167308] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.499 [2024-12-08 02:30:01.167336] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.499 qpair failed and we were unable to recover it. 00:27:33.499 [2024-12-08 02:30:01.177128] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.499 [2024-12-08 02:30:01.177236] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.499 [2024-12-08 02:30:01.177261] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.499 [2024-12-08 02:30:01.177275] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.499 [2024-12-08 02:30:01.177288] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.499 [2024-12-08 02:30:01.177317] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.499 qpair failed and we were unable to recover it. 00:27:33.499 [2024-12-08 02:30:01.187134] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.499 [2024-12-08 02:30:01.187226] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.499 [2024-12-08 02:30:01.187252] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.499 [2024-12-08 02:30:01.187267] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.499 [2024-12-08 02:30:01.187280] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.499 [2024-12-08 02:30:01.187308] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.499 qpair failed and we were unable to recover it. 00:27:33.499 [2024-12-08 02:30:01.197164] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.499 [2024-12-08 02:30:01.197251] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.499 [2024-12-08 02:30:01.197276] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.499 [2024-12-08 02:30:01.197298] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.499 [2024-12-08 02:30:01.197312] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.499 [2024-12-08 02:30:01.197341] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.499 qpair failed and we were unable to recover it. 00:27:33.499 [2024-12-08 02:30:01.207208] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.499 [2024-12-08 02:30:01.207329] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.499 [2024-12-08 02:30:01.207354] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.499 [2024-12-08 02:30:01.207369] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.499 [2024-12-08 02:30:01.207382] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.499 [2024-12-08 02:30:01.207411] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.499 qpair failed and we were unable to recover it. 00:27:33.499 [2024-12-08 02:30:01.217213] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.499 [2024-12-08 02:30:01.217304] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.499 [2024-12-08 02:30:01.217329] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.499 [2024-12-08 02:30:01.217344] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.499 [2024-12-08 02:30:01.217357] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.499 [2024-12-08 02:30:01.217385] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.499 qpair failed and we were unable to recover it. 00:27:33.499 [2024-12-08 02:30:01.227300] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.499 [2024-12-08 02:30:01.227390] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.499 [2024-12-08 02:30:01.227416] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.499 [2024-12-08 02:30:01.227430] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.499 [2024-12-08 02:30:01.227459] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.499 [2024-12-08 02:30:01.227493] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.499 qpair failed and we were unable to recover it. 00:27:33.499 [2024-12-08 02:30:01.237295] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.499 [2024-12-08 02:30:01.237381] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.499 [2024-12-08 02:30:01.237406] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.499 [2024-12-08 02:30:01.237420] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.499 [2024-12-08 02:30:01.237433] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.499 [2024-12-08 02:30:01.237463] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.499 qpair failed and we were unable to recover it. 00:27:33.499 [2024-12-08 02:30:01.247306] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.499 [2024-12-08 02:30:01.247392] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.499 [2024-12-08 02:30:01.247417] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.499 [2024-12-08 02:30:01.247432] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.499 [2024-12-08 02:30:01.247446] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.500 [2024-12-08 02:30:01.247476] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.500 qpair failed and we were unable to recover it. 00:27:33.500 [2024-12-08 02:30:01.257353] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.500 [2024-12-08 02:30:01.257442] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.500 [2024-12-08 02:30:01.257468] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.500 [2024-12-08 02:30:01.257483] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.500 [2024-12-08 02:30:01.257496] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.500 [2024-12-08 02:30:01.257524] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.500 qpair failed and we were unable to recover it. 00:27:33.500 [2024-12-08 02:30:01.267397] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.500 [2024-12-08 02:30:01.267491] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.500 [2024-12-08 02:30:01.267520] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.500 [2024-12-08 02:30:01.267548] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.500 [2024-12-08 02:30:01.267567] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.500 [2024-12-08 02:30:01.267598] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.500 qpair failed and we were unable to recover it. 00:27:33.760 [2024-12-08 02:30:01.277396] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.760 [2024-12-08 02:30:01.277483] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.760 [2024-12-08 02:30:01.277509] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.760 [2024-12-08 02:30:01.277532] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.760 [2024-12-08 02:30:01.277554] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.760 [2024-12-08 02:30:01.277585] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.760 qpair failed and we were unable to recover it. 00:27:33.760 [2024-12-08 02:30:01.287419] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.760 [2024-12-08 02:30:01.287502] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.760 [2024-12-08 02:30:01.287542] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.760 [2024-12-08 02:30:01.287565] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.760 [2024-12-08 02:30:01.287579] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.760 [2024-12-08 02:30:01.287608] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.760 qpair failed and we were unable to recover it. 00:27:33.760 [2024-12-08 02:30:01.297558] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.760 [2024-12-08 02:30:01.297674] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.760 [2024-12-08 02:30:01.297700] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.760 [2024-12-08 02:30:01.297714] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.760 [2024-12-08 02:30:01.297728] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.760 [2024-12-08 02:30:01.297756] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.760 qpair failed and we were unable to recover it. 00:27:33.760 [2024-12-08 02:30:01.307494] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.760 [2024-12-08 02:30:01.307603] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.760 [2024-12-08 02:30:01.307629] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.760 [2024-12-08 02:30:01.307644] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.760 [2024-12-08 02:30:01.307657] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.760 [2024-12-08 02:30:01.307686] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.760 qpair failed and we were unable to recover it. 00:27:33.760 [2024-12-08 02:30:01.317504] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.760 [2024-12-08 02:30:01.317600] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.760 [2024-12-08 02:30:01.317625] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.760 [2024-12-08 02:30:01.317640] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.760 [2024-12-08 02:30:01.317653] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.760 [2024-12-08 02:30:01.317683] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.760 qpair failed and we were unable to recover it. 00:27:33.760 [2024-12-08 02:30:01.327547] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.760 [2024-12-08 02:30:01.327635] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.760 [2024-12-08 02:30:01.327660] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.760 [2024-12-08 02:30:01.327674] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.760 [2024-12-08 02:30:01.327687] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.760 [2024-12-08 02:30:01.327715] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.760 qpair failed and we were unable to recover it. 00:27:33.760 [2024-12-08 02:30:01.337576] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.760 [2024-12-08 02:30:01.337663] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.760 [2024-12-08 02:30:01.337688] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.760 [2024-12-08 02:30:01.337703] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.760 [2024-12-08 02:30:01.337716] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.760 [2024-12-08 02:30:01.337744] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.760 qpair failed and we were unable to recover it. 00:27:33.760 [2024-12-08 02:30:01.347676] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.760 [2024-12-08 02:30:01.347786] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.760 [2024-12-08 02:30:01.347812] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.760 [2024-12-08 02:30:01.347826] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.760 [2024-12-08 02:30:01.347840] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.760 [2024-12-08 02:30:01.347868] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.760 qpair failed and we were unable to recover it. 00:27:33.760 [2024-12-08 02:30:01.357634] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.760 [2024-12-08 02:30:01.357723] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.760 [2024-12-08 02:30:01.357748] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.760 [2024-12-08 02:30:01.357765] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.761 [2024-12-08 02:30:01.357778] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.761 [2024-12-08 02:30:01.357806] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.761 qpair failed and we were unable to recover it. 00:27:33.761 [2024-12-08 02:30:01.367678] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.761 [2024-12-08 02:30:01.367765] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.761 [2024-12-08 02:30:01.367791] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.761 [2024-12-08 02:30:01.367806] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.761 [2024-12-08 02:30:01.367819] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.761 [2024-12-08 02:30:01.367847] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.761 qpair failed and we were unable to recover it. 00:27:33.761 [2024-12-08 02:30:01.377704] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.761 [2024-12-08 02:30:01.377789] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.761 [2024-12-08 02:30:01.377820] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.761 [2024-12-08 02:30:01.377835] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.761 [2024-12-08 02:30:01.377848] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.761 [2024-12-08 02:30:01.377877] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.761 qpair failed and we were unable to recover it. 00:27:33.761 [2024-12-08 02:30:01.387727] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.761 [2024-12-08 02:30:01.387814] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.761 [2024-12-08 02:30:01.387839] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.761 [2024-12-08 02:30:01.387854] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.761 [2024-12-08 02:30:01.387867] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.761 [2024-12-08 02:30:01.387895] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.761 qpair failed and we were unable to recover it. 00:27:33.761 [2024-12-08 02:30:01.397775] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.761 [2024-12-08 02:30:01.397864] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.761 [2024-12-08 02:30:01.397890] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.761 [2024-12-08 02:30:01.397904] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.761 [2024-12-08 02:30:01.397917] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.761 [2024-12-08 02:30:01.397945] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.761 qpair failed and we were unable to recover it. 00:27:33.761 [2024-12-08 02:30:01.407817] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.761 [2024-12-08 02:30:01.407923] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.761 [2024-12-08 02:30:01.407947] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.761 [2024-12-08 02:30:01.407961] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.761 [2024-12-08 02:30:01.407973] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.761 [2024-12-08 02:30:01.408000] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.761 qpair failed and we were unable to recover it. 00:27:33.761 [2024-12-08 02:30:01.417868] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.761 [2024-12-08 02:30:01.417956] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.761 [2024-12-08 02:30:01.417982] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.761 [2024-12-08 02:30:01.417997] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.761 [2024-12-08 02:30:01.418010] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.761 [2024-12-08 02:30:01.418038] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.761 qpair failed and we were unable to recover it. 00:27:33.761 [2024-12-08 02:30:01.427927] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.761 [2024-12-08 02:30:01.428027] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.761 [2024-12-08 02:30:01.428052] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.761 [2024-12-08 02:30:01.428067] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.761 [2024-12-08 02:30:01.428080] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.761 [2024-12-08 02:30:01.428108] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.761 qpair failed and we were unable to recover it. 00:27:33.761 [2024-12-08 02:30:01.437875] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.761 [2024-12-08 02:30:01.437961] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.761 [2024-12-08 02:30:01.437986] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.761 [2024-12-08 02:30:01.438001] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.761 [2024-12-08 02:30:01.438015] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.761 [2024-12-08 02:30:01.438043] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.761 qpair failed and we were unable to recover it. 00:27:33.761 [2024-12-08 02:30:01.447888] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.761 [2024-12-08 02:30:01.447978] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.761 [2024-12-08 02:30:01.448003] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.761 [2024-12-08 02:30:01.448017] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.761 [2024-12-08 02:30:01.448030] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.761 [2024-12-08 02:30:01.448059] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.761 qpair failed and we were unable to recover it. 00:27:33.761 [2024-12-08 02:30:01.458026] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.761 [2024-12-08 02:30:01.458114] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.761 [2024-12-08 02:30:01.458140] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.761 [2024-12-08 02:30:01.458155] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.761 [2024-12-08 02:30:01.458168] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.761 [2024-12-08 02:30:01.458196] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.761 qpair failed and we were unable to recover it. 00:27:33.761 [2024-12-08 02:30:01.468047] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.761 [2024-12-08 02:30:01.468138] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.761 [2024-12-08 02:30:01.468168] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.761 [2024-12-08 02:30:01.468184] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.761 [2024-12-08 02:30:01.468197] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.761 [2024-12-08 02:30:01.468226] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.761 qpair failed and we were unable to recover it. 00:27:33.761 [2024-12-08 02:30:01.478039] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.761 [2024-12-08 02:30:01.478162] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.761 [2024-12-08 02:30:01.478188] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.761 [2024-12-08 02:30:01.478202] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.761 [2024-12-08 02:30:01.478215] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.761 [2024-12-08 02:30:01.478243] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.761 qpair failed and we were unable to recover it. 00:27:33.761 [2024-12-08 02:30:01.488001] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.761 [2024-12-08 02:30:01.488089] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.761 [2024-12-08 02:30:01.488114] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.761 [2024-12-08 02:30:01.488130] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.761 [2024-12-08 02:30:01.488144] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.761 [2024-12-08 02:30:01.488171] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.761 qpair failed and we were unable to recover it. 00:27:33.761 [2024-12-08 02:30:01.498071] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.761 [2024-12-08 02:30:01.498162] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.761 [2024-12-08 02:30:01.498188] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.761 [2024-12-08 02:30:01.498202] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.761 [2024-12-08 02:30:01.498215] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.761 [2024-12-08 02:30:01.498244] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.761 qpair failed and we were unable to recover it. 00:27:33.761 [2024-12-08 02:30:01.508127] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.761 [2024-12-08 02:30:01.508228] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.761 [2024-12-08 02:30:01.508254] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.761 [2024-12-08 02:30:01.508269] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.761 [2024-12-08 02:30:01.508282] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.761 [2024-12-08 02:30:01.508317] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.761 qpair failed and we were unable to recover it. 00:27:33.761 [2024-12-08 02:30:01.518094] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.761 [2024-12-08 02:30:01.518223] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.761 [2024-12-08 02:30:01.518249] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.761 [2024-12-08 02:30:01.518264] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.761 [2024-12-08 02:30:01.518277] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.761 [2024-12-08 02:30:01.518306] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.761 qpair failed and we were unable to recover it. 00:27:33.761 [2024-12-08 02:30:01.528166] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.761 [2024-12-08 02:30:01.528256] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.761 [2024-12-08 02:30:01.528281] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.761 [2024-12-08 02:30:01.528296] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.761 [2024-12-08 02:30:01.528309] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.761 [2024-12-08 02:30:01.528338] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.761 qpair failed and we were unable to recover it. 00:27:33.761 [2024-12-08 02:30:01.538176] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:33.761 [2024-12-08 02:30:01.538290] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:33.761 [2024-12-08 02:30:01.538315] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:33.761 [2024-12-08 02:30:01.538330] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:33.761 [2024-12-08 02:30:01.538343] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:33.761 [2024-12-08 02:30:01.538372] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:33.761 qpair failed and we were unable to recover it. 00:27:34.021 [2024-12-08 02:30:01.548271] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.021 [2024-12-08 02:30:01.548366] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.021 [2024-12-08 02:30:01.548391] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.021 [2024-12-08 02:30:01.548406] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.021 [2024-12-08 02:30:01.548419] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.021 [2024-12-08 02:30:01.548447] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.021 qpair failed and we were unable to recover it. 00:27:34.021 [2024-12-08 02:30:01.558307] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.021 [2024-12-08 02:30:01.558405] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.021 [2024-12-08 02:30:01.558436] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.021 [2024-12-08 02:30:01.558451] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.021 [2024-12-08 02:30:01.558464] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.021 [2024-12-08 02:30:01.558493] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.021 qpair failed and we were unable to recover it. 00:27:34.021 [2024-12-08 02:30:01.568327] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.021 [2024-12-08 02:30:01.568409] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.021 [2024-12-08 02:30:01.568435] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.021 [2024-12-08 02:30:01.568449] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.021 [2024-12-08 02:30:01.568462] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.021 [2024-12-08 02:30:01.568490] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.021 qpair failed and we were unable to recover it. 00:27:34.021 [2024-12-08 02:30:01.578364] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.021 [2024-12-08 02:30:01.578448] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.021 [2024-12-08 02:30:01.578473] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.021 [2024-12-08 02:30:01.578488] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.021 [2024-12-08 02:30:01.578501] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.021 [2024-12-08 02:30:01.578529] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.021 qpair failed and we were unable to recover it. 00:27:34.021 [2024-12-08 02:30:01.588310] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.021 [2024-12-08 02:30:01.588402] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.021 [2024-12-08 02:30:01.588427] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.021 [2024-12-08 02:30:01.588442] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.021 [2024-12-08 02:30:01.588456] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.021 [2024-12-08 02:30:01.588486] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.021 qpair failed and we were unable to recover it. 00:27:34.021 [2024-12-08 02:30:01.598348] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.021 [2024-12-08 02:30:01.598443] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.021 [2024-12-08 02:30:01.598469] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.021 [2024-12-08 02:30:01.598484] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.021 [2024-12-08 02:30:01.598498] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.021 [2024-12-08 02:30:01.598532] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.021 qpair failed and we were unable to recover it. 00:27:34.021 [2024-12-08 02:30:01.608342] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.021 [2024-12-08 02:30:01.608438] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.021 [2024-12-08 02:30:01.608463] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.021 [2024-12-08 02:30:01.608477] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.021 [2024-12-08 02:30:01.608490] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.021 [2024-12-08 02:30:01.608519] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.021 qpair failed and we were unable to recover it. 00:27:34.021 [2024-12-08 02:30:01.618467] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.021 [2024-12-08 02:30:01.618600] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.021 [2024-12-08 02:30:01.618625] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.021 [2024-12-08 02:30:01.618640] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.021 [2024-12-08 02:30:01.618653] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.021 [2024-12-08 02:30:01.618682] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.021 qpair failed and we were unable to recover it. 00:27:34.021 [2024-12-08 02:30:01.628453] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.021 [2024-12-08 02:30:01.628564] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.021 [2024-12-08 02:30:01.628590] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.021 [2024-12-08 02:30:01.628605] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.021 [2024-12-08 02:30:01.628618] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.022 [2024-12-08 02:30:01.628646] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.022 qpair failed and we were unable to recover it. 00:27:34.022 [2024-12-08 02:30:01.638478] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.022 [2024-12-08 02:30:01.638570] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.022 [2024-12-08 02:30:01.638595] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.022 [2024-12-08 02:30:01.638610] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.022 [2024-12-08 02:30:01.638622] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.022 [2024-12-08 02:30:01.638653] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.022 qpair failed and we were unable to recover it. 00:27:34.022 [2024-12-08 02:30:01.648618] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.022 [2024-12-08 02:30:01.648739] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.022 [2024-12-08 02:30:01.648770] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.022 [2024-12-08 02:30:01.648786] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.022 [2024-12-08 02:30:01.648799] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.022 [2024-12-08 02:30:01.648828] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.022 qpair failed and we were unable to recover it. 00:27:34.022 [2024-12-08 02:30:01.658541] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.022 [2024-12-08 02:30:01.658627] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.022 [2024-12-08 02:30:01.658652] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.022 [2024-12-08 02:30:01.658666] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.022 [2024-12-08 02:30:01.658679] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.022 [2024-12-08 02:30:01.658707] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.022 qpair failed and we were unable to recover it. 00:27:34.022 [2024-12-08 02:30:01.668566] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.022 [2024-12-08 02:30:01.668659] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.022 [2024-12-08 02:30:01.668684] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.022 [2024-12-08 02:30:01.668698] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.022 [2024-12-08 02:30:01.668712] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.022 [2024-12-08 02:30:01.668743] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.022 qpair failed and we were unable to recover it. 00:27:34.022 [2024-12-08 02:30:01.678589] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.022 [2024-12-08 02:30:01.678686] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.022 [2024-12-08 02:30:01.678716] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.022 [2024-12-08 02:30:01.678733] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.022 [2024-12-08 02:30:01.678747] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.022 [2024-12-08 02:30:01.678778] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.022 qpair failed and we were unable to recover it. 00:27:34.022 [2024-12-08 02:30:01.688614] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.022 [2024-12-08 02:30:01.688697] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.022 [2024-12-08 02:30:01.688723] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.022 [2024-12-08 02:30:01.688737] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.022 [2024-12-08 02:30:01.688750] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.022 [2024-12-08 02:30:01.688786] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.022 qpair failed and we were unable to recover it. 00:27:34.022 [2024-12-08 02:30:01.698643] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.022 [2024-12-08 02:30:01.698749] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.022 [2024-12-08 02:30:01.698775] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.022 [2024-12-08 02:30:01.698789] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.022 [2024-12-08 02:30:01.698803] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.022 [2024-12-08 02:30:01.698832] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.022 qpair failed and we were unable to recover it. 00:27:34.022 [2024-12-08 02:30:01.708676] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.022 [2024-12-08 02:30:01.708761] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.022 [2024-12-08 02:30:01.708786] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.022 [2024-12-08 02:30:01.708800] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.022 [2024-12-08 02:30:01.708813] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.022 [2024-12-08 02:30:01.708842] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.022 qpair failed and we were unable to recover it. 00:27:34.022 [2024-12-08 02:30:01.718700] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.022 [2024-12-08 02:30:01.718786] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.022 [2024-12-08 02:30:01.718811] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.022 [2024-12-08 02:30:01.718826] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.022 [2024-12-08 02:30:01.718839] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.022 [2024-12-08 02:30:01.718867] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.022 qpair failed and we were unable to recover it. 00:27:34.022 [2024-12-08 02:30:01.728842] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.022 [2024-12-08 02:30:01.728927] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.022 [2024-12-08 02:30:01.728952] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.022 [2024-12-08 02:30:01.728967] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.022 [2024-12-08 02:30:01.728980] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.022 [2024-12-08 02:30:01.729008] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.022 qpair failed and we were unable to recover it. 00:27:34.022 [2024-12-08 02:30:01.738754] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.022 [2024-12-08 02:30:01.738841] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.022 [2024-12-08 02:30:01.738875] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.022 [2024-12-08 02:30:01.738890] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.022 [2024-12-08 02:30:01.738904] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.022 [2024-12-08 02:30:01.738932] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.022 qpair failed and we were unable to recover it. 00:27:34.022 [2024-12-08 02:30:01.748806] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.022 [2024-12-08 02:30:01.748912] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.022 [2024-12-08 02:30:01.748937] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.022 [2024-12-08 02:30:01.748952] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.022 [2024-12-08 02:30:01.748965] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.022 [2024-12-08 02:30:01.748993] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.022 qpair failed and we were unable to recover it. 00:27:34.022 [2024-12-08 02:30:01.758817] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.022 [2024-12-08 02:30:01.758921] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.022 [2024-12-08 02:30:01.758947] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.022 [2024-12-08 02:30:01.758962] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.022 [2024-12-08 02:30:01.758975] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.022 [2024-12-08 02:30:01.759003] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.022 qpair failed and we were unable to recover it. 00:27:34.022 [2024-12-08 02:30:01.768840] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.023 [2024-12-08 02:30:01.768934] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.023 [2024-12-08 02:30:01.768960] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.023 [2024-12-08 02:30:01.768974] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.023 [2024-12-08 02:30:01.768988] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.023 [2024-12-08 02:30:01.769016] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.023 qpair failed and we were unable to recover it. 00:27:34.023 [2024-12-08 02:30:01.778853] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.023 [2024-12-08 02:30:01.778974] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.023 [2024-12-08 02:30:01.778999] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.023 [2024-12-08 02:30:01.779013] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.023 [2024-12-08 02:30:01.779026] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.023 [2024-12-08 02:30:01.779060] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.023 qpair failed and we were unable to recover it. 00:27:34.023 [2024-12-08 02:30:01.788907] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.023 [2024-12-08 02:30:01.788997] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.023 [2024-12-08 02:30:01.789023] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.023 [2024-12-08 02:30:01.789038] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.023 [2024-12-08 02:30:01.789051] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.023 [2024-12-08 02:30:01.789079] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.023 qpair failed and we were unable to recover it. 00:27:34.023 [2024-12-08 02:30:01.798961] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.023 [2024-12-08 02:30:01.799062] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.023 [2024-12-08 02:30:01.799088] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.023 [2024-12-08 02:30:01.799103] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.023 [2024-12-08 02:30:01.799116] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.023 [2024-12-08 02:30:01.799144] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.023 qpair failed and we were unable to recover it. 00:27:34.282 [2024-12-08 02:30:01.808956] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.282 [2024-12-08 02:30:01.809045] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.282 [2024-12-08 02:30:01.809070] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.282 [2024-12-08 02:30:01.809085] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.282 [2024-12-08 02:30:01.809099] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.282 [2024-12-08 02:30:01.809127] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.282 qpair failed and we were unable to recover it. 00:27:34.282 [2024-12-08 02:30:01.818980] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.282 [2024-12-08 02:30:01.819101] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.282 [2024-12-08 02:30:01.819126] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.282 [2024-12-08 02:30:01.819140] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.282 [2024-12-08 02:30:01.819153] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.282 [2024-12-08 02:30:01.819182] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.282 qpair failed and we were unable to recover it. 00:27:34.282 [2024-12-08 02:30:01.829084] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.282 [2024-12-08 02:30:01.829174] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.282 [2024-12-08 02:30:01.829214] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.282 [2024-12-08 02:30:01.829229] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.282 [2024-12-08 02:30:01.829243] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.282 [2024-12-08 02:30:01.829270] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.282 qpair failed and we were unable to recover it. 00:27:34.282 [2024-12-08 02:30:01.839048] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.282 [2024-12-08 02:30:01.839137] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.282 [2024-12-08 02:30:01.839163] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.282 [2024-12-08 02:30:01.839178] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.282 [2024-12-08 02:30:01.839191] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.282 [2024-12-08 02:30:01.839219] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.282 qpair failed and we were unable to recover it. 00:27:34.282 [2024-12-08 02:30:01.849118] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.282 [2024-12-08 02:30:01.849202] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.282 [2024-12-08 02:30:01.849228] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.282 [2024-12-08 02:30:01.849242] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.282 [2024-12-08 02:30:01.849256] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.282 [2024-12-08 02:30:01.849284] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.282 qpair failed and we were unable to recover it. 00:27:34.282 [2024-12-08 02:30:01.859109] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.282 [2024-12-08 02:30:01.859221] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.282 [2024-12-08 02:30:01.859246] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.282 [2024-12-08 02:30:01.859261] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.282 [2024-12-08 02:30:01.859274] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.282 [2024-12-08 02:30:01.859302] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.282 qpair failed and we were unable to recover it. 00:27:34.282 [2024-12-08 02:30:01.869212] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.282 [2024-12-08 02:30:01.869301] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.282 [2024-12-08 02:30:01.869327] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.282 [2024-12-08 02:30:01.869341] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.282 [2024-12-08 02:30:01.869360] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.282 [2024-12-08 02:30:01.869388] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.282 qpair failed and we were unable to recover it. 00:27:34.282 [2024-12-08 02:30:01.879199] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.282 [2024-12-08 02:30:01.879283] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.282 [2024-12-08 02:30:01.879308] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.282 [2024-12-08 02:30:01.879322] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.282 [2024-12-08 02:30:01.879336] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.282 [2024-12-08 02:30:01.879364] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.282 qpair failed and we were unable to recover it. 00:27:34.282 [2024-12-08 02:30:01.889208] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.282 [2024-12-08 02:30:01.889294] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.282 [2024-12-08 02:30:01.889319] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.282 [2024-12-08 02:30:01.889333] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.282 [2024-12-08 02:30:01.889347] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.282 [2024-12-08 02:30:01.889375] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.282 qpair failed and we were unable to recover it. 00:27:34.282 [2024-12-08 02:30:01.899216] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.282 [2024-12-08 02:30:01.899313] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.282 [2024-12-08 02:30:01.899339] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.282 [2024-12-08 02:30:01.899354] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.282 [2024-12-08 02:30:01.899367] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.282 [2024-12-08 02:30:01.899395] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.282 qpair failed and we were unable to recover it. 00:27:34.282 [2024-12-08 02:30:01.909247] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.282 [2024-12-08 02:30:01.909388] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.282 [2024-12-08 02:30:01.909417] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.282 [2024-12-08 02:30:01.909434] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.282 [2024-12-08 02:30:01.909447] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.282 [2024-12-08 02:30:01.909476] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.282 qpair failed and we were unable to recover it. 00:27:34.282 [2024-12-08 02:30:01.919330] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.282 [2024-12-08 02:30:01.919422] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.282 [2024-12-08 02:30:01.919448] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.282 [2024-12-08 02:30:01.919463] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.282 [2024-12-08 02:30:01.919477] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.282 [2024-12-08 02:30:01.919505] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.282 qpair failed and we were unable to recover it. 00:27:34.282 [2024-12-08 02:30:01.929290] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.282 [2024-12-08 02:30:01.929371] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.282 [2024-12-08 02:30:01.929396] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.282 [2024-12-08 02:30:01.929411] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.282 [2024-12-08 02:30:01.929424] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.282 [2024-12-08 02:30:01.929453] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.282 qpair failed and we were unable to recover it. 00:27:34.282 [2024-12-08 02:30:01.939341] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.282 [2024-12-08 02:30:01.939431] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.282 [2024-12-08 02:30:01.939457] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.282 [2024-12-08 02:30:01.939471] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.282 [2024-12-08 02:30:01.939484] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.282 [2024-12-08 02:30:01.939512] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.282 qpair failed and we were unable to recover it. 00:27:34.282 [2024-12-08 02:30:01.949349] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.282 [2024-12-08 02:30:01.949438] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.282 [2024-12-08 02:30:01.949463] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.282 [2024-12-08 02:30:01.949478] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.282 [2024-12-08 02:30:01.949492] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.282 [2024-12-08 02:30:01.949520] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.282 qpair failed and we were unable to recover it. 00:27:34.282 [2024-12-08 02:30:01.959384] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.282 [2024-12-08 02:30:01.959477] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.282 [2024-12-08 02:30:01.959502] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.282 [2024-12-08 02:30:01.959516] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.282 [2024-12-08 02:30:01.959542] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.282 [2024-12-08 02:30:01.959574] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.282 qpair failed and we were unable to recover it. 00:27:34.282 [2024-12-08 02:30:01.969407] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.282 [2024-12-08 02:30:01.969489] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.282 [2024-12-08 02:30:01.969514] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.282 [2024-12-08 02:30:01.969528] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.282 [2024-12-08 02:30:01.969549] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.282 [2024-12-08 02:30:01.969579] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.282 qpair failed and we were unable to recover it. 00:27:34.282 [2024-12-08 02:30:01.979427] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.282 [2024-12-08 02:30:01.979564] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.282 [2024-12-08 02:30:01.979590] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.282 [2024-12-08 02:30:01.979605] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.283 [2024-12-08 02:30:01.979618] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.283 [2024-12-08 02:30:01.979646] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.283 qpair failed and we were unable to recover it. 00:27:34.283 [2024-12-08 02:30:01.989513] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.283 [2024-12-08 02:30:01.989660] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.283 [2024-12-08 02:30:01.989685] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.283 [2024-12-08 02:30:01.989700] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.283 [2024-12-08 02:30:01.989713] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.283 [2024-12-08 02:30:01.989742] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.283 qpair failed and we were unable to recover it. 00:27:34.283 [2024-12-08 02:30:01.999508] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.283 [2024-12-08 02:30:01.999613] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.283 [2024-12-08 02:30:01.999639] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.283 [2024-12-08 02:30:01.999653] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.283 [2024-12-08 02:30:01.999667] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.283 [2024-12-08 02:30:01.999695] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.283 qpair failed and we were unable to recover it. 00:27:34.283 [2024-12-08 02:30:02.009502] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.283 [2024-12-08 02:30:02.009600] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.283 [2024-12-08 02:30:02.009625] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.283 [2024-12-08 02:30:02.009640] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.283 [2024-12-08 02:30:02.009653] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.283 [2024-12-08 02:30:02.009681] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.283 qpair failed and we were unable to recover it. 00:27:34.283 [2024-12-08 02:30:02.019548] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.283 [2024-12-08 02:30:02.019638] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.283 [2024-12-08 02:30:02.019664] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.283 [2024-12-08 02:30:02.019678] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.283 [2024-12-08 02:30:02.019692] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.283 [2024-12-08 02:30:02.019720] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.283 qpair failed and we were unable to recover it. 00:27:34.283 [2024-12-08 02:30:02.029698] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.283 [2024-12-08 02:30:02.029830] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.283 [2024-12-08 02:30:02.029856] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.283 [2024-12-08 02:30:02.029870] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.283 [2024-12-08 02:30:02.029884] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.283 [2024-12-08 02:30:02.029912] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.283 qpair failed and we were unable to recover it. 00:27:34.283 [2024-12-08 02:30:02.039607] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.283 [2024-12-08 02:30:02.039700] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.283 [2024-12-08 02:30:02.039727] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.283 [2024-12-08 02:30:02.039742] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.283 [2024-12-08 02:30:02.039755] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.283 [2024-12-08 02:30:02.039784] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.283 qpair failed and we were unable to recover it. 00:27:34.283 [2024-12-08 02:30:02.049651] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.283 [2024-12-08 02:30:02.049732] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.283 [2024-12-08 02:30:02.049758] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.283 [2024-12-08 02:30:02.049773] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.283 [2024-12-08 02:30:02.049792] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.283 [2024-12-08 02:30:02.049823] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.283 qpair failed and we were unable to recover it. 00:27:34.283 [2024-12-08 02:30:02.059772] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.283 [2024-12-08 02:30:02.059859] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.283 [2024-12-08 02:30:02.059885] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.283 [2024-12-08 02:30:02.059900] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.283 [2024-12-08 02:30:02.059913] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.283 [2024-12-08 02:30:02.059942] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.283 qpair failed and we were unable to recover it. 00:27:34.543 [2024-12-08 02:30:02.069698] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.543 [2024-12-08 02:30:02.069823] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.543 [2024-12-08 02:30:02.069849] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.543 [2024-12-08 02:30:02.069864] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.543 [2024-12-08 02:30:02.069877] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.543 [2024-12-08 02:30:02.069906] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.544 qpair failed and we were unable to recover it. 00:27:34.544 [2024-12-08 02:30:02.079763] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.544 [2024-12-08 02:30:02.079887] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.544 [2024-12-08 02:30:02.079912] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.544 [2024-12-08 02:30:02.079927] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.544 [2024-12-08 02:30:02.079940] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.544 [2024-12-08 02:30:02.079968] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.544 qpair failed and we were unable to recover it. 00:27:34.544 [2024-12-08 02:30:02.089762] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.544 [2024-12-08 02:30:02.089864] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.544 [2024-12-08 02:30:02.089889] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.544 [2024-12-08 02:30:02.089904] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.544 [2024-12-08 02:30:02.089917] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.544 [2024-12-08 02:30:02.089945] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.544 qpair failed and we were unable to recover it. 00:27:34.544 [2024-12-08 02:30:02.099858] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.544 [2024-12-08 02:30:02.099951] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.544 [2024-12-08 02:30:02.099977] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.544 [2024-12-08 02:30:02.099991] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.544 [2024-12-08 02:30:02.100004] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.544 [2024-12-08 02:30:02.100031] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.544 qpair failed and we were unable to recover it. 00:27:34.544 [2024-12-08 02:30:02.109805] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.544 [2024-12-08 02:30:02.109899] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.544 [2024-12-08 02:30:02.109924] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.544 [2024-12-08 02:30:02.109939] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.544 [2024-12-08 02:30:02.109952] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.544 [2024-12-08 02:30:02.109980] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.544 qpair failed and we were unable to recover it. 00:27:34.544 [2024-12-08 02:30:02.119840] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.544 [2024-12-08 02:30:02.119928] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.544 [2024-12-08 02:30:02.119953] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.544 [2024-12-08 02:30:02.119967] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.544 [2024-12-08 02:30:02.119980] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.544 [2024-12-08 02:30:02.120009] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.544 qpair failed and we were unable to recover it. 00:27:34.544 [2024-12-08 02:30:02.129884] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.544 [2024-12-08 02:30:02.129969] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.544 [2024-12-08 02:30:02.129994] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.544 [2024-12-08 02:30:02.130009] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.544 [2024-12-08 02:30:02.130022] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.544 [2024-12-08 02:30:02.130050] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.544 qpair failed and we were unable to recover it. 00:27:34.544 [2024-12-08 02:30:02.139885] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.544 [2024-12-08 02:30:02.139978] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.544 [2024-12-08 02:30:02.140004] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.544 [2024-12-08 02:30:02.140018] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.544 [2024-12-08 02:30:02.140037] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.544 [2024-12-08 02:30:02.140066] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.544 qpair failed and we were unable to recover it. 00:27:34.544 [2024-12-08 02:30:02.150013] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.544 [2024-12-08 02:30:02.150111] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.544 [2024-12-08 02:30:02.150136] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.544 [2024-12-08 02:30:02.150151] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.544 [2024-12-08 02:30:02.150164] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.544 [2024-12-08 02:30:02.150192] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.544 qpair failed and we were unable to recover it. 00:27:34.544 [2024-12-08 02:30:02.159996] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.544 [2024-12-08 02:30:02.160086] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.544 [2024-12-08 02:30:02.160111] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.544 [2024-12-08 02:30:02.160126] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.544 [2024-12-08 02:30:02.160139] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.544 [2024-12-08 02:30:02.160168] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.544 qpair failed and we were unable to recover it. 00:27:34.544 [2024-12-08 02:30:02.169995] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.544 [2024-12-08 02:30:02.170126] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.544 [2024-12-08 02:30:02.170151] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.544 [2024-12-08 02:30:02.170165] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.544 [2024-12-08 02:30:02.170179] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.544 [2024-12-08 02:30:02.170207] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.544 qpair failed and we were unable to recover it. 00:27:34.544 [2024-12-08 02:30:02.179995] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.544 [2024-12-08 02:30:02.180095] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.544 [2024-12-08 02:30:02.180121] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.544 [2024-12-08 02:30:02.180135] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.544 [2024-12-08 02:30:02.180149] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.544 [2024-12-08 02:30:02.180177] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.544 qpair failed and we were unable to recover it. 00:27:34.544 [2024-12-08 02:30:02.190114] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.544 [2024-12-08 02:30:02.190206] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.544 [2024-12-08 02:30:02.190231] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.544 [2024-12-08 02:30:02.190246] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.544 [2024-12-08 02:30:02.190259] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.544 [2024-12-08 02:30:02.190287] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.544 qpair failed and we were unable to recover it. 00:27:34.544 [2024-12-08 02:30:02.200079] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.544 [2024-12-08 02:30:02.200190] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.544 [2024-12-08 02:30:02.200216] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.544 [2024-12-08 02:30:02.200230] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.544 [2024-12-08 02:30:02.200243] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.544 [2024-12-08 02:30:02.200271] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.544 qpair failed and we were unable to recover it. 00:27:34.544 [2024-12-08 02:30:02.210113] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.544 [2024-12-08 02:30:02.210202] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.544 [2024-12-08 02:30:02.210227] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.544 [2024-12-08 02:30:02.210242] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.544 [2024-12-08 02:30:02.210256] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.544 [2024-12-08 02:30:02.210284] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.544 qpair failed and we were unable to recover it. 00:27:34.544 [2024-12-08 02:30:02.220092] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.544 [2024-12-08 02:30:02.220176] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.544 [2024-12-08 02:30:02.220202] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.544 [2024-12-08 02:30:02.220216] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.544 [2024-12-08 02:30:02.220229] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.544 [2024-12-08 02:30:02.220257] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.544 qpair failed and we were unable to recover it. 00:27:34.544 [2024-12-08 02:30:02.230139] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.544 [2024-12-08 02:30:02.230229] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.544 [2024-12-08 02:30:02.230254] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.544 [2024-12-08 02:30:02.230275] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.544 [2024-12-08 02:30:02.230289] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.544 [2024-12-08 02:30:02.230318] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.544 qpair failed and we were unable to recover it. 00:27:34.544 [2024-12-08 02:30:02.240156] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.544 [2024-12-08 02:30:02.240256] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.544 [2024-12-08 02:30:02.240282] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.544 [2024-12-08 02:30:02.240296] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.544 [2024-12-08 02:30:02.240310] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.544 [2024-12-08 02:30:02.240338] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.544 qpair failed and we were unable to recover it. 00:27:34.544 [2024-12-08 02:30:02.250204] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.544 [2024-12-08 02:30:02.250286] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.544 [2024-12-08 02:30:02.250311] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.544 [2024-12-08 02:30:02.250326] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.544 [2024-12-08 02:30:02.250339] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.544 [2024-12-08 02:30:02.250366] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.544 qpair failed and we were unable to recover it. 00:27:34.544 [2024-12-08 02:30:02.260251] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.544 [2024-12-08 02:30:02.260373] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.544 [2024-12-08 02:30:02.260398] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.544 [2024-12-08 02:30:02.260413] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.544 [2024-12-08 02:30:02.260426] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.544 [2024-12-08 02:30:02.260456] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.544 qpair failed and we were unable to recover it. 00:27:34.544 [2024-12-08 02:30:02.270290] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.544 [2024-12-08 02:30:02.270413] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.544 [2024-12-08 02:30:02.270439] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.544 [2024-12-08 02:30:02.270454] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.544 [2024-12-08 02:30:02.270467] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.544 [2024-12-08 02:30:02.270495] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.544 qpair failed and we were unable to recover it. 00:27:34.544 [2024-12-08 02:30:02.280369] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.544 [2024-12-08 02:30:02.280456] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.544 [2024-12-08 02:30:02.280481] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.544 [2024-12-08 02:30:02.280498] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.544 [2024-12-08 02:30:02.280512] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.544 [2024-12-08 02:30:02.280546] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.544 qpair failed and we were unable to recover it. 00:27:34.544 [2024-12-08 02:30:02.290334] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.544 [2024-12-08 02:30:02.290423] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.544 [2024-12-08 02:30:02.290448] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.544 [2024-12-08 02:30:02.290462] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.544 [2024-12-08 02:30:02.290475] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.544 [2024-12-08 02:30:02.290504] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.544 qpair failed and we were unable to recover it. 00:27:34.544 [2024-12-08 02:30:02.300352] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.544 [2024-12-08 02:30:02.300455] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.544 [2024-12-08 02:30:02.300481] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.544 [2024-12-08 02:30:02.300495] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.544 [2024-12-08 02:30:02.300508] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.544 [2024-12-08 02:30:02.300541] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.544 qpair failed and we were unable to recover it. 00:27:34.544 [2024-12-08 02:30:02.310381] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.544 [2024-12-08 02:30:02.310468] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.544 [2024-12-08 02:30:02.310493] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.544 [2024-12-08 02:30:02.310508] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.544 [2024-12-08 02:30:02.310521] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.544 [2024-12-08 02:30:02.310557] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.544 qpair failed and we were unable to recover it. 00:27:34.544 [2024-12-08 02:30:02.320438] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.544 [2024-12-08 02:30:02.320574] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.544 [2024-12-08 02:30:02.320599] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.544 [2024-12-08 02:30:02.320621] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.544 [2024-12-08 02:30:02.320635] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.544 [2024-12-08 02:30:02.320664] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.544 qpair failed and we were unable to recover it. 00:27:34.803 [2024-12-08 02:30:02.330486] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.803 [2024-12-08 02:30:02.330574] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.804 [2024-12-08 02:30:02.330600] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.804 [2024-12-08 02:30:02.330614] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.804 [2024-12-08 02:30:02.330626] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.804 [2024-12-08 02:30:02.330656] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.804 qpair failed and we were unable to recover it. 00:27:34.804 [2024-12-08 02:30:02.340469] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.804 [2024-12-08 02:30:02.340583] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.804 [2024-12-08 02:30:02.340609] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.804 [2024-12-08 02:30:02.340624] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.804 [2024-12-08 02:30:02.340637] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.804 [2024-12-08 02:30:02.340665] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.804 qpair failed and we were unable to recover it. 00:27:34.804 [2024-12-08 02:30:02.350505] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.804 [2024-12-08 02:30:02.350603] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.804 [2024-12-08 02:30:02.350629] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.804 [2024-12-08 02:30:02.350644] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.804 [2024-12-08 02:30:02.350657] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.804 [2024-12-08 02:30:02.350685] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.804 qpair failed and we were unable to recover it. 00:27:34.804 [2024-12-08 02:30:02.360559] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.804 [2024-12-08 02:30:02.360676] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.804 [2024-12-08 02:30:02.360702] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.804 [2024-12-08 02:30:02.360716] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.804 [2024-12-08 02:30:02.360730] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.804 [2024-12-08 02:30:02.360758] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.804 qpair failed and we were unable to recover it. 00:27:34.804 [2024-12-08 02:30:02.370575] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.804 [2024-12-08 02:30:02.370668] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.804 [2024-12-08 02:30:02.370693] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.804 [2024-12-08 02:30:02.370707] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.804 [2024-12-08 02:30:02.370720] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.804 [2024-12-08 02:30:02.370749] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.804 qpair failed and we were unable to recover it. 00:27:34.804 [2024-12-08 02:30:02.380630] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.804 [2024-12-08 02:30:02.380730] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.804 [2024-12-08 02:30:02.380756] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.804 [2024-12-08 02:30:02.380770] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.804 [2024-12-08 02:30:02.380783] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.804 [2024-12-08 02:30:02.380812] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.804 qpair failed and we were unable to recover it. 00:27:34.804 [2024-12-08 02:30:02.390649] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.804 [2024-12-08 02:30:02.390735] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.804 [2024-12-08 02:30:02.390760] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.804 [2024-12-08 02:30:02.390775] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.804 [2024-12-08 02:30:02.390788] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.804 [2024-12-08 02:30:02.390817] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.804 qpair failed and we were unable to recover it. 00:27:34.804 [2024-12-08 02:30:02.400700] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.804 [2024-12-08 02:30:02.400789] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.804 [2024-12-08 02:30:02.400814] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.804 [2024-12-08 02:30:02.400828] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.804 [2024-12-08 02:30:02.400842] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.804 [2024-12-08 02:30:02.400870] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.804 qpair failed and we were unable to recover it. 00:27:34.804 [2024-12-08 02:30:02.410683] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.804 [2024-12-08 02:30:02.410818] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.804 [2024-12-08 02:30:02.410845] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.804 [2024-12-08 02:30:02.410864] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.804 [2024-12-08 02:30:02.410877] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.804 [2024-12-08 02:30:02.410905] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.804 qpair failed and we were unable to recover it. 00:27:34.804 [2024-12-08 02:30:02.420773] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.804 [2024-12-08 02:30:02.420858] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.804 [2024-12-08 02:30:02.420883] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.804 [2024-12-08 02:30:02.420898] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.804 [2024-12-08 02:30:02.420910] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.804 [2024-12-08 02:30:02.420938] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.804 qpair failed and we were unable to recover it. 00:27:34.804 [2024-12-08 02:30:02.430741] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.804 [2024-12-08 02:30:02.430839] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.804 [2024-12-08 02:30:02.430864] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.804 [2024-12-08 02:30:02.430878] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.804 [2024-12-08 02:30:02.430892] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.804 [2024-12-08 02:30:02.430920] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.804 qpair failed and we were unable to recover it. 00:27:34.804 [2024-12-08 02:30:02.440740] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.804 [2024-12-08 02:30:02.440829] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.804 [2024-12-08 02:30:02.440853] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.804 [2024-12-08 02:30:02.440868] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.804 [2024-12-08 02:30:02.440881] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.804 [2024-12-08 02:30:02.440909] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.804 qpair failed and we were unable to recover it. 00:27:34.804 [2024-12-08 02:30:02.450784] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.804 [2024-12-08 02:30:02.450871] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.804 [2024-12-08 02:30:02.450896] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.804 [2024-12-08 02:30:02.450911] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.804 [2024-12-08 02:30:02.450924] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.804 [2024-12-08 02:30:02.450952] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.804 qpair failed and we were unable to recover it. 00:27:34.804 [2024-12-08 02:30:02.460918] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.804 [2024-12-08 02:30:02.461052] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.804 [2024-12-08 02:30:02.461081] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.804 [2024-12-08 02:30:02.461097] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.804 [2024-12-08 02:30:02.461111] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.805 [2024-12-08 02:30:02.461140] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.805 qpair failed and we were unable to recover it. 00:27:34.805 [2024-12-08 02:30:02.470854] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.805 [2024-12-08 02:30:02.470942] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.805 [2024-12-08 02:30:02.470967] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.805 [2024-12-08 02:30:02.470982] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.805 [2024-12-08 02:30:02.470996] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f3cb0 00:27:34.805 [2024-12-08 02:30:02.471024] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:34.805 qpair failed and we were unable to recover it. 00:27:34.805 [2024-12-08 02:30:02.480910] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.805 [2024-12-08 02:30:02.480996] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.805 [2024-12-08 02:30:02.481030] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.805 [2024-12-08 02:30:02.481046] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.805 [2024-12-08 02:30:02.481060] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f5758000b90 00:27:34.805 [2024-12-08 02:30:02.481107] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:34.805 qpair failed and we were unable to recover it. 00:27:34.805 [2024-12-08 02:30:02.490890] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.805 [2024-12-08 02:30:02.491022] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.805 [2024-12-08 02:30:02.491050] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.805 [2024-12-08 02:30:02.491066] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.805 [2024-12-08 02:30:02.491079] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f5758000b90 00:27:34.805 [2024-12-08 02:30:02.491111] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:34.805 qpair failed and we were unable to recover it. 00:27:34.805 [2024-12-08 02:30:02.491213] nvme_ctrlr.c:4339:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:27:34.805 A controller has encountered a failure and is being reset. 00:27:34.805 [2024-12-08 02:30:02.500937] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.805 [2024-12-08 02:30:02.501031] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.805 [2024-12-08 02:30:02.501072] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.805 [2024-12-08 02:30:02.501091] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.805 [2024-12-08 02:30:02.501105] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f5764000b90 00:27:34.805 [2024-12-08 02:30:02.501138] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:34.805 qpair failed and we were unable to recover it. 00:27:34.805 [2024-12-08 02:30:02.510974] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.805 [2024-12-08 02:30:02.511086] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.805 [2024-12-08 02:30:02.511113] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.805 [2024-12-08 02:30:02.511128] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.805 [2024-12-08 02:30:02.511142] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f5764000b90 00:27:34.805 [2024-12-08 02:30:02.511172] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:34.805 qpair failed and we were unable to recover it. 00:27:34.805 [2024-12-08 02:30:02.520981] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.805 [2024-12-08 02:30:02.521084] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.805 [2024-12-08 02:30:02.521117] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.805 [2024-12-08 02:30:02.521134] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.805 [2024-12-08 02:30:02.521148] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f575c000b90 00:27:34.805 [2024-12-08 02:30:02.521179] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:34.805 qpair failed and we were unable to recover it. 00:27:34.805 [2024-12-08 02:30:02.531001] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:34.805 [2024-12-08 02:30:02.531130] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:34.805 [2024-12-08 02:30:02.531157] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:34.805 [2024-12-08 02:30:02.531173] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:34.805 [2024-12-08 02:30:02.531187] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f575c000b90 00:27:34.805 [2024-12-08 02:30:02.531231] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:34.805 qpair failed and we were unable to recover it. 00:27:34.805 [2024-12-08 02:30:02.531337] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1801600 (9): Bad file descriptor 00:27:34.805 Controller properly reset. 00:27:34.805 Initializing NVMe Controllers 00:27:34.805 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:34.805 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:34.805 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:27:34.805 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:27:34.805 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:27:34.805 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:27:34.805 Initialization complete. Launching workers. 00:27:34.805 Starting thread on core 1 00:27:34.805 Starting thread on core 2 00:27:34.805 Starting thread on core 3 00:27:34.805 Starting thread on core 0 00:27:34.805 02:30:02 -- host/target_disconnect.sh@59 -- # sync 00:27:34.805 00:27:34.805 real 0m10.743s 00:27:34.805 user 0m19.189s 00:27:34.805 sys 0m5.272s 00:27:34.805 02:30:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:34.805 02:30:02 -- common/autotest_common.sh@10 -- # set +x 00:27:34.805 ************************************ 00:27:34.805 END TEST nvmf_target_disconnect_tc2 00:27:34.805 ************************************ 00:27:34.805 02:30:02 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:27:34.805 02:30:02 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:27:34.805 02:30:02 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:27:34.805 02:30:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:34.805 02:30:02 -- nvmf/common.sh@116 -- # sync 00:27:34.805 02:30:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:34.805 02:30:02 -- nvmf/common.sh@119 -- # set +e 00:27:34.805 02:30:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:34.805 02:30:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:34.805 rmmod nvme_tcp 00:27:35.063 rmmod nvme_fabrics 00:27:35.063 rmmod nvme_keyring 00:27:35.063 02:30:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:35.063 02:30:02 -- nvmf/common.sh@123 -- # set -e 00:27:35.063 02:30:02 -- nvmf/common.sh@124 -- # return 0 00:27:35.063 02:30:02 -- nvmf/common.sh@477 -- # '[' -n 2230879 ']' 00:27:35.063 02:30:02 -- nvmf/common.sh@478 -- # killprocess 2230879 00:27:35.063 02:30:02 -- common/autotest_common.sh@936 -- # '[' -z 2230879 ']' 00:27:35.063 02:30:02 -- common/autotest_common.sh@940 -- # kill -0 2230879 00:27:35.063 02:30:02 -- common/autotest_common.sh@941 -- # uname 00:27:35.063 02:30:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:35.063 02:30:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2230879 00:27:35.063 02:30:02 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:27:35.063 02:30:02 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:27:35.063 02:30:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2230879' 00:27:35.063 killing process with pid 2230879 00:27:35.063 02:30:02 -- common/autotest_common.sh@955 -- # kill 2230879 00:27:35.063 02:30:02 -- common/autotest_common.sh@960 -- # wait 2230879 00:27:35.354 02:30:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:35.354 02:30:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:35.354 02:30:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:35.354 02:30:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:35.354 02:30:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:35.354 02:30:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:35.354 02:30:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:35.354 02:30:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:37.255 02:30:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:37.255 00:27:37.255 real 0m15.685s 00:27:37.255 user 0m44.957s 00:27:37.255 sys 0m7.309s 00:27:37.255 02:30:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:37.255 02:30:04 -- common/autotest_common.sh@10 -- # set +x 00:27:37.255 ************************************ 00:27:37.255 END TEST nvmf_target_disconnect 00:27:37.255 ************************************ 00:27:37.255 02:30:05 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:27:37.255 02:30:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:37.255 02:30:05 -- common/autotest_common.sh@10 -- # set +x 00:27:37.255 02:30:05 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:27:37.255 00:27:37.255 real 21m32.937s 00:27:37.255 user 62m33.510s 00:27:37.255 sys 4m56.846s 00:27:37.255 02:30:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:37.255 02:30:05 -- common/autotest_common.sh@10 -- # set +x 00:27:37.255 ************************************ 00:27:37.255 END TEST nvmf_tcp 00:27:37.255 ************************************ 00:27:37.515 02:30:05 -- spdk/autotest.sh@283 -- # [[ 0 -eq 0 ]] 00:27:37.515 02:30:05 -- spdk/autotest.sh@284 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:27:37.515 02:30:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:37.515 02:30:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:37.515 02:30:05 -- common/autotest_common.sh@10 -- # set +x 00:27:37.515 ************************************ 00:27:37.515 START TEST spdkcli_nvmf_tcp 00:27:37.515 ************************************ 00:27:37.515 02:30:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:27:37.515 * Looking for test storage... 00:27:37.515 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:27:37.515 02:30:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:37.515 02:30:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:37.515 02:30:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:37.515 02:30:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:37.515 02:30:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:37.515 02:30:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:37.515 02:30:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:37.515 02:30:05 -- scripts/common.sh@335 -- # IFS=.-: 00:27:37.515 02:30:05 -- scripts/common.sh@335 -- # read -ra ver1 00:27:37.515 02:30:05 -- scripts/common.sh@336 -- # IFS=.-: 00:27:37.515 02:30:05 -- scripts/common.sh@336 -- # read -ra ver2 00:27:37.515 02:30:05 -- scripts/common.sh@337 -- # local 'op=<' 00:27:37.515 02:30:05 -- scripts/common.sh@339 -- # ver1_l=2 00:27:37.515 02:30:05 -- scripts/common.sh@340 -- # ver2_l=1 00:27:37.515 02:30:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:37.515 02:30:05 -- scripts/common.sh@343 -- # case "$op" in 00:27:37.515 02:30:05 -- scripts/common.sh@344 -- # : 1 00:27:37.515 02:30:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:37.515 02:30:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:37.515 02:30:05 -- scripts/common.sh@364 -- # decimal 1 00:27:37.515 02:30:05 -- scripts/common.sh@352 -- # local d=1 00:27:37.515 02:30:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:37.515 02:30:05 -- scripts/common.sh@354 -- # echo 1 00:27:37.515 02:30:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:37.515 02:30:05 -- scripts/common.sh@365 -- # decimal 2 00:27:37.515 02:30:05 -- scripts/common.sh@352 -- # local d=2 00:27:37.515 02:30:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:37.515 02:30:05 -- scripts/common.sh@354 -- # echo 2 00:27:37.515 02:30:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:37.515 02:30:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:37.515 02:30:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:37.515 02:30:05 -- scripts/common.sh@367 -- # return 0 00:27:37.515 02:30:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:37.515 02:30:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:37.515 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:37.515 --rc genhtml_branch_coverage=1 00:27:37.515 --rc genhtml_function_coverage=1 00:27:37.515 --rc genhtml_legend=1 00:27:37.515 --rc geninfo_all_blocks=1 00:27:37.515 --rc geninfo_unexecuted_blocks=1 00:27:37.515 00:27:37.515 ' 00:27:37.515 02:30:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:37.515 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:37.515 --rc genhtml_branch_coverage=1 00:27:37.515 --rc genhtml_function_coverage=1 00:27:37.515 --rc genhtml_legend=1 00:27:37.515 --rc geninfo_all_blocks=1 00:27:37.515 --rc geninfo_unexecuted_blocks=1 00:27:37.515 00:27:37.515 ' 00:27:37.515 02:30:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:37.515 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:37.515 --rc genhtml_branch_coverage=1 00:27:37.515 --rc genhtml_function_coverage=1 00:27:37.515 --rc genhtml_legend=1 00:27:37.515 --rc geninfo_all_blocks=1 00:27:37.516 --rc geninfo_unexecuted_blocks=1 00:27:37.516 00:27:37.516 ' 00:27:37.516 02:30:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:37.516 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:37.516 --rc genhtml_branch_coverage=1 00:27:37.516 --rc genhtml_function_coverage=1 00:27:37.516 --rc genhtml_legend=1 00:27:37.516 --rc geninfo_all_blocks=1 00:27:37.516 --rc geninfo_unexecuted_blocks=1 00:27:37.516 00:27:37.516 ' 00:27:37.516 02:30:05 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:27:37.516 02:30:05 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:27:37.516 02:30:05 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:27:37.516 02:30:05 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:37.516 02:30:05 -- nvmf/common.sh@7 -- # uname -s 00:27:37.516 02:30:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:37.516 02:30:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:37.516 02:30:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:37.516 02:30:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:37.516 02:30:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:37.516 02:30:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:37.516 02:30:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:37.516 02:30:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:37.516 02:30:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:37.516 02:30:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:37.516 02:30:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:37.516 02:30:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:37.516 02:30:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:37.516 02:30:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:37.516 02:30:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:37.516 02:30:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:37.516 02:30:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:37.516 02:30:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:37.516 02:30:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:37.516 02:30:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:37.516 02:30:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:37.516 02:30:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:37.516 02:30:05 -- paths/export.sh@5 -- # export PATH 00:27:37.516 02:30:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:37.516 02:30:05 -- nvmf/common.sh@46 -- # : 0 00:27:37.516 02:30:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:37.516 02:30:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:37.516 02:30:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:37.516 02:30:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:37.516 02:30:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:37.516 02:30:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:37.516 02:30:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:37.516 02:30:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:37.516 02:30:05 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:27:37.516 02:30:05 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:27:37.516 02:30:05 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:27:37.516 02:30:05 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:27:37.516 02:30:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:37.516 02:30:05 -- common/autotest_common.sh@10 -- # set +x 00:27:37.516 02:30:05 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:27:37.516 02:30:05 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=2232216 00:27:37.516 02:30:05 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:27:37.516 02:30:05 -- spdkcli/common.sh@34 -- # waitforlisten 2232216 00:27:37.516 02:30:05 -- common/autotest_common.sh@829 -- # '[' -z 2232216 ']' 00:27:37.516 02:30:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:37.516 02:30:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:37.516 02:30:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:37.516 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:37.516 02:30:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:37.516 02:30:05 -- common/autotest_common.sh@10 -- # set +x 00:27:37.516 [2024-12-08 02:30:05.251115] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:37.516 [2024-12-08 02:30:05.251207] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2232216 ] 00:27:37.516 EAL: No free 2048 kB hugepages reported on node 1 00:27:37.772 [2024-12-08 02:30:05.309018] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:27:37.772 [2024-12-08 02:30:05.418826] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:37.772 [2024-12-08 02:30:05.419035] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:37.772 [2024-12-08 02:30:05.419040] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:38.706 02:30:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:38.706 02:30:06 -- common/autotest_common.sh@862 -- # return 0 00:27:38.706 02:30:06 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:27:38.706 02:30:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:38.706 02:30:06 -- common/autotest_common.sh@10 -- # set +x 00:27:38.706 02:30:06 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:27:38.706 02:30:06 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:27:38.706 02:30:06 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:27:38.706 02:30:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:38.706 02:30:06 -- common/autotest_common.sh@10 -- # set +x 00:27:38.706 02:30:06 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:27:38.706 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:27:38.706 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:27:38.706 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:27:38.706 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:27:38.706 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:27:38.706 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:27:38.706 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:27:38.706 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:27:38.706 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:27:38.706 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:27:38.706 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:38.706 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:27:38.706 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:27:38.706 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:38.706 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:27:38.706 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:27:38.706 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:27:38.706 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:27:38.706 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:38.706 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:27:38.706 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:27:38.706 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:27:38.706 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:27:38.706 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:38.706 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:27:38.706 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:27:38.706 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:27:38.707 ' 00:27:38.965 [2024-12-08 02:30:06.681868] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:27:41.495 [2024-12-08 02:30:08.856639] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:42.434 [2024-12-08 02:30:10.109225] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:27:44.968 [2024-12-08 02:30:12.424515] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:27:46.876 [2024-12-08 02:30:14.423014] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:27:48.262 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:27:48.262 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:27:48.262 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:27:48.262 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:27:48.262 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:27:48.262 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:27:48.262 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:27:48.262 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:27:48.262 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:27:48.262 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:27:48.262 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:27:48.262 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:27:48.262 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:27:48.262 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:27:48.262 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:27:48.262 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:27:48.262 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:27:48.262 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:27:48.262 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:27:48.262 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:27:48.262 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:27:48.262 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:27:48.262 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:27:48.262 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:27:48.262 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:27:48.262 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:27:48.262 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:27:48.262 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:27:48.522 02:30:16 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:27:48.522 02:30:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:48.522 02:30:16 -- common/autotest_common.sh@10 -- # set +x 00:27:48.522 02:30:16 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:27:48.522 02:30:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:48.522 02:30:16 -- common/autotest_common.sh@10 -- # set +x 00:27:48.522 02:30:16 -- spdkcli/nvmf.sh@69 -- # check_match 00:27:48.522 02:30:16 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:27:48.781 02:30:16 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:27:48.781 02:30:16 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:27:48.781 02:30:16 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:27:48.781 02:30:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:48.781 02:30:16 -- common/autotest_common.sh@10 -- # set +x 00:27:48.781 02:30:16 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:27:48.781 02:30:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:48.781 02:30:16 -- common/autotest_common.sh@10 -- # set +x 00:27:48.781 02:30:16 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:27:48.781 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:27:48.781 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:27:48.781 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:27:48.781 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:27:48.781 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:27:48.781 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:27:48.781 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:27:48.781 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:27:48.781 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:27:48.781 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:27:48.781 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:27:48.781 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:27:48.781 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:27:48.781 ' 00:27:54.059 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:27:54.059 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:27:54.059 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:27:54.059 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:27:54.059 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:27:54.059 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:27:54.059 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:27:54.059 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:27:54.059 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:27:54.059 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:27:54.059 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:27:54.059 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:27:54.059 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:27:54.059 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:27:54.059 02:30:21 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:27:54.059 02:30:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:54.059 02:30:21 -- common/autotest_common.sh@10 -- # set +x 00:27:54.319 02:30:21 -- spdkcli/nvmf.sh@90 -- # killprocess 2232216 00:27:54.319 02:30:21 -- common/autotest_common.sh@936 -- # '[' -z 2232216 ']' 00:27:54.319 02:30:21 -- common/autotest_common.sh@940 -- # kill -0 2232216 00:27:54.319 02:30:21 -- common/autotest_common.sh@941 -- # uname 00:27:54.319 02:30:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:54.319 02:30:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2232216 00:27:54.319 02:30:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:54.319 02:30:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:54.319 02:30:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2232216' 00:27:54.319 killing process with pid 2232216 00:27:54.319 02:30:21 -- common/autotest_common.sh@955 -- # kill 2232216 00:27:54.319 [2024-12-08 02:30:21.884039] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:27:54.319 02:30:21 -- common/autotest_common.sh@960 -- # wait 2232216 00:27:54.580 02:30:22 -- spdkcli/nvmf.sh@1 -- # cleanup 00:27:54.580 02:30:22 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:27:54.580 02:30:22 -- spdkcli/common.sh@13 -- # '[' -n 2232216 ']' 00:27:54.580 02:30:22 -- spdkcli/common.sh@14 -- # killprocess 2232216 00:27:54.580 02:30:22 -- common/autotest_common.sh@936 -- # '[' -z 2232216 ']' 00:27:54.580 02:30:22 -- common/autotest_common.sh@940 -- # kill -0 2232216 00:27:54.580 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2232216) - No such process 00:27:54.580 02:30:22 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2232216 is not found' 00:27:54.580 Process with pid 2232216 is not found 00:27:54.580 02:30:22 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:27:54.580 02:30:22 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:27:54.580 02:30:22 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:27:54.580 00:27:54.580 real 0m17.111s 00:27:54.580 user 0m36.470s 00:27:54.580 sys 0m0.821s 00:27:54.580 02:30:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:54.580 02:30:22 -- common/autotest_common.sh@10 -- # set +x 00:27:54.580 ************************************ 00:27:54.580 END TEST spdkcli_nvmf_tcp 00:27:54.580 ************************************ 00:27:54.580 02:30:22 -- spdk/autotest.sh@285 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:27:54.580 02:30:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:54.580 02:30:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:54.580 02:30:22 -- common/autotest_common.sh@10 -- # set +x 00:27:54.580 ************************************ 00:27:54.580 START TEST nvmf_identify_passthru 00:27:54.580 ************************************ 00:27:54.580 02:30:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:27:54.580 * Looking for test storage... 00:27:54.580 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:27:54.580 02:30:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:54.580 02:30:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:54.580 02:30:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:54.580 02:30:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:54.580 02:30:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:54.580 02:30:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:54.580 02:30:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:54.580 02:30:22 -- scripts/common.sh@335 -- # IFS=.-: 00:27:54.580 02:30:22 -- scripts/common.sh@335 -- # read -ra ver1 00:27:54.580 02:30:22 -- scripts/common.sh@336 -- # IFS=.-: 00:27:54.580 02:30:22 -- scripts/common.sh@336 -- # read -ra ver2 00:27:54.580 02:30:22 -- scripts/common.sh@337 -- # local 'op=<' 00:27:54.580 02:30:22 -- scripts/common.sh@339 -- # ver1_l=2 00:27:54.580 02:30:22 -- scripts/common.sh@340 -- # ver2_l=1 00:27:54.580 02:30:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:54.580 02:30:22 -- scripts/common.sh@343 -- # case "$op" in 00:27:54.580 02:30:22 -- scripts/common.sh@344 -- # : 1 00:27:54.580 02:30:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:54.580 02:30:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:54.580 02:30:22 -- scripts/common.sh@364 -- # decimal 1 00:27:54.580 02:30:22 -- scripts/common.sh@352 -- # local d=1 00:27:54.580 02:30:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:54.580 02:30:22 -- scripts/common.sh@354 -- # echo 1 00:27:54.580 02:30:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:54.580 02:30:22 -- scripts/common.sh@365 -- # decimal 2 00:27:54.580 02:30:22 -- scripts/common.sh@352 -- # local d=2 00:27:54.580 02:30:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:54.580 02:30:22 -- scripts/common.sh@354 -- # echo 2 00:27:54.580 02:30:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:54.580 02:30:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:54.580 02:30:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:54.580 02:30:22 -- scripts/common.sh@367 -- # return 0 00:27:54.580 02:30:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:54.580 02:30:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:54.580 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:54.580 --rc genhtml_branch_coverage=1 00:27:54.580 --rc genhtml_function_coverage=1 00:27:54.580 --rc genhtml_legend=1 00:27:54.580 --rc geninfo_all_blocks=1 00:27:54.580 --rc geninfo_unexecuted_blocks=1 00:27:54.580 00:27:54.580 ' 00:27:54.580 02:30:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:54.580 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:54.580 --rc genhtml_branch_coverage=1 00:27:54.580 --rc genhtml_function_coverage=1 00:27:54.580 --rc genhtml_legend=1 00:27:54.580 --rc geninfo_all_blocks=1 00:27:54.580 --rc geninfo_unexecuted_blocks=1 00:27:54.580 00:27:54.580 ' 00:27:54.581 02:30:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:54.581 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:54.581 --rc genhtml_branch_coverage=1 00:27:54.581 --rc genhtml_function_coverage=1 00:27:54.581 --rc genhtml_legend=1 00:27:54.581 --rc geninfo_all_blocks=1 00:27:54.581 --rc geninfo_unexecuted_blocks=1 00:27:54.581 00:27:54.581 ' 00:27:54.581 02:30:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:54.581 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:54.581 --rc genhtml_branch_coverage=1 00:27:54.581 --rc genhtml_function_coverage=1 00:27:54.581 --rc genhtml_legend=1 00:27:54.581 --rc geninfo_all_blocks=1 00:27:54.581 --rc geninfo_unexecuted_blocks=1 00:27:54.581 00:27:54.581 ' 00:27:54.581 02:30:22 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:54.581 02:30:22 -- nvmf/common.sh@7 -- # uname -s 00:27:54.581 02:30:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:54.581 02:30:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:54.581 02:30:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:54.581 02:30:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:54.581 02:30:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:54.581 02:30:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:54.581 02:30:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:54.581 02:30:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:54.581 02:30:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:54.581 02:30:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:54.581 02:30:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:54.581 02:30:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:54.581 02:30:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:54.581 02:30:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:54.581 02:30:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:54.581 02:30:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:54.581 02:30:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:54.581 02:30:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:54.581 02:30:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:54.581 02:30:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:54.581 02:30:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:54.581 02:30:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:54.581 02:30:22 -- paths/export.sh@5 -- # export PATH 00:27:54.581 02:30:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:54.581 02:30:22 -- nvmf/common.sh@46 -- # : 0 00:27:54.581 02:30:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:54.581 02:30:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:54.581 02:30:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:54.581 02:30:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:54.581 02:30:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:54.581 02:30:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:54.581 02:30:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:54.581 02:30:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:54.581 02:30:22 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:54.581 02:30:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:54.581 02:30:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:54.581 02:30:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:54.581 02:30:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:54.581 02:30:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:54.581 02:30:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:54.581 02:30:22 -- paths/export.sh@5 -- # export PATH 00:27:54.581 02:30:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:54.581 02:30:22 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:27:54.581 02:30:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:54.581 02:30:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:54.581 02:30:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:54.581 02:30:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:54.581 02:30:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:54.581 02:30:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:54.581 02:30:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:27:54.581 02:30:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:54.581 02:30:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:54.581 02:30:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:54.581 02:30:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:54.581 02:30:22 -- common/autotest_common.sh@10 -- # set +x 00:27:57.117 02:30:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:57.117 02:30:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:57.117 02:30:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:57.117 02:30:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:57.117 02:30:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:57.117 02:30:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:57.117 02:30:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:57.117 02:30:24 -- nvmf/common.sh@294 -- # net_devs=() 00:27:57.117 02:30:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:57.117 02:30:24 -- nvmf/common.sh@295 -- # e810=() 00:27:57.117 02:30:24 -- nvmf/common.sh@295 -- # local -ga e810 00:27:57.117 02:30:24 -- nvmf/common.sh@296 -- # x722=() 00:27:57.117 02:30:24 -- nvmf/common.sh@296 -- # local -ga x722 00:27:57.117 02:30:24 -- nvmf/common.sh@297 -- # mlx=() 00:27:57.117 02:30:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:57.117 02:30:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:57.117 02:30:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:57.117 02:30:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:57.117 02:30:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:57.117 02:30:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:57.117 02:30:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:57.117 02:30:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:57.117 02:30:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:57.117 02:30:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:57.117 02:30:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:57.117 02:30:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:57.117 02:30:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:57.117 02:30:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:57.117 02:30:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:57.117 02:30:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:57.117 02:30:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:57.117 02:30:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:57.117 02:30:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:57.117 02:30:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:57.117 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:57.117 02:30:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:57.117 02:30:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:57.117 02:30:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:57.117 02:30:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:57.117 02:30:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:57.117 02:30:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:57.117 02:30:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:57.117 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:57.117 02:30:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:57.117 02:30:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:57.117 02:30:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:57.117 02:30:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:57.117 02:30:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:57.117 02:30:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:57.117 02:30:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:57.117 02:30:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:57.118 02:30:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:57.118 02:30:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:57.118 02:30:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:57.118 02:30:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:57.118 02:30:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:57.118 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:57.118 02:30:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:57.118 02:30:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:57.118 02:30:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:57.118 02:30:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:57.118 02:30:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:57.118 02:30:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:57.118 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:57.118 02:30:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:57.118 02:30:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:57.118 02:30:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:57.118 02:30:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:57.118 02:30:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:57.118 02:30:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:57.118 02:30:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:57.118 02:30:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:57.118 02:30:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:57.118 02:30:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:57.118 02:30:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:57.118 02:30:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:57.118 02:30:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:57.118 02:30:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:57.118 02:30:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:57.118 02:30:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:57.118 02:30:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:57.118 02:30:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:57.118 02:30:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:57.118 02:30:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:57.118 02:30:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:57.118 02:30:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:57.118 02:30:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:57.118 02:30:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:57.118 02:30:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:57.118 02:30:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:57.118 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:57.118 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.246 ms 00:27:57.118 00:27:57.118 --- 10.0.0.2 ping statistics --- 00:27:57.118 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:57.118 rtt min/avg/max/mdev = 0.246/0.246/0.246/0.000 ms 00:27:57.118 02:30:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:57.118 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:57.118 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.113 ms 00:27:57.118 00:27:57.118 --- 10.0.0.1 ping statistics --- 00:27:57.118 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:57.118 rtt min/avg/max/mdev = 0.113/0.113/0.113/0.000 ms 00:27:57.118 02:30:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:57.118 02:30:24 -- nvmf/common.sh@410 -- # return 0 00:27:57.118 02:30:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:57.118 02:30:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:57.118 02:30:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:57.118 02:30:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:57.118 02:30:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:57.118 02:30:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:57.118 02:30:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:57.118 02:30:24 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:27:57.118 02:30:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:57.118 02:30:24 -- common/autotest_common.sh@10 -- # set +x 00:27:57.118 02:30:24 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:27:57.118 02:30:24 -- common/autotest_common.sh@1519 -- # bdfs=() 00:27:57.118 02:30:24 -- common/autotest_common.sh@1519 -- # local bdfs 00:27:57.118 02:30:24 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:27:57.118 02:30:24 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:27:57.118 02:30:24 -- common/autotest_common.sh@1508 -- # bdfs=() 00:27:57.118 02:30:24 -- common/autotest_common.sh@1508 -- # local bdfs 00:27:57.118 02:30:24 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:27:57.118 02:30:24 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:27:57.118 02:30:24 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:27:57.118 02:30:24 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:27:57.118 02:30:24 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:27:57.118 02:30:24 -- common/autotest_common.sh@1522 -- # echo 0000:88:00.0 00:27:57.118 02:30:24 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:27:57.118 02:30:24 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:27:57.118 02:30:24 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:27:57.118 02:30:24 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:27:57.118 02:30:24 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:27:57.118 EAL: No free 2048 kB hugepages reported on node 1 00:28:01.312 02:30:28 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:28:01.312 02:30:28 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:28:01.312 02:30:28 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:28:01.312 02:30:28 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:28:01.312 EAL: No free 2048 kB hugepages reported on node 1 00:28:05.502 02:30:32 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:28:05.502 02:30:32 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:28:05.502 02:30:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:05.502 02:30:32 -- common/autotest_common.sh@10 -- # set +x 00:28:05.502 02:30:32 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:28:05.502 02:30:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:05.502 02:30:32 -- common/autotest_common.sh@10 -- # set +x 00:28:05.502 02:30:32 -- target/identify_passthru.sh@31 -- # nvmfpid=2237463 00:28:05.502 02:30:32 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:28:05.502 02:30:32 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:05.502 02:30:32 -- target/identify_passthru.sh@35 -- # waitforlisten 2237463 00:28:05.502 02:30:32 -- common/autotest_common.sh@829 -- # '[' -z 2237463 ']' 00:28:05.502 02:30:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:05.502 02:30:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:05.502 02:30:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:05.502 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:05.502 02:30:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:05.502 02:30:32 -- common/autotest_common.sh@10 -- # set +x 00:28:05.502 [2024-12-08 02:30:33.028107] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:05.502 [2024-12-08 02:30:33.028204] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:05.502 EAL: No free 2048 kB hugepages reported on node 1 00:28:05.502 [2024-12-08 02:30:33.092161] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:28:05.502 [2024-12-08 02:30:33.203807] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:05.502 [2024-12-08 02:30:33.203970] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:05.502 [2024-12-08 02:30:33.203988] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:05.503 [2024-12-08 02:30:33.204001] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:05.503 [2024-12-08 02:30:33.204068] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:05.503 [2024-12-08 02:30:33.204123] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:05.503 [2024-12-08 02:30:33.204121] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:05.503 [2024-12-08 02:30:33.204093] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:05.503 02:30:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:05.503 02:30:33 -- common/autotest_common.sh@862 -- # return 0 00:28:05.503 02:30:33 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:28:05.503 02:30:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:05.503 02:30:33 -- common/autotest_common.sh@10 -- # set +x 00:28:05.503 INFO: Log level set to 20 00:28:05.503 INFO: Requests: 00:28:05.503 { 00:28:05.503 "jsonrpc": "2.0", 00:28:05.503 "method": "nvmf_set_config", 00:28:05.503 "id": 1, 00:28:05.503 "params": { 00:28:05.503 "admin_cmd_passthru": { 00:28:05.503 "identify_ctrlr": true 00:28:05.503 } 00:28:05.503 } 00:28:05.503 } 00:28:05.503 00:28:05.503 INFO: response: 00:28:05.503 { 00:28:05.503 "jsonrpc": "2.0", 00:28:05.503 "id": 1, 00:28:05.503 "result": true 00:28:05.503 } 00:28:05.503 00:28:05.503 02:30:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:05.503 02:30:33 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:28:05.503 02:30:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:05.503 02:30:33 -- common/autotest_common.sh@10 -- # set +x 00:28:05.503 INFO: Setting log level to 20 00:28:05.503 INFO: Setting log level to 20 00:28:05.503 INFO: Log level set to 20 00:28:05.503 INFO: Log level set to 20 00:28:05.503 INFO: Requests: 00:28:05.503 { 00:28:05.503 "jsonrpc": "2.0", 00:28:05.503 "method": "framework_start_init", 00:28:05.503 "id": 1 00:28:05.503 } 00:28:05.503 00:28:05.503 INFO: Requests: 00:28:05.503 { 00:28:05.503 "jsonrpc": "2.0", 00:28:05.503 "method": "framework_start_init", 00:28:05.503 "id": 1 00:28:05.503 } 00:28:05.503 00:28:05.762 [2024-12-08 02:30:33.381918] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:28:05.762 INFO: response: 00:28:05.762 { 00:28:05.762 "jsonrpc": "2.0", 00:28:05.762 "id": 1, 00:28:05.762 "result": true 00:28:05.762 } 00:28:05.762 00:28:05.762 INFO: response: 00:28:05.762 { 00:28:05.762 "jsonrpc": "2.0", 00:28:05.762 "id": 1, 00:28:05.762 "result": true 00:28:05.762 } 00:28:05.762 00:28:05.762 02:30:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:05.762 02:30:33 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:28:05.762 02:30:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:05.762 02:30:33 -- common/autotest_common.sh@10 -- # set +x 00:28:05.762 INFO: Setting log level to 40 00:28:05.762 INFO: Setting log level to 40 00:28:05.762 INFO: Setting log level to 40 00:28:05.762 [2024-12-08 02:30:33.391988] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:05.762 02:30:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:05.762 02:30:33 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:28:05.762 02:30:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:05.762 02:30:33 -- common/autotest_common.sh@10 -- # set +x 00:28:05.762 02:30:33 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:28:05.762 02:30:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:05.762 02:30:33 -- common/autotest_common.sh@10 -- # set +x 00:28:09.041 Nvme0n1 00:28:09.041 02:30:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:09.041 02:30:36 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:28:09.041 02:30:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:09.041 02:30:36 -- common/autotest_common.sh@10 -- # set +x 00:28:09.041 02:30:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:09.041 02:30:36 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:28:09.041 02:30:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:09.041 02:30:36 -- common/autotest_common.sh@10 -- # set +x 00:28:09.041 02:30:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:09.041 02:30:36 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:09.041 02:30:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:09.041 02:30:36 -- common/autotest_common.sh@10 -- # set +x 00:28:09.041 [2024-12-08 02:30:36.287346] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:09.041 02:30:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:09.041 02:30:36 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:28:09.041 02:30:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:09.041 02:30:36 -- common/autotest_common.sh@10 -- # set +x 00:28:09.041 [2024-12-08 02:30:36.295087] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:28:09.041 [ 00:28:09.041 { 00:28:09.041 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:28:09.041 "subtype": "Discovery", 00:28:09.041 "listen_addresses": [], 00:28:09.041 "allow_any_host": true, 00:28:09.041 "hosts": [] 00:28:09.041 }, 00:28:09.041 { 00:28:09.041 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:28:09.041 "subtype": "NVMe", 00:28:09.041 "listen_addresses": [ 00:28:09.041 { 00:28:09.041 "transport": "TCP", 00:28:09.041 "trtype": "TCP", 00:28:09.041 "adrfam": "IPv4", 00:28:09.041 "traddr": "10.0.0.2", 00:28:09.041 "trsvcid": "4420" 00:28:09.041 } 00:28:09.041 ], 00:28:09.041 "allow_any_host": true, 00:28:09.041 "hosts": [], 00:28:09.041 "serial_number": "SPDK00000000000001", 00:28:09.041 "model_number": "SPDK bdev Controller", 00:28:09.041 "max_namespaces": 1, 00:28:09.041 "min_cntlid": 1, 00:28:09.041 "max_cntlid": 65519, 00:28:09.041 "namespaces": [ 00:28:09.041 { 00:28:09.041 "nsid": 1, 00:28:09.041 "bdev_name": "Nvme0n1", 00:28:09.041 "name": "Nvme0n1", 00:28:09.041 "nguid": "4270A1CB572D469ABF45843B6D22A1CA", 00:28:09.041 "uuid": "4270a1cb-572d-469a-bf45-843b6d22a1ca" 00:28:09.041 } 00:28:09.041 ] 00:28:09.041 } 00:28:09.041 ] 00:28:09.041 02:30:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:09.041 02:30:36 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:09.041 02:30:36 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:28:09.041 02:30:36 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:28:09.041 EAL: No free 2048 kB hugepages reported on node 1 00:28:09.041 02:30:36 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:28:09.041 02:30:36 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:09.041 02:30:36 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:28:09.041 02:30:36 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:28:09.041 EAL: No free 2048 kB hugepages reported on node 1 00:28:09.041 02:30:36 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:28:09.041 02:30:36 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:28:09.041 02:30:36 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:28:09.041 02:30:36 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:09.041 02:30:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:09.041 02:30:36 -- common/autotest_common.sh@10 -- # set +x 00:28:09.041 02:30:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:09.041 02:30:36 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:28:09.041 02:30:36 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:28:09.041 02:30:36 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:09.041 02:30:36 -- nvmf/common.sh@116 -- # sync 00:28:09.042 02:30:36 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:09.042 02:30:36 -- nvmf/common.sh@119 -- # set +e 00:28:09.042 02:30:36 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:09.042 02:30:36 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:09.042 rmmod nvme_tcp 00:28:09.042 rmmod nvme_fabrics 00:28:09.042 rmmod nvme_keyring 00:28:09.042 02:30:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:09.042 02:30:36 -- nvmf/common.sh@123 -- # set -e 00:28:09.042 02:30:36 -- nvmf/common.sh@124 -- # return 0 00:28:09.042 02:30:36 -- nvmf/common.sh@477 -- # '[' -n 2237463 ']' 00:28:09.042 02:30:36 -- nvmf/common.sh@478 -- # killprocess 2237463 00:28:09.042 02:30:36 -- common/autotest_common.sh@936 -- # '[' -z 2237463 ']' 00:28:09.042 02:30:36 -- common/autotest_common.sh@940 -- # kill -0 2237463 00:28:09.042 02:30:36 -- common/autotest_common.sh@941 -- # uname 00:28:09.042 02:30:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:09.042 02:30:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2237463 00:28:09.042 02:30:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:09.042 02:30:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:09.042 02:30:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2237463' 00:28:09.042 killing process with pid 2237463 00:28:09.042 02:30:36 -- common/autotest_common.sh@955 -- # kill 2237463 00:28:09.042 [2024-12-08 02:30:36.609841] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:28:09.042 02:30:36 -- common/autotest_common.sh@960 -- # wait 2237463 00:28:10.941 02:30:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:10.941 02:30:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:10.941 02:30:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:10.941 02:30:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:10.941 02:30:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:10.941 02:30:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:10.941 02:30:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:10.941 02:30:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:12.849 02:30:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:12.849 00:28:12.849 real 0m18.055s 00:28:12.849 user 0m26.431s 00:28:12.849 sys 0m2.332s 00:28:12.849 02:30:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:12.849 02:30:40 -- common/autotest_common.sh@10 -- # set +x 00:28:12.849 ************************************ 00:28:12.849 END TEST nvmf_identify_passthru 00:28:12.849 ************************************ 00:28:12.849 02:30:40 -- spdk/autotest.sh@287 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:12.849 02:30:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:12.849 02:30:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:12.849 02:30:40 -- common/autotest_common.sh@10 -- # set +x 00:28:12.849 ************************************ 00:28:12.849 START TEST nvmf_dif 00:28:12.849 ************************************ 00:28:12.849 02:30:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:12.849 * Looking for test storage... 00:28:12.849 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:28:12.849 02:30:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:12.849 02:30:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:12.849 02:30:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:12.849 02:30:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:12.849 02:30:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:12.849 02:30:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:12.849 02:30:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:12.849 02:30:40 -- scripts/common.sh@335 -- # IFS=.-: 00:28:12.849 02:30:40 -- scripts/common.sh@335 -- # read -ra ver1 00:28:12.849 02:30:40 -- scripts/common.sh@336 -- # IFS=.-: 00:28:12.849 02:30:40 -- scripts/common.sh@336 -- # read -ra ver2 00:28:12.849 02:30:40 -- scripts/common.sh@337 -- # local 'op=<' 00:28:12.849 02:30:40 -- scripts/common.sh@339 -- # ver1_l=2 00:28:12.849 02:30:40 -- scripts/common.sh@340 -- # ver2_l=1 00:28:12.849 02:30:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:12.849 02:30:40 -- scripts/common.sh@343 -- # case "$op" in 00:28:12.849 02:30:40 -- scripts/common.sh@344 -- # : 1 00:28:12.849 02:30:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:12.849 02:30:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:12.849 02:30:40 -- scripts/common.sh@364 -- # decimal 1 00:28:12.849 02:30:40 -- scripts/common.sh@352 -- # local d=1 00:28:12.849 02:30:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:12.849 02:30:40 -- scripts/common.sh@354 -- # echo 1 00:28:12.849 02:30:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:12.849 02:30:40 -- scripts/common.sh@365 -- # decimal 2 00:28:12.849 02:30:40 -- scripts/common.sh@352 -- # local d=2 00:28:12.849 02:30:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:12.849 02:30:40 -- scripts/common.sh@354 -- # echo 2 00:28:12.849 02:30:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:12.849 02:30:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:12.849 02:30:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:12.849 02:30:40 -- scripts/common.sh@367 -- # return 0 00:28:12.849 02:30:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:12.849 02:30:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:12.849 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:12.849 --rc genhtml_branch_coverage=1 00:28:12.849 --rc genhtml_function_coverage=1 00:28:12.849 --rc genhtml_legend=1 00:28:12.849 --rc geninfo_all_blocks=1 00:28:12.849 --rc geninfo_unexecuted_blocks=1 00:28:12.849 00:28:12.849 ' 00:28:12.849 02:30:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:12.849 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:12.849 --rc genhtml_branch_coverage=1 00:28:12.849 --rc genhtml_function_coverage=1 00:28:12.849 --rc genhtml_legend=1 00:28:12.849 --rc geninfo_all_blocks=1 00:28:12.849 --rc geninfo_unexecuted_blocks=1 00:28:12.849 00:28:12.849 ' 00:28:12.849 02:30:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:12.849 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:12.849 --rc genhtml_branch_coverage=1 00:28:12.849 --rc genhtml_function_coverage=1 00:28:12.849 --rc genhtml_legend=1 00:28:12.849 --rc geninfo_all_blocks=1 00:28:12.849 --rc geninfo_unexecuted_blocks=1 00:28:12.849 00:28:12.849 ' 00:28:12.849 02:30:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:12.849 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:12.849 --rc genhtml_branch_coverage=1 00:28:12.849 --rc genhtml_function_coverage=1 00:28:12.849 --rc genhtml_legend=1 00:28:12.850 --rc geninfo_all_blocks=1 00:28:12.850 --rc geninfo_unexecuted_blocks=1 00:28:12.850 00:28:12.850 ' 00:28:12.850 02:30:40 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:12.850 02:30:40 -- nvmf/common.sh@7 -- # uname -s 00:28:12.850 02:30:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:12.850 02:30:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:12.850 02:30:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:12.850 02:30:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:12.850 02:30:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:12.850 02:30:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:12.850 02:30:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:12.850 02:30:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:12.850 02:30:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:12.850 02:30:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:12.850 02:30:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:12.850 02:30:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:12.850 02:30:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:12.850 02:30:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:12.850 02:30:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:12.850 02:30:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:12.850 02:30:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:12.850 02:30:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:12.850 02:30:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:12.850 02:30:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:12.850 02:30:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:12.850 02:30:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:12.850 02:30:40 -- paths/export.sh@5 -- # export PATH 00:28:12.850 02:30:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:12.850 02:30:40 -- nvmf/common.sh@46 -- # : 0 00:28:12.850 02:30:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:12.850 02:30:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:12.850 02:30:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:12.850 02:30:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:12.850 02:30:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:12.850 02:30:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:12.850 02:30:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:12.850 02:30:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:12.850 02:30:40 -- target/dif.sh@15 -- # NULL_META=16 00:28:12.850 02:30:40 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:28:12.850 02:30:40 -- target/dif.sh@15 -- # NULL_SIZE=64 00:28:12.850 02:30:40 -- target/dif.sh@15 -- # NULL_DIF=1 00:28:12.850 02:30:40 -- target/dif.sh@135 -- # nvmftestinit 00:28:12.850 02:30:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:12.850 02:30:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:12.850 02:30:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:12.850 02:30:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:12.850 02:30:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:12.850 02:30:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:12.850 02:30:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:12.850 02:30:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:12.850 02:30:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:12.850 02:30:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:12.850 02:30:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:12.850 02:30:40 -- common/autotest_common.sh@10 -- # set +x 00:28:14.755 02:30:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:14.755 02:30:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:14.755 02:30:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:14.755 02:30:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:14.755 02:30:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:14.755 02:30:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:14.755 02:30:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:14.755 02:30:42 -- nvmf/common.sh@294 -- # net_devs=() 00:28:14.755 02:30:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:14.755 02:30:42 -- nvmf/common.sh@295 -- # e810=() 00:28:14.755 02:30:42 -- nvmf/common.sh@295 -- # local -ga e810 00:28:14.755 02:30:42 -- nvmf/common.sh@296 -- # x722=() 00:28:14.755 02:30:42 -- nvmf/common.sh@296 -- # local -ga x722 00:28:14.755 02:30:42 -- nvmf/common.sh@297 -- # mlx=() 00:28:14.755 02:30:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:14.755 02:30:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:14.755 02:30:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:14.755 02:30:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:14.755 02:30:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:14.755 02:30:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:14.755 02:30:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:14.755 02:30:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:14.755 02:30:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:14.755 02:30:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:14.755 02:30:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:14.755 02:30:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:14.755 02:30:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:14.755 02:30:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:14.755 02:30:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:14.755 02:30:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:14.755 02:30:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:14.755 02:30:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:14.755 02:30:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:14.755 02:30:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:14.755 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:14.755 02:30:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:14.755 02:30:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:14.755 02:30:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:14.755 02:30:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:14.755 02:30:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:14.755 02:30:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:14.755 02:30:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:14.755 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:14.755 02:30:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:14.755 02:30:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:14.755 02:30:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:14.755 02:30:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:14.755 02:30:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:14.755 02:30:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:14.755 02:30:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:14.755 02:30:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:14.755 02:30:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:14.755 02:30:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:14.755 02:30:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:14.755 02:30:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:14.755 02:30:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:14.755 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:14.755 02:30:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:14.755 02:30:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:14.755 02:30:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:14.755 02:30:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:14.755 02:30:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:14.755 02:30:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:14.755 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:14.755 02:30:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:14.755 02:30:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:14.755 02:30:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:14.755 02:30:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:14.755 02:30:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:14.755 02:30:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:14.755 02:30:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:14.755 02:30:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:14.755 02:30:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:14.755 02:30:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:14.755 02:30:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:14.755 02:30:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:14.755 02:30:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:14.755 02:30:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:14.755 02:30:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:14.755 02:30:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:14.755 02:30:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:14.755 02:30:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:14.755 02:30:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:14.755 02:30:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:14.755 02:30:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:14.755 02:30:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:14.755 02:30:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:14.755 02:30:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:14.755 02:30:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:14.755 02:30:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:14.755 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:14.755 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.298 ms 00:28:14.755 00:28:14.755 --- 10.0.0.2 ping statistics --- 00:28:14.755 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:14.755 rtt min/avg/max/mdev = 0.298/0.298/0.298/0.000 ms 00:28:14.755 02:30:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:14.755 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:14.755 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.141 ms 00:28:14.755 00:28:14.755 --- 10.0.0.1 ping statistics --- 00:28:14.755 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:14.755 rtt min/avg/max/mdev = 0.141/0.141/0.141/0.000 ms 00:28:14.755 02:30:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:14.755 02:30:42 -- nvmf/common.sh@410 -- # return 0 00:28:14.755 02:30:42 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:28:14.755 02:30:42 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:28:16.130 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:16.130 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:28:16.130 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:16.130 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:16.130 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:16.130 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:16.130 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:16.130 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:16.130 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:16.130 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:16.130 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:16.130 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:16.130 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:16.130 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:16.130 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:16.130 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:16.130 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:16.130 02:30:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:16.130 02:30:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:16.130 02:30:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:16.130 02:30:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:16.130 02:30:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:16.130 02:30:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:16.130 02:30:43 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:28:16.130 02:30:43 -- target/dif.sh@137 -- # nvmfappstart 00:28:16.130 02:30:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:16.130 02:30:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:16.130 02:30:43 -- common/autotest_common.sh@10 -- # set +x 00:28:16.130 02:30:43 -- nvmf/common.sh@469 -- # nvmfpid=2240693 00:28:16.130 02:30:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:28:16.130 02:30:43 -- nvmf/common.sh@470 -- # waitforlisten 2240693 00:28:16.130 02:30:43 -- common/autotest_common.sh@829 -- # '[' -z 2240693 ']' 00:28:16.130 02:30:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:16.130 02:30:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:16.130 02:30:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:16.130 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:16.130 02:30:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:16.130 02:30:43 -- common/autotest_common.sh@10 -- # set +x 00:28:16.130 [2024-12-08 02:30:43.798475] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:16.130 [2024-12-08 02:30:43.798598] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:16.130 EAL: No free 2048 kB hugepages reported on node 1 00:28:16.130 [2024-12-08 02:30:43.869216] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:16.389 [2024-12-08 02:30:43.983106] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:16.389 [2024-12-08 02:30:43.983265] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:16.389 [2024-12-08 02:30:43.983285] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:16.389 [2024-12-08 02:30:43.983298] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:16.389 [2024-12-08 02:30:43.983329] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:17.323 02:30:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:17.323 02:30:44 -- common/autotest_common.sh@862 -- # return 0 00:28:17.323 02:30:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:17.323 02:30:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:17.323 02:30:44 -- common/autotest_common.sh@10 -- # set +x 00:28:17.323 02:30:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:17.323 02:30:44 -- target/dif.sh@139 -- # create_transport 00:28:17.323 02:30:44 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:28:17.323 02:30:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:17.323 02:30:44 -- common/autotest_common.sh@10 -- # set +x 00:28:17.323 [2024-12-08 02:30:44.786984] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:17.323 02:30:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:17.323 02:30:44 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:28:17.323 02:30:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:17.323 02:30:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:17.323 02:30:44 -- common/autotest_common.sh@10 -- # set +x 00:28:17.323 ************************************ 00:28:17.323 START TEST fio_dif_1_default 00:28:17.323 ************************************ 00:28:17.323 02:30:44 -- common/autotest_common.sh@1114 -- # fio_dif_1 00:28:17.323 02:30:44 -- target/dif.sh@86 -- # create_subsystems 0 00:28:17.323 02:30:44 -- target/dif.sh@28 -- # local sub 00:28:17.323 02:30:44 -- target/dif.sh@30 -- # for sub in "$@" 00:28:17.323 02:30:44 -- target/dif.sh@31 -- # create_subsystem 0 00:28:17.323 02:30:44 -- target/dif.sh@18 -- # local sub_id=0 00:28:17.323 02:30:44 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:17.323 02:30:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:17.323 02:30:44 -- common/autotest_common.sh@10 -- # set +x 00:28:17.323 bdev_null0 00:28:17.323 02:30:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:17.323 02:30:44 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:17.323 02:30:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:17.323 02:30:44 -- common/autotest_common.sh@10 -- # set +x 00:28:17.323 02:30:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:17.323 02:30:44 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:17.323 02:30:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:17.323 02:30:44 -- common/autotest_common.sh@10 -- # set +x 00:28:17.323 02:30:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:17.323 02:30:44 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:17.323 02:30:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:17.323 02:30:44 -- common/autotest_common.sh@10 -- # set +x 00:28:17.323 [2024-12-08 02:30:44.823265] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:17.323 02:30:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:17.323 02:30:44 -- target/dif.sh@87 -- # fio /dev/fd/62 00:28:17.323 02:30:44 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:28:17.323 02:30:44 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:28:17.323 02:30:44 -- nvmf/common.sh@520 -- # config=() 00:28:17.323 02:30:44 -- nvmf/common.sh@520 -- # local subsystem config 00:28:17.323 02:30:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:17.323 02:30:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:17.323 { 00:28:17.323 "params": { 00:28:17.323 "name": "Nvme$subsystem", 00:28:17.323 "trtype": "$TEST_TRANSPORT", 00:28:17.323 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:17.323 "adrfam": "ipv4", 00:28:17.323 "trsvcid": "$NVMF_PORT", 00:28:17.323 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:17.323 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:17.323 "hdgst": ${hdgst:-false}, 00:28:17.323 "ddgst": ${ddgst:-false} 00:28:17.323 }, 00:28:17.323 "method": "bdev_nvme_attach_controller" 00:28:17.323 } 00:28:17.323 EOF 00:28:17.323 )") 00:28:17.323 02:30:44 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:17.323 02:30:44 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:17.323 02:30:44 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:17.323 02:30:44 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:17.323 02:30:44 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:17.323 02:30:44 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:17.323 02:30:44 -- target/dif.sh@82 -- # gen_fio_conf 00:28:17.323 02:30:44 -- common/autotest_common.sh@1330 -- # shift 00:28:17.323 02:30:44 -- target/dif.sh@54 -- # local file 00:28:17.323 02:30:44 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:17.323 02:30:44 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:17.323 02:30:44 -- target/dif.sh@56 -- # cat 00:28:17.323 02:30:44 -- nvmf/common.sh@542 -- # cat 00:28:17.323 02:30:44 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:17.323 02:30:44 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:17.323 02:30:44 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:17.323 02:30:44 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:17.323 02:30:44 -- target/dif.sh@72 -- # (( file <= files )) 00:28:17.323 02:30:44 -- nvmf/common.sh@544 -- # jq . 00:28:17.323 02:30:44 -- nvmf/common.sh@545 -- # IFS=, 00:28:17.323 02:30:44 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:17.323 "params": { 00:28:17.323 "name": "Nvme0", 00:28:17.323 "trtype": "tcp", 00:28:17.323 "traddr": "10.0.0.2", 00:28:17.323 "adrfam": "ipv4", 00:28:17.323 "trsvcid": "4420", 00:28:17.323 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:17.323 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:17.323 "hdgst": false, 00:28:17.323 "ddgst": false 00:28:17.323 }, 00:28:17.323 "method": "bdev_nvme_attach_controller" 00:28:17.323 }' 00:28:17.323 02:30:44 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:17.323 02:30:44 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:17.323 02:30:44 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:17.323 02:30:44 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:17.323 02:30:44 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:17.323 02:30:44 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:17.323 02:30:44 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:17.323 02:30:44 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:17.323 02:30:44 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:17.323 02:30:44 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:17.323 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:17.324 fio-3.35 00:28:17.324 Starting 1 thread 00:28:17.581 EAL: No free 2048 kB hugepages reported on node 1 00:28:17.845 [2024-12-08 02:30:45.454793] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:17.845 [2024-12-08 02:30:45.454880] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:27.812 00:28:27.812 filename0: (groupid=0, jobs=1): err= 0: pid=2241022: Sun Dec 8 02:30:55 2024 00:28:27.812 read: IOPS=189, BW=758KiB/s (776kB/s)(7584KiB/10008msec) 00:28:27.812 slat (nsec): min=4143, max=57074, avg=8279.22, stdev=2995.86 00:28:27.812 clat (usec): min=541, max=44542, avg=21087.43, stdev=20316.93 00:28:27.812 lat (usec): min=548, max=44568, avg=21095.71, stdev=20316.90 00:28:27.812 clat percentiles (usec): 00:28:27.812 | 1.00th=[ 562], 5.00th=[ 594], 10.00th=[ 611], 20.00th=[ 685], 00:28:27.812 | 30.00th=[ 742], 40.00th=[ 758], 50.00th=[40633], 60.00th=[41157], 00:28:27.812 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:28:27.812 | 99.00th=[42206], 99.50th=[42206], 99.90th=[44303], 99.95th=[44303], 00:28:27.812 | 99.99th=[44303] 00:28:27.812 bw ( KiB/s): min= 704, max= 768, per=99.76%, avg=756.80, stdev=21.47, samples=20 00:28:27.812 iops : min= 176, max= 192, avg=189.20, stdev= 5.37, samples=20 00:28:27.812 lat (usec) : 750=37.34%, 1000=12.45% 00:28:27.812 lat (msec) : 50=50.21% 00:28:27.812 cpu : usr=91.30%, sys=8.42%, ctx=19, majf=0, minf=267 00:28:27.812 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:27.812 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:27.812 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:27.812 issued rwts: total=1896,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:27.812 latency : target=0, window=0, percentile=100.00%, depth=4 00:28:27.812 00:28:27.812 Run status group 0 (all jobs): 00:28:27.812 READ: bw=758KiB/s (776kB/s), 758KiB/s-758KiB/s (776kB/s-776kB/s), io=7584KiB (7766kB), run=10008-10008msec 00:28:28.426 02:30:55 -- target/dif.sh@88 -- # destroy_subsystems 0 00:28:28.426 02:30:55 -- target/dif.sh@43 -- # local sub 00:28:28.426 02:30:55 -- target/dif.sh@45 -- # for sub in "$@" 00:28:28.426 02:30:55 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:28.426 02:30:55 -- target/dif.sh@36 -- # local sub_id=0 00:28:28.426 02:30:55 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:28.426 02:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:28.426 02:30:55 -- common/autotest_common.sh@10 -- # set +x 00:28:28.426 02:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:28.426 02:30:55 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:28.426 02:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:28.426 02:30:55 -- common/autotest_common.sh@10 -- # set +x 00:28:28.426 02:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:28.426 00:28:28.426 real 0m11.127s 00:28:28.426 user 0m10.314s 00:28:28.426 sys 0m1.102s 00:28:28.426 02:30:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:28.426 02:30:55 -- common/autotest_common.sh@10 -- # set +x 00:28:28.426 ************************************ 00:28:28.426 END TEST fio_dif_1_default 00:28:28.426 ************************************ 00:28:28.426 02:30:55 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:28:28.426 02:30:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:28.426 02:30:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:28.426 02:30:55 -- common/autotest_common.sh@10 -- # set +x 00:28:28.426 ************************************ 00:28:28.426 START TEST fio_dif_1_multi_subsystems 00:28:28.426 ************************************ 00:28:28.426 02:30:55 -- common/autotest_common.sh@1114 -- # fio_dif_1_multi_subsystems 00:28:28.426 02:30:55 -- target/dif.sh@92 -- # local files=1 00:28:28.426 02:30:55 -- target/dif.sh@94 -- # create_subsystems 0 1 00:28:28.426 02:30:55 -- target/dif.sh@28 -- # local sub 00:28:28.426 02:30:55 -- target/dif.sh@30 -- # for sub in "$@" 00:28:28.426 02:30:55 -- target/dif.sh@31 -- # create_subsystem 0 00:28:28.426 02:30:55 -- target/dif.sh@18 -- # local sub_id=0 00:28:28.426 02:30:55 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:28.426 02:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:28.426 02:30:55 -- common/autotest_common.sh@10 -- # set +x 00:28:28.426 bdev_null0 00:28:28.426 02:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:28.426 02:30:55 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:28.426 02:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:28.426 02:30:55 -- common/autotest_common.sh@10 -- # set +x 00:28:28.426 02:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:28.426 02:30:55 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:28.426 02:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:28.426 02:30:55 -- common/autotest_common.sh@10 -- # set +x 00:28:28.426 02:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:28.426 02:30:55 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:28.426 02:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:28.426 02:30:55 -- common/autotest_common.sh@10 -- # set +x 00:28:28.426 [2024-12-08 02:30:55.977976] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:28.426 02:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:28.426 02:30:55 -- target/dif.sh@30 -- # for sub in "$@" 00:28:28.426 02:30:55 -- target/dif.sh@31 -- # create_subsystem 1 00:28:28.426 02:30:55 -- target/dif.sh@18 -- # local sub_id=1 00:28:28.426 02:30:55 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:28:28.426 02:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:28.426 02:30:55 -- common/autotest_common.sh@10 -- # set +x 00:28:28.426 bdev_null1 00:28:28.426 02:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:28.426 02:30:55 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:28:28.426 02:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:28.426 02:30:55 -- common/autotest_common.sh@10 -- # set +x 00:28:28.426 02:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:28.426 02:30:55 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:28:28.426 02:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:28.426 02:30:55 -- common/autotest_common.sh@10 -- # set +x 00:28:28.426 02:30:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:28.426 02:30:56 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:28.427 02:30:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:28.427 02:30:56 -- common/autotest_common.sh@10 -- # set +x 00:28:28.427 02:30:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:28.427 02:30:56 -- target/dif.sh@95 -- # fio /dev/fd/62 00:28:28.427 02:30:56 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:28:28.427 02:30:56 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:28:28.427 02:30:56 -- nvmf/common.sh@520 -- # config=() 00:28:28.427 02:30:56 -- nvmf/common.sh@520 -- # local subsystem config 00:28:28.427 02:30:56 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:28.427 02:30:56 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:28.427 02:30:56 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:28.427 { 00:28:28.427 "params": { 00:28:28.427 "name": "Nvme$subsystem", 00:28:28.427 "trtype": "$TEST_TRANSPORT", 00:28:28.427 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:28.427 "adrfam": "ipv4", 00:28:28.427 "trsvcid": "$NVMF_PORT", 00:28:28.427 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:28.427 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:28.427 "hdgst": ${hdgst:-false}, 00:28:28.427 "ddgst": ${ddgst:-false} 00:28:28.427 }, 00:28:28.427 "method": "bdev_nvme_attach_controller" 00:28:28.427 } 00:28:28.427 EOF 00:28:28.427 )") 00:28:28.427 02:30:56 -- target/dif.sh@82 -- # gen_fio_conf 00:28:28.427 02:30:56 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:28.427 02:30:56 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:28.427 02:30:56 -- target/dif.sh@54 -- # local file 00:28:28.427 02:30:56 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:28.427 02:30:56 -- target/dif.sh@56 -- # cat 00:28:28.427 02:30:56 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:28.427 02:30:56 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:28.427 02:30:56 -- common/autotest_common.sh@1330 -- # shift 00:28:28.427 02:30:56 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:28.427 02:30:56 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:28.427 02:30:56 -- nvmf/common.sh@542 -- # cat 00:28:28.427 02:30:56 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:28.427 02:30:56 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:28.427 02:30:56 -- target/dif.sh@72 -- # (( file <= files )) 00:28:28.427 02:30:56 -- target/dif.sh@73 -- # cat 00:28:28.427 02:30:56 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:28.427 02:30:56 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:28.427 02:30:56 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:28.427 02:30:56 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:28.427 { 00:28:28.427 "params": { 00:28:28.427 "name": "Nvme$subsystem", 00:28:28.427 "trtype": "$TEST_TRANSPORT", 00:28:28.427 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:28.427 "adrfam": "ipv4", 00:28:28.427 "trsvcid": "$NVMF_PORT", 00:28:28.427 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:28.427 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:28.427 "hdgst": ${hdgst:-false}, 00:28:28.427 "ddgst": ${ddgst:-false} 00:28:28.427 }, 00:28:28.427 "method": "bdev_nvme_attach_controller" 00:28:28.427 } 00:28:28.427 EOF 00:28:28.427 )") 00:28:28.427 02:30:56 -- nvmf/common.sh@542 -- # cat 00:28:28.427 02:30:56 -- target/dif.sh@72 -- # (( file++ )) 00:28:28.427 02:30:56 -- target/dif.sh@72 -- # (( file <= files )) 00:28:28.427 02:30:56 -- nvmf/common.sh@544 -- # jq . 00:28:28.427 02:30:56 -- nvmf/common.sh@545 -- # IFS=, 00:28:28.427 02:30:56 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:28.427 "params": { 00:28:28.427 "name": "Nvme0", 00:28:28.427 "trtype": "tcp", 00:28:28.427 "traddr": "10.0.0.2", 00:28:28.427 "adrfam": "ipv4", 00:28:28.427 "trsvcid": "4420", 00:28:28.427 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:28.427 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:28.427 "hdgst": false, 00:28:28.427 "ddgst": false 00:28:28.427 }, 00:28:28.427 "method": "bdev_nvme_attach_controller" 00:28:28.427 },{ 00:28:28.427 "params": { 00:28:28.427 "name": "Nvme1", 00:28:28.427 "trtype": "tcp", 00:28:28.427 "traddr": "10.0.0.2", 00:28:28.427 "adrfam": "ipv4", 00:28:28.427 "trsvcid": "4420", 00:28:28.427 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:28:28.427 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:28:28.427 "hdgst": false, 00:28:28.427 "ddgst": false 00:28:28.427 }, 00:28:28.427 "method": "bdev_nvme_attach_controller" 00:28:28.427 }' 00:28:28.427 02:30:56 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:28.427 02:30:56 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:28.427 02:30:56 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:28.427 02:30:56 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:28.427 02:30:56 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:28.427 02:30:56 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:28.427 02:30:56 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:28.427 02:30:56 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:28.427 02:30:56 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:28.427 02:30:56 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:28.684 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:28.684 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:28.684 fio-3.35 00:28:28.684 Starting 2 threads 00:28:28.684 EAL: No free 2048 kB hugepages reported on node 1 00:28:29.249 [2024-12-08 02:30:56.927915] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:29.249 [2024-12-08 02:30:56.927985] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:41.444 00:28:41.444 filename0: (groupid=0, jobs=1): err= 0: pid=2242473: Sun Dec 8 02:31:07 2024 00:28:41.444 read: IOPS=97, BW=392KiB/s (401kB/s)(3920KiB/10010msec) 00:28:41.444 slat (nsec): min=6494, max=71050, avg=8815.14, stdev=3280.42 00:28:41.444 clat (usec): min=580, max=45800, avg=40828.66, stdev=2595.56 00:28:41.444 lat (usec): min=587, max=45829, avg=40837.48, stdev=2594.67 00:28:41.444 clat percentiles (usec): 00:28:41.444 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:28:41.444 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:28:41.444 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:28:41.444 | 99.00th=[41157], 99.50th=[41157], 99.90th=[45876], 99.95th=[45876], 00:28:41.444 | 99.99th=[45876] 00:28:41.444 bw ( KiB/s): min= 384, max= 416, per=49.61%, avg=390.40, stdev=13.13, samples=20 00:28:41.444 iops : min= 96, max= 104, avg=97.60, stdev= 3.28, samples=20 00:28:41.444 lat (usec) : 750=0.41% 00:28:41.444 lat (msec) : 50=99.59% 00:28:41.444 cpu : usr=95.32%, sys=4.37%, ctx=16, majf=0, minf=227 00:28:41.444 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:41.444 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:41.444 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:41.444 issued rwts: total=980,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:41.444 latency : target=0, window=0, percentile=100.00%, depth=4 00:28:41.444 filename1: (groupid=0, jobs=1): err= 0: pid=2242474: Sun Dec 8 02:31:07 2024 00:28:41.444 read: IOPS=98, BW=395KiB/s (404kB/s)(3952KiB/10013msec) 00:28:41.444 slat (nsec): min=6110, max=28608, avg=8808.93, stdev=2629.54 00:28:41.444 clat (usec): min=553, max=47794, avg=40510.05, stdev=4448.87 00:28:41.444 lat (usec): min=560, max=47822, avg=40518.86, stdev=4448.90 00:28:41.444 clat percentiles (usec): 00:28:41.444 | 1.00th=[ 627], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:28:41.444 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:28:41.444 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:28:41.444 | 99.00th=[41157], 99.50th=[41157], 99.90th=[47973], 99.95th=[47973], 00:28:41.444 | 99.99th=[47973] 00:28:41.444 bw ( KiB/s): min= 384, max= 448, per=49.99%, avg=393.60, stdev=18.28, samples=20 00:28:41.444 iops : min= 96, max= 112, avg=98.40, stdev= 4.57, samples=20 00:28:41.444 lat (usec) : 750=1.21% 00:28:41.444 lat (msec) : 50=98.79% 00:28:41.444 cpu : usr=95.13%, sys=4.56%, ctx=15, majf=0, minf=131 00:28:41.444 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:41.444 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:41.444 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:41.444 issued rwts: total=988,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:41.444 latency : target=0, window=0, percentile=100.00%, depth=4 00:28:41.444 00:28:41.444 Run status group 0 (all jobs): 00:28:41.444 READ: bw=786KiB/s (805kB/s), 392KiB/s-395KiB/s (401kB/s-404kB/s), io=7872KiB (8061kB), run=10010-10013msec 00:28:41.444 02:31:07 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:28:41.444 02:31:07 -- target/dif.sh@43 -- # local sub 00:28:41.444 02:31:07 -- target/dif.sh@45 -- # for sub in "$@" 00:28:41.444 02:31:07 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:41.444 02:31:07 -- target/dif.sh@36 -- # local sub_id=0 00:28:41.444 02:31:07 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:41.444 02:31:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.444 02:31:07 -- common/autotest_common.sh@10 -- # set +x 00:28:41.444 02:31:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.444 02:31:07 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:41.444 02:31:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.444 02:31:07 -- common/autotest_common.sh@10 -- # set +x 00:28:41.444 02:31:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.444 02:31:07 -- target/dif.sh@45 -- # for sub in "$@" 00:28:41.444 02:31:07 -- target/dif.sh@46 -- # destroy_subsystem 1 00:28:41.444 02:31:07 -- target/dif.sh@36 -- # local sub_id=1 00:28:41.444 02:31:07 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:41.444 02:31:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.444 02:31:07 -- common/autotest_common.sh@10 -- # set +x 00:28:41.444 02:31:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.444 02:31:07 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:28:41.444 02:31:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.444 02:31:07 -- common/autotest_common.sh@10 -- # set +x 00:28:41.444 02:31:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.444 00:28:41.444 real 0m11.478s 00:28:41.444 user 0m20.585s 00:28:41.444 sys 0m1.177s 00:28:41.444 02:31:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:41.444 02:31:07 -- common/autotest_common.sh@10 -- # set +x 00:28:41.444 ************************************ 00:28:41.444 END TEST fio_dif_1_multi_subsystems 00:28:41.444 ************************************ 00:28:41.444 02:31:07 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:28:41.444 02:31:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:41.444 02:31:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:41.444 02:31:07 -- common/autotest_common.sh@10 -- # set +x 00:28:41.444 ************************************ 00:28:41.444 START TEST fio_dif_rand_params 00:28:41.444 ************************************ 00:28:41.444 02:31:07 -- common/autotest_common.sh@1114 -- # fio_dif_rand_params 00:28:41.444 02:31:07 -- target/dif.sh@100 -- # local NULL_DIF 00:28:41.444 02:31:07 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:28:41.444 02:31:07 -- target/dif.sh@103 -- # NULL_DIF=3 00:28:41.444 02:31:07 -- target/dif.sh@103 -- # bs=128k 00:28:41.444 02:31:07 -- target/dif.sh@103 -- # numjobs=3 00:28:41.444 02:31:07 -- target/dif.sh@103 -- # iodepth=3 00:28:41.444 02:31:07 -- target/dif.sh@103 -- # runtime=5 00:28:41.444 02:31:07 -- target/dif.sh@105 -- # create_subsystems 0 00:28:41.444 02:31:07 -- target/dif.sh@28 -- # local sub 00:28:41.444 02:31:07 -- target/dif.sh@30 -- # for sub in "$@" 00:28:41.444 02:31:07 -- target/dif.sh@31 -- # create_subsystem 0 00:28:41.444 02:31:07 -- target/dif.sh@18 -- # local sub_id=0 00:28:41.444 02:31:07 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:28:41.444 02:31:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.444 02:31:07 -- common/autotest_common.sh@10 -- # set +x 00:28:41.444 bdev_null0 00:28:41.444 02:31:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.444 02:31:07 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:41.445 02:31:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.445 02:31:07 -- common/autotest_common.sh@10 -- # set +x 00:28:41.445 02:31:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.445 02:31:07 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:41.445 02:31:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.445 02:31:07 -- common/autotest_common.sh@10 -- # set +x 00:28:41.445 02:31:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.445 02:31:07 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:41.445 02:31:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.445 02:31:07 -- common/autotest_common.sh@10 -- # set +x 00:28:41.445 [2024-12-08 02:31:07.478907] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:41.445 02:31:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.445 02:31:07 -- target/dif.sh@106 -- # fio /dev/fd/62 00:28:41.445 02:31:07 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:28:41.445 02:31:07 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:28:41.445 02:31:07 -- nvmf/common.sh@520 -- # config=() 00:28:41.445 02:31:07 -- nvmf/common.sh@520 -- # local subsystem config 00:28:41.445 02:31:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:41.445 02:31:07 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:41.445 02:31:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:41.445 { 00:28:41.445 "params": { 00:28:41.445 "name": "Nvme$subsystem", 00:28:41.445 "trtype": "$TEST_TRANSPORT", 00:28:41.445 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:41.445 "adrfam": "ipv4", 00:28:41.445 "trsvcid": "$NVMF_PORT", 00:28:41.445 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:41.445 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:41.445 "hdgst": ${hdgst:-false}, 00:28:41.445 "ddgst": ${ddgst:-false} 00:28:41.445 }, 00:28:41.445 "method": "bdev_nvme_attach_controller" 00:28:41.445 } 00:28:41.445 EOF 00:28:41.445 )") 00:28:41.445 02:31:07 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:41.445 02:31:07 -- target/dif.sh@82 -- # gen_fio_conf 00:28:41.445 02:31:07 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:41.445 02:31:07 -- target/dif.sh@54 -- # local file 00:28:41.445 02:31:07 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:41.445 02:31:07 -- target/dif.sh@56 -- # cat 00:28:41.445 02:31:07 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:41.445 02:31:07 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:41.445 02:31:07 -- common/autotest_common.sh@1330 -- # shift 00:28:41.445 02:31:07 -- nvmf/common.sh@542 -- # cat 00:28:41.445 02:31:07 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:41.445 02:31:07 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:41.445 02:31:07 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:41.445 02:31:07 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:41.445 02:31:07 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:41.445 02:31:07 -- target/dif.sh@72 -- # (( file <= files )) 00:28:41.445 02:31:07 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:41.445 02:31:07 -- nvmf/common.sh@544 -- # jq . 00:28:41.445 02:31:07 -- nvmf/common.sh@545 -- # IFS=, 00:28:41.445 02:31:07 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:41.445 "params": { 00:28:41.445 "name": "Nvme0", 00:28:41.445 "trtype": "tcp", 00:28:41.445 "traddr": "10.0.0.2", 00:28:41.445 "adrfam": "ipv4", 00:28:41.445 "trsvcid": "4420", 00:28:41.445 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:41.445 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:41.445 "hdgst": false, 00:28:41.445 "ddgst": false 00:28:41.445 }, 00:28:41.445 "method": "bdev_nvme_attach_controller" 00:28:41.445 }' 00:28:41.445 02:31:07 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:41.445 02:31:07 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:41.445 02:31:07 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:41.445 02:31:07 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:41.445 02:31:07 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:41.445 02:31:07 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:41.445 02:31:07 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:41.445 02:31:07 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:41.445 02:31:07 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:41.445 02:31:07 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:41.445 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:28:41.445 ... 00:28:41.445 fio-3.35 00:28:41.445 Starting 3 threads 00:28:41.445 EAL: No free 2048 kB hugepages reported on node 1 00:28:41.445 [2024-12-08 02:31:08.127401] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:41.445 [2024-12-08 02:31:08.127486] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:45.631 00:28:45.631 filename0: (groupid=0, jobs=1): err= 0: pid=2243910: Sun Dec 8 02:31:13 2024 00:28:45.631 read: IOPS=235, BW=29.5MiB/s (30.9MB/s)(149MiB/5046msec) 00:28:45.631 slat (nsec): min=5018, max=39708, avg=12953.60, stdev=3379.03 00:28:45.631 clat (usec): min=7957, max=55309, avg=12666.24, stdev=6659.32 00:28:45.631 lat (usec): min=7968, max=55322, avg=12679.20, stdev=6659.04 00:28:45.631 clat percentiles (usec): 00:28:45.631 | 1.00th=[ 8848], 5.00th=[ 9503], 10.00th=[ 9896], 20.00th=[10290], 00:28:45.631 | 30.00th=[10683], 40.00th=[11076], 50.00th=[11469], 60.00th=[11863], 00:28:45.631 | 70.00th=[12256], 80.00th=[12911], 90.00th=[13829], 95.00th=[15008], 00:28:45.631 | 99.00th=[52167], 99.50th=[53216], 99.90th=[54264], 99.95th=[55313], 00:28:45.631 | 99.99th=[55313] 00:28:45.631 bw ( KiB/s): min=19712, max=34560, per=33.91%, avg=30412.80, stdev=4379.19, samples=10 00:28:45.631 iops : min= 154, max= 270, avg=237.60, stdev=34.21, samples=10 00:28:45.631 lat (msec) : 10=12.61%, 20=84.45%, 50=0.67%, 100=2.27% 00:28:45.631 cpu : usr=92.78%, sys=6.74%, ctx=11, majf=0, minf=118 00:28:45.631 IO depths : 1=0.3%, 2=99.7%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:45.631 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.631 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.632 issued rwts: total=1190,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:45.632 latency : target=0, window=0, percentile=100.00%, depth=3 00:28:45.632 filename0: (groupid=0, jobs=1): err= 0: pid=2243911: Sun Dec 8 02:31:13 2024 00:28:45.632 read: IOPS=232, BW=29.1MiB/s (30.5MB/s)(146MiB/5005msec) 00:28:45.632 slat (nsec): min=4652, max=33270, avg=12636.98, stdev=2461.46 00:28:45.632 clat (usec): min=7006, max=53038, avg=12859.91, stdev=3001.08 00:28:45.632 lat (usec): min=7017, max=53050, avg=12872.55, stdev=3001.00 00:28:45.632 clat percentiles (usec): 00:28:45.632 | 1.00th=[ 7635], 5.00th=[ 8586], 10.00th=[ 9634], 20.00th=[11076], 00:28:45.632 | 30.00th=[11600], 40.00th=[12256], 50.00th=[12911], 60.00th=[13435], 00:28:45.632 | 70.00th=[13960], 80.00th=[14746], 90.00th=[15533], 95.00th=[16319], 00:28:45.632 | 99.00th=[17695], 99.50th=[19792], 99.90th=[53216], 99.95th=[53216], 00:28:45.632 | 99.99th=[53216] 00:28:45.632 bw ( KiB/s): min=25856, max=31744, per=33.20%, avg=29778.60, stdev=1621.57, samples=10 00:28:45.632 iops : min= 202, max= 248, avg=232.60, stdev=12.69, samples=10 00:28:45.632 lat (msec) : 10=12.01%, 20=87.74%, 100=0.26% 00:28:45.632 cpu : usr=93.11%, sys=6.39%, ctx=13, majf=0, minf=169 00:28:45.632 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:45.632 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.632 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.632 issued rwts: total=1166,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:45.632 latency : target=0, window=0, percentile=100.00%, depth=3 00:28:45.632 filename0: (groupid=0, jobs=1): err= 0: pid=2243912: Sun Dec 8 02:31:13 2024 00:28:45.632 read: IOPS=233, BW=29.2MiB/s (30.7MB/s)(148MiB/5046msec) 00:28:45.632 slat (nsec): min=4212, max=71075, avg=12518.59, stdev=3165.41 00:28:45.632 clat (usec): min=4518, max=48037, avg=12775.37, stdev=2760.15 00:28:45.632 lat (usec): min=4526, max=48050, avg=12787.89, stdev=2760.28 00:28:45.632 clat percentiles (usec): 00:28:45.632 | 1.00th=[ 5211], 5.00th=[ 8356], 10.00th=[ 9372], 20.00th=[10945], 00:28:45.632 | 30.00th=[11731], 40.00th=[12256], 50.00th=[12911], 60.00th=[13566], 00:28:45.632 | 70.00th=[14222], 80.00th=[14746], 90.00th=[15401], 95.00th=[15926], 00:28:45.632 | 99.00th=[17433], 99.50th=[18744], 99.90th=[46400], 99.95th=[47973], 00:28:45.632 | 99.99th=[47973] 00:28:45.632 bw ( KiB/s): min=27904, max=36352, per=33.59%, avg=30131.20, stdev=2674.22, samples=10 00:28:45.632 iops : min= 218, max= 284, avg=235.40, stdev=20.89, samples=10 00:28:45.632 lat (msec) : 10=12.80%, 20=87.03%, 50=0.17% 00:28:45.632 cpu : usr=94.03%, sys=5.47%, ctx=9, majf=0, minf=205 00:28:45.632 IO depths : 1=0.4%, 2=99.6%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:45.632 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.632 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.632 issued rwts: total=1180,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:45.632 latency : target=0, window=0, percentile=100.00%, depth=3 00:28:45.632 00:28:45.632 Run status group 0 (all jobs): 00:28:45.632 READ: bw=87.6MiB/s (91.8MB/s), 29.1MiB/s-29.5MiB/s (30.5MB/s-30.9MB/s), io=442MiB (463MB), run=5005-5046msec 00:28:45.890 02:31:13 -- target/dif.sh@107 -- # destroy_subsystems 0 00:28:45.890 02:31:13 -- target/dif.sh@43 -- # local sub 00:28:45.890 02:31:13 -- target/dif.sh@45 -- # for sub in "$@" 00:28:45.890 02:31:13 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:45.890 02:31:13 -- target/dif.sh@36 -- # local sub_id=0 00:28:45.890 02:31:13 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:45.890 02:31:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:45.890 02:31:13 -- common/autotest_common.sh@10 -- # set +x 00:28:45.890 02:31:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:45.890 02:31:13 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:45.890 02:31:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:45.890 02:31:13 -- common/autotest_common.sh@10 -- # set +x 00:28:45.890 02:31:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:45.890 02:31:13 -- target/dif.sh@109 -- # NULL_DIF=2 00:28:45.890 02:31:13 -- target/dif.sh@109 -- # bs=4k 00:28:45.890 02:31:13 -- target/dif.sh@109 -- # numjobs=8 00:28:45.890 02:31:13 -- target/dif.sh@109 -- # iodepth=16 00:28:45.890 02:31:13 -- target/dif.sh@109 -- # runtime= 00:28:45.890 02:31:13 -- target/dif.sh@109 -- # files=2 00:28:45.890 02:31:13 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:28:45.890 02:31:13 -- target/dif.sh@28 -- # local sub 00:28:45.890 02:31:13 -- target/dif.sh@30 -- # for sub in "$@" 00:28:45.890 02:31:13 -- target/dif.sh@31 -- # create_subsystem 0 00:28:45.890 02:31:13 -- target/dif.sh@18 -- # local sub_id=0 00:28:45.890 02:31:13 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:28:45.890 02:31:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:45.890 02:31:13 -- common/autotest_common.sh@10 -- # set +x 00:28:45.890 bdev_null0 00:28:45.890 02:31:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:45.890 02:31:13 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:45.890 02:31:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:45.890 02:31:13 -- common/autotest_common.sh@10 -- # set +x 00:28:45.890 02:31:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:45.890 02:31:13 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:45.890 02:31:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:45.891 02:31:13 -- common/autotest_common.sh@10 -- # set +x 00:28:45.891 02:31:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:45.891 02:31:13 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:45.891 02:31:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:45.891 02:31:13 -- common/autotest_common.sh@10 -- # set +x 00:28:45.891 [2024-12-08 02:31:13.550076] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:45.891 02:31:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:45.891 02:31:13 -- target/dif.sh@30 -- # for sub in "$@" 00:28:45.891 02:31:13 -- target/dif.sh@31 -- # create_subsystem 1 00:28:45.891 02:31:13 -- target/dif.sh@18 -- # local sub_id=1 00:28:45.891 02:31:13 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:28:45.891 02:31:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:45.891 02:31:13 -- common/autotest_common.sh@10 -- # set +x 00:28:45.891 bdev_null1 00:28:45.891 02:31:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:45.891 02:31:13 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:28:45.891 02:31:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:45.891 02:31:13 -- common/autotest_common.sh@10 -- # set +x 00:28:45.891 02:31:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:45.891 02:31:13 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:28:45.891 02:31:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:45.891 02:31:13 -- common/autotest_common.sh@10 -- # set +x 00:28:45.891 02:31:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:45.891 02:31:13 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:45.891 02:31:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:45.891 02:31:13 -- common/autotest_common.sh@10 -- # set +x 00:28:45.891 02:31:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:45.891 02:31:13 -- target/dif.sh@30 -- # for sub in "$@" 00:28:45.891 02:31:13 -- target/dif.sh@31 -- # create_subsystem 2 00:28:45.891 02:31:13 -- target/dif.sh@18 -- # local sub_id=2 00:28:45.891 02:31:13 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:28:45.891 02:31:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:45.891 02:31:13 -- common/autotest_common.sh@10 -- # set +x 00:28:45.891 bdev_null2 00:28:45.891 02:31:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:45.891 02:31:13 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:28:45.891 02:31:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:45.891 02:31:13 -- common/autotest_common.sh@10 -- # set +x 00:28:45.891 02:31:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:45.891 02:31:13 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:28:45.891 02:31:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:45.891 02:31:13 -- common/autotest_common.sh@10 -- # set +x 00:28:45.891 02:31:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:45.891 02:31:13 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:28:45.891 02:31:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:45.891 02:31:13 -- common/autotest_common.sh@10 -- # set +x 00:28:45.891 02:31:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:45.891 02:31:13 -- target/dif.sh@112 -- # fio /dev/fd/62 00:28:45.891 02:31:13 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:28:45.891 02:31:13 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:28:45.891 02:31:13 -- nvmf/common.sh@520 -- # config=() 00:28:45.891 02:31:13 -- nvmf/common.sh@520 -- # local subsystem config 00:28:45.891 02:31:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:45.891 02:31:13 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:45.891 02:31:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:45.891 { 00:28:45.891 "params": { 00:28:45.891 "name": "Nvme$subsystem", 00:28:45.891 "trtype": "$TEST_TRANSPORT", 00:28:45.891 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:45.891 "adrfam": "ipv4", 00:28:45.891 "trsvcid": "$NVMF_PORT", 00:28:45.891 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:45.891 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:45.891 "hdgst": ${hdgst:-false}, 00:28:45.891 "ddgst": ${ddgst:-false} 00:28:45.891 }, 00:28:45.891 "method": "bdev_nvme_attach_controller" 00:28:45.891 } 00:28:45.891 EOF 00:28:45.891 )") 00:28:45.891 02:31:13 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:45.891 02:31:13 -- target/dif.sh@82 -- # gen_fio_conf 00:28:45.891 02:31:13 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:45.891 02:31:13 -- target/dif.sh@54 -- # local file 00:28:45.891 02:31:13 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:45.891 02:31:13 -- target/dif.sh@56 -- # cat 00:28:45.891 02:31:13 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:45.891 02:31:13 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:45.891 02:31:13 -- common/autotest_common.sh@1330 -- # shift 00:28:45.891 02:31:13 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:45.891 02:31:13 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:45.891 02:31:13 -- nvmf/common.sh@542 -- # cat 00:28:45.891 02:31:13 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:45.891 02:31:13 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:45.891 02:31:13 -- target/dif.sh@72 -- # (( file <= files )) 00:28:45.891 02:31:13 -- target/dif.sh@73 -- # cat 00:28:45.891 02:31:13 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:45.891 02:31:13 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:45.891 02:31:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:45.891 02:31:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:45.891 { 00:28:45.891 "params": { 00:28:45.891 "name": "Nvme$subsystem", 00:28:45.891 "trtype": "$TEST_TRANSPORT", 00:28:45.891 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:45.891 "adrfam": "ipv4", 00:28:45.891 "trsvcid": "$NVMF_PORT", 00:28:45.891 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:45.891 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:45.891 "hdgst": ${hdgst:-false}, 00:28:45.891 "ddgst": ${ddgst:-false} 00:28:45.891 }, 00:28:45.891 "method": "bdev_nvme_attach_controller" 00:28:45.891 } 00:28:45.891 EOF 00:28:45.891 )") 00:28:45.891 02:31:13 -- nvmf/common.sh@542 -- # cat 00:28:45.891 02:31:13 -- target/dif.sh@72 -- # (( file++ )) 00:28:45.891 02:31:13 -- target/dif.sh@72 -- # (( file <= files )) 00:28:45.891 02:31:13 -- target/dif.sh@73 -- # cat 00:28:45.891 02:31:13 -- target/dif.sh@72 -- # (( file++ )) 00:28:45.891 02:31:13 -- target/dif.sh@72 -- # (( file <= files )) 00:28:45.891 02:31:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:45.891 02:31:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:45.891 { 00:28:45.891 "params": { 00:28:45.891 "name": "Nvme$subsystem", 00:28:45.891 "trtype": "$TEST_TRANSPORT", 00:28:45.891 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:45.891 "adrfam": "ipv4", 00:28:45.891 "trsvcid": "$NVMF_PORT", 00:28:45.891 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:45.891 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:45.891 "hdgst": ${hdgst:-false}, 00:28:45.891 "ddgst": ${ddgst:-false} 00:28:45.891 }, 00:28:45.891 "method": "bdev_nvme_attach_controller" 00:28:45.891 } 00:28:45.891 EOF 00:28:45.891 )") 00:28:45.891 02:31:13 -- nvmf/common.sh@542 -- # cat 00:28:45.891 02:31:13 -- nvmf/common.sh@544 -- # jq . 00:28:45.891 02:31:13 -- nvmf/common.sh@545 -- # IFS=, 00:28:45.891 02:31:13 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:45.891 "params": { 00:28:45.891 "name": "Nvme0", 00:28:45.891 "trtype": "tcp", 00:28:45.891 "traddr": "10.0.0.2", 00:28:45.891 "adrfam": "ipv4", 00:28:45.891 "trsvcid": "4420", 00:28:45.891 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:45.891 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:45.891 "hdgst": false, 00:28:45.891 "ddgst": false 00:28:45.891 }, 00:28:45.891 "method": "bdev_nvme_attach_controller" 00:28:45.891 },{ 00:28:45.891 "params": { 00:28:45.891 "name": "Nvme1", 00:28:45.891 "trtype": "tcp", 00:28:45.891 "traddr": "10.0.0.2", 00:28:45.891 "adrfam": "ipv4", 00:28:45.891 "trsvcid": "4420", 00:28:45.891 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:28:45.891 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:28:45.891 "hdgst": false, 00:28:45.891 "ddgst": false 00:28:45.891 }, 00:28:45.891 "method": "bdev_nvme_attach_controller" 00:28:45.891 },{ 00:28:45.891 "params": { 00:28:45.891 "name": "Nvme2", 00:28:45.891 "trtype": "tcp", 00:28:45.891 "traddr": "10.0.0.2", 00:28:45.891 "adrfam": "ipv4", 00:28:45.891 "trsvcid": "4420", 00:28:45.891 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:28:45.891 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:28:45.891 "hdgst": false, 00:28:45.891 "ddgst": false 00:28:45.891 }, 00:28:45.891 "method": "bdev_nvme_attach_controller" 00:28:45.891 }' 00:28:45.891 02:31:13 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:45.891 02:31:13 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:45.891 02:31:13 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:45.891 02:31:13 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:45.891 02:31:13 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:45.891 02:31:13 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:45.891 02:31:13 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:45.891 02:31:13 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:45.891 02:31:13 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:45.891 02:31:13 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:46.150 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:28:46.150 ... 00:28:46.150 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:28:46.150 ... 00:28:46.150 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:28:46.150 ... 00:28:46.150 fio-3.35 00:28:46.150 Starting 24 threads 00:28:46.150 EAL: No free 2048 kB hugepages reported on node 1 00:28:47.085 [2024-12-08 02:31:14.795716] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:47.085 [2024-12-08 02:31:14.795782] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:59.293 00:28:59.293 filename0: (groupid=0, jobs=1): err= 0: pid=2244796: Sun Dec 8 02:31:25 2024 00:28:59.293 read: IOPS=435, BW=1740KiB/s (1782kB/s)(17.3MiB/10163msec) 00:28:59.293 slat (nsec): min=7739, max=94578, avg=14568.25, stdev=14689.24 00:28:59.293 clat (msec): min=4, max=296, avg=36.53, stdev=32.97 00:28:59.293 lat (msec): min=4, max=296, avg=36.55, stdev=32.97 00:28:59.293 clat percentiles (msec): 00:28:59.293 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:28:59.293 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:59.293 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 35], 00:28:59.293 | 99.00th=[ 279], 99.50th=[ 284], 99.90th=[ 296], 99.95th=[ 296], 00:28:59.293 | 99.99th=[ 296] 00:28:59.293 bw ( KiB/s): min= 256, max= 2048, per=4.27%, avg=1762.40, stdev=633.11, samples=20 00:28:59.293 iops : min= 64, max= 512, avg=440.60, stdev=158.28, samples=20 00:28:59.293 lat (msec) : 10=0.63%, 20=0.23%, 50=96.61%, 250=1.13%, 500=1.40% 00:28:59.293 cpu : usr=98.76%, sys=0.84%, ctx=18, majf=0, minf=72 00:28:59.293 IO depths : 1=6.1%, 2=12.3%, 4=24.8%, 8=50.4%, 16=6.4%, 32=0.0%, >=64=0.0% 00:28:59.293 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.293 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.293 issued rwts: total=4422,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:59.293 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:59.293 filename0: (groupid=0, jobs=1): err= 0: pid=2244797: Sun Dec 8 02:31:25 2024 00:28:59.293 read: IOPS=432, BW=1732KiB/s (1774kB/s)(17.2MiB/10162msec) 00:28:59.293 slat (usec): min=5, max=206, avg=24.35, stdev=17.51 00:28:59.293 clat (msec): min=16, max=308, avg=36.75, stdev=33.56 00:28:59.293 lat (msec): min=16, max=308, avg=36.78, stdev=33.56 00:28:59.293 clat percentiles (msec): 00:28:59.293 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 32], 00:28:59.293 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:59.293 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 35], 00:28:59.293 | 99.00th=[ 266], 99.50th=[ 271], 99.90th=[ 309], 99.95th=[ 309], 00:28:59.293 | 99.99th=[ 309] 00:28:59.293 bw ( KiB/s): min= 256, max= 2048, per=4.25%, avg=1753.60, stdev=631.32, samples=20 00:28:59.293 iops : min= 64, max= 512, avg=438.40, stdev=157.83, samples=20 00:28:59.293 lat (msec) : 20=0.36%, 50=97.09%, 250=0.73%, 500=1.82% 00:28:59.293 cpu : usr=98.59%, sys=1.00%, ctx=22, majf=0, minf=52 00:28:59.293 IO depths : 1=6.1%, 2=12.3%, 4=24.9%, 8=50.2%, 16=6.4%, 32=0.0%, >=64=0.0% 00:28:59.293 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.293 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.293 issued rwts: total=4400,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:59.293 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:59.293 filename0: (groupid=0, jobs=1): err= 0: pid=2244798: Sun Dec 8 02:31:25 2024 00:28:59.293 read: IOPS=430, BW=1723KiB/s (1764kB/s)(17.0MiB/10131msec) 00:28:59.293 slat (usec): min=5, max=109, avg=31.98, stdev=19.20 00:28:59.293 clat (msec): min=8, max=408, avg=36.91, stdev=40.37 00:28:59.293 lat (msec): min=8, max=408, avg=36.94, stdev=40.37 00:28:59.293 clat percentiles (msec): 00:28:59.293 | 1.00th=[ 18], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:28:59.293 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:59.293 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 35], 00:28:59.293 | 99.00th=[ 347], 99.50th=[ 355], 99.90th=[ 368], 99.95th=[ 376], 00:28:59.293 | 99.99th=[ 409] 00:28:59.293 bw ( KiB/s): min= 128, max= 2160, per=4.22%, avg=1739.35, stdev=680.64, samples=20 00:28:59.293 iops : min= 32, max= 540, avg=434.80, stdev=170.16, samples=20 00:28:59.293 lat (msec) : 10=0.32%, 20=1.10%, 50=95.83%, 100=0.92%, 500=1.83% 00:28:59.293 cpu : usr=97.35%, sys=1.44%, ctx=127, majf=0, minf=54 00:28:59.293 IO depths : 1=0.9%, 2=6.9%, 4=24.1%, 8=56.5%, 16=11.7%, 32=0.0%, >=64=0.0% 00:28:59.293 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.293 complete : 0=0.0%, 4=94.2%, 8=0.3%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.293 issued rwts: total=4364,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:59.293 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:59.293 filename0: (groupid=0, jobs=1): err= 0: pid=2244799: Sun Dec 8 02:31:25 2024 00:28:59.293 read: IOPS=428, BW=1714KiB/s (1755kB/s)(16.9MiB/10123msec) 00:28:59.293 slat (usec): min=7, max=135, avg=42.01, stdev=16.63 00:28:59.293 clat (msec): min=10, max=365, avg=36.96, stdev=40.39 00:28:59.293 lat (msec): min=10, max=365, avg=37.00, stdev=40.39 00:28:59.293 clat percentiles (msec): 00:28:59.293 | 1.00th=[ 26], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:28:59.294 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:59.294 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 36], 00:28:59.294 | 99.00th=[ 347], 99.50th=[ 351], 99.90th=[ 368], 99.95th=[ 368], 00:28:59.294 | 99.99th=[ 368] 00:28:59.294 bw ( KiB/s): min= 128, max= 2096, per=4.19%, avg=1728.80, stdev=678.73, samples=20 00:28:59.294 iops : min= 32, max= 524, avg=432.20, stdev=169.68, samples=20 00:28:59.294 lat (msec) : 20=0.55%, 50=97.05%, 100=0.55%, 500=1.84% 00:28:59.294 cpu : usr=96.34%, sys=2.12%, ctx=308, majf=0, minf=57 00:28:59.294 IO depths : 1=4.8%, 2=10.7%, 4=23.6%, 8=53.0%, 16=7.9%, 32=0.0%, >=64=0.0% 00:28:59.294 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.294 complete : 0=0.0%, 4=93.8%, 8=0.6%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.294 issued rwts: total=4338,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:59.294 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:59.294 filename0: (groupid=0, jobs=1): err= 0: pid=2244800: Sun Dec 8 02:31:25 2024 00:28:59.294 read: IOPS=430, BW=1721KiB/s (1762kB/s)(17.1MiB/10149msec) 00:28:59.294 slat (nsec): min=8053, max=97933, avg=26864.31, stdev=10438.03 00:28:59.294 clat (msec): min=27, max=565, avg=36.95, stdev=38.56 00:28:59.294 lat (msec): min=27, max=565, avg=36.97, stdev=38.56 00:28:59.294 clat percentiles (msec): 00:28:59.294 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 32], 00:28:59.294 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:59.294 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 35], 00:28:59.294 | 99.00th=[ 334], 99.50th=[ 338], 99.90th=[ 376], 99.95th=[ 376], 00:28:59.294 | 99.99th=[ 567] 00:28:59.294 bw ( KiB/s): min= 144, max= 2048, per=4.22%, avg=1740.00, stdev=664.13, samples=20 00:28:59.294 iops : min= 36, max= 512, avg=435.00, stdev=166.03, samples=20 00:28:59.294 lat (msec) : 50=97.85%, 250=0.73%, 500=1.37%, 750=0.05% 00:28:59.294 cpu : usr=98.77%, sys=0.83%, ctx=25, majf=0, minf=59 00:28:59.294 IO depths : 1=5.2%, 2=11.5%, 4=25.0%, 8=51.1%, 16=7.3%, 32=0.0%, >=64=0.0% 00:28:59.294 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.294 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.294 issued rwts: total=4366,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:59.294 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:59.294 filename0: (groupid=0, jobs=1): err= 0: pid=2244801: Sun Dec 8 02:31:25 2024 00:28:59.294 read: IOPS=428, BW=1713KiB/s (1754kB/s)(16.9MiB/10123msec) 00:28:59.294 slat (usec): min=7, max=325, avg=47.90, stdev=18.95 00:28:59.294 clat (msec): min=17, max=417, avg=36.92, stdev=40.38 00:28:59.294 lat (msec): min=17, max=417, avg=36.96, stdev=40.38 00:28:59.294 clat percentiles (msec): 00:28:59.294 | 1.00th=[ 27], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:28:59.294 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:59.294 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 35], 00:28:59.294 | 99.00th=[ 347], 99.50th=[ 355], 99.90th=[ 368], 99.95th=[ 368], 00:28:59.294 | 99.99th=[ 418] 00:28:59.294 bw ( KiB/s): min= 128, max= 2064, per=4.19%, avg=1728.15, stdev=677.81, samples=20 00:28:59.294 iops : min= 32, max= 516, avg=432.00, stdev=169.46, samples=20 00:28:59.294 lat (msec) : 20=0.14%, 50=97.65%, 100=0.37%, 500=1.85% 00:28:59.294 cpu : usr=98.07%, sys=1.16%, ctx=105, majf=0, minf=42 00:28:59.294 IO depths : 1=5.2%, 2=11.3%, 4=24.6%, 8=51.5%, 16=7.4%, 32=0.0%, >=64=0.0% 00:28:59.294 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.294 complete : 0=0.0%, 4=94.1%, 8=0.2%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.294 issued rwts: total=4336,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:59.294 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:59.294 filename0: (groupid=0, jobs=1): err= 0: pid=2244802: Sun Dec 8 02:31:25 2024 00:28:59.294 read: IOPS=427, BW=1711KiB/s (1752kB/s)(16.9MiB/10138msec) 00:28:59.294 slat (usec): min=13, max=172, avg=52.67, stdev=33.01 00:28:59.294 clat (msec): min=25, max=397, avg=36.83, stdev=40.41 00:28:59.294 lat (msec): min=25, max=397, avg=36.89, stdev=40.41 00:28:59.294 clat percentiles (msec): 00:28:59.294 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:28:59.294 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:59.294 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 35], 00:28:59.294 | 99.00th=[ 347], 99.50th=[ 355], 99.90th=[ 368], 99.95th=[ 368], 00:28:59.294 | 99.99th=[ 397] 00:28:59.294 bw ( KiB/s): min= 128, max= 2064, per=4.19%, avg=1727.80, stdev=677.99, samples=20 00:28:59.294 iops : min= 32, max= 516, avg=431.95, stdev=169.50, samples=20 00:28:59.294 lat (msec) : 50=97.79%, 100=0.37%, 500=1.85% 00:28:59.294 cpu : usr=98.70%, sys=0.86%, ctx=16, majf=0, minf=35 00:28:59.294 IO depths : 1=6.0%, 2=12.2%, 4=25.0%, 8=50.3%, 16=6.5%, 32=0.0%, >=64=0.0% 00:28:59.294 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.294 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.294 issued rwts: total=4336,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:59.294 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:59.294 filename0: (groupid=0, jobs=1): err= 0: pid=2244803: Sun Dec 8 02:31:25 2024 00:28:59.294 read: IOPS=431, BW=1727KiB/s (1769kB/s)(17.1MiB/10147msec) 00:28:59.294 slat (usec): min=7, max=124, avg=34.78, stdev=20.41 00:28:59.294 clat (msec): min=29, max=308, avg=36.71, stdev=33.46 00:28:59.294 lat (msec): min=29, max=309, avg=36.75, stdev=33.46 00:28:59.294 clat percentiles (msec): 00:28:59.294 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:28:59.294 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:59.294 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 35], 00:28:59.294 | 99.00th=[ 266], 99.50th=[ 271], 99.90th=[ 309], 99.95th=[ 309], 00:28:59.294 | 99.99th=[ 309] 00:28:59.294 bw ( KiB/s): min= 128, max= 2048, per=4.24%, avg=1746.40, stdev=649.51, samples=20 00:28:59.294 iops : min= 32, max= 512, avg=436.60, stdev=162.38, samples=20 00:28:59.294 lat (msec) : 50=97.49%, 250=0.73%, 500=1.78% 00:28:59.294 cpu : usr=98.88%, sys=0.71%, ctx=56, majf=0, minf=43 00:28:59.294 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:28:59.294 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.294 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.294 issued rwts: total=4382,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:59.294 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:59.294 filename1: (groupid=0, jobs=1): err= 0: pid=2244804: Sun Dec 8 02:31:25 2024 00:28:59.294 read: IOPS=430, BW=1721KiB/s (1763kB/s)(17.0MiB/10123msec) 00:28:59.294 slat (nsec): min=7782, max=99363, avg=36556.06, stdev=20293.80 00:28:59.294 clat (msec): min=8, max=417, avg=36.87, stdev=40.48 00:28:59.294 lat (msec): min=8, max=417, avg=36.90, stdev=40.48 00:28:59.294 clat percentiles (msec): 00:28:59.294 | 1.00th=[ 18], 5.00th=[ 28], 10.00th=[ 31], 20.00th=[ 31], 00:28:59.294 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:59.294 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 34], 95.00th=[ 43], 00:28:59.294 | 99.00th=[ 347], 99.50th=[ 351], 99.90th=[ 368], 99.95th=[ 368], 00:28:59.294 | 99.99th=[ 418] 00:28:59.294 bw ( KiB/s): min= 128, max= 2240, per=4.21%, avg=1736.15, stdev=686.05, samples=20 00:28:59.294 iops : min= 32, max= 560, avg=434.00, stdev=171.52, samples=20 00:28:59.294 lat (msec) : 10=0.37%, 20=2.16%, 50=94.72%, 100=0.92%, 500=1.84% 00:28:59.294 cpu : usr=96.97%, sys=1.75%, ctx=309, majf=0, minf=80 00:28:59.294 IO depths : 1=3.5%, 2=7.9%, 4=18.5%, 8=60.1%, 16=10.0%, 32=0.0%, >=64=0.0% 00:28:59.294 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.294 complete : 0=0.0%, 4=92.6%, 8=2.7%, 16=4.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.294 issued rwts: total=4356,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:59.294 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:59.294 filename1: (groupid=0, jobs=1): err= 0: pid=2244805: Sun Dec 8 02:31:25 2024 00:28:59.294 read: IOPS=428, BW=1712KiB/s (1754kB/s)(16.9MiB/10128msec) 00:28:59.294 slat (nsec): min=7872, max=76222, avg=38590.49, stdev=13049.73 00:28:59.294 clat (msec): min=25, max=417, avg=37.03, stdev=40.40 00:28:59.294 lat (msec): min=25, max=417, avg=37.07, stdev=40.40 00:28:59.294 clat percentiles (msec): 00:28:59.294 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:28:59.294 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:59.294 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 35], 00:28:59.294 | 99.00th=[ 347], 99.50th=[ 351], 99.90th=[ 368], 99.95th=[ 368], 00:28:59.294 | 99.99th=[ 418] 00:28:59.294 bw ( KiB/s): min= 128, max= 2048, per=4.19%, avg=1728.00, stdev=677.81, samples=20 00:28:59.294 iops : min= 32, max= 512, avg=432.00, stdev=169.45, samples=20 00:28:59.294 lat (msec) : 50=97.79%, 100=0.37%, 500=1.85% 00:28:59.294 cpu : usr=98.46%, sys=1.13%, ctx=15, majf=0, minf=55 00:28:59.294 IO depths : 1=5.6%, 2=11.8%, 4=24.7%, 8=51.0%, 16=6.9%, 32=0.0%, >=64=0.0% 00:28:59.294 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.294 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.294 issued rwts: total=4336,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:59.294 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:59.294 filename1: (groupid=0, jobs=1): err= 0: pid=2244806: Sun Dec 8 02:31:25 2024 00:28:59.294 read: IOPS=428, BW=1712KiB/s (1754kB/s)(16.9MiB/10128msec) 00:28:59.294 slat (usec): min=14, max=132, avg=45.81, stdev=14.67 00:28:59.294 clat (msec): min=26, max=366, avg=36.95, stdev=40.35 00:28:59.294 lat (msec): min=26, max=366, avg=36.99, stdev=40.35 00:28:59.294 clat percentiles (msec): 00:28:59.294 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:28:59.294 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:59.294 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 35], 00:28:59.294 | 99.00th=[ 347], 99.50th=[ 351], 99.90th=[ 368], 99.95th=[ 368], 00:28:59.294 | 99.99th=[ 368] 00:28:59.294 bw ( KiB/s): min= 128, max= 2048, per=4.19%, avg=1728.00, stdev=677.95, samples=20 00:28:59.294 iops : min= 32, max= 512, avg=432.00, stdev=169.49, samples=20 00:28:59.294 lat (msec) : 50=97.79%, 100=0.37%, 500=1.85% 00:28:59.294 cpu : usr=98.69%, sys=0.81%, ctx=58, majf=0, minf=48 00:28:59.294 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:28:59.294 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.294 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.294 issued rwts: total=4336,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:59.294 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:59.294 filename1: (groupid=0, jobs=1): err= 0: pid=2244807: Sun Dec 8 02:31:25 2024 00:28:59.294 read: IOPS=433, BW=1734KiB/s (1775kB/s)(17.1MiB/10115msec) 00:28:59.294 slat (nsec): min=7854, max=96711, avg=31462.33, stdev=15617.87 00:28:59.294 clat (msec): min=29, max=295, avg=36.62, stdev=33.09 00:28:59.294 lat (msec): min=29, max=295, avg=36.65, stdev=33.08 00:28:59.294 clat percentiles (msec): 00:28:59.294 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 32], 00:28:59.294 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:59.294 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 35], 00:28:59.294 | 99.00th=[ 279], 99.50th=[ 284], 99.90th=[ 296], 99.95th=[ 296], 00:28:59.294 | 99.99th=[ 296] 00:28:59.294 bw ( KiB/s): min= 256, max= 2048, per=4.24%, avg=1747.20, stdev=646.09, samples=20 00:28:59.294 iops : min= 64, max= 512, avg=436.80, stdev=161.53, samples=20 00:28:59.294 lat (msec) : 50=97.45%, 250=1.09%, 500=1.46% 00:28:59.294 cpu : usr=97.37%, sys=1.54%, ctx=143, majf=0, minf=71 00:28:59.294 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:28:59.294 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.294 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.294 issued rwts: total=4384,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:59.294 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:59.294 filename1: (groupid=0, jobs=1): err= 0: pid=2244808: Sun Dec 8 02:31:25 2024 00:28:59.294 read: IOPS=434, BW=1738KiB/s (1780kB/s)(17.2MiB/10163msec) 00:28:59.294 slat (usec): min=7, max=235, avg=23.82, stdev=20.90 00:28:59.294 clat (msec): min=9, max=308, avg=36.61, stdev=33.53 00:28:59.294 lat (msec): min=9, max=309, avg=36.64, stdev=33.53 00:28:59.294 clat percentiles (msec): 00:28:59.294 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 32], 00:28:59.294 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:59.294 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 35], 00:28:59.294 | 99.00th=[ 264], 99.50th=[ 271], 99.90th=[ 309], 99.95th=[ 309], 00:28:59.294 | 99.99th=[ 309] 00:28:59.294 bw ( KiB/s): min= 256, max= 2048, per=4.27%, avg=1760.00, stdev=632.38, samples=20 00:28:59.294 iops : min= 64, max= 512, avg=440.00, stdev=158.09, samples=20 00:28:59.294 lat (msec) : 10=0.36%, 20=0.36%, 50=96.74%, 250=0.72%, 500=1.81% 00:28:59.294 cpu : usr=98.61%, sys=0.98%, ctx=17, majf=0, minf=47 00:28:59.294 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:28:59.294 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.294 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.294 issued rwts: total=4416,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:59.294 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:59.294 filename1: (groupid=0, jobs=1): err= 0: pid=2244809: Sun Dec 8 02:31:25 2024 00:28:59.294 read: IOPS=428, BW=1715KiB/s (1757kB/s)(17.0MiB/10148msec) 00:28:59.294 slat (usec): min=9, max=116, avg=47.29, stdev=16.24 00:28:59.294 clat (msec): min=30, max=408, avg=36.90, stdev=40.34 00:28:59.294 lat (msec): min=30, max=408, avg=36.95, stdev=40.33 00:28:59.294 clat percentiles (msec): 00:28:59.294 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:28:59.294 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:59.294 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 35], 00:28:59.294 | 99.00th=[ 347], 99.50th=[ 355], 99.90th=[ 368], 99.95th=[ 397], 00:28:59.294 | 99.99th=[ 409] 00:28:59.294 bw ( KiB/s): min= 128, max= 2048, per=4.21%, avg=1734.40, stdev=677.92, samples=20 00:28:59.294 iops : min= 32, max= 512, avg=433.60, stdev=169.48, samples=20 00:28:59.294 lat (msec) : 50=98.16%, 500=1.84% 00:28:59.294 cpu : usr=96.67%, sys=1.88%, ctx=253, majf=0, minf=51 00:28:59.294 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:28:59.294 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.294 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.294 issued rwts: total=4352,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:59.294 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:59.294 filename1: (groupid=0, jobs=1): err= 0: pid=2244810: Sun Dec 8 02:31:25 2024 00:28:59.294 read: IOPS=430, BW=1722KiB/s (1763kB/s)(17.1MiB/10149msec) 00:28:59.294 slat (usec): min=7, max=113, avg=29.56, stdev=11.54 00:28:59.294 clat (msec): min=28, max=575, avg=36.89, stdev=38.29 00:28:59.294 lat (msec): min=28, max=575, avg=36.92, stdev=38.29 00:28:59.294 clat percentiles (msec): 00:28:59.294 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 32], 00:28:59.294 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:59.294 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 35], 00:28:59.294 | 99.00th=[ 334], 99.50th=[ 338], 99.90th=[ 376], 99.95th=[ 376], 00:28:59.294 | 99.99th=[ 575] 00:28:59.294 bw ( KiB/s): min= 128, max= 2048, per=4.22%, avg=1740.80, stdev=662.38, samples=20 00:28:59.294 iops : min= 32, max= 512, avg=435.20, stdev=165.59, samples=20 00:28:59.294 lat (msec) : 50=97.80%, 250=0.78%, 500=1.37%, 750=0.05% 00:28:59.294 cpu : usr=97.11%, sys=1.56%, ctx=301, majf=0, minf=55 00:28:59.294 IO depths : 1=6.0%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.5%, 32=0.0%, >=64=0.0% 00:28:59.294 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.294 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.294 issued rwts: total=4368,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:59.294 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:59.294 filename1: (groupid=0, jobs=1): err= 0: pid=2244811: Sun Dec 8 02:31:25 2024 00:28:59.294 read: IOPS=428, BW=1713KiB/s (1754kB/s)(16.9MiB/10126msec) 00:28:59.294 slat (usec): min=12, max=106, avg=47.11, stdev=15.42 00:28:59.294 clat (msec): min=29, max=408, avg=36.92, stdev=40.43 00:28:59.294 lat (msec): min=30, max=408, avg=36.97, stdev=40.43 00:28:59.294 clat percentiles (msec): 00:28:59.294 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:28:59.295 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:59.295 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 34], 00:28:59.295 | 99.00th=[ 347], 99.50th=[ 355], 99.90th=[ 368], 99.95th=[ 397], 00:28:59.295 | 99.99th=[ 409] 00:28:59.295 bw ( KiB/s): min= 128, max= 2048, per=4.19%, avg=1728.15, stdev=677.93, samples=20 00:28:59.295 iops : min= 32, max= 512, avg=432.00, stdev=169.49, samples=20 00:28:59.295 lat (msec) : 50=97.79%, 100=0.37%, 500=1.85% 00:28:59.295 cpu : usr=97.07%, sys=1.66%, ctx=113, majf=0, minf=52 00:28:59.295 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:28:59.295 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.295 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.295 issued rwts: total=4336,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:59.295 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:59.295 filename2: (groupid=0, jobs=1): err= 0: pid=2244812: Sun Dec 8 02:31:25 2024 00:28:59.295 read: IOPS=428, BW=1716KiB/s (1757kB/s)(17.0MiB/10147msec) 00:28:59.295 slat (usec): min=9, max=121, avg=45.44, stdev=18.64 00:28:59.295 clat (msec): min=15, max=365, avg=36.94, stdev=40.25 00:28:59.295 lat (msec): min=15, max=365, avg=36.98, stdev=40.25 00:28:59.295 clat percentiles (msec): 00:28:59.295 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:28:59.295 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:59.295 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 35], 00:28:59.295 | 99.00th=[ 347], 99.50th=[ 355], 99.90th=[ 368], 99.95th=[ 368], 00:28:59.295 | 99.99th=[ 368] 00:28:59.295 bw ( KiB/s): min= 128, max= 2048, per=4.21%, avg=1734.40, stdev=677.92, samples=20 00:28:59.295 iops : min= 32, max= 512, avg=433.60, stdev=169.48, samples=20 00:28:59.295 lat (msec) : 20=0.05%, 50=98.07%, 100=0.05%, 500=1.84% 00:28:59.295 cpu : usr=98.56%, sys=0.99%, ctx=17, majf=0, minf=52 00:28:59.295 IO depths : 1=5.9%, 2=12.1%, 4=25.0%, 8=50.4%, 16=6.6%, 32=0.0%, >=64=0.0% 00:28:59.295 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.295 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.295 issued rwts: total=4352,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:59.295 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:59.295 filename2: (groupid=0, jobs=1): err= 0: pid=2244813: Sun Dec 8 02:31:25 2024 00:28:59.295 read: IOPS=432, BW=1732KiB/s (1774kB/s)(17.2MiB/10162msec) 00:28:59.295 slat (usec): min=7, max=170, avg=52.58, stdev=32.21 00:28:59.295 clat (msec): min=8, max=364, avg=36.28, stdev=36.17 00:28:59.295 lat (msec): min=8, max=364, avg=36.34, stdev=36.16 00:28:59.295 clat percentiles (msec): 00:28:59.295 | 1.00th=[ 27], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:28:59.295 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:59.295 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 35], 00:28:59.295 | 99.00th=[ 279], 99.50th=[ 284], 99.90th=[ 363], 99.95th=[ 363], 00:28:59.295 | 99.99th=[ 363] 00:28:59.295 bw ( KiB/s): min= 256, max= 2048, per=4.25%, avg=1753.75, stdev=647.54, samples=20 00:28:59.295 iops : min= 64, max= 512, avg=438.40, stdev=161.88, samples=20 00:28:59.295 lat (msec) : 10=0.36%, 20=0.36%, 50=97.09%, 250=0.41%, 500=1.77% 00:28:59.295 cpu : usr=98.79%, sys=0.77%, ctx=14, majf=0, minf=56 00:28:59.295 IO depths : 1=6.0%, 2=12.2%, 4=25.0%, 8=50.2%, 16=6.5%, 32=0.0%, >=64=0.0% 00:28:59.295 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.295 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.295 issued rwts: total=4400,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:59.295 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:59.295 filename2: (groupid=0, jobs=1): err= 0: pid=2244814: Sun Dec 8 02:31:25 2024 00:28:59.295 read: IOPS=431, BW=1724KiB/s (1766kB/s)(17.1MiB/10147msec) 00:28:59.295 slat (usec): min=7, max=116, avg=47.23, stdev=17.80 00:28:59.295 clat (msec): min=29, max=329, avg=36.43, stdev=33.44 00:28:59.295 lat (msec): min=29, max=329, avg=36.48, stdev=33.44 00:28:59.295 clat percentiles (msec): 00:28:59.295 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:28:59.295 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:59.295 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 35], 00:28:59.295 | 99.00th=[ 266], 99.50th=[ 275], 99.90th=[ 309], 99.95th=[ 309], 00:28:59.295 | 99.99th=[ 330] 00:28:59.295 bw ( KiB/s): min= 128, max= 2048, per=4.23%, avg=1743.20, stdev=657.35, samples=20 00:28:59.295 iops : min= 32, max= 512, avg=435.80, stdev=164.34, samples=20 00:28:59.295 lat (msec) : 50=97.67%, 250=0.59%, 500=1.74% 00:28:59.295 cpu : usr=98.51%, sys=0.96%, ctx=70, majf=0, minf=53 00:28:59.295 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.2%, 16=6.4%, 32=0.0%, >=64=0.0% 00:28:59.295 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.295 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.295 issued rwts: total=4374,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:59.295 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:59.295 filename2: (groupid=0, jobs=1): err= 0: pid=2244815: Sun Dec 8 02:31:25 2024 00:28:59.295 read: IOPS=433, BW=1734KiB/s (1776kB/s)(17.2MiB/10162msec) 00:28:59.295 slat (usec): min=7, max=151, avg=15.72, stdev=15.11 00:28:59.295 clat (msec): min=8, max=330, avg=36.42, stdev=33.23 00:28:59.295 lat (msec): min=8, max=330, avg=36.44, stdev=33.22 00:28:59.295 clat percentiles (msec): 00:28:59.295 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:28:59.295 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:59.295 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 35], 00:28:59.295 | 99.00th=[ 271], 99.50th=[ 309], 99.90th=[ 309], 99.95th=[ 309], 00:28:59.295 | 99.99th=[ 330] 00:28:59.295 bw ( KiB/s): min= 192, max= 2048, per=4.26%, avg=1756.15, stdev=642.35, samples=20 00:28:59.295 iops : min= 48, max= 512, avg=439.00, stdev=160.58, samples=20 00:28:59.295 lat (msec) : 10=0.36%, 20=0.36%, 50=96.96%, 250=0.77%, 500=1.54% 00:28:59.295 cpu : usr=98.75%, sys=0.87%, ctx=11, majf=0, minf=37 00:28:59.295 IO depths : 1=6.2%, 2=12.4%, 4=24.9%, 8=50.2%, 16=6.4%, 32=0.0%, >=64=0.0% 00:28:59.295 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.295 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.295 issued rwts: total=4406,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:59.295 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:59.295 filename2: (groupid=0, jobs=1): err= 0: pid=2244816: Sun Dec 8 02:31:25 2024 00:28:59.295 read: IOPS=428, BW=1715KiB/s (1757kB/s)(17.0MiB/10148msec) 00:28:59.295 slat (usec): min=10, max=116, avg=45.05, stdev=14.55 00:28:59.295 clat (msec): min=29, max=417, avg=36.92, stdev=40.31 00:28:59.295 lat (msec): min=29, max=417, avg=36.96, stdev=40.30 00:28:59.295 clat percentiles (msec): 00:28:59.295 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:28:59.295 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:59.295 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 35], 00:28:59.295 | 99.00th=[ 347], 99.50th=[ 355], 99.90th=[ 368], 99.95th=[ 368], 00:28:59.295 | 99.99th=[ 418] 00:28:59.295 bw ( KiB/s): min= 128, max= 2048, per=4.21%, avg=1734.40, stdev=677.78, samples=20 00:28:59.295 iops : min= 32, max= 512, avg=433.60, stdev=169.44, samples=20 00:28:59.295 lat (msec) : 50=98.16%, 500=1.84% 00:28:59.295 cpu : usr=98.77%, sys=0.83%, ctx=15, majf=0, minf=47 00:28:59.295 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:28:59.295 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.295 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.295 issued rwts: total=4352,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:59.295 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:59.295 filename2: (groupid=0, jobs=1): err= 0: pid=2244817: Sun Dec 8 02:31:25 2024 00:28:59.295 read: IOPS=428, BW=1713KiB/s (1754kB/s)(16.9MiB/10127msec) 00:28:59.295 slat (nsec): min=5082, max=89878, avg=42818.71, stdev=12073.43 00:28:59.295 clat (msec): min=26, max=365, avg=36.98, stdev=40.35 00:28:59.295 lat (msec): min=26, max=365, avg=37.02, stdev=40.35 00:28:59.295 clat percentiles (msec): 00:28:59.295 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:28:59.295 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:59.295 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 35], 00:28:59.295 | 99.00th=[ 347], 99.50th=[ 355], 99.90th=[ 368], 99.95th=[ 368], 00:28:59.295 | 99.99th=[ 368] 00:28:59.295 bw ( KiB/s): min= 128, max= 2048, per=4.19%, avg=1728.15, stdev=677.93, samples=20 00:28:59.295 iops : min= 32, max= 512, avg=432.00, stdev=169.49, samples=20 00:28:59.295 lat (msec) : 50=97.79%, 100=0.37%, 500=1.85% 00:28:59.295 cpu : usr=97.19%, sys=1.70%, ctx=277, majf=0, minf=41 00:28:59.295 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.4%, 32=0.0%, >=64=0.0% 00:28:59.295 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.295 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.295 issued rwts: total=4336,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:59.295 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:59.295 filename2: (groupid=0, jobs=1): err= 0: pid=2244818: Sun Dec 8 02:31:25 2024 00:28:59.295 read: IOPS=429, BW=1718KiB/s (1759kB/s)(17.0MiB/10123msec) 00:28:59.295 slat (usec): min=7, max=115, avg=41.45, stdev=18.86 00:28:59.295 clat (msec): min=16, max=365, avg=36.93, stdev=40.17 00:28:59.295 lat (msec): min=16, max=365, avg=36.97, stdev=40.16 00:28:59.295 clat percentiles (msec): 00:28:59.295 | 1.00th=[ 20], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:28:59.295 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:59.295 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 35], 00:28:59.295 | 99.00th=[ 347], 99.50th=[ 351], 99.90th=[ 368], 99.95th=[ 368], 00:28:59.295 | 99.99th=[ 368] 00:28:59.295 bw ( KiB/s): min= 128, max= 2072, per=4.20%, avg=1732.95, stdev=677.45, samples=20 00:28:59.295 iops : min= 32, max= 518, avg=433.20, stdev=169.37, samples=20 00:28:59.295 lat (msec) : 20=1.01%, 50=96.73%, 100=0.41%, 500=1.84% 00:28:59.295 cpu : usr=98.91%, sys=0.68%, ctx=11, majf=0, minf=75 00:28:59.295 IO depths : 1=0.7%, 2=5.7%, 4=21.3%, 8=59.7%, 16=12.6%, 32=0.0%, >=64=0.0% 00:28:59.295 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.295 complete : 0=0.0%, 4=93.6%, 8=1.6%, 16=4.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.295 issued rwts: total=4348,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:59.295 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:59.295 filename2: (groupid=0, jobs=1): err= 0: pid=2244819: Sun Dec 8 02:31:25 2024 00:28:59.295 read: IOPS=427, BW=1712KiB/s (1753kB/s)(16.9MiB/10132msec) 00:28:59.295 slat (usec): min=13, max=119, avg=47.76, stdev=15.39 00:28:59.295 clat (msec): min=29, max=417, avg=36.95, stdev=40.42 00:28:59.295 lat (msec): min=29, max=417, avg=37.00, stdev=40.41 00:28:59.295 clat percentiles (msec): 00:28:59.295 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:28:59.295 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:59.295 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 34], 00:28:59.295 | 99.00th=[ 347], 99.50th=[ 351], 99.90th=[ 368], 99.95th=[ 368], 00:28:59.295 | 99.99th=[ 418] 00:28:59.295 bw ( KiB/s): min= 128, max= 2048, per=4.19%, avg=1728.00, stdev=677.81, samples=20 00:28:59.295 iops : min= 32, max= 512, avg=432.00, stdev=169.45, samples=20 00:28:59.295 lat (msec) : 50=97.79%, 100=0.37%, 500=1.85% 00:28:59.295 cpu : usr=97.88%, sys=1.27%, ctx=97, majf=0, minf=55 00:28:59.295 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:28:59.295 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.295 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.295 issued rwts: total=4336,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:59.295 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:59.295 00:28:59.295 Run status group 0 (all jobs): 00:28:59.295 READ: bw=40.3MiB/s (42.2MB/s), 1711KiB/s-1740KiB/s (1752kB/s-1782kB/s), io=409MiB (429MB), run=10115-10163msec 00:28:59.295 02:31:25 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:28:59.295 02:31:25 -- target/dif.sh@43 -- # local sub 00:28:59.295 02:31:25 -- target/dif.sh@45 -- # for sub in "$@" 00:28:59.295 02:31:25 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:59.295 02:31:25 -- target/dif.sh@36 -- # local sub_id=0 00:28:59.295 02:31:25 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:59.295 02:31:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.295 02:31:25 -- common/autotest_common.sh@10 -- # set +x 00:28:59.295 02:31:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.295 02:31:25 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:59.295 02:31:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.295 02:31:25 -- common/autotest_common.sh@10 -- # set +x 00:28:59.295 02:31:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.295 02:31:25 -- target/dif.sh@45 -- # for sub in "$@" 00:28:59.295 02:31:25 -- target/dif.sh@46 -- # destroy_subsystem 1 00:28:59.295 02:31:25 -- target/dif.sh@36 -- # local sub_id=1 00:28:59.295 02:31:25 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:59.295 02:31:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.295 02:31:25 -- common/autotest_common.sh@10 -- # set +x 00:28:59.295 02:31:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.295 02:31:25 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:28:59.295 02:31:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.295 02:31:25 -- common/autotest_common.sh@10 -- # set +x 00:28:59.295 02:31:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.295 02:31:25 -- target/dif.sh@45 -- # for sub in "$@" 00:28:59.295 02:31:25 -- target/dif.sh@46 -- # destroy_subsystem 2 00:28:59.295 02:31:25 -- target/dif.sh@36 -- # local sub_id=2 00:28:59.295 02:31:25 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:28:59.295 02:31:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.295 02:31:25 -- common/autotest_common.sh@10 -- # set +x 00:28:59.295 02:31:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.295 02:31:25 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:28:59.295 02:31:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.295 02:31:25 -- common/autotest_common.sh@10 -- # set +x 00:28:59.295 02:31:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.295 02:31:25 -- target/dif.sh@115 -- # NULL_DIF=1 00:28:59.295 02:31:25 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:28:59.295 02:31:25 -- target/dif.sh@115 -- # numjobs=2 00:28:59.295 02:31:25 -- target/dif.sh@115 -- # iodepth=8 00:28:59.295 02:31:25 -- target/dif.sh@115 -- # runtime=5 00:28:59.295 02:31:25 -- target/dif.sh@115 -- # files=1 00:28:59.295 02:31:25 -- target/dif.sh@117 -- # create_subsystems 0 1 00:28:59.295 02:31:25 -- target/dif.sh@28 -- # local sub 00:28:59.295 02:31:25 -- target/dif.sh@30 -- # for sub in "$@" 00:28:59.295 02:31:25 -- target/dif.sh@31 -- # create_subsystem 0 00:28:59.295 02:31:25 -- target/dif.sh@18 -- # local sub_id=0 00:28:59.295 02:31:25 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:59.295 02:31:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.295 02:31:25 -- common/autotest_common.sh@10 -- # set +x 00:28:59.295 bdev_null0 00:28:59.295 02:31:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.295 02:31:25 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:59.295 02:31:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.295 02:31:25 -- common/autotest_common.sh@10 -- # set +x 00:28:59.295 02:31:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.295 02:31:25 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:59.295 02:31:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.295 02:31:25 -- common/autotest_common.sh@10 -- # set +x 00:28:59.295 02:31:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.295 02:31:25 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:59.295 02:31:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.295 02:31:25 -- common/autotest_common.sh@10 -- # set +x 00:28:59.295 [2024-12-08 02:31:25.450833] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:59.295 02:31:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.295 02:31:25 -- target/dif.sh@30 -- # for sub in "$@" 00:28:59.295 02:31:25 -- target/dif.sh@31 -- # create_subsystem 1 00:28:59.295 02:31:25 -- target/dif.sh@18 -- # local sub_id=1 00:28:59.295 02:31:25 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:28:59.295 02:31:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.295 02:31:25 -- common/autotest_common.sh@10 -- # set +x 00:28:59.295 bdev_null1 00:28:59.295 02:31:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.296 02:31:25 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:28:59.296 02:31:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.296 02:31:25 -- common/autotest_common.sh@10 -- # set +x 00:28:59.296 02:31:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.296 02:31:25 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:28:59.296 02:31:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.296 02:31:25 -- common/autotest_common.sh@10 -- # set +x 00:28:59.296 02:31:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.296 02:31:25 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:59.296 02:31:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.296 02:31:25 -- common/autotest_common.sh@10 -- # set +x 00:28:59.296 02:31:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.296 02:31:25 -- target/dif.sh@118 -- # fio /dev/fd/62 00:28:59.296 02:31:25 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:28:59.296 02:31:25 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:28:59.296 02:31:25 -- nvmf/common.sh@520 -- # config=() 00:28:59.296 02:31:25 -- nvmf/common.sh@520 -- # local subsystem config 00:28:59.296 02:31:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:59.296 02:31:25 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:59.296 02:31:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:59.296 { 00:28:59.296 "params": { 00:28:59.296 "name": "Nvme$subsystem", 00:28:59.296 "trtype": "$TEST_TRANSPORT", 00:28:59.296 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:59.296 "adrfam": "ipv4", 00:28:59.296 "trsvcid": "$NVMF_PORT", 00:28:59.296 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:59.296 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:59.296 "hdgst": ${hdgst:-false}, 00:28:59.296 "ddgst": ${ddgst:-false} 00:28:59.296 }, 00:28:59.296 "method": "bdev_nvme_attach_controller" 00:28:59.296 } 00:28:59.296 EOF 00:28:59.296 )") 00:28:59.296 02:31:25 -- target/dif.sh@82 -- # gen_fio_conf 00:28:59.296 02:31:25 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:59.296 02:31:25 -- target/dif.sh@54 -- # local file 00:28:59.296 02:31:25 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:59.296 02:31:25 -- target/dif.sh@56 -- # cat 00:28:59.296 02:31:25 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:59.296 02:31:25 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:59.296 02:31:25 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:59.296 02:31:25 -- common/autotest_common.sh@1330 -- # shift 00:28:59.296 02:31:25 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:59.296 02:31:25 -- nvmf/common.sh@542 -- # cat 00:28:59.296 02:31:25 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:59.296 02:31:25 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:59.296 02:31:25 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:59.296 02:31:25 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:59.296 02:31:25 -- target/dif.sh@72 -- # (( file <= files )) 00:28:59.296 02:31:25 -- target/dif.sh@73 -- # cat 00:28:59.296 02:31:25 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:59.296 02:31:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:59.296 02:31:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:59.296 { 00:28:59.296 "params": { 00:28:59.296 "name": "Nvme$subsystem", 00:28:59.296 "trtype": "$TEST_TRANSPORT", 00:28:59.296 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:59.296 "adrfam": "ipv4", 00:28:59.296 "trsvcid": "$NVMF_PORT", 00:28:59.296 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:59.296 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:59.296 "hdgst": ${hdgst:-false}, 00:28:59.296 "ddgst": ${ddgst:-false} 00:28:59.296 }, 00:28:59.296 "method": "bdev_nvme_attach_controller" 00:28:59.296 } 00:28:59.296 EOF 00:28:59.296 )") 00:28:59.296 02:31:25 -- nvmf/common.sh@542 -- # cat 00:28:59.296 02:31:25 -- target/dif.sh@72 -- # (( file++ )) 00:28:59.296 02:31:25 -- target/dif.sh@72 -- # (( file <= files )) 00:28:59.296 02:31:25 -- nvmf/common.sh@544 -- # jq . 00:28:59.296 02:31:25 -- nvmf/common.sh@545 -- # IFS=, 00:28:59.296 02:31:25 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:59.296 "params": { 00:28:59.296 "name": "Nvme0", 00:28:59.296 "trtype": "tcp", 00:28:59.296 "traddr": "10.0.0.2", 00:28:59.296 "adrfam": "ipv4", 00:28:59.296 "trsvcid": "4420", 00:28:59.296 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:59.296 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:59.296 "hdgst": false, 00:28:59.296 "ddgst": false 00:28:59.296 }, 00:28:59.296 "method": "bdev_nvme_attach_controller" 00:28:59.296 },{ 00:28:59.296 "params": { 00:28:59.296 "name": "Nvme1", 00:28:59.296 "trtype": "tcp", 00:28:59.296 "traddr": "10.0.0.2", 00:28:59.296 "adrfam": "ipv4", 00:28:59.296 "trsvcid": "4420", 00:28:59.296 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:28:59.296 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:28:59.296 "hdgst": false, 00:28:59.296 "ddgst": false 00:28:59.296 }, 00:28:59.296 "method": "bdev_nvme_attach_controller" 00:28:59.296 }' 00:28:59.296 02:31:25 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:59.296 02:31:25 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:59.296 02:31:25 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:59.296 02:31:25 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:59.296 02:31:25 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:59.296 02:31:25 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:59.296 02:31:25 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:59.296 02:31:25 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:59.296 02:31:25 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:59.296 02:31:25 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:59.296 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:28:59.296 ... 00:28:59.296 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:28:59.296 ... 00:28:59.296 fio-3.35 00:28:59.296 Starting 4 threads 00:28:59.296 EAL: No free 2048 kB hugepages reported on node 1 00:28:59.296 [2024-12-08 02:31:26.528655] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:59.296 [2024-12-08 02:31:26.528722] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:04.563 00:29:04.563 filename0: (groupid=0, jobs=1): err= 0: pid=2246244: Sun Dec 8 02:31:31 2024 00:29:04.563 read: IOPS=1923, BW=15.0MiB/s (15.8MB/s)(75.2MiB/5001msec) 00:29:04.563 slat (nsec): min=5233, max=73006, avg=15409.89, stdev=9132.31 00:29:04.563 clat (usec): min=694, max=8158, avg=4105.89, stdev=618.42 00:29:04.563 lat (usec): min=711, max=8173, avg=4121.30, stdev=618.56 00:29:04.563 clat percentiles (usec): 00:29:04.563 | 1.00th=[ 2278], 5.00th=[ 3195], 10.00th=[ 3523], 20.00th=[ 3785], 00:29:04.563 | 30.00th=[ 3949], 40.00th=[ 4015], 50.00th=[ 4113], 60.00th=[ 4178], 00:29:04.563 | 70.00th=[ 4228], 80.00th=[ 4359], 90.00th=[ 4621], 95.00th=[ 5080], 00:29:04.563 | 99.00th=[ 6390], 99.50th=[ 6783], 99.90th=[ 7373], 99.95th=[ 7504], 00:29:04.563 | 99.99th=[ 8160] 00:29:04.563 bw ( KiB/s): min=14752, max=15792, per=25.20%, avg=15331.33, stdev=339.48, samples=9 00:29:04.563 iops : min= 1844, max= 1974, avg=1916.33, stdev=42.43, samples=9 00:29:04.563 lat (usec) : 750=0.01%, 1000=0.04% 00:29:04.563 lat (msec) : 2=0.54%, 4=35.88%, 10=63.52% 00:29:04.563 cpu : usr=94.44%, sys=5.04%, ctx=13, majf=0, minf=47 00:29:04.563 IO depths : 1=0.3%, 2=14.1%, 4=57.7%, 8=27.9%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:04.563 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:04.563 complete : 0=0.0%, 4=92.6%, 8=7.4%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:04.563 issued rwts: total=9620,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:04.563 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:04.563 filename0: (groupid=0, jobs=1): err= 0: pid=2246245: Sun Dec 8 02:31:31 2024 00:29:04.563 read: IOPS=1861, BW=14.5MiB/s (15.3MB/s)(72.7MiB/5001msec) 00:29:04.563 slat (nsec): min=7030, max=72878, avg=16550.02, stdev=9416.96 00:29:04.563 clat (usec): min=686, max=8686, avg=4239.59, stdev=703.30 00:29:04.563 lat (usec): min=698, max=8709, avg=4256.14, stdev=702.84 00:29:04.563 clat percentiles (usec): 00:29:04.563 | 1.00th=[ 2212], 5.00th=[ 3392], 10.00th=[ 3654], 20.00th=[ 3916], 00:29:04.563 | 30.00th=[ 4015], 40.00th=[ 4080], 50.00th=[ 4146], 60.00th=[ 4228], 00:29:04.563 | 70.00th=[ 4293], 80.00th=[ 4490], 90.00th=[ 5014], 95.00th=[ 5604], 00:29:04.563 | 99.00th=[ 6849], 99.50th=[ 7177], 99.90th=[ 7701], 99.95th=[ 7832], 00:29:04.563 | 99.99th=[ 8717] 00:29:04.563 bw ( KiB/s): min=14080, max=15328, per=24.41%, avg=14851.22, stdev=391.38, samples=9 00:29:04.563 iops : min= 1760, max= 1916, avg=1856.33, stdev=48.97, samples=9 00:29:04.563 lat (usec) : 750=0.02%, 1000=0.04% 00:29:04.563 lat (msec) : 2=0.58%, 4=28.38%, 10=70.98% 00:29:04.563 cpu : usr=95.48%, sys=4.04%, ctx=6, majf=0, minf=47 00:29:04.563 IO depths : 1=0.1%, 2=13.1%, 4=58.7%, 8=28.1%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:04.563 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:04.563 complete : 0=0.0%, 4=92.7%, 8=7.3%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:04.563 issued rwts: total=9311,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:04.563 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:04.563 filename1: (groupid=0, jobs=1): err= 0: pid=2246246: Sun Dec 8 02:31:31 2024 00:29:04.563 read: IOPS=1939, BW=15.2MiB/s (15.9MB/s)(75.8MiB/5003msec) 00:29:04.563 slat (nsec): min=5324, max=59437, avg=14106.49, stdev=7439.36 00:29:04.563 clat (usec): min=719, max=7740, avg=4076.17, stdev=581.39 00:29:04.563 lat (usec): min=736, max=7754, avg=4090.28, stdev=581.46 00:29:04.563 clat percentiles (usec): 00:29:04.563 | 1.00th=[ 2343], 5.00th=[ 3228], 10.00th=[ 3458], 20.00th=[ 3752], 00:29:04.563 | 30.00th=[ 3949], 40.00th=[ 4015], 50.00th=[ 4113], 60.00th=[ 4178], 00:29:04.563 | 70.00th=[ 4228], 80.00th=[ 4359], 90.00th=[ 4555], 95.00th=[ 4948], 00:29:04.563 | 99.00th=[ 5997], 99.50th=[ 6652], 99.90th=[ 7308], 99.95th=[ 7504], 00:29:04.563 | 99.99th=[ 7767] 00:29:04.563 bw ( KiB/s): min=14768, max=16016, per=25.47%, avg=15493.33, stdev=411.51, samples=9 00:29:04.563 iops : min= 1846, max= 2002, avg=1936.67, stdev=51.44, samples=9 00:29:04.563 lat (usec) : 750=0.01%, 1000=0.03% 00:29:04.563 lat (msec) : 2=0.57%, 4=35.93%, 10=63.46% 00:29:04.563 cpu : usr=95.06%, sys=4.42%, ctx=9, majf=0, minf=84 00:29:04.563 IO depths : 1=0.4%, 2=12.3%, 4=59.5%, 8=27.8%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:04.563 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:04.563 complete : 0=0.0%, 4=92.5%, 8=7.5%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:04.563 issued rwts: total=9704,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:04.563 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:04.563 filename1: (groupid=0, jobs=1): err= 0: pid=2246247: Sun Dec 8 02:31:31 2024 00:29:04.563 read: IOPS=1881, BW=14.7MiB/s (15.4MB/s)(73.5MiB/5002msec) 00:29:04.563 slat (usec): min=7, max=116, avg=18.72, stdev= 9.19 00:29:04.563 clat (usec): min=781, max=8015, avg=4188.23, stdev=662.63 00:29:04.563 lat (usec): min=800, max=8038, avg=4206.95, stdev=662.65 00:29:04.563 clat percentiles (usec): 00:29:04.563 | 1.00th=[ 2180], 5.00th=[ 3359], 10.00th=[ 3621], 20.00th=[ 3884], 00:29:04.563 | 30.00th=[ 3982], 40.00th=[ 4047], 50.00th=[ 4113], 60.00th=[ 4228], 00:29:04.563 | 70.00th=[ 4293], 80.00th=[ 4424], 90.00th=[ 4883], 95.00th=[ 5407], 00:29:04.563 | 99.00th=[ 6587], 99.50th=[ 6849], 99.90th=[ 7242], 99.95th=[ 7439], 00:29:04.563 | 99.99th=[ 8029] 00:29:04.563 bw ( KiB/s): min=14336, max=15632, per=24.68%, avg=15015.11, stdev=434.00, samples=9 00:29:04.563 iops : min= 1792, max= 1954, avg=1876.89, stdev=54.25, samples=9 00:29:04.563 lat (usec) : 1000=0.07% 00:29:04.563 lat (msec) : 2=0.67%, 4=31.75%, 10=67.51% 00:29:04.563 cpu : usr=91.90%, sys=5.66%, ctx=149, majf=0, minf=43 00:29:04.563 IO depths : 1=0.1%, 2=13.9%, 4=57.6%, 8=28.4%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:04.563 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:04.563 complete : 0=0.0%, 4=92.8%, 8=7.2%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:04.563 issued rwts: total=9409,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:04.563 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:04.563 00:29:04.563 Run status group 0 (all jobs): 00:29:04.563 READ: bw=59.4MiB/s (62.3MB/s), 14.5MiB/s-15.2MiB/s (15.3MB/s-15.9MB/s), io=297MiB (312MB), run=5001-5003msec 00:29:04.563 02:31:31 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:29:04.563 02:31:31 -- target/dif.sh@43 -- # local sub 00:29:04.563 02:31:31 -- target/dif.sh@45 -- # for sub in "$@" 00:29:04.563 02:31:31 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:04.563 02:31:31 -- target/dif.sh@36 -- # local sub_id=0 00:29:04.563 02:31:31 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:04.563 02:31:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.563 02:31:31 -- common/autotest_common.sh@10 -- # set +x 00:29:04.563 02:31:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.563 02:31:31 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:04.563 02:31:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.563 02:31:31 -- common/autotest_common.sh@10 -- # set +x 00:29:04.563 02:31:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.563 02:31:31 -- target/dif.sh@45 -- # for sub in "$@" 00:29:04.563 02:31:31 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:04.563 02:31:31 -- target/dif.sh@36 -- # local sub_id=1 00:29:04.563 02:31:31 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:04.563 02:31:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.563 02:31:31 -- common/autotest_common.sh@10 -- # set +x 00:29:04.563 02:31:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.563 02:31:31 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:04.563 02:31:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.563 02:31:31 -- common/autotest_common.sh@10 -- # set +x 00:29:04.563 02:31:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.563 00:29:04.563 real 0m24.549s 00:29:04.563 user 4m36.413s 00:29:04.563 sys 0m5.733s 00:29:04.563 02:31:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:04.563 02:31:31 -- common/autotest_common.sh@10 -- # set +x 00:29:04.563 ************************************ 00:29:04.563 END TEST fio_dif_rand_params 00:29:04.563 ************************************ 00:29:04.563 02:31:32 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:29:04.563 02:31:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:04.563 02:31:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:04.563 02:31:32 -- common/autotest_common.sh@10 -- # set +x 00:29:04.563 ************************************ 00:29:04.563 START TEST fio_dif_digest 00:29:04.563 ************************************ 00:29:04.563 02:31:32 -- common/autotest_common.sh@1114 -- # fio_dif_digest 00:29:04.564 02:31:32 -- target/dif.sh@123 -- # local NULL_DIF 00:29:04.564 02:31:32 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:29:04.564 02:31:32 -- target/dif.sh@125 -- # local hdgst ddgst 00:29:04.564 02:31:32 -- target/dif.sh@127 -- # NULL_DIF=3 00:29:04.564 02:31:32 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:29:04.564 02:31:32 -- target/dif.sh@127 -- # numjobs=3 00:29:04.564 02:31:32 -- target/dif.sh@127 -- # iodepth=3 00:29:04.564 02:31:32 -- target/dif.sh@127 -- # runtime=10 00:29:04.564 02:31:32 -- target/dif.sh@128 -- # hdgst=true 00:29:04.564 02:31:32 -- target/dif.sh@128 -- # ddgst=true 00:29:04.564 02:31:32 -- target/dif.sh@130 -- # create_subsystems 0 00:29:04.564 02:31:32 -- target/dif.sh@28 -- # local sub 00:29:04.564 02:31:32 -- target/dif.sh@30 -- # for sub in "$@" 00:29:04.564 02:31:32 -- target/dif.sh@31 -- # create_subsystem 0 00:29:04.564 02:31:32 -- target/dif.sh@18 -- # local sub_id=0 00:29:04.564 02:31:32 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:29:04.564 02:31:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.564 02:31:32 -- common/autotest_common.sh@10 -- # set +x 00:29:04.564 bdev_null0 00:29:04.564 02:31:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.564 02:31:32 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:04.564 02:31:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.564 02:31:32 -- common/autotest_common.sh@10 -- # set +x 00:29:04.564 02:31:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.564 02:31:32 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:04.564 02:31:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.564 02:31:32 -- common/autotest_common.sh@10 -- # set +x 00:29:04.564 02:31:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.564 02:31:32 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:04.564 02:31:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.564 02:31:32 -- common/autotest_common.sh@10 -- # set +x 00:29:04.564 [2024-12-08 02:31:32.060105] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:04.564 02:31:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.564 02:31:32 -- target/dif.sh@131 -- # fio /dev/fd/62 00:29:04.564 02:31:32 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:29:04.564 02:31:32 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:29:04.564 02:31:32 -- nvmf/common.sh@520 -- # config=() 00:29:04.564 02:31:32 -- nvmf/common.sh@520 -- # local subsystem config 00:29:04.564 02:31:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:04.564 02:31:32 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:04.564 02:31:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:04.564 { 00:29:04.564 "params": { 00:29:04.564 "name": "Nvme$subsystem", 00:29:04.564 "trtype": "$TEST_TRANSPORT", 00:29:04.564 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:04.564 "adrfam": "ipv4", 00:29:04.564 "trsvcid": "$NVMF_PORT", 00:29:04.564 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:04.564 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:04.564 "hdgst": ${hdgst:-false}, 00:29:04.564 "ddgst": ${ddgst:-false} 00:29:04.564 }, 00:29:04.564 "method": "bdev_nvme_attach_controller" 00:29:04.564 } 00:29:04.564 EOF 00:29:04.564 )") 00:29:04.564 02:31:32 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:04.564 02:31:32 -- target/dif.sh@82 -- # gen_fio_conf 00:29:04.564 02:31:32 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:04.564 02:31:32 -- target/dif.sh@54 -- # local file 00:29:04.564 02:31:32 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:04.564 02:31:32 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:04.564 02:31:32 -- target/dif.sh@56 -- # cat 00:29:04.564 02:31:32 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:04.564 02:31:32 -- common/autotest_common.sh@1330 -- # shift 00:29:04.564 02:31:32 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:04.564 02:31:32 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:04.564 02:31:32 -- nvmf/common.sh@542 -- # cat 00:29:04.564 02:31:32 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:04.564 02:31:32 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:04.564 02:31:32 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:04.564 02:31:32 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:04.564 02:31:32 -- target/dif.sh@72 -- # (( file <= files )) 00:29:04.564 02:31:32 -- nvmf/common.sh@544 -- # jq . 00:29:04.564 02:31:32 -- nvmf/common.sh@545 -- # IFS=, 00:29:04.564 02:31:32 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:04.564 "params": { 00:29:04.564 "name": "Nvme0", 00:29:04.564 "trtype": "tcp", 00:29:04.564 "traddr": "10.0.0.2", 00:29:04.564 "adrfam": "ipv4", 00:29:04.564 "trsvcid": "4420", 00:29:04.564 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:04.564 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:04.564 "hdgst": true, 00:29:04.564 "ddgst": true 00:29:04.564 }, 00:29:04.564 "method": "bdev_nvme_attach_controller" 00:29:04.564 }' 00:29:04.564 02:31:32 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:04.564 02:31:32 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:04.564 02:31:32 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:04.564 02:31:32 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:04.564 02:31:32 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:04.564 02:31:32 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:04.564 02:31:32 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:04.564 02:31:32 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:04.564 02:31:32 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:04.564 02:31:32 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:04.564 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:29:04.564 ... 00:29:04.564 fio-3.35 00:29:04.564 Starting 3 threads 00:29:04.823 EAL: No free 2048 kB hugepages reported on node 1 00:29:05.081 [2024-12-08 02:31:32.751871] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:05.081 [2024-12-08 02:31:32.751926] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:17.282 00:29:17.282 filename0: (groupid=0, jobs=1): err= 0: pid=2247019: Sun Dec 8 02:31:42 2024 00:29:17.282 read: IOPS=202, BW=25.3MiB/s (26.5MB/s)(254MiB/10046msec) 00:29:17.282 slat (nsec): min=7055, max=43035, avg=17221.39, stdev=3881.83 00:29:17.282 clat (usec): min=10761, max=54453, avg=14805.17, stdev=2054.44 00:29:17.282 lat (usec): min=10779, max=54478, avg=14822.39, stdev=2054.40 00:29:17.282 clat percentiles (usec): 00:29:17.282 | 1.00th=[12518], 5.00th=[13304], 10.00th=[13566], 20.00th=[13960], 00:29:17.282 | 30.00th=[14222], 40.00th=[14484], 50.00th=[14746], 60.00th=[15008], 00:29:17.282 | 70.00th=[15139], 80.00th=[15401], 90.00th=[15926], 95.00th=[16188], 00:29:17.282 | 99.00th=[16909], 99.50th=[17433], 99.90th=[54264], 99.95th=[54264], 00:29:17.282 | 99.99th=[54264] 00:29:17.282 bw ( KiB/s): min=23808, max=26624, per=32.43%, avg=25945.60, stdev=600.52, samples=20 00:29:17.282 iops : min= 186, max= 208, avg=202.70, stdev= 4.69, samples=20 00:29:17.282 lat (msec) : 20=99.75%, 50=0.10%, 100=0.15% 00:29:17.282 cpu : usr=94.87%, sys=4.64%, ctx=18, majf=0, minf=95 00:29:17.282 IO depths : 1=0.5%, 2=99.5%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:17.282 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:17.282 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:17.282 issued rwts: total=2030,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:17.282 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:17.282 filename0: (groupid=0, jobs=1): err= 0: pid=2247020: Sun Dec 8 02:31:42 2024 00:29:17.282 read: IOPS=216, BW=27.1MiB/s (28.4MB/s)(272MiB/10047msec) 00:29:17.282 slat (nsec): min=3626, max=59044, avg=18662.55, stdev=6217.92 00:29:17.282 clat (usec): min=8618, max=52460, avg=13809.09, stdev=1506.51 00:29:17.282 lat (usec): min=8633, max=52474, avg=13827.75, stdev=1506.52 00:29:17.282 clat percentiles (usec): 00:29:17.282 | 1.00th=[11469], 5.00th=[12125], 10.00th=[12518], 20.00th=[13042], 00:29:17.282 | 30.00th=[13304], 40.00th=[13566], 50.00th=[13829], 60.00th=[14091], 00:29:17.282 | 70.00th=[14222], 80.00th=[14484], 90.00th=[15008], 95.00th=[15270], 00:29:17.282 | 99.00th=[16057], 99.50th=[16319], 99.90th=[20055], 99.95th=[50070], 00:29:17.282 | 99.99th=[52691] 00:29:17.282 bw ( KiB/s): min=27136, max=28416, per=34.78%, avg=27827.20, stdev=343.46, samples=20 00:29:17.282 iops : min= 212, max= 222, avg=217.40, stdev= 2.68, samples=20 00:29:17.282 lat (msec) : 10=0.32%, 20=99.45%, 50=0.14%, 100=0.09% 00:29:17.282 cpu : usr=87.51%, sys=8.16%, ctx=1020, majf=0, minf=172 00:29:17.282 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:17.282 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:17.282 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:17.282 issued rwts: total=2176,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:17.282 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:17.282 filename0: (groupid=0, jobs=1): err= 0: pid=2247021: Sun Dec 8 02:31:42 2024 00:29:17.282 read: IOPS=206, BW=25.8MiB/s (27.1MB/s)(259MiB/10048msec) 00:29:17.282 slat (nsec): min=4064, max=64928, avg=16364.03, stdev=3678.85 00:29:17.282 clat (usec): min=8261, max=54045, avg=14485.55, stdev=1566.31 00:29:17.282 lat (usec): min=8275, max=54063, avg=14501.92, stdev=1566.34 00:29:17.282 clat percentiles (usec): 00:29:17.282 | 1.00th=[11994], 5.00th=[12911], 10.00th=[13304], 20.00th=[13698], 00:29:17.282 | 30.00th=[13960], 40.00th=[14222], 50.00th=[14484], 60.00th=[14615], 00:29:17.282 | 70.00th=[14877], 80.00th=[15139], 90.00th=[15664], 95.00th=[16057], 00:29:17.282 | 99.00th=[16909], 99.50th=[17171], 99.90th=[23462], 99.95th=[51643], 00:29:17.282 | 99.99th=[54264] 00:29:17.282 bw ( KiB/s): min=25856, max=27136, per=33.15%, avg=26524.25, stdev=339.52, samples=20 00:29:17.282 iops : min= 202, max= 212, avg=207.20, stdev= 2.63, samples=20 00:29:17.283 lat (msec) : 10=0.48%, 20=99.33%, 50=0.10%, 100=0.10% 00:29:17.283 cpu : usr=95.55%, sys=3.95%, ctx=17, majf=0, minf=165 00:29:17.283 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:17.283 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:17.283 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:17.283 issued rwts: total=2075,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:17.283 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:17.283 00:29:17.283 Run status group 0 (all jobs): 00:29:17.283 READ: bw=78.1MiB/s (81.9MB/s), 25.3MiB/s-27.1MiB/s (26.5MB/s-28.4MB/s), io=785MiB (823MB), run=10046-10048msec 00:29:17.283 02:31:43 -- target/dif.sh@132 -- # destroy_subsystems 0 00:29:17.283 02:31:43 -- target/dif.sh@43 -- # local sub 00:29:17.283 02:31:43 -- target/dif.sh@45 -- # for sub in "$@" 00:29:17.283 02:31:43 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:17.283 02:31:43 -- target/dif.sh@36 -- # local sub_id=0 00:29:17.283 02:31:43 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:17.283 02:31:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:17.283 02:31:43 -- common/autotest_common.sh@10 -- # set +x 00:29:17.283 02:31:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:17.283 02:31:43 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:17.283 02:31:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:17.283 02:31:43 -- common/autotest_common.sh@10 -- # set +x 00:29:17.283 02:31:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:17.283 00:29:17.283 real 0m11.129s 00:29:17.283 user 0m29.281s 00:29:17.283 sys 0m1.977s 00:29:17.283 02:31:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:17.283 02:31:43 -- common/autotest_common.sh@10 -- # set +x 00:29:17.283 ************************************ 00:29:17.283 END TEST fio_dif_digest 00:29:17.283 ************************************ 00:29:17.283 02:31:43 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:29:17.283 02:31:43 -- target/dif.sh@147 -- # nvmftestfini 00:29:17.283 02:31:43 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:17.283 02:31:43 -- nvmf/common.sh@116 -- # sync 00:29:17.283 02:31:43 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:17.283 02:31:43 -- nvmf/common.sh@119 -- # set +e 00:29:17.283 02:31:43 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:17.283 02:31:43 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:17.283 rmmod nvme_tcp 00:29:17.283 rmmod nvme_fabrics 00:29:17.283 rmmod nvme_keyring 00:29:17.283 02:31:43 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:17.283 02:31:43 -- nvmf/common.sh@123 -- # set -e 00:29:17.283 02:31:43 -- nvmf/common.sh@124 -- # return 0 00:29:17.283 02:31:43 -- nvmf/common.sh@477 -- # '[' -n 2240693 ']' 00:29:17.283 02:31:43 -- nvmf/common.sh@478 -- # killprocess 2240693 00:29:17.283 02:31:43 -- common/autotest_common.sh@936 -- # '[' -z 2240693 ']' 00:29:17.283 02:31:43 -- common/autotest_common.sh@940 -- # kill -0 2240693 00:29:17.283 02:31:43 -- common/autotest_common.sh@941 -- # uname 00:29:17.283 02:31:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:17.283 02:31:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2240693 00:29:17.283 02:31:43 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:17.283 02:31:43 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:17.283 02:31:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2240693' 00:29:17.283 killing process with pid 2240693 00:29:17.283 02:31:43 -- common/autotest_common.sh@955 -- # kill 2240693 00:29:17.283 02:31:43 -- common/autotest_common.sh@960 -- # wait 2240693 00:29:17.283 02:31:43 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:29:17.283 02:31:43 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:17.283 Waiting for block devices as requested 00:29:17.283 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:29:17.283 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:17.283 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:17.283 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:17.545 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:17.545 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:17.545 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:17.545 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:17.545 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:17.805 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:17.805 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:17.805 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:18.063 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:18.063 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:18.063 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:18.063 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:18.321 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:18.321 02:31:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:18.321 02:31:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:18.321 02:31:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:18.321 02:31:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:18.321 02:31:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:18.321 02:31:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:18.321 02:31:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:20.239 02:31:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:20.239 00:29:20.239 real 1m7.743s 00:29:20.239 user 6m34.689s 00:29:20.239 sys 0m16.759s 00:29:20.239 02:31:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:20.239 02:31:48 -- common/autotest_common.sh@10 -- # set +x 00:29:20.239 ************************************ 00:29:20.239 END TEST nvmf_dif 00:29:20.239 ************************************ 00:29:20.545 02:31:48 -- spdk/autotest.sh@288 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:20.545 02:31:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:20.545 02:31:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:20.545 02:31:48 -- common/autotest_common.sh@10 -- # set +x 00:29:20.545 ************************************ 00:29:20.545 START TEST nvmf_abort_qd_sizes 00:29:20.545 ************************************ 00:29:20.545 02:31:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:20.545 * Looking for test storage... 00:29:20.545 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:29:20.545 02:31:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:20.545 02:31:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:20.545 02:31:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:20.545 02:31:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:20.545 02:31:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:20.545 02:31:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:20.545 02:31:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:20.545 02:31:48 -- scripts/common.sh@335 -- # IFS=.-: 00:29:20.545 02:31:48 -- scripts/common.sh@335 -- # read -ra ver1 00:29:20.545 02:31:48 -- scripts/common.sh@336 -- # IFS=.-: 00:29:20.545 02:31:48 -- scripts/common.sh@336 -- # read -ra ver2 00:29:20.545 02:31:48 -- scripts/common.sh@337 -- # local 'op=<' 00:29:20.545 02:31:48 -- scripts/common.sh@339 -- # ver1_l=2 00:29:20.545 02:31:48 -- scripts/common.sh@340 -- # ver2_l=1 00:29:20.545 02:31:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:20.545 02:31:48 -- scripts/common.sh@343 -- # case "$op" in 00:29:20.545 02:31:48 -- scripts/common.sh@344 -- # : 1 00:29:20.545 02:31:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:20.545 02:31:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:20.545 02:31:48 -- scripts/common.sh@364 -- # decimal 1 00:29:20.545 02:31:48 -- scripts/common.sh@352 -- # local d=1 00:29:20.545 02:31:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:20.545 02:31:48 -- scripts/common.sh@354 -- # echo 1 00:29:20.545 02:31:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:20.545 02:31:48 -- scripts/common.sh@365 -- # decimal 2 00:29:20.545 02:31:48 -- scripts/common.sh@352 -- # local d=2 00:29:20.545 02:31:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:20.545 02:31:48 -- scripts/common.sh@354 -- # echo 2 00:29:20.545 02:31:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:20.545 02:31:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:20.545 02:31:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:20.545 02:31:48 -- scripts/common.sh@367 -- # return 0 00:29:20.545 02:31:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:20.545 02:31:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:20.545 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:20.545 --rc genhtml_branch_coverage=1 00:29:20.545 --rc genhtml_function_coverage=1 00:29:20.545 --rc genhtml_legend=1 00:29:20.545 --rc geninfo_all_blocks=1 00:29:20.545 --rc geninfo_unexecuted_blocks=1 00:29:20.545 00:29:20.545 ' 00:29:20.545 02:31:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:20.545 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:20.545 --rc genhtml_branch_coverage=1 00:29:20.545 --rc genhtml_function_coverage=1 00:29:20.545 --rc genhtml_legend=1 00:29:20.545 --rc geninfo_all_blocks=1 00:29:20.545 --rc geninfo_unexecuted_blocks=1 00:29:20.545 00:29:20.545 ' 00:29:20.545 02:31:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:20.545 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:20.545 --rc genhtml_branch_coverage=1 00:29:20.545 --rc genhtml_function_coverage=1 00:29:20.545 --rc genhtml_legend=1 00:29:20.545 --rc geninfo_all_blocks=1 00:29:20.545 --rc geninfo_unexecuted_blocks=1 00:29:20.545 00:29:20.545 ' 00:29:20.545 02:31:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:20.545 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:20.545 --rc genhtml_branch_coverage=1 00:29:20.545 --rc genhtml_function_coverage=1 00:29:20.545 --rc genhtml_legend=1 00:29:20.545 --rc geninfo_all_blocks=1 00:29:20.545 --rc geninfo_unexecuted_blocks=1 00:29:20.545 00:29:20.545 ' 00:29:20.545 02:31:48 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:20.545 02:31:48 -- nvmf/common.sh@7 -- # uname -s 00:29:20.545 02:31:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:20.545 02:31:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:20.545 02:31:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:20.545 02:31:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:20.545 02:31:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:20.545 02:31:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:20.545 02:31:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:20.545 02:31:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:20.545 02:31:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:20.545 02:31:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:20.545 02:31:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:20.545 02:31:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:20.545 02:31:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:20.545 02:31:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:20.545 02:31:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:20.545 02:31:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:20.546 02:31:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:20.546 02:31:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:20.546 02:31:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:20.546 02:31:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:20.546 02:31:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:20.546 02:31:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:20.546 02:31:48 -- paths/export.sh@5 -- # export PATH 00:29:20.546 02:31:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:20.546 02:31:48 -- nvmf/common.sh@46 -- # : 0 00:29:20.546 02:31:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:20.546 02:31:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:20.546 02:31:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:20.546 02:31:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:20.546 02:31:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:20.546 02:31:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:20.546 02:31:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:20.546 02:31:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:20.546 02:31:48 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:29:20.546 02:31:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:20.546 02:31:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:20.546 02:31:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:20.546 02:31:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:20.546 02:31:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:20.546 02:31:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:20.546 02:31:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:20.546 02:31:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:20.546 02:31:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:20.546 02:31:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:20.546 02:31:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:20.546 02:31:48 -- common/autotest_common.sh@10 -- # set +x 00:29:22.453 02:31:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:22.453 02:31:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:22.453 02:31:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:22.453 02:31:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:22.453 02:31:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:22.453 02:31:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:22.453 02:31:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:22.453 02:31:50 -- nvmf/common.sh@294 -- # net_devs=() 00:29:22.453 02:31:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:22.453 02:31:50 -- nvmf/common.sh@295 -- # e810=() 00:29:22.453 02:31:50 -- nvmf/common.sh@295 -- # local -ga e810 00:29:22.453 02:31:50 -- nvmf/common.sh@296 -- # x722=() 00:29:22.453 02:31:50 -- nvmf/common.sh@296 -- # local -ga x722 00:29:22.453 02:31:50 -- nvmf/common.sh@297 -- # mlx=() 00:29:22.453 02:31:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:22.453 02:31:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:22.453 02:31:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:22.453 02:31:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:22.453 02:31:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:22.453 02:31:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:22.453 02:31:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:22.453 02:31:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:22.453 02:31:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:22.453 02:31:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:22.453 02:31:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:22.453 02:31:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:22.453 02:31:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:22.453 02:31:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:22.453 02:31:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:22.453 02:31:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:22.453 02:31:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:22.453 02:31:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:22.453 02:31:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:22.453 02:31:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:22.453 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:22.453 02:31:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:22.453 02:31:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:22.453 02:31:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:22.453 02:31:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:22.453 02:31:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:22.453 02:31:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:22.453 02:31:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:22.453 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:22.453 02:31:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:22.453 02:31:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:22.453 02:31:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:22.453 02:31:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:22.453 02:31:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:22.453 02:31:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:22.453 02:31:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:22.453 02:31:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:22.453 02:31:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:22.453 02:31:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:22.453 02:31:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:22.453 02:31:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:22.453 02:31:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:22.453 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:22.453 02:31:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:22.453 02:31:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:22.453 02:31:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:22.453 02:31:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:22.453 02:31:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:22.453 02:31:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:22.453 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:22.453 02:31:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:22.453 02:31:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:22.453 02:31:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:22.453 02:31:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:22.453 02:31:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:22.453 02:31:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:22.453 02:31:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:22.453 02:31:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:22.453 02:31:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:22.453 02:31:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:22.454 02:31:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:22.454 02:31:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:22.454 02:31:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:22.454 02:31:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:22.454 02:31:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:22.454 02:31:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:22.454 02:31:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:22.454 02:31:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:22.454 02:31:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:22.712 02:31:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:22.712 02:31:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:22.712 02:31:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:22.712 02:31:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:22.712 02:31:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:22.712 02:31:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:22.712 02:31:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:22.712 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:22.712 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.485 ms 00:29:22.712 00:29:22.712 --- 10.0.0.2 ping statistics --- 00:29:22.712 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:22.712 rtt min/avg/max/mdev = 0.485/0.485/0.485/0.000 ms 00:29:22.712 02:31:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:22.712 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:22.712 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.061 ms 00:29:22.712 00:29:22.712 --- 10.0.0.1 ping statistics --- 00:29:22.712 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:22.712 rtt min/avg/max/mdev = 0.061/0.061/0.061/0.000 ms 00:29:22.712 02:31:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:22.712 02:31:50 -- nvmf/common.sh@410 -- # return 0 00:29:22.712 02:31:50 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:29:22.712 02:31:50 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:29:24.088 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:24.088 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:24.088 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:24.088 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:24.088 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:24.088 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:24.088 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:24.088 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:24.088 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:24.088 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:24.088 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:24.088 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:24.088 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:24.088 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:24.088 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:24.088 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:25.025 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:29:25.025 02:31:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:25.025 02:31:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:25.025 02:31:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:25.025 02:31:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:25.025 02:31:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:25.025 02:31:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:25.025 02:31:52 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:29:25.025 02:31:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:25.025 02:31:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:25.025 02:31:52 -- common/autotest_common.sh@10 -- # set +x 00:29:25.025 02:31:52 -- nvmf/common.sh@469 -- # nvmfpid=2252049 00:29:25.025 02:31:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:29:25.025 02:31:52 -- nvmf/common.sh@470 -- # waitforlisten 2252049 00:29:25.025 02:31:52 -- common/autotest_common.sh@829 -- # '[' -z 2252049 ']' 00:29:25.025 02:31:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:25.025 02:31:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:25.025 02:31:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:25.025 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:25.025 02:31:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:25.025 02:31:52 -- common/autotest_common.sh@10 -- # set +x 00:29:25.283 [2024-12-08 02:31:52.833237] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:25.283 [2024-12-08 02:31:52.833326] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:25.283 EAL: No free 2048 kB hugepages reported on node 1 00:29:25.283 [2024-12-08 02:31:52.907948] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:29:25.283 [2024-12-08 02:31:53.031733] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:25.283 [2024-12-08 02:31:53.031883] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:25.283 [2024-12-08 02:31:53.031900] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:25.283 [2024-12-08 02:31:53.031917] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:25.283 [2024-12-08 02:31:53.035561] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:25.283 [2024-12-08 02:31:53.035613] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:25.283 [2024-12-08 02:31:53.039592] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:25.283 [2024-12-08 02:31:53.039596] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:26.219 02:31:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:26.219 02:31:53 -- common/autotest_common.sh@862 -- # return 0 00:29:26.219 02:31:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:26.219 02:31:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:26.219 02:31:53 -- common/autotest_common.sh@10 -- # set +x 00:29:26.219 02:31:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:26.219 02:31:53 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:29:26.219 02:31:53 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:29:26.219 02:31:53 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:29:26.219 02:31:53 -- scripts/common.sh@311 -- # local bdf bdfs 00:29:26.219 02:31:53 -- scripts/common.sh@312 -- # local nvmes 00:29:26.219 02:31:53 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:29:26.219 02:31:53 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:29:26.219 02:31:53 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:29:26.219 02:31:53 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:29:26.219 02:31:53 -- scripts/common.sh@322 -- # uname -s 00:29:26.219 02:31:53 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:29:26.219 02:31:53 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:29:26.219 02:31:53 -- scripts/common.sh@327 -- # (( 1 )) 00:29:26.219 02:31:53 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:29:26.219 02:31:53 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:29:26.219 02:31:53 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:29:26.219 02:31:53 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:29:26.219 02:31:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:26.219 02:31:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:26.219 02:31:53 -- common/autotest_common.sh@10 -- # set +x 00:29:26.219 ************************************ 00:29:26.219 START TEST spdk_target_abort 00:29:26.219 ************************************ 00:29:26.219 02:31:53 -- common/autotest_common.sh@1114 -- # spdk_target 00:29:26.219 02:31:53 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:29:26.219 02:31:53 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:29:26.219 02:31:53 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:29:26.219 02:31:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:26.219 02:31:53 -- common/autotest_common.sh@10 -- # set +x 00:29:29.496 spdk_targetn1 00:29:29.496 02:31:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:29.496 02:31:56 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:29.496 02:31:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:29.497 02:31:56 -- common/autotest_common.sh@10 -- # set +x 00:29:29.497 [2024-12-08 02:31:56.723363] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:29.497 02:31:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:29.497 02:31:56 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:29:29.497 02:31:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:29.497 02:31:56 -- common/autotest_common.sh@10 -- # set +x 00:29:29.497 02:31:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:29.497 02:31:56 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:29:29.497 02:31:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:29.497 02:31:56 -- common/autotest_common.sh@10 -- # set +x 00:29:29.497 02:31:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:29.497 02:31:56 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:29:29.497 02:31:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:29.497 02:31:56 -- common/autotest_common.sh@10 -- # set +x 00:29:29.497 [2024-12-08 02:31:56.755705] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:29.497 02:31:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:29.497 02:31:56 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:29:29.497 02:31:56 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:29:29.497 02:31:56 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:29:29.497 02:31:56 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:29:29.497 02:31:56 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:29:29.497 02:31:56 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:29:29.497 02:31:56 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:29:29.497 02:31:56 -- target/abort_qd_sizes.sh@24 -- # local target r 00:29:29.497 02:31:56 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:29:29.497 02:31:56 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:29.497 02:31:56 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:29:29.497 02:31:56 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:29.497 02:31:56 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:29:29.497 02:31:56 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:29.497 02:31:56 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:29:29.497 02:31:56 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:29.497 02:31:56 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:29:29.497 02:31:56 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:29.497 02:31:56 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:29.497 02:31:56 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:29.497 02:31:56 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:29.497 EAL: No free 2048 kB hugepages reported on node 1 00:29:32.788 Initializing NVMe Controllers 00:29:32.788 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:32.788 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:32.788 Initialization complete. Launching workers. 00:29:32.788 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 13674, failed: 0 00:29:32.788 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1213, failed to submit 12461 00:29:32.788 success 746, unsuccess 467, failed 0 00:29:32.788 02:31:59 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:32.788 02:31:59 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:32.788 EAL: No free 2048 kB hugepages reported on node 1 00:29:35.313 [2024-12-08 02:32:03.044568] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10e45e0 is same with the state(5) to be set 00:29:35.313 [2024-12-08 02:32:03.044624] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10e45e0 is same with the state(5) to be set 00:29:35.313 [2024-12-08 02:32:03.044640] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10e45e0 is same with the state(5) to be set 00:29:35.313 [2024-12-08 02:32:03.044653] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10e45e0 is same with the state(5) to be set 00:29:35.313 [2024-12-08 02:32:03.044665] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10e45e0 is same with the state(5) to be set 00:29:35.313 [2024-12-08 02:32:03.044677] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10e45e0 is same with the state(5) to be set 00:29:35.313 [2024-12-08 02:32:03.044689] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10e45e0 is same with the state(5) to be set 00:29:35.313 [2024-12-08 02:32:03.044711] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10e45e0 is same with the state(5) to be set 00:29:35.313 [2024-12-08 02:32:03.044723] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10e45e0 is same with the state(5) to be set 00:29:35.313 [2024-12-08 02:32:03.044735] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10e45e0 is same with the state(5) to be set 00:29:35.313 [2024-12-08 02:32:03.044746] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10e45e0 is same with the state(5) to be set 00:29:35.313 [2024-12-08 02:32:03.044758] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10e45e0 is same with the state(5) to be set 00:29:35.313 [2024-12-08 02:32:03.044769] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10e45e0 is same with the state(5) to be set 00:29:35.313 [2024-12-08 02:32:03.044781] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10e45e0 is same with the state(5) to be set 00:29:35.313 [2024-12-08 02:32:03.044793] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10e45e0 is same with the state(5) to be set 00:29:35.313 [2024-12-08 02:32:03.044804] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10e45e0 is same with the state(5) to be set 00:29:35.572 Initializing NVMe Controllers 00:29:35.572 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:35.572 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:35.572 Initialization complete. Launching workers. 00:29:35.572 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8670, failed: 0 00:29:35.572 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1211, failed to submit 7459 00:29:35.572 success 316, unsuccess 895, failed 0 00:29:35.572 02:32:03 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:35.572 02:32:03 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:35.572 EAL: No free 2048 kB hugepages reported on node 1 00:29:38.851 Initializing NVMe Controllers 00:29:38.851 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:38.851 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:38.851 Initialization complete. Launching workers. 00:29:38.851 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 32265, failed: 0 00:29:38.851 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2591, failed to submit 29674 00:29:38.851 success 568, unsuccess 2023, failed 0 00:29:38.851 02:32:06 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:29:38.851 02:32:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:38.851 02:32:06 -- common/autotest_common.sh@10 -- # set +x 00:29:38.851 02:32:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:38.851 02:32:06 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:29:38.851 02:32:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:38.851 02:32:06 -- common/autotest_common.sh@10 -- # set +x 00:29:40.220 02:32:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:40.220 02:32:07 -- target/abort_qd_sizes.sh@62 -- # killprocess 2252049 00:29:40.220 02:32:07 -- common/autotest_common.sh@936 -- # '[' -z 2252049 ']' 00:29:40.220 02:32:07 -- common/autotest_common.sh@940 -- # kill -0 2252049 00:29:40.220 02:32:07 -- common/autotest_common.sh@941 -- # uname 00:29:40.220 02:32:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:40.220 02:32:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2252049 00:29:40.220 02:32:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:40.220 02:32:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:40.220 02:32:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2252049' 00:29:40.220 killing process with pid 2252049 00:29:40.220 02:32:07 -- common/autotest_common.sh@955 -- # kill 2252049 00:29:40.220 02:32:07 -- common/autotest_common.sh@960 -- # wait 2252049 00:29:40.220 00:29:40.220 real 0m14.092s 00:29:40.220 user 0m55.969s 00:29:40.220 sys 0m2.499s 00:29:40.220 02:32:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:40.220 02:32:07 -- common/autotest_common.sh@10 -- # set +x 00:29:40.220 ************************************ 00:29:40.220 END TEST spdk_target_abort 00:29:40.220 ************************************ 00:29:40.220 02:32:07 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:29:40.220 02:32:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:40.220 02:32:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:40.220 02:32:07 -- common/autotest_common.sh@10 -- # set +x 00:29:40.479 ************************************ 00:29:40.479 START TEST kernel_target_abort 00:29:40.479 ************************************ 00:29:40.479 02:32:08 -- common/autotest_common.sh@1114 -- # kernel_target 00:29:40.479 02:32:08 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:29:40.479 02:32:08 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:29:40.479 02:32:08 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:29:40.479 02:32:08 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:29:40.479 02:32:08 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:29:40.479 02:32:08 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:29:40.479 02:32:08 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:29:40.479 02:32:08 -- nvmf/common.sh@627 -- # local block nvme 00:29:40.479 02:32:08 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:29:40.479 02:32:08 -- nvmf/common.sh@630 -- # modprobe nvmet 00:29:40.479 02:32:08 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:29:40.479 02:32:08 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:41.411 Waiting for block devices as requested 00:29:41.411 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:29:41.669 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:41.669 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:41.927 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:41.927 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:41.927 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:41.927 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:42.185 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:42.185 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:42.185 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:42.185 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:42.443 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:42.443 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:42.443 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:42.443 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:42.701 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:42.701 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:42.701 02:32:10 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:29:42.701 02:32:10 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:29:42.701 02:32:10 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:29:42.701 02:32:10 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:29:42.701 02:32:10 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:29:42.960 No valid GPT data, bailing 00:29:42.960 02:32:10 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:29:42.960 02:32:10 -- scripts/common.sh@393 -- # pt= 00:29:42.960 02:32:10 -- scripts/common.sh@394 -- # return 1 00:29:42.960 02:32:10 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:29:42.960 02:32:10 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:29:42.960 02:32:10 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:29:42.960 02:32:10 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:29:42.960 02:32:10 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:29:42.960 02:32:10 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:29:42.960 02:32:10 -- nvmf/common.sh@654 -- # echo 1 00:29:42.960 02:32:10 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:29:42.960 02:32:10 -- nvmf/common.sh@656 -- # echo 1 00:29:42.960 02:32:10 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:29:42.960 02:32:10 -- nvmf/common.sh@663 -- # echo tcp 00:29:42.960 02:32:10 -- nvmf/common.sh@664 -- # echo 4420 00:29:42.960 02:32:10 -- nvmf/common.sh@665 -- # echo ipv4 00:29:42.960 02:32:10 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:29:42.960 02:32:10 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:29:42.960 00:29:42.960 Discovery Log Number of Records 2, Generation counter 2 00:29:42.960 =====Discovery Log Entry 0====== 00:29:42.960 trtype: tcp 00:29:42.960 adrfam: ipv4 00:29:42.960 subtype: current discovery subsystem 00:29:42.960 treq: not specified, sq flow control disable supported 00:29:42.960 portid: 1 00:29:42.960 trsvcid: 4420 00:29:42.960 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:29:42.960 traddr: 10.0.0.1 00:29:42.960 eflags: none 00:29:42.960 sectype: none 00:29:42.960 =====Discovery Log Entry 1====== 00:29:42.960 trtype: tcp 00:29:42.960 adrfam: ipv4 00:29:42.960 subtype: nvme subsystem 00:29:42.960 treq: not specified, sq flow control disable supported 00:29:42.960 portid: 1 00:29:42.960 trsvcid: 4420 00:29:42.960 subnqn: kernel_target 00:29:42.960 traddr: 10.0.0.1 00:29:42.960 eflags: none 00:29:42.960 sectype: none 00:29:42.960 02:32:10 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:29:42.960 02:32:10 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:29:42.960 02:32:10 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:29:42.960 02:32:10 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:29:42.960 02:32:10 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:29:42.960 02:32:10 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:29:42.960 02:32:10 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:29:42.960 02:32:10 -- target/abort_qd_sizes.sh@24 -- # local target r 00:29:42.960 02:32:10 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:29:42.960 02:32:10 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:42.960 02:32:10 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:29:42.960 02:32:10 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:42.960 02:32:10 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:29:42.960 02:32:10 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:42.960 02:32:10 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:29:42.960 02:32:10 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:42.960 02:32:10 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:29:42.960 02:32:10 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:42.960 02:32:10 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:29:42.960 02:32:10 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:42.960 02:32:10 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:29:42.960 EAL: No free 2048 kB hugepages reported on node 1 00:29:46.241 Initializing NVMe Controllers 00:29:46.241 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:29:46.241 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:29:46.241 Initialization complete. Launching workers. 00:29:46.241 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 46886, failed: 0 00:29:46.241 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 46886, failed to submit 0 00:29:46.241 success 0, unsuccess 46886, failed 0 00:29:46.241 02:32:13 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:46.241 02:32:13 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:29:46.241 EAL: No free 2048 kB hugepages reported on node 1 00:29:49.519 Initializing NVMe Controllers 00:29:49.520 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:29:49.520 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:29:49.520 Initialization complete. Launching workers. 00:29:49.520 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 82097, failed: 0 00:29:49.520 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 20706, failed to submit 61391 00:29:49.520 success 0, unsuccess 20706, failed 0 00:29:49.520 02:32:16 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:49.520 02:32:16 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:29:49.520 EAL: No free 2048 kB hugepages reported on node 1 00:29:52.803 Initializing NVMe Controllers 00:29:52.803 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:29:52.803 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:29:52.803 Initialization complete. Launching workers. 00:29:52.803 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 79179, failed: 0 00:29:52.803 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 19778, failed to submit 59401 00:29:52.803 success 0, unsuccess 19778, failed 0 00:29:52.803 02:32:19 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:29:52.803 02:32:19 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:29:52.803 02:32:19 -- nvmf/common.sh@677 -- # echo 0 00:29:52.803 02:32:19 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:29:52.803 02:32:19 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:29:52.803 02:32:19 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:29:52.803 02:32:19 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:29:52.803 02:32:19 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:29:52.803 02:32:19 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:29:52.803 00:29:52.803 real 0m12.034s 00:29:52.803 user 0m5.983s 00:29:52.803 sys 0m2.317s 00:29:52.803 02:32:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:52.803 02:32:20 -- common/autotest_common.sh@10 -- # set +x 00:29:52.803 ************************************ 00:29:52.803 END TEST kernel_target_abort 00:29:52.803 ************************************ 00:29:52.803 02:32:20 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:29:52.803 02:32:20 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:29:52.803 02:32:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:52.803 02:32:20 -- nvmf/common.sh@116 -- # sync 00:29:52.803 02:32:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:52.803 02:32:20 -- nvmf/common.sh@119 -- # set +e 00:29:52.803 02:32:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:52.803 02:32:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:52.803 rmmod nvme_tcp 00:29:52.803 rmmod nvme_fabrics 00:29:52.803 rmmod nvme_keyring 00:29:52.803 02:32:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:52.803 02:32:20 -- nvmf/common.sh@123 -- # set -e 00:29:52.803 02:32:20 -- nvmf/common.sh@124 -- # return 0 00:29:52.803 02:32:20 -- nvmf/common.sh@477 -- # '[' -n 2252049 ']' 00:29:52.803 02:32:20 -- nvmf/common.sh@478 -- # killprocess 2252049 00:29:52.803 02:32:20 -- common/autotest_common.sh@936 -- # '[' -z 2252049 ']' 00:29:52.803 02:32:20 -- common/autotest_common.sh@940 -- # kill -0 2252049 00:29:52.803 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2252049) - No such process 00:29:52.803 02:32:20 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2252049 is not found' 00:29:52.803 Process with pid 2252049 is not found 00:29:52.803 02:32:20 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:29:52.803 02:32:20 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:53.740 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:29:53.740 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:29:53.740 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:29:53.740 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:29:53.740 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:29:53.740 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:29:53.740 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:29:53.740 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:29:53.740 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:29:53.740 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:29:53.740 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:29:53.740 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:29:53.740 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:29:53.740 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:29:53.740 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:29:53.740 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:29:53.740 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:29:54.000 02:32:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:54.000 02:32:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:54.000 02:32:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:54.000 02:32:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:54.000 02:32:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:54.000 02:32:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:54.000 02:32:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:55.908 02:32:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:55.908 00:29:55.908 real 0m35.539s 00:29:55.908 user 1m4.377s 00:29:55.908 sys 0m8.258s 00:29:55.908 02:32:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:55.908 02:32:23 -- common/autotest_common.sh@10 -- # set +x 00:29:55.908 ************************************ 00:29:55.908 END TEST nvmf_abort_qd_sizes 00:29:55.908 ************************************ 00:29:55.908 02:32:23 -- spdk/autotest.sh@298 -- # '[' 0 -eq 1 ']' 00:29:55.908 02:32:23 -- spdk/autotest.sh@302 -- # '[' 0 -eq 1 ']' 00:29:55.908 02:32:23 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:29:55.908 02:32:23 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:29:55.908 02:32:23 -- spdk/autotest.sh@320 -- # '[' 0 -eq 1 ']' 00:29:55.908 02:32:23 -- spdk/autotest.sh@325 -- # '[' 0 -eq 1 ']' 00:29:55.908 02:32:23 -- spdk/autotest.sh@329 -- # '[' 0 -eq 1 ']' 00:29:55.908 02:32:23 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:29:55.908 02:32:23 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:29:55.908 02:32:23 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:29:55.908 02:32:23 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:29:55.908 02:32:23 -- spdk/autotest.sh@353 -- # [[ 0 -eq 1 ]] 00:29:55.908 02:32:23 -- spdk/autotest.sh@357 -- # [[ 0 -eq 1 ]] 00:29:55.908 02:32:23 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:29:55.908 02:32:23 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:29:55.908 02:32:23 -- spdk/autotest.sh@370 -- # trap - SIGINT SIGTERM EXIT 00:29:55.908 02:32:23 -- spdk/autotest.sh@372 -- # timing_enter post_cleanup 00:29:55.908 02:32:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:55.908 02:32:23 -- common/autotest_common.sh@10 -- # set +x 00:29:55.908 02:32:23 -- spdk/autotest.sh@373 -- # autotest_cleanup 00:29:55.908 02:32:23 -- common/autotest_common.sh@1381 -- # local autotest_es=0 00:29:55.908 02:32:23 -- common/autotest_common.sh@1382 -- # xtrace_disable 00:29:55.908 02:32:23 -- common/autotest_common.sh@10 -- # set +x 00:29:57.858 INFO: APP EXITING 00:29:57.858 INFO: killing all VMs 00:29:57.858 INFO: killing vhost app 00:29:57.858 INFO: EXIT DONE 00:29:58.820 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:29:58.820 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:29:58.820 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:29:58.820 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:29:58.820 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:29:58.820 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:29:58.820 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:29:58.820 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:29:58.820 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:29:58.820 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:29:58.820 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:29:58.820 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:29:58.820 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:29:58.820 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:29:58.820 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:29:58.820 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:29:58.820 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:30:00.197 Cleaning 00:30:00.197 Removing: /var/run/dpdk/spdk0/config 00:30:00.197 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:30:00.197 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:30:00.197 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:30:00.197 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:30:00.197 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:30:00.197 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:30:00.197 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:30:00.197 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:30:00.197 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:30:00.197 Removing: /var/run/dpdk/spdk0/hugepage_info 00:30:00.197 Removing: /var/run/dpdk/spdk1/config 00:30:00.197 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:30:00.197 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:30:00.197 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:30:00.197 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:30:00.197 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:30:00.197 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:30:00.197 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:30:00.197 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:30:00.197 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:30:00.197 Removing: /var/run/dpdk/spdk1/hugepage_info 00:30:00.197 Removing: /var/run/dpdk/spdk1/mp_socket 00:30:00.197 Removing: /var/run/dpdk/spdk2/config 00:30:00.197 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:30:00.197 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:30:00.197 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:30:00.197 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:30:00.197 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:30:00.197 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:30:00.197 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:30:00.197 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:30:00.197 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:30:00.197 Removing: /var/run/dpdk/spdk2/hugepage_info 00:30:00.197 Removing: /var/run/dpdk/spdk3/config 00:30:00.197 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:30:00.197 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:30:00.197 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:30:00.197 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:30:00.197 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:30:00.197 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:30:00.197 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:30:00.197 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:30:00.197 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:30:00.197 Removing: /var/run/dpdk/spdk3/hugepage_info 00:30:00.197 Removing: /var/run/dpdk/spdk4/config 00:30:00.197 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:30:00.197 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:30:00.197 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:30:00.197 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:30:00.197 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:30:00.197 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:30:00.197 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:30:00.197 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:30:00.197 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:30:00.197 Removing: /var/run/dpdk/spdk4/hugepage_info 00:30:00.197 Removing: /dev/shm/bdev_svc_trace.1 00:30:00.197 Removing: /dev/shm/nvmf_trace.0 00:30:00.197 Removing: /dev/shm/spdk_tgt_trace.pid1982292 00:30:00.197 Removing: /var/run/dpdk/spdk0 00:30:00.197 Removing: /var/run/dpdk/spdk1 00:30:00.197 Removing: /var/run/dpdk/spdk2 00:30:00.197 Removing: /var/run/dpdk/spdk3 00:30:00.197 Removing: /var/run/dpdk/spdk4 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1980225 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1981083 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1982292 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1983073 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1984416 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1985364 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1985640 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1985893 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1986241 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1986569 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1986732 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1986888 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1987075 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1987669 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1990221 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1990421 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1990695 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1990833 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1991161 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1991292 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1991722 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1991866 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1992036 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1992180 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1992346 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1992486 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1992940 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1993151 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1993357 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1993534 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1993683 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1993740 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1994011 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1994164 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1994310 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1994591 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1994740 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1994907 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1995139 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1995335 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1995475 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1995701 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1995903 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1996062 00:30:00.197 Removing: /var/run/dpdk/spdk_pid1996206 00:30:00.456 Removing: /var/run/dpdk/spdk_pid1996495 00:30:00.456 Removing: /var/run/dpdk/spdk_pid1996636 00:30:00.456 Removing: /var/run/dpdk/spdk_pid1996795 00:30:00.456 Removing: /var/run/dpdk/spdk_pid1997063 00:30:00.456 Removing: /var/run/dpdk/spdk_pid1997223 00:30:00.456 Removing: /var/run/dpdk/spdk_pid1997363 00:30:00.456 Removing: /var/run/dpdk/spdk_pid1997643 00:30:00.456 Removing: /var/run/dpdk/spdk_pid1997791 00:30:00.456 Removing: /var/run/dpdk/spdk_pid1997950 00:30:00.456 Removing: /var/run/dpdk/spdk_pid1998209 00:30:00.456 Removing: /var/run/dpdk/spdk_pid1998377 00:30:00.456 Removing: /var/run/dpdk/spdk_pid1998518 00:30:00.456 Removing: /var/run/dpdk/spdk_pid1998751 00:30:00.456 Removing: /var/run/dpdk/spdk_pid1998940 00:30:00.456 Removing: /var/run/dpdk/spdk_pid1999098 00:30:00.456 Removing: /var/run/dpdk/spdk_pid1999258 00:30:00.456 Removing: /var/run/dpdk/spdk_pid1999517 00:30:00.456 Removing: /var/run/dpdk/spdk_pid1999668 00:30:00.456 Removing: /var/run/dpdk/spdk_pid1999836 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2000094 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2000255 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2000408 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2000684 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2000838 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2001003 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2001262 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2001421 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2001617 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2001962 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2004190 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2062076 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2064744 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2072412 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2075838 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2078220 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2078633 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2083859 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2084143 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2086829 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2090607 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2092854 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2099626 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2105131 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2106867 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2107707 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2118472 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2120781 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2123690 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2124911 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2126285 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2126555 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2126709 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2126942 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2127554 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2128946 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2129965 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2130424 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2134039 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2137627 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2141895 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2165729 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2169194 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2173169 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2174148 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2175276 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2177964 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2180497 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2184903 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2184905 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2187852 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2187996 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2188144 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2188523 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2188543 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2189651 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2190870 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2192102 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2193376 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2194641 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2195858 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2199757 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2200260 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2202158 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2202909 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2206723 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2208891 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2212508 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2216144 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2219815 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2220246 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2220790 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2221214 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2221806 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2222356 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2222917 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2223466 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2226145 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2226296 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2230284 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2230335 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2232216 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2237887 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2237898 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2240866 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2242293 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2243846 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2244611 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2246058 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2246956 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2252488 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2252891 00:30:00.456 Removing: /var/run/dpdk/spdk_pid2253295 00:30:00.457 Removing: /var/run/dpdk/spdk_pid2254773 00:30:00.457 Removing: /var/run/dpdk/spdk_pid2255182 00:30:00.457 Removing: /var/run/dpdk/spdk_pid2255595 00:30:00.457 Clean 00:30:00.715 killing process with pid 1952558 00:30:08.831 killing process with pid 1952555 00:30:08.831 killing process with pid 1952557 00:30:08.831 killing process with pid 1952556 00:30:08.831 02:32:36 -- common/autotest_common.sh@1446 -- # return 0 00:30:08.831 02:32:36 -- spdk/autotest.sh@374 -- # timing_exit post_cleanup 00:30:08.831 02:32:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:08.831 02:32:36 -- common/autotest_common.sh@10 -- # set +x 00:30:08.831 02:32:36 -- spdk/autotest.sh@376 -- # timing_exit autotest 00:30:08.831 02:32:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:08.831 02:32:36 -- common/autotest_common.sh@10 -- # set +x 00:30:08.831 02:32:36 -- spdk/autotest.sh@377 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:30:08.831 02:32:36 -- spdk/autotest.sh@379 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:30:08.831 02:32:36 -- spdk/autotest.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:30:08.831 02:32:36 -- spdk/autotest.sh@381 -- # [[ y == y ]] 00:30:08.831 02:32:36 -- spdk/autotest.sh@383 -- # hostname 00:30:08.831 02:32:36 -- spdk/autotest.sh@383 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:30:08.831 geninfo: WARNING: invalid characters removed from testname! 00:30:35.362 02:33:03 -- spdk/autotest.sh@384 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:39.543 02:33:06 -- spdk/autotest.sh@385 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:42.067 02:33:09 -- spdk/autotest.sh@389 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info --ignore-errors unused,unused '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:44.597 02:33:12 -- spdk/autotest.sh@390 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:47.126 02:33:14 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:49.659 02:33:17 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:52.946 02:33:19 -- spdk/autotest.sh@393 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:30:52.946 02:33:20 -- common/autotest_common.sh@1689 -- $ [[ y == y ]] 00:30:52.946 02:33:20 -- common/autotest_common.sh@1690 -- $ lcov --version 00:30:52.946 02:33:20 -- common/autotest_common.sh@1690 -- $ awk '{print $NF}' 00:30:52.946 02:33:20 -- common/autotest_common.sh@1690 -- $ lt 1.15 2 00:30:52.946 02:33:20 -- scripts/common.sh@372 -- $ cmp_versions 1.15 '<' 2 00:30:52.946 02:33:20 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:30:52.946 02:33:20 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:30:52.946 02:33:20 -- scripts/common.sh@335 -- $ IFS=.-: 00:30:52.946 02:33:20 -- scripts/common.sh@335 -- $ read -ra ver1 00:30:52.946 02:33:20 -- scripts/common.sh@336 -- $ IFS=.-: 00:30:52.946 02:33:20 -- scripts/common.sh@336 -- $ read -ra ver2 00:30:52.946 02:33:20 -- scripts/common.sh@337 -- $ local 'op=<' 00:30:52.946 02:33:20 -- scripts/common.sh@339 -- $ ver1_l=2 00:30:52.946 02:33:20 -- scripts/common.sh@340 -- $ ver2_l=1 00:30:52.946 02:33:20 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:30:52.946 02:33:20 -- scripts/common.sh@343 -- $ case "$op" in 00:30:52.946 02:33:20 -- scripts/common.sh@344 -- $ : 1 00:30:52.946 02:33:20 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:30:52.946 02:33:20 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:52.946 02:33:20 -- scripts/common.sh@364 -- $ decimal 1 00:30:52.946 02:33:20 -- scripts/common.sh@352 -- $ local d=1 00:30:52.946 02:33:20 -- scripts/common.sh@353 -- $ [[ 1 =~ ^[0-9]+$ ]] 00:30:52.946 02:33:20 -- scripts/common.sh@354 -- $ echo 1 00:30:52.946 02:33:20 -- scripts/common.sh@364 -- $ ver1[v]=1 00:30:52.946 02:33:20 -- scripts/common.sh@365 -- $ decimal 2 00:30:52.946 02:33:20 -- scripts/common.sh@352 -- $ local d=2 00:30:52.946 02:33:20 -- scripts/common.sh@353 -- $ [[ 2 =~ ^[0-9]+$ ]] 00:30:52.946 02:33:20 -- scripts/common.sh@354 -- $ echo 2 00:30:52.946 02:33:20 -- scripts/common.sh@365 -- $ ver2[v]=2 00:30:52.946 02:33:20 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:30:52.946 02:33:20 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:30:52.946 02:33:20 -- scripts/common.sh@367 -- $ return 0 00:30:52.946 02:33:20 -- common/autotest_common.sh@1691 -- $ lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:52.946 02:33:20 -- common/autotest_common.sh@1703 -- $ export 'LCOV_OPTS= 00:30:52.946 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:52.946 --rc genhtml_branch_coverage=1 00:30:52.946 --rc genhtml_function_coverage=1 00:30:52.946 --rc genhtml_legend=1 00:30:52.946 --rc geninfo_all_blocks=1 00:30:52.946 --rc geninfo_unexecuted_blocks=1 00:30:52.946 00:30:52.946 ' 00:30:52.946 02:33:20 -- common/autotest_common.sh@1703 -- $ LCOV_OPTS=' 00:30:52.946 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:52.946 --rc genhtml_branch_coverage=1 00:30:52.946 --rc genhtml_function_coverage=1 00:30:52.946 --rc genhtml_legend=1 00:30:52.946 --rc geninfo_all_blocks=1 00:30:52.946 --rc geninfo_unexecuted_blocks=1 00:30:52.946 00:30:52.946 ' 00:30:52.946 02:33:20 -- common/autotest_common.sh@1704 -- $ export 'LCOV=lcov 00:30:52.946 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:52.946 --rc genhtml_branch_coverage=1 00:30:52.946 --rc genhtml_function_coverage=1 00:30:52.946 --rc genhtml_legend=1 00:30:52.946 --rc geninfo_all_blocks=1 00:30:52.946 --rc geninfo_unexecuted_blocks=1 00:30:52.946 00:30:52.946 ' 00:30:52.946 02:33:20 -- common/autotest_common.sh@1704 -- $ LCOV='lcov 00:30:52.946 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:52.946 --rc genhtml_branch_coverage=1 00:30:52.946 --rc genhtml_function_coverage=1 00:30:52.946 --rc genhtml_legend=1 00:30:52.946 --rc geninfo_all_blocks=1 00:30:52.946 --rc geninfo_unexecuted_blocks=1 00:30:52.946 00:30:52.946 ' 00:30:52.946 02:33:20 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:52.946 02:33:20 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:30:52.946 02:33:20 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:52.946 02:33:20 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:52.946 02:33:20 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:52.946 02:33:20 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:52.946 02:33:20 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:52.946 02:33:20 -- paths/export.sh@5 -- $ export PATH 00:30:52.946 02:33:20 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:52.946 02:33:20 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:30:52.946 02:33:20 -- common/autobuild_common.sh@440 -- $ date +%s 00:30:52.946 02:33:20 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1733621600.XXXXXX 00:30:52.946 02:33:20 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1733621600.Vf0sEy 00:30:52.946 02:33:20 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:30:52.946 02:33:20 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:30:52.946 02:33:20 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:30:52.946 02:33:20 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:30:52.946 02:33:20 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:30:52.946 02:33:20 -- common/autobuild_common.sh@456 -- $ get_config_params 00:30:52.946 02:33:20 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:30:52.946 02:33:20 -- common/autotest_common.sh@10 -- $ set +x 00:30:52.946 02:33:20 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:30:52.946 02:33:20 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:30:52.946 02:33:20 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:30:52.946 02:33:20 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:30:52.946 02:33:20 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:30:52.946 02:33:20 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:30:52.946 02:33:20 -- spdk/autopackage.sh@19 -- $ timing_finish 00:30:52.946 02:33:20 -- common/autotest_common.sh@734 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:30:52.946 02:33:20 -- common/autotest_common.sh@735 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:30:52.946 02:33:20 -- common/autotest_common.sh@737 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:30:52.946 02:33:20 -- spdk/autopackage.sh@20 -- $ exit 0 00:30:52.946 + [[ -n 1910257 ]] 00:30:52.946 + sudo kill 1910257 00:30:52.957 [Pipeline] } 00:30:52.978 [Pipeline] // stage 00:30:52.983 [Pipeline] } 00:30:53.001 [Pipeline] // timeout 00:30:53.007 [Pipeline] } 00:30:53.024 [Pipeline] // catchError 00:30:53.030 [Pipeline] } 00:30:53.048 [Pipeline] // wrap 00:30:53.054 [Pipeline] } 00:30:53.070 [Pipeline] // catchError 00:30:53.081 [Pipeline] stage 00:30:53.084 [Pipeline] { (Epilogue) 00:30:53.100 [Pipeline] catchError 00:30:53.102 [Pipeline] { 00:30:53.117 [Pipeline] echo 00:30:53.119 Cleanup processes 00:30:53.125 [Pipeline] sh 00:30:53.408 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:30:53.409 2268214 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:30:53.422 [Pipeline] sh 00:30:53.817 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:30:53.817 ++ grep -v 'sudo pgrep' 00:30:53.817 ++ awk '{print $1}' 00:30:53.817 + sudo kill -9 00:30:53.817 + true 00:30:53.831 [Pipeline] sh 00:30:54.117 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:31:04.120 [Pipeline] sh 00:31:04.406 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:31:04.406 Artifacts sizes are good 00:31:04.423 [Pipeline] archiveArtifacts 00:31:04.432 Archiving artifacts 00:31:04.577 [Pipeline] sh 00:31:04.860 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:31:04.874 [Pipeline] cleanWs 00:31:04.884 [WS-CLEANUP] Deleting project workspace... 00:31:04.884 [WS-CLEANUP] Deferred wipeout is used... 00:31:04.890 [WS-CLEANUP] done 00:31:04.892 [Pipeline] } 00:31:04.909 [Pipeline] // catchError 00:31:04.921 [Pipeline] sh 00:31:05.203 + logger -p user.info -t JENKINS-CI 00:31:05.210 [Pipeline] } 00:31:05.221 [Pipeline] // stage 00:31:05.227 [Pipeline] } 00:31:05.239 [Pipeline] // node 00:31:05.244 [Pipeline] End of Pipeline 00:31:05.275 Finished: SUCCESS